René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Framework: Move Ops parameter to call method where possible","articleBody":"I'd like to move the `Ops` parameters of framework classes to the call method, where possible.  This is primarily for Kotlin interop, but has a few other benefits as well.  It won't be possible for stateful classes (Metrics, Optimizers), but should be possible for most, as far as I can tell (Initializers, Activations, Losses).  I'm going to use Losses as a standin for all 3 for my examples.\r\n1. Kotlin interop w/ `@FunctionInterface`.  If we do this, we can then define new losses like `Loss{ tf, x -\u003e tf.stuff(x) }` or pass lambdas to methods that take losses.  This is very nice for layers, where we might have something Keras-like `Layer(activation=ReLU())` but want to replace it with something custom.\r\n2. Re-use of objects.  Currently, losses create any subsequent calls in the same scope as their first call.  That means if it's called inside a sub-scope, including device ones, it ignores the scope.  This is somewhat expected, but not ideal.  It also causes further issues if we use `Ops` for (eager) tensor lifetime management, which has been suggested and is something I'd like to do (it's easy enough to make a long-lived copy of the initial scope, but then the tensors created in the call methods live forever, and the framework classes need to be closable).\r\n3. Passing configs, like Keras.  In Keras, if you have a activation or loss that requires some parameters, you can pass it to a layer like `Layer(activation=LeakyReLU(alpha=0.3))`.  I expect this will be common with our API, as well.  Currently, this runs into the above issue w/ scoping, and prevents you from passing activations (or losses) from scopes that don't have an Ops instance available.\r\n\r\nI'd look at having the stateful classes take `Ops` in `call` as well, and only using the constructor ops for initializing state.  This works better with scoping and lifetimes as mentioned above.","author":{"url":"https://github.com/rnett","@type":"Person","name":"rnett"},"datePublished":"2021-01-31T04:10:45.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":25},"url":"https://github.com/202/java/issues/202"}