Keras API about adanet HOT 16 OPEN

We're working on a new Keras API for AdaNet, but don't have a timeline on it yet. Keep an eye out for related commits over the next few months.

from adanet.

The timeline will look roughly like so (subject to change):

1. Support tf.keras.Layers in subnetworks.
2. Support tf.keras.Sequential and Keras functional API models in adanet.AutoEnsembleEstimator.
3. Implement adanet.keras.Model and adanet.keras.AutoEnsemble APIs to be Keras end-to-end.

Please reach out here or PM me if you are interested in testing out our new Keras support as we add it.

from adanet.

We are going for an API that is both familiar, but also flexible enough to define an search space of keras models. Here's an idea of the kind of API we are going for:

submodel1 = Sequential()
submodel1.add(Dense(8, input_dim=4, activation='relu'))
submodel1.add(Dense(3, activation='softmax'))
submodel1.compile(loss='categorical_crossentropy', optimizer='adam')

submodel2 = Sequential()
submodel2.add(Dense(16, input_dim=4, activation='relu'))
submodel2.add(Dense(3, activation='softmax'))
submodel2.compile(loss='categorical_crossentropy', optimizer='adam')

model = adanet.keras.AutoEnsemble(
    ensembler=adanet.ensemble.UniformAverage(),
    ensemble_strategy=adanet.ensemble.AllStrategy(),
    candidate_pool={
        "Model1": submodel1,
        "Model2": submodel2,
    })
model.compile(loss='categorical_crossentropy', optimizer='adam')
model.fit(x=..., y=..., steps=100)

Feedback is welcome!

from adanet.

I would love to use it when it comes out

from adanet.

@shendiaomo: This is still a work in progress, but we are actively pursuing this direction. It's all very experimental at the moment, since we would like it to fit in well with the rest of the Keras and TF 2.0 ecosystem, meaning good integration with other systems like keras-tuner.

We're working on an experimental AdaNet model search API. You can have a peek under adanet/experimental. We will be demoing this Tuesday Morning at the Google Booth at NeurIPS.

from adanet.

@minimaxir, @shendiaomo: adanet.experimental.ModelSearch (a.k.a. adanet.ModelFlow) is @csvillalta's API for AutoML using Keras and TF 2. Please take a look at in under adanet/experimental, and let us know what you think.

Be sure to try out the ModelFlow demo.

from adanet.

@atinsood: We don't currently have anything you can try out, since we're still coming up with a reasonable design. But keep an eye out, we'll be pushing some experimental code soon to an adanet.keras subpackage soon.

from adanet.

@minimaxir Thank you for filing this feature request. We'll take a look.

from adanet.

/cc @jhfjhfj1

from adanet.

Without Keras support of project, it may have some trouble to visualize AdaNet produced construction,
like use graphviz in plot_model
Are there some replacement to implement this function ?

from adanet.

@svjack: You can visualize the learned architecture in TensorBoard by looking at the Graph tab.

from adanet.

@cweill I suggest, Can create a chapter to tell about the algorithm procedure among different iteration (with namespace control) with the help of tensorboard to visualize in the document you will release.

from adanet.

Any news on this?

from adanet.

this is amazing!

from adanet.

@cweill this looks great but is this already close to an alpha/beta(or merged into some branch already) where if I want to try this out I can go ahead and try it out, or you guys still working through this. any rough notebook with a broad idea of steps would be great.

• thanks

from adanet.

When would this Keras API have a final distribution? I think it's vital for the widespread application of AdaNet.

from adanet.