thoughts on better neural net about deeposm HOT 3 CLOSED

@lacker says to make a simpler neural net that works better with the given amount of IR training data, so the analysis overfits less.

Then expand the layers/data.

Don't just use some complicated neural net unsuited to the task.

from deeposm.

Yeah, I think you want to get to a state where "it works, just could be better" before scaling up. That way you can figure out how long you need to train, and keep params in a state where you don't overfit. I would try something real simple, like one convolution layer plus one softmax layer, and see if you can make it "work". By "work" I mean significantly better than random, like 80% accuracy, and not much of an overfitting problem.

from deeposm.

I think we're now in a state of "works with the simplest network." A single relu or single convolutional relu with a maxpool.

from deeposm.