examples/mnist/mlp.lisp - reset-compiled-function-cache! question about cl-waffe2 HOT 3 CLOSED

I didn't expect such a behavior because caches are created for each AbstractNode whose complied codes does not include any tensors. (As a design), users do not have to consider the existence of the function as it is not exported.

I suspect that this is caused by some caching in the compiler and different initializations ...

I thought about that one too; and I guess the current implementation of adam has something to do with since if i change these lines:

;; Case1. Adam -> SGD
;; From
(mapc (hooker x (Adam x :lr lr)) (model-parameters model))
;; To
(mapc (hooker x (SGD x :lr lr)) (model-parameters model))

;; Case2. Deleting Adam
;; deleting this line (and fails to optimize the model)
(mapc #'call-optimizer! (model-parameters model))

In the both two cases, the loss is in the same range for each epoch, and each run.
I'm still analyzing the issue. Thank you for the bug report.

from cl-waffe2.

The issue should be fixed at the latest PR #149; so closing.
I have been had a lot on my plates this month and i could not tackle this issue quickly; sorry for my delayed answer.

from cl-waffe2.

Yes, it works, thanks!

from cl-waffe2.