Feature request: Callbacks about pyoperon HOT 2 OPEN

A general monitoring callback is already supported by the bindings:

But calling python lambdas from C++ can be unreliable due to the GIL. We could expose this as callback=... in the SymbolicRegressor. More detailed callbacks would require changes to the C++ library and to implement some termination operators.

Regarding Optuna, is this similar to what you had in mind? https://gist.github.com/foolnotion/226fe764b9af79f219d63c8c10b0d497

from pyoperon.

Indeed exposing callbacks=... is the customary API design for ML libraries. See for example:

• Keras callbacks where one can create callbacks inheriting from a Callback class
• Lightning callbacks follow a very similar logic
• Pymoo callback likewise

other examples of ML libraries using callback API: xgboost, lightgbm.

All of these provide the required functionality to use callbacks with TensorBoard, a leading ML experiment tracker, and I imagine that the same could be done for MLFlow, see for example how one can use Keras callbacks.

Regarding optuna: I was thinking about using callbacks to extend optuna's functionality with pyoperon. For example, optuna has integration callbacks to use pruners to kill unpromising trials. It's an example of application, not strictly part of the feature requested.

from pyoperon.