caching rust deps locally about explorer HOT 5 CLOSED

@dustinfarris this is not supported right now, but you can disable the compilation of the Polars by adding the option skip_compilation?: true to the Explorer.PolarsBackend.Native module, where Rustler is configured. Reference for these options can be found in Rustler's doc.

Just make sure that the file priv/native/libexplorer.* exists. This file is generated when Polars is compiled with Rustler and the extension can changed based on your OS.

We are researching a way to use precompiled Polars. Stay tuned :)

from explorer.

Just to give an update: we are waiting for this PR to get merged (or we publish that work as a separated package): rusterlium/rustler#419

I can ping you here when we have the feature :)

from explorer.

@dustinfarris precompiled Polars will be available soon. I was closing as I thought @philss answer solved the specific issue -- if that's not right I'm happy to reopen.

ok got it thanks for clarifying — i'll keep watching the repo for an update on precompiled.

fyi for anyone else watching this, we went with a slightly different workaround:

config :explorer, Explorer.PolarsBackend.Native,
  # By default, Polars compiles inside a build directry in deps/explorer.
  # Fully compiling Polars can take well over 15 minutes. This config moves the
  # location outside of deps, so that Polars does not have to fully re-compile
  # whenever deps is cleaned or re-created.  To force Polars to recompile, just
  # remove _explorer from your project root.
  target_dir: Path.expand("_explorer/build")

which has been working fairly well in CI (except when GitHub Actions randomly busts our cache for no reason)

from explorer.

@cigrainger was this resolved?

from explorer.

@dustinfarris precompiled Polars will be available soon. I was closing as I thought @philss answer solved the specific issue -- if that's not right I'm happy to reopen.

from explorer.