any plans to support persistence for Browser like leveldb about cozo HOT 6 OPEN

@simonwh, my technique isn't ideal either. Exporting on every transaction causes performance issue. My workaround:

• Run the cozo wasm from a worker thread, so all the database I/O is isolated from the UI thread
• Export only upon user request, leading to data loss when user closes the app without saving.

In my opinion, a good continuous export implementation is a balancing act between the inevitable tradeoff between performance and data integrity. A few ideas I find useful:

• Use requestIdleCallback to let the browser pick a best moment to export but that won't work in Safari.
• Use some throttle and debounce techniques to reduce the export frequency
• Compare the stringified values and perform the export only when the value changes.

from cozo.

I am also interested in this. A few thoughts:

• Enabling the sqlite backend for wasm targets may be possible. See this PR to do so in rusqlite as an example.
• Could there be an addition to the current in-memory API so that you could optionally pass an impl of e.g. std::io::Write as an alternative location to write to? Then persisting to OPFS or localstorage would be relatively easy.

from cozo.

In the interim, I've been using json-based export/import relations against browser's origin private filesystem. It isn't the fastest solution but provides the functionality. Ideally I'd love to have the ability to load and save data in binary.

from cozo.

@chuanqisun We've done something similar, with in-memory cozo + localstorage (instead of origin private filesystem). We find it's working-ish. It's not super stable, and definitely not a long-term solution :) Would be interest to hear how you implemented it. Do you export/write file after every cozo operation? Or periodically? And then import on page load?

from cozo.

I would love browser based persistentence for local first applications.

I wonder if saving to ElectricSQL would be possible, enabling automatic sync to a back end as well?

from cozo.

I've been using sqlite in the browser via the wasm release , backed by OPFS (as mentioned above) and its awesome

i imagine for cozo to accomplish similar, the easiest route would be like @94bryanr suggested and get a sqlite backend for the wasm build ? instead of managing/creating your own persistence layer in the browser

but yeah regardless, browser persistence would be AMAZING

i have some recursive traversals over json blobs in sqlite to crudely accomplish traversals and bounded graph queries, but would vastly prefer an engine fit to purpose

from cozo.