Comments (5)
@jsgm Just to plan my activities, are you going to work on this? If you are busy, I'll put this on my todo list :=)
Sorry for the delay! A bit busy this week, feel free to put it in your todo list. In any case still looking forward to further contributions 😃
from clover.
Hi, jsgm, first of all thank you for the nice suggestion.
How to handle the conversion specially for bigger databases. Possible bottlenecks?
Regarding this point, I think that conversion should be performed in a cleaver way than simply calling json.Marshal on a document slice. I think that, in order to serialize large collections efficiently, documents should be progressively serialized and written to the exported file.
Use one just single file or multiple files. Maybe both options?
I think that it is fine to start by implementing a db.ExportCollection(collectionName, exportPath) function, which allow to export a single collection in a json file with the same name of the collection itself.
Then, by using this function, we could also implement an additional ExportDatabase(folderPath) function, exporting each collection inside a folder.
In the last case, we could also reason about an option for exporting the entire database in a single file (but this could also be added in a second step).
from clover.
@jsgm Just to plan my activities, are you going to work on this? If you are busy, I'll put this on my todo list :=)
from clover.
There is no rush, if you are interested in this ;=)
from clover.
There is no rush, if you are interested in this ;=)
Thanks for your patient. If there's no rush I can definitely go with this. Starting today!
from clover.
Related Issues (20)
- Example Request: Unmarshal/Update/Replace HOT 6
- Cannot allocate initial memory HOT 1
- GT LT operation very slow HOT 3
- Question: Is there a way to search for a value in all fields? HOT 2
- Getting error when during bulk insert HOT 3
- Small v2 package annoyance HOT 10
- Question: Searching for all documents within time range HOT 1
- distributed? HOT 1
- Support struct in Save() method HOT 7
- Add `OpenWithOptions()` to badger store
- Memory efficient `ExportCollection()` HOT 1
- need update readme HOT 2
- Hope to support semantic query building function HOT 9
- Memory store was removed in v2 HOT 1
- doc.Unmarshal does not play well with `json` tag HOT 5
- Badger storage | RunValueLogGC() is managed with a fatal error HOT 3
- using BadgerDB: DropCollection returns a "Txn is too big to fit into one request" HOT 3
- Why is the _id a uuid
- Runtime error by using of function db.Insert HOT 2
- Unmarshalling with embedded structs is failing HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from clover.