Comments (4)
We could try switching the allocator back to jemalloc as per: https://doc.rust-lang.org/1.9.0/book/custom-allocators.html
from locustdb.
I had a go at it and it doesn't seem to be super easy to make this work, might be better to just remove the Heapsize dependency entirely. The only use of it right now is to get (approximate) size of data stored in memory, which is dominated by the DataSection
structs in Column
. Just estimating their memory usage with Vec::capacity() * std::mem::size_of
should work well enough. It wouldn't account for allocator overhead, but it was never quite clear to me what exactly the heapsize crate did in that regard anyway.
from locustdb.
Yep, I have tried many days but eventually failed. heapsize
has hard-coded link name on Mac OS X(https://github.com/servo/heapsize/blob/master/src/lib.rs#L44). After the removal of jemalloc, It's difficult to make this function available for rust to be linked.
In the future, if we want to have fine-grained control of memory, we can benefit from https://github.com/servo/servo/tree/master/components/malloc_size_of which is currently used by Servo
.
from locustdb.
I have create a pr for this. Please have a look. #115
from locustdb.
Related Issues (20)
- Fix usages of `unsafe` related to hard-to-model lifetimes
- Perform merging of select queries by constructing and executing query plan
- Expand cases where intermediary results can be streamed between operators
- Columns in query output are not always in same order as projections in query
- Revisit choice of hash functions during hash grouping HOT 1
- Query planner chooses names for anonymous result columns that might be identical to existing ones HOT 4
- Fix performance regression in benchmark case
- String packed columns break things
- Logo? HOT 3
- Queries that have type errors or reference missing columns should give helpful errors/warnings HOT 7
- Order by string column fails with `top_n_asc not supported for type ScalarStr` HOT 4
- Support window functions like row_number() HOT 4
- Default ordering of index columns and inserts to the already existing data HOT 1
- Why not support ansi SQL? HOT 1
- Allow simple GROUP BY clauses
- It does not work at all. HOT 3
- Is the project still alive? HOT 1
- ORDER BY clause referencing named column crashes
- 'cargo test' panic - test_group_by_nullable attempt to add with overflow HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from locustdb.