Comments (6)
Perform state-of-the-art benchmarks on a 64 bits platform. Test on a mono-core system + multi-core system, and compare. Test against different kinds of work-loads, performances against different sizes of DBs (large and very small), and compare.
Those results will be necessary to spot optimization points for #2
from sonic.
Some logs from our batch-import script; Sonic ~75% 1 CPU, this is per-1000 request:
Step: cursor #79000; took 0.251 sec (worst 0.475 sec; best 0.17 sec)
Step: cursor #80000; took 0.276 sec (worst 0.475 sec; best 0.17 sec)
Step: cursor #81000; took 0.273 sec (worst 0.475 sec; best 0.17 sec)
Step: cursor #82000; took 0.283 sec (worst 0.475 sec; best 0.17 sec)
Step: cursor #83000; took 0.239 sec (worst 0.475 sec; best 0.17 sec)
Step: cursor #84000; took 0.279 sec (worst 0.475 sec; best 0.17 sec)
from sonic.
Test the following operations at scale:
- PUSH
- POP
- SEARCH
- SUGGEST
Measure the 95th percentile, mean, median values and put all of this in a beautiful Markdown table in README.
from sonic.
Would be good to use a code tracing utility, to analyze which expression / function call / block does take the most time or is repeated too often.
from sonic.
Checklist:
- Add benchmarks to the tests; and provide clear
cargo bench
results (see: https://doc.rust-lang.org/1.2.0/book/benchmark-tests.html) - Follow: http://www.codeofview.com/fix-rs/2017/01/24/how-to-optimize-rust-programs-on-linux/ for more advanced CPU tick tracing
from sonic.
All good!
from sonic.
Related Issues (20)
- Search: LIMIT out of minimum/maximum bounds HOT 2
- Terminal crashes when pushing to sonic HOT 6
- Bulk index speed is slow HOT 5
- Memory allocation while indexing data HOT 6
- Update document in sonic HOT 4
- Please don't use country flags to refer to languages HOT 2
- Use a varint encoding for the IID? HOT 1
- User defined stopwords HOT 1
- Search "terms"? Searching for multiple words? HOT 1
- Docker run throws an error HOT 2
- buffer size overflow error while ingesting large size document. HOT 4
- Bucket count limits HOT 2
- can not push chinese HOT 2
- Old version 1.3.5 on crates HOT 1
- Sonic image is not working in Kubernetes HOT 1
- sonic 1.4.1 regression test failure HOT 3
- upgrade rocksdb dependency to use newer bindgen
- clang - llvm@17 not compatible HOT 1
- What's the max length for an obj? HOT 4
- Limit on `<object>` length during `ingest` `PUSH`? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sonic.