Comments (3)
For my understanding, besides the obvious accumulation of garbage, what happens if we don't cleanup all tombstones before the server starts?
i.e. can they be dealt with in the background by some kind of simple, single threaded garbage collection logic?
Rather than spawning just one of the goroutines outlined in (1), we should spawn multiple m goroutines.
All of the inner functions seem tightly locked so I wonder how far we can go with concurrency, but that's the ideal solution.
from weaviate.
Changed the title to widen the scope a bit. It is no longer about a specific way to increase the supported frequency of deletes but rather about increasing it βΒ with any means necessary.
from weaviate.
Completed in #4003.
from weaviate.
Related Issues (20)
- [v1.24] Tx can get stuck on some nodes when tx commit fails
- Better tenant observability
- `with_near_vector` function does not work HOT 2
- `X-Azure-Api-Key` doesn't work in headers. Asking openai api key instead. while calling withNearText search. HOT 4
- Windows is not supported with Embedded
- Multivector: knn search: distance between entrypoint and query node: got a nil or zero-length vector at docID 1115 HOT 5
- Duplicate and inconsistent results of BM25 search
- Major loading speed regression with v1.24.9 HOT 6
- Improvements to geo-coordinate based filtering HOT 5
- explainScore containing only one score when performing hybrid search HOT 2
- Weaviate backup using S3 closed pipe http 499 after 1m 3s
- Update by Query
- Duplicate CONTEXTIONARY_URL in dev setup HOT 1
- Data encryption in weaviate for securing sensitive information
- text2vec-ollama is not working HOT 2
- Observability metrics for async indexing queue
- Existing replication factor increase implementation does not work with raft
- High variance of latency when doing a benchmark of query (GET) by id
- [proposal] Vectorizer select and exclude properties β in one place
- Hybrid should skip properties with indexSearchable=False HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
π Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. πππ
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google β€οΈ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from weaviate.