Comments (3)
This was mentioned in the Discord as well:
w.r.t. batches being rejected: the issue is likely annotations which disappear after a set amount of time, so "x user is livestreaming right now" can end up changing the size of the batch significantly if it contains multiple videos from the same channel
You can look at these two pastes side-by-side to see an example:
The first one has a "teaser_text": "Litoral TV is live now!"
annotation that bumps the size of the single file significantly, multiplied by several videos by the same channel with the same additional annotation, can cause the batch to fail.
I plan on updating the server to accept batches in a wider range, so the one you submitted will be accepted. You may also need to clear the config.json
(or remove .worker_info if you're using the Crystal worker) to get a new worker_id.
from archive.
Just pushed a fix so workers will be able to submit a new version if they're well trusted
This is in addition to the current batch, anything that has already been archived will not be overridden
So big changes in file sizes can be accepted. 44ddb17 allows new versions to be uploaded, which I think closes this issue.
from archive.
The problem with that is that workers have to build reputation first. Otherwise, they get stuck on an infinite loop of invalid size errors without being assigned a new batch and become useless. This has happened to mine (batch fe9e101b-1040-4147-b592-bdc2fb8cfef2,
here's the batch.json.gz if that helps).
I did make a new worker, but I'd rather not have to personally.
from archive.
Related Issues (12)
- consider advertising it on invidio.us HOT 7
- Add docker instructions for windows HOT 1
- Uploads always have a similar size HOT 1
- Everything completed? HOT 2
- missing dependencies HOT 3
- shards: command not found HOT 5
- some items failed HOT 3
- failed to upload HOT 2
- node.js variant exits if the batch finished but not all annotations were fetched HOT 2
- the instructions for the docker container should include installing docker and wgeting the dockerfile HOT 1
- cannot build with docker HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from archive.