Comments (2)
To support additional data types one needs to create a new Field
and its corresponding decoder, all the available ones are in the ffcv/fields
folder. The only reason FFCV doesn't support video yet is because our lab doesn't regularly work with them. We are happy to integrate pull requests that would add that feature.
Parallelizing with FFCV is generally not an issue. As one can see in https://github.com/libffcv/ffcv/blob/main/ffcv/fields/rgb_image.py#L122 it's just a matter of using the result of Compiler.get_iterator
instead of range
and marking the code as is_parallel
.
A sequence of jpeg would work and I could definitely see it as an option but I'm not sure it's the most space efficient method. Most video codecs leverage the information about the previous image to encode the next to save space.
If you are interested in adding Video support you can join our slack and we can guide you/help you troubleshoot.
from ffcv.
Closing due to inactivity. Feel free to submit a PR if you happen to have implemented it. We unfortunately don't have the bandwidth to add more Fields and will focus on improving FFCV's core
from ffcv.
Related Issues (20)
- Changing Indices during training leads to much slower training HOT 2
- Memory Leak in Ffcv Loader? HOT 4
- Import error - libopencv_impgproc missing HOT 2
- Installation issues HOT 6
- Small bug (improvement suggestion) in the quickstart doc HOT 1
- stuck in the loader when using only cpu HOT 4
- Grayscale Image Datasets HOT 2
- Top-1 accuracy on ImageNet drops between runs -- only difference is FFCV HOT 2
- Large .beton files slow down or even freeze learning during loading [possible bug] HOT 2
- [General question] FFCV scope
- ModuleNotFoundError: No module named 'ffcv.compiler
- doubt about mutli-gpu train when use imagenet 4 gpus HOT 1
- Default num_workers is incompatible with SLURM
- Installing FFCV on CPU-only node HOT 1
- Exact performance improvement
- Unable to save anything in the Fields HOT 1
- Compression error causes performance drop
- Reuse memory?
- Installing ffcv fails HOT 1
- Unexpected output with BytesField, question for genomics
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ffcv.