Comments (7)
Done by @noodlesbad !
from 4mc.
Hi @carlomedas I know you are probably focused on different projects. Is there any chance that you will give some hint how to update?
from 4mc.
I'll see if we can make it become a Fing company github project so we can maintain officially here, as I'm kind of out of personal time for this.
We've been using this in our big-data architecture so it makes a lot of sense.
The problem in updating is not putting latest libraries, which is very fast, unless interface headers changed signatures, but more problematic point is to build the library on all platforms before releasing a new version, as I don't have any more all build VM's.
Let me propose it as Fing project and let you know.
Last point: even by updating libraries, binary compressed data is not going to change, so you can start using it today and when there is updated version you can switch seamlessly.
from 4mc.
Thank you very much for effort.
The problem in updating is not putting latest libraries, which is very fast, unless interface headers changed signatures, but more problematic point is to build the library on all platforms before releasing a new version, as I don't have any more all build VM's.
That's what I am afraid of, that interfaces changed after that many years.
As far as platforms support: I will be little selfish and say linux is all I need.
Last point: even by updating libraries, binary compressed data is not going to change, so you can start using it today and when there is updated version you can switch seamlessly.
I tried ZSTD and it needs lot more memory (20-30%) than other compressions (GZIP, LZ4, SNAPPY) so I am not sure if its nature of algorithm or it's just old version where they didn't focus on memory consumption. But compression ratio is the best.
from 4mc.
Let me confirm we are progressing on that. 4mc has been transferred to Fing company and we will make sure to keep it up to date.
from 4mc.
Once again, thanks. :) looking forward for updates.
from 4mc.
Stay tuned, new release should be coming this week.
from 4mc.
Related Issues (20)
- Create DataSet using SparkSession HOT 1
- Commit 17c36e08653162f6956ef27f55c96c20425df4b8 breaks test units HOT 1
- Fix Typo in FourMzTextInputFormat
- Request: upload maven artifact for java library HOT 3
- Consider changing license to Apache?
- PySpark Example doesn't work HOT 3
- could you provide a 4mc example for flink HOT 1
- The Travis link is broken
- 4mz - Zstd - cannot load csv.4mz into Spark (4mc works correctly) HOT 2
- how to use 4mc/4mz when write to json or parquet HOT 1
- how to use 4mc tool for linux fs batch processing and logging HOT 2
- null pointer exception HOT 2
- Issue creating output stream
- Decompressing from stdin HOT 2
- why is FourMcTextInputFormat not an InputFormat? HOT 1
- How to use 4mc in Hive? HOT 1
- Requesting to Publish FourMC Project to maven Central Repository HOT 6
- Can't load AMD 64-bit .so on a AARCH64-bit platform HOT 1
- release-3.0.0 make error on centos7.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from 4mc.