neurojson / zmat Goto Github PK

it would be cool if you added zstd support (apparently that also can run easily in parallel) link: https://github.com/facebook/zstd

This is on-going.

NeuroFedora pagure tracker:
https://pagure.io/neuro-sig/NeuroFedora/issue/300

Package spec file:
https://github.com/fangq/fedorapkg/tree/zmat

Redhat new package review request:
https://bugzilla.redhat.com/show_bug.cgi?id=1757993

It doesn't really tax-out all CPU when running, is there a way to increase performance? (matlab, windows server)

Installation looks to be working with MATLAB 2014b, but when running example/demo_zmat_basic.m it would be nice if each command output would be dupl;icated such that user cold check at once if it is working or not

The building of the zmat package ignores the setting of the environment variables CFLAGS, CPPFLAGS, and LDFLAGS.

We are currently applying a patch to the Debian package zmat that fixes the problem. This allows the inclusion of hardening flags like -D_FORTIFY_SOURCE=2, -fstack-protector-strong, -Wformat, -Werror=format-security, and -Wl,-z,relro.

Just an idea, but I used the CompressLib (https://mathworks.com/matlabcentral/fileexchange/25656-compression-routines) to append the 'info' variable to the main output, because then it's a bit easier to store a single file on disk.

Workflow is along the lines of: load/generate data => compress in MATLAB using zmat => save to disk (as uint8) => load from disk directly into ram => decompress

Thanks for the work

When trying to build the Fedora octave-zmat file with octave 7.1, make oct fails with:

CXXFLAGS='-O3' LFLAGS='' LDFLAGS='' mkoctfile zmat.cpp  -o ../zipmat zmatlib.o lz4/lz4.o lz4/lz4hc.o easylzma/compress.o easylzma/decompress.o easylzma/lzma_header.o easylzma/lzip_header.o easylzma/common_internal.o easylzma/pavlov/LzmaEnc.o easylzma/pavlov/LzmaDec.o easylzma/pavlov/LzmaLib.o easylzma/pavlov/LzFind.o easylzma/pavlov/Bra.o easylzma/pavlov/BraIA64.o easylzma/pavlov/Alloc.o easylzma/pavlov/7zCrc.o --mex -I../include -Ieasylzma -Ieasylzma/pavlov -Ilz4 
make: *** [Makefile:148: ../zipmat] Error 127

This is because it appears that mkoctfile-7.1.0 calls $CXX and with CXX=mkoctfile it create and infinite recursive loop. There may be something special about the Fedora rpm build environment that causes the CXX variable to get exported as I can run 'make oct' by hand without any trouble. But I think the zmat makefile needs to handle calling mkoctfile in a different way.

lzma gives higher compression rate. will implement in the next release - v0.8 (Mox-the-fox).