Comments (6)
Build notes for avro:
- the avro c++ docs are here: http://avro.apache.org/docs/current/api/cpp/html/
- the avro c++ driver package is available here: http://mirror.switch.ch/mirror/apache/dist/avro/avro-1.7.7/ under cpp
- avro requires libboost (best bet just install all the boost libraries) >= version 1.55. The Ubuntu 14.04 core repo version as of now is 1.54. Avro does not compile with this version so you have to compile boost from source.
Setting up boost:
-
Get the source. I got version 1.57 (newest) here: http://sourceforge.net/projects/boost/files/boost/1.57.0
-
Untar the package (tar -zxvf). You can access docs by opening index.html in the extracted dir.
-
Follow the instructions in the docs. Otherwise these commands should work:
./bootstrap.sh --prefix=/usr/local sudo ./b2 install
- Get a coffee. Or lunch. It takes a while.
Install avro
Next you can install avro. Get it at the links above. Pro tip: if you mess something up and you want to change cmake options you have to delete the cmake cache. Or just delete the avro folder and untar it again.
1. Use the following commands to install avro
./build.sh test
./build.sh install
2. That should be it. Avro is not installed in /usr/local
Keep in mind that /usr/local/include and /usr/local/lib should be in your path and library path.
from kodiaq.
I would wait a little on this...
from kodiaq.
Why? Are we considering other formats for 1T data? If so what?
from kodiaq.
Avro seems good, but I mainly want to see what the outcome of the CM is. On the 20th of this month, we'll hear about a grant for an engineer that would be related to data formats. Maybe they come up with something smarter (and can help also the kodiaq implementation if you want)? Basho was telling me that this Avro stuff wasn't too straightforward in C++.
Let's discuss in person, but what if we just did BSON? That way there is no extra dependency for example. I sort of wanted to see how our DAQ test goes and if the file builder (e.g. avro) is a bottleneck. Afterwards, we can know how we finalize it.
from kodiaq.
We can freeze Avro and it's still much better than XED. However, we can also do better if you find the external dependency to be a burden.
from kodiaq.
Won't fix. Using BSON output for 1T.
from kodiaq.
Related Issues (20)
- Slaves can get stuck in 'undefined' state HOT 1
- Starting combined runs now broken.
- Sanity check for options files
- Dispatcher segmentation fault with MongoDB error HOT 1
- MongoDB runs DB instabilities during high load HOT 2
- Segmentation fault in Mongo driver when inserting status information HOT 1
- Stopping a run that was never started can cause a crash HOT 1
- Concurrency issue in network code leads to seg fault in master HOT 1
- Memory leak when adding V1495 module HOT 1
- Better way to manage bulk inserts
- Slave times out after baseline estimation. HOT 1
- Store DAC register / DC-offset values in run doc HOT 1
- Runs with Same Name HOT 3
- Keep track of time kodiaq read buffer of digitizer HOT 1
- Run stop appears asynchronous HOT 1
- Large 'wake up' pulse HOT 2
- Batch of data from some digitizers out of sync near start of run HOT 1
- Last run in queue sometimes repeats
- Trigger monitor data not available online if TPC and MV run start with same name HOT 1
- Current version tag?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kodiaq.