jeffreylovitz / ldbc_snb_implementations Goto Github PK

Implementations for the Workload components of the LDBC Social Network Benchmark (specification).

⚠️ The most recent version of the code can be found on the dev branch. The master branch tends to be better tested and uses a stable version of the LDBC SNB driver.

⚠️ Implementations in this repository are preliminary, i.e. they are unaudited and - in rare cases - do not pass validation. For details, feel free to contact us through an issue or email.

Multiple configuration files and scripts use relative paths to address the data generator's directory. Hence, it is recommended to clone the LDBC Data Generator and the LDBC implementations repositories next to each other and keep their original directory names. For example:

• ldbc
  • ldbc_snb_datagen
  • ldbc_snb_driver – use the dev branch
  • ldbc_snb_implementations

Each project has its own README:

• Cypher (Neo4j driver) implementation
• PostgreSQL implementation
• SPARQL implementation

The Sparksee implementation is maintained in a separate repository.

The queries in this repository are work-in-progress. If possible, please cross-validate your queries against multiple implementations.

1. If you are on the dev branch or any other unstable branche, first build and install the driver from source.

   1. Grab the driver source code from: https://github.com/ldbc/ldbc_snb_driver.

   2. Install the driver artifact to the local Maven repository:

      mvn clean install -DskipTests

2. Navigate to the root of this repository and build it to generate the JAR files for the implementations:

   ./build.sh

3. For each implementation, it is possible to (1) create validation parameters, (2) validate against an existing validation parameters, and (3) run the benchmark. Set the parameters according to your system configuration in the appropriate .properties file and run the driver with one of the following scripts:

   # BI workload
   ./bi-create-validation-parameters.sh
   ./bi-validate.sh
   ./bi-benchmark.sh
   # Interactive workload - note that if the workload contains updates, the database needs to be re-loaded between steps
   ./interactive-create-validation-parameters.sh
   ./interactive-validate.sh
   ./interactive-benchmark.sh

For more details, on validating and benchmarking, visit the driver wiki.

To generate small data sets, use scale factor 1 (SF1) with the persons and years set according to this template:

ldbc.snb.datagen.generator.scaleFactor:snb.interactive.1

ldbc.snb.datagen.generator.numPersons:50
ldbc.snb.datagen.generator.numYears:1
ldbc.snb.datagen.generator.startYear:2010

ldbc.snb.datagen.generator.numThreads:1
ldbc.snb.datagen.serializer.outputDir:./test_data/

ldbc.snb.datagen.serializer.personSerializer:ldbc.snb.datagen.serializer.snb.interactive.<SerializerType>PersonSerializer
ldbc.snb.datagen.serializer.invariantSerializer:ldbc.snb.datagen.serializer.snb.interactive.<SerializerType>InvariantSerializer
ldbc.snb.datagen.serializer.personActivitySerializer:ldbc.snb.datagen.serializer.snb.interactive.<SerializerType>PersonActivitySerializer