This example shows how to keep 30ms worth of values in a single sliding window by multiple threads.

Creates multi-threaded workers that will:

• for best performance, data is stored in memory
• create a sliding window bin holding a map timestamp as key associated with a list of transaction ids
• for a specific timestamp (key) put a transaction into a list
• check that the transaction exists in the list
• Compare with doing your own using custom: Maps, Lists and JSON

• Maven
• Java 8
• Aerospike Client 4.4.6
• Aerospike Server CE 4.8.0.6
• Docker Compose

Check on your own system (adjust the number of threads):

• Intel i9 10th Gen (32 threads) on Ubuntu using single instance of Aerospike CE server (memory):

  • TEST_MODE = BinMap (uses Aerospike CDT): 320K operations per second
  • TEST_MODE = Json (serialise Java Objects to Json with client side read-update): 114k operations per second
  • TEST_MODE = Blob (serialise Java Objects to Binary with client side read-update): 78k operations per second

• Intel i9 10th Gen (1 thread) on Ubuntu using single instance of Aerospike CE server (memory):

  • TEST_MODE = BinMap (uses Aerospike CDT): 33K operations per second
  • TEST_MODE = Json (serialise Java Objects to Json with client side read-update): 9k operations per second
  • TEST_MODE = Blob (serialise Java Objects to Binary with client side read-update): 6k operations per second

Start Aerospike service using docker (expose port 3000 locally)

docker network create backend
docker-compose up -d

Build benchmark

mvn install
mvn package

Default run (32 threads, 10,000 operations per thread):

mvn test -Pbenchmark

Default run (1 threads, 10,000 operations per thread):

mvn test -Pbenchmark -Dexec.args="-z 1 -c 10000"

To validate record write using option -V:

mvn test -Pbenchmark -Dexec.args="-z 1 -c 10000 -V"

NOTE: To get then number of CPUs on Unbuntu use:

lscpu | grep "^CPU(s):"

Max hyper threads is number of CPUs x 2

To examine the structure of the bin perform this AQL command:

aql> select * from test
+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| mapbin1                                                                                                                                                                                                                                                        |
+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| KEY_ORDERED_MAP('{1614945124800:["f62a8dc4-64a2-40eb-bcc4-648f7521c3f0"], 1614945124801:["c2e490c8-7d6c-489d-ad1a-7f4a2e62a136"], 1614945124803:["7c234fc3-5ec9-4565-9ccb-b69bd0a21b44"], 1614945124804:["64956264-2d68-4c9a-b354-c52eff7242d3"], 161494512477 |
+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+