This project is based on version 0.17.0 of YCSB, with additional support for transaction features as discussed in Dr. Akon Dey's 2014 IEEE paper.
YCSB+T is an extension of the popular Yahoo! Cloud Serving Benchmark (YCSB), designed to measure the performance of cloud-based databases. This enhanced version, YCSB+T, introduces additional functionality for measuring the latency of transactions. Traditional YCSB primarily focused on throughput measurements, neglecting transactional latency. With YCSB+T, we aim to provide a more comprehensive performance evaluation tool by including latency metrics alongside throughput.
YCSB+T introduces methods such as start(), commit(), and abort() for recording transactional latency. These methods enable users to precisely measure the time taken for each transaction, providing insights into system responsiveness and consistency.
The ClosedEconomyWorkload
within the framework emulates a closed economy executing database operations such as create, read, update, and delete, among others, allowing for an extensive degree of customization. This setup features post-workload validation to ensure database state consistency, making it a versatile tool for analyzing database scalability and performance.
- YCSB official site: https://ycsb.site
- Original YCSB project docs
- The original announcement from Yahoo!
First, we will use the original YCSB repository for data loading. This is more efficient as YCSB performs batch inserts and commits each batch instead of each individual record.
curl -O --location https://github.com/brianfrankcooper/YCSB/releases/download/0.17.0/ycsb-0.17.0.tar.gz
tar xfvz ycsb-0.17.0.tar.gz
cd ycsb-0.17.0
Configure your database according to the README file found under the specific binding directory of your database in the extracted YCSB folder.
-
On Linux:
bin/ycsb.sh load basic -P workloads/workloada
-
On Windows:
bin/ycsb.bat load basic -P workloads\workloada
After loading the data using the original YCSB, switch to YCSB+T for the running phase to explicitly coordinate transactions.
curl -O --location https://github.com/kkty39/YCSB-Transactions
# Replace {module-name} with the specific module you're benchmarking, e.g., cloudspanner
mvn -pl site.ycsb:{module-name}-binding -am clean package
cd {module-name}/target/
tar -xzf ycsb-{module-name}-binding-0.17.0.tar.gz
cd ycsb-{module-name}-binding-0.17.0
Ensure your database is set up for transactions as per the README in the YCSB+T binding directory.
-
On Linux:
./bin/ycsb load {module-name} -P workloads/workloada ./bin/ycsb run {module-name} -P workloads/workloada
-
On Windows:
./bin/ycsb.bat load {module-name} -P workloads\workloada ./bin/ycsb.bat run {module-name} -P workloads\workloada
-
The
{module-name}
placeholder should be replaced with the name of the specific database binding you are testing, such ascloudspanner
. -
For detailed configuration options and database-specific setup, refer to the README files within each binding's directory in both YCSB and YCSB+T repositories.
Running the
ycsb
command without any argument will print the usage.See https://github.com/brianfrankcooper/YCSB/wiki/Running-a-Workload for a detailed documentation on how to run a workload.
See https://github.com/brianfrankcooper/YCSB/wiki/Core-Properties for the list of available workload properties.
- CockroachDB, MongoDB and JDBC drivers are still undergoing testing, so use with care