Giter Club home page Giter Club logo

fs-benchmark's Introduction

fs-benchmark

This benchmark supports read-write and metadata performance test on the wide distribute file system, such as ceph, moosefs, lizardfs and so on and generates test graphs using pandas.

read-write test

This test uses iozone to run the read-write test and includes write, read, randread, randwrite.

default parameters

block size(KiB): 8 16 32 64 128 256 512 1024 2048
concurrent: 1 2 4 8 16
file size: 1GiB

run and plot

cd /path/to/mount/fs
NAME=test TEST_LOOP=3 DIRECT="" bash $ROOT/rw-benchmark/iozone/perftest.sh | tee /tmp/testlog
# the result files is in $HOME dir
python $ROOT/rw-benchmark/plot/plot.py -f $HOME/iozone-test-<date>-{}.tar.gz -r 3

metadata test

metadata test tests the performance of MDS of ceph, or master of moosefs, or other fs

Usage of perftest:
  -b uint
        start index of operations
  -c uint
        concurrent of operations (default 1)
  -id uint
        client id (default 1)
  -interval duration
        interval to calculate tps, e.g. 1h5m8s (default 1m0s)
  -n string
        count string of operations, k,m,g (default "10")
  -period duration
        period duration of each stages, e.g. 1h5m8s (default 5m0s)
  -s string
        count of operations in one dir, k,m,g (default "10")
  -t    for test
  -v    show version

Example

cd /path/to/mount/fs
$ROOT/meta-benchmark/bin/perftest -n 3m -c 100 -id 1 -interval 1m -period 3h
-n 3,000,000 files
-c 100 concurrent
-id 1
-interval 1 minute
-period 3 hour

fs-benchmark's People

Contributors

hacky-dh avatar

Stargazers

 avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.