Giter Club home page Giter Club logo

arnie's Introduction

Arnie

Arnie is a command-line benchmarking tool for Janet.

Features

Arnie has the following features:

  • downloads and compiles the Janet version to benchmark
    • supports URLs to Git repositories
    • supports commit hashes and tags for GitHub repositories
  • benchmarks against an extensive test suite
    • supports benchmarking multiple Janet executables
    • supports user-defined benchmarks
    • supports printing results as JDN, JSON or plain text

Installation

Install via JPM:

$ jpm install https://github.com/pyrmont/arnie
$ arnie --help

Usage

Arnie can be used like this:

$ arnie make v1.35.0
$ arnie make v1.32.0
$ arnie bench
# Benchmark: benchmarks/knucleotide/knucleotide2.janet
Janet 1.32.0-b5996f5    Avg: 0.161672115325928
Janet 1.35.0-0d9e999    Avg: 0.147693157196045

# Benchmark: benchmarks/regex-redux/regexredux2.janet
Janet 1.32.0-b5996f5    Avg: 0.00700902938842773
Janet 1.35.0-0d9e999    Avg: 0.0256609916687012

# Benchmark: benchmarks/nbody/nbody2.janet
Janet 1.32.0-b5996f5    Avg: 0.0324769020080566
Janet 1.35.0-0d9e999    Avg: 0.0349478721618652

# Benchmark: benchmarks/fannkuch/fannkuch4-parallel.janet
Janet 1.32.0-b5996f5    Avg: 0.995783090591431
Janet 1.35.0-0d9e999    Avg: 0.916385889053345

# Benchmark: benchmarks/fannkuch/fannkuch1.janet
Janet 1.32.0-b5996f5    Avg: 6.55872511863708
Janet 1.35.0-0d9e999    Avg: 6.42196393013

# Benchmark: benchmarks/fannkuch/fannkuch2.janet
Janet 1.32.0-b5996f5    Avg: 4.95723104476929
Janet 1.35.0-0d9e999    Avg: 4.99268579483032

# Benchmark: benchmarks/fannkuch/fannkuch3.janet
Janet 1.32.0-b5996f5    Avg: 1.38383603096008
Janet 1.35.0-0d9e999    Avg: 1.38260197639465

# Benchmark: benchmarks/fannkuch/fannkuch2b.janet
Janet 1.32.0-b5996f5    Avg: 0.229254961013794
Janet 1.35.0-0d9e999    Avg: 0.0403671264648438

# Benchmark: benchmarks/fannkuch/fannkuch5.janet
Janet 1.32.0-b5996f5    Avg: 2.87757301330566
Janet 1.35.0-0d9e999    Avg: 2.47903203964233

# Benchmark: benchmarks/fannkuch/fannkuch2-in.janet
Janet 1.32.0-b5996f5    Avg: 4.76161003112793
Janet 1.35.0-0d9e999    Avg: 4.70300483703613

# Benchmark: benchmarks/regex-redux/regexredux.janet
Janet 1.32.0-b5996f5    Avg: 0.0431818962097168
Janet 1.35.0-0d9e999    Avg: 0.0177791118621826

# Benchmark: benchmarks/regex-redux/regexredux2.janet
Janet 1.32.0-b5996f5    Avg: 0.00700902938842773
Janet 1.35.0-0d9e999    Avg: 0.0256609916687012

# Benchmark: benchmarks/nbody/nbody2.janet
Janet 1.32.0-b5996f5    Avg: 0.0324769020080566
Janet 1.35.0-0d9e999    Avg: 0.0349478721618652

# Benchmark: benchmarks/fannkuch/fannkuch4-parallel.janet
Janet 1.32.0-b5996f5    Avg: 0.995783090591431
Janet 1.35.0-0d9e999    Avg: 0.916385889053345

# Benchmark: benchmarks/fannkuch/fannkuch1.janet
Janet 1.32.0-b5996f5    Avg: 6.55872511863708
Janet 1.35.0-0d9e999    Avg: 6.42196393013

# Benchmark: benchmarks/fannkuch/fannkuch2.janet
Janet 1.32.0-b5996f5    Avg: 4.95723104476929
Janet 1.35.0-0d9e999    Avg: 4.99268579483032

# Benchmark: benchmarks/fannkuch/fannkuch3.janet
Janet 1.32.0-b5996f5    Avg: 1.38383603096008
Janet 1.35.0-0d9e999    Avg: 1.38260197639465

# Benchmark: benchmarks/fannkuch/fannkuch2b.janet
Janet 1.32.0-b5996f5    Avg: 0.229254961013794
Janet 1.35.0-0d9e999    Avg: 0.0403671264648438

# Benchmark: benchmarks/fannkuch/fannkuch5.janet
Janet 1.32.0-b5996f5    Avg: 2.87757301330566
Janet 1.35.0-0d9e999    Avg: 2.47903203964233

# Benchmark: benchmarks/fannkuch/fannkuch2-in.janet
Janet 1.32.0-b5996f5    Avg: 4.76161003112793
Janet 1.35.0-0d9e999    Avg: 4.70300483703613

# Benchmark: benchmarks/regex-redux/regexredux.janet
Janet 1.32.0-b5996f5    Avg: 0.0431818962097168
Janet 1.35.0-0d9e999    Avg: 0.0177791118621826

# Benchmark: benchmarks/fannkuch/fannkuch4.janet
Janet 1.32.0-b5996f5    Avg: 3.56411409378052
Janet 1.35.0-0d9e999    Avg: 3.69160199165344

# Benchmark: benchmarks/reverse-complement/revcomp2_113.janet
Janet 1.32.0-b5996f5    Avg: 0.00463700294494629
Janet 1.35.0-0d9e999    Avg: 0.0048828125

# Benchmark: benchmarks/binarytrees/binarytrees1.janet
Janet 1.32.0-b5996f5    Avg: 0.0272018909454346
Janet 1.35.0-0d9e999    Avg: 0.0221970081329346

# Benchmark: benchmarks/reverse-complement/revcomp2.janet
Janet 1.32.0-b5996f5    Avg: 0.0215470790863037
Janet 1.35.0-0d9e999    Avg: 0.00510501861572266

# Benchmark: benchmarks/knucleotide/knucleotide.janet
Janet 1.32.0-b5996f5    Avg: 0.279989004135132
Janet 1.35.0-0d9e999    Avg: 0.155150890350342

# Benchmark: benchmarks/nbody/nbody.janet
Janet 1.32.0-b5996f5    Avg: 0.0543398857116699
Janet 1.35.0-0d9e999    Avg: 0.0534029006958008

# Benchmark: benchmarks/reverse-complement/counts.janet
Janet 1.32.0-b5996f5    Avg: 0.0332131385803223
Janet 1.35.0-0d9e999    Avg: 0.0292308330535889

# Benchmark: benchmarks/reverse-complement/revcomp.janet
Janet 1.32.0-b5996f5    Avg: 0.021298885345459
Janet 1.35.0-0d9e999    Avg: 0.00989699363708496

# Benchmark: benchmarks/pidigits/pidigits.janet
Janet 1.32.0-b5996f5    Avg: 0.212692975997925
Janet 1.35.0-0d9e999    Avg: 0.39533805847168

# Benchmark: benchmarks/fannkuch/fannkuch4-bakpakin.janet
Janet 1.32.0-b5996f5    Avg: 3.37368202209473
Janet 1.35.0-0d9e999    Avg: 3.26073312759399

Bugs

Found a bug? I'd love to know about it. The best way is to report your bug in the Issues section on GitHub.

Licence

Arnie is licensed under the MIT Licence. See LICENSE for more details. It includes code from janet-benchmarksgame and janet-big.

arnie's People

Contributors

pyrmont avatar

Stargazers

Caleb Foust avatar  avatar Josef Pospíšil avatar

Watchers

Josef Pospíšil avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.