Comments (1)
smarr
commented on July 3, 2024
The content of a data file currently looks something like:
#!/Users/smarr/Projects/ReBench/main.py -R -d rebench.conf progr-rep-mem
# Execution Start: 2023-04-07T17:08:32.416178+00:00
# Environment: {"userName": "smarr", "manualRun": true, "hostName": "A2", "osType": "Darwin", "memory": 103079215104, "denoise": {}, "cpu": "Apple M2 Max", "clockSpeed": 0, "software": [{"name": "kernel", "version": "Darwin Kernel Version 22.3.0"}, {"name": "kernel-release", "version": "22.3.0"}, {"name": "architecture", "version": "arm64"}]}
# Source: {"repoURL": "[email protected]:SOM-st/TruffleSOM.git", "branchOrTag": "master", "commitId": "9aeb6ba2ca872e6844cb4f7f6ba5db094f04204f", "commitMsg": "Blocks with a field read nested in a block are not yet supported (#181)\n\n", "authorName": "Stefan Marr", "committerName": "GitHub", "authorEmail": "[email protected]", "committerEmail": "[email protected]"}
1 1 131552.000000 kb MaxRSS TestGC TruffleSOM-native-interp-bc progr-rep-mem 10 1 38 yuria
1 1 540.000000 ms total TestGC TruffleSOM-native-interp-bc progr-rep-mem 10 1 38 yuria
From the top, the lines encode:
- How rebench was invoked
- The start time
- Data on the environment in which the results were recorded
- The status of the source repository in which rebench was run
Afterwards, we have tab-separated lines with values.
From the top of my head, these lines are parsed by the from_str_list methods on the model classes, and they are produced by the corresponding as_str_list methods.
So, after writing out the source info, I would think we want to call get_str_list_header or similar on the relevant model class, which basically does the same as as_str_list but instead gives readable names for the columns.
See for instance:
https://github.com/smarr/ReBench/blob/master/rebench/model/run_id.py#L313-L319
So, I imaging the first line after # Source:
Would read something like invocation, iteration, value, unit, criterion, benchmark, executor, suite, ... (this isn't complete).
from rebench.
Related Issues (20)
- [T.4.1] 5min Tutorials
- [T.4.3] Improve Documentation and Tutorials
- Parser for perf output fails on some input HOT 4
- ReBench environment variable inconsistency HOT 6
- Fast abort of benchmarks when same binary is missing HOT 1
- Parse git branch info when running in developer checkout
- `ReBenchLog` gauge adapter doesn't work on case-sensitive filesystems HOT 7
- Could we use hwnoise to assess whether performance fluctuations are coming from hardware noise?
- Can we drop Python 2 support? HOT 1
- Add option to explicitly disable all use of denois HOT 4
- There seem to be 'None' string values for extraArgs that are send to ReBenchDB HOT 1
- Make invocation number accessible in command line. HOT 2
- Add support for single-value metrics
- Add support to capture custom version details
- Making environment handling more user-friendly HOT 3
- CSV Headers should be added only exactly once, to avoid being confused with data
- Reenable testing on PyPy on GitHub Actions once the PyYAML issue is resolved
- ReBench commandline exit code should not be non-zero when there's nothing to do
- The ~ in a path should be replaced by the home directory
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from rebench.