A common package to provide example files (e.g. ROOT) for testing and developing packages against. The sample of files is representative of typical files found "in the wild".
In addition to including some root files directly, this package adds some simple helper methods to get larger files from common open-access data repositories.
To install:
python -m pip install scikit-hep-testdataOnce installed, absolute file paths can be resolved using the helper methods:
from skhep_testdata import data_path
filename = data_path("some_file.root")By default, if an unknown file is requested an exception is raised but this can be skipped by passing the above method raise_missing=False:
filename = data_path("unknown_file.root", raise_missing=False)The files are not stored on PyPI, so if installed from SDist/wheel, the "local"
files will not be present, but will be downloaded from GitHub and cached in the
~/.local/skhepdata directory. If you make an editable install from the Git repo,
or if you set SKHEP_DATA=1 when building/installing from the Git repo, you will
have the data files locally.
You can see all "local" files with skhep_testdata.known_files, and you can
download all files at once with skhep_testdata.download_all(), optionally selecting
the download cache directory.
Some files, particularly large ones, for example, are not stored within this
package and instead live on a remote server; we call these "remote files". To
obtain these use the same data_path method as above, however this will
trigger the code to download and configure the remote file. This might be slow
the first time round but will subsequently be as fast as for a local file.
WARNING: the local file caching system has not yet been applied to remote
files.
You can also interact with this package from the command-line:
# Print a path (download if needed)
python -m skhep_testdata cms_hep_2012_tutorial/data.root
# Show all "local" files
python -m skhep_testdata --list
# Download all files to an existing directory
python -m skhep_testdata --all --dir localYou can also use pipx run scikit-hep-testdata to access the above CLI without installing.
We're on the look out for new, interesting files!
- Large files: If the file is particularly large, for example > 25 MB, it might be worth adding to an external open access data repository and adding a configuration here so that the internal helper methods can pull this down.
- Experiment data policies: Please make sure you have permissions to add the file to this collection, and that any private or sensitive data has been appropriately masked, salted, or scrambled.
The following lists describe the files known by this package.
We hereby acknowledge the contributors that made this project possible (emoji key):
This project follows the all-contributors specification.
- Many of the files collected directly within this package were collated originally by Jim Pivarski for uproot
This package uses pytest to run the unit tests. Install with pip install scikit-hep-testdata[test] or pip install -e .[test] (dev) to get the testing requirements.
then run:
pytest
![allcontributors[bot] avatar](https://avatars.githubusercontent.com/in/23186?v=4 "allcontributors[bot]")
![pre-commit-ci[bot] avatar](https://avatars.githubusercontent.com/in/68672?v=4 "pre-commit-ci[bot]")
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent