These are various tools I've created and used in my life as a computational scientist in NERSC's Advanced Technologies Group. Use at your own risk.
mpiio-cp.c
- a tool to copy a large file in parallel using MPI-IOtimer.c
- boilerplate code to perform high-resolution timingis_file_in_page_cache.c
- boilerplate code demonstrating how to check if a file is in page cachedrop_file_from_page_cache.c
- boilerplate code demonstrating howposix_fadvise
may be used to drop files from page cache as an unprivileged usermmap-vs-posix.c
- boilerplate code demonstrating how to perform POSIX file-based and mmap-based I/Ommap-test.c
- a simple tool to measure mmap I/O performance
aggregate-h5lmt.py
- boilerplate code to parse LMT HDF5 filesarchive_darshan.sh
- script to back up Darshan logs to HPSS. Run usingNERSC_HOST=cori ./archive_darshan.sh ~/darshanlogs/
or something similar.build-darshan.sh
- compile and cross-compile Darshan in the NERSC environmentior-sequence.py
- boilerplate code to prototype new IOR kernelsmissingdata-h5lmt.py
- boilerplate code to work with pyLMT'sFSMissingDataSet
parse_dvs_counters.py
- boilerplate code to parse DVS client counters
ncbi-blast-2.2.31-traces.patch
- patch needed to make NCBI's blast report detailed I/O telemetryparse_instrumented_blast.py
- tool to parse the output from a BLAST job instrumented with the above patch
This software was developed in the course of prime contract No. DE-AC02-05CH11231 between the U.S. Department of Energy and the University of California but has not been licensed for public use. If you would like to use any of this software and require a license, please contact me and I can arrange for a proper public-use license.