Comments (4)
Interesting.
Is this running in a conda environment or python environment? We occasionally see issues when running in conda.
Are you able to merge the remaining 20 files into the ip_merge.pod5 file?
from pod5-file-format.
Hi, @HalfPhoton
We occasionally see issues when running in conda.
I run this code in conda environment.
Are you able to merge the remaining 20 files into the ip_merge.pod5 file?
I don't know how pod5 merge handles the order of files.
Like test_0.pod5...test_1.pod5... test_20.pod5?
If so, I will try to merge it.
Best wishes,
Kirito
from pod5-file-format.
ah - I see.
In this case please create a list of missing read ids from the first merged output and all inputs using pod5 view.
# get read ids
pod5 view -IH input_data/ -o input.ids
pod5 view -IH merged.pod5 -o merged.ids
# Sort the files (comm requires sorted files)
sort input.ids > input.ids.sorted
sort merged.ids > merged.ids.sorted
# Find ids in input that are not in merged file
comm -23 input.ids.sorted merged.ids.sorted > missing.ids
# Get a pod5 file of only missing ids
pod5 filter input_data/ --ids missing.ids -o missing.pod5
# Merge in missing ids
pod5 merge merged.pod5 missing.pod5 -o merged.final.pod5
from pod5-file-format.
I recommend using a python virtual environment instead of a conda environment:
python3.10 -m venv venv --prompt=pod5
source venv/bin/activate
pip install -U pip pod5
pod5 --version
from pod5-file-format.
Related Issues (20)
- MantaControl': Unable to read fast5 file at /path/: HDF5 exception", HOT 2
- Getting the signal chunk size of a pod5 file HOT 1
- Missing conda pod5 package HOT 2
- No documentation regarding multi-file pod5 dependency HOT 2
- pod5 convert fast5 warning: Failed to read key read_XXX HOT 2
- Troubleshooting Conversion of Fast5 Files to Pod5 Format HOT 12
- error:XX.fast5 is not a multi-read fast5 file HOT 2
- pod5 filter get killed HOT 5
- pod5 convert fast5 is stalling HOT 4
- Split Read IDs Cause Missing Read Error? HOT 1
- Support for sampling rates larger than int16 when writing pod5 files
- Lost signal data HOT 3
- pod5 convert fast5 doesn't finish for a set of files HOT 11
- Is it possible to repack pod5 files with a specific read number? HOT 4
- Pod5 convert to_fast5 is losing signal data HOT 2
- pod5 breaks with new numpy 2.0.0 HOT 7
- Timeout Issue with POD5 conversion HOT 21
- Pyarrow error HOT 10
- Question about iteratively getting a read subset HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pod5-file-format.