Comments (5)
EJFielding
commented on July 23, 2024
1
Thanks for returning to close this issue @yunjunz.
from mintpy.
EJFielding
commented on July 23, 2024
1
I went back to the dataset that was crashing before and ran the geocoding again. The geocoding of the large timeseries.h5 was successful!
grab dataset structure from ref_file: timeseries.h5
create HDF5 file: /net/kraken/nobak/fielding/Ridgecrest/S1AB/A064/stack2/MintPy_v1/geo/geo_timeseries.h5 with w mode
create dataset : bperp of float32 in size of (87,) with compression = None
create dataset : date of |S8 in size of (87,) with compression = None
create dataset : timeseries of float32 in size of (87, 3988, 9791) with compression = None
close HDF5 file: /net/kraken/nobak/fielding/Ridgecrest/S1AB/A064/stack2/MintPy_v1/geo/geo_timeseries.h5
--------------------------------------------------
reading timeseries in block (0, 0, 9791, 3988) from timeseries.h5 ...
nearest resampling with pyresample.kd_tree using 1 CPU cores in 4 segments ...
write data in block [0, 87, 0, 307, 0, 9791] to file: /net/kraken/nobak/fielding/Ridgecrest/S1AB/A064/stack2/MintPy_v1/geo/geo_timeseries.h5
--------------------------------------------------
reading timeseries in block (0, 0, 9791, 3988) from timeseries.h5 ...
nearest resampling with pyresample.kd_tree using 1 CPU cores in 4 segments ...
write data in block [0, 87, 307, 614, 0, 9791] to file: /net/kraken/nobak/fielding/Ridgecrest/S1AB/A064/stack2/MintPy_v1/geo/geo_timeseries.h5
--------------------------------------------------
reading timeseries in block (0, 0, 9791, 3988) from timeseries.h5 ...
nearest resampling with pyresample.kd_tree using 1 CPU cores in 4 segments ...
write data in block [0, 87, 614, 921, 0, 9791] to file: /net/kraken/nobak/fielding/Ridgecrest/S1AB/A064/stack2/MintPy_v1/geo/geo_timeseries.h5
--------------------------------------------------
reading timeseries in block (0, 0, 9791, 3988) from timeseries.h5 ...
nearest resampling with pyresample.kd_tree using 1 CPU cores in 4 segments ...
write data in block [0, 87, 921, 1228, 0, 9791] to file: /net/kraken/nobak/fielding/Ridgecrest/S1AB/A064/stack2/MintPy_v1/geo/geo_timeseries.h5
--------------------------------------------------
reading timeseries in block (0, 0, 9791, 3988) from timeseries.h5 ...
nearest resampling with pyresample.kd_tree using 1 CPU cores in 4 segments ...
write data in block [0, 87, 1228, 1535, 0, 9791] to file: /net/kraken/nobak/fielding/Ridgecrest/S1AB/A064/stack2/MintPy_v1/geo/geo_timeseries.h5
--------------------------------------------------
reading timeseries in block (0, 0, 9791, 3988) from timeseries.h5 ...
nearest resampling with pyresample.kd_tree using 1 CPU cores in 4 segments ...
write data in block [0, 87, 1535, 1842, 0, 9791] to file: /net/kraken/nobak/fielding/Ridgecrest/S1AB/A064/stack2/MintPy_v1/geo/geo_timeseries.h5
--------------------------------------------------
reading timeseries in block (0, 0, 9791, 3988) from timeseries.h5 ...
nearest resampling with pyresample.kd_tree using 1 CPU cores in 4 segments ...
write data in block [0, 87, 1842, 2149, 0, 9791] to file: /net/kraken/nobak/fielding/Ridgecrest/S1AB/A064/stack2/MintPy_v1/geo/geo_timeseries.h5
--------------------------------------------------
reading timeseries in block (0, 0, 9791, 3988) from timeseries.h5 ...
nearest resampling with pyresample.kd_tree using 1 CPU cores in 4 segments ...
write data in block [0, 87, 2149, 2456, 0, 9791] to file: /net/kraken/nobak/fielding/Ridgecrest/S1AB/A064/stack2/MintPy_v1/geo/geo_timeseries.h5
--------------------------------------------------
reading timeseries in block (0, 0, 9791, 3988) from timeseries.h5 ...
nearest resampling with pyresample.kd_tree using 1 CPU cores in 4 segments ...
write data in block [0, 87, 2456, 2763, 0, 9791] to file: /net/kraken/nobak/fielding/Ridgecrest/S1AB/A064/stack2/MintPy_v1/geo/geo_timeseries.h5
--------------------------------------------------
reading timeseries in block (0, 0, 9791, 3988) from timeseries.h5 ...
nearest resampling with pyresample.kd_tree using 1 CPU cores in 4 segments ...
write data in block [0, 87, 2763, 3070, 0, 9791] to file: /net/kraken/nobak/fielding/Ridgecrest/S1AB/A064/stack2/MintPy_v1/geo/geo_timeseries.h5
--------------------------------------------------
reading timeseries in block (0, 0, 9791, 3988) from timeseries.h5 ...
nearest resampling with pyresample.kd_tree using 1 CPU cores in 4 segments ...
write data in block [0, 87, 3070, 3377, 0, 9791] to file: /net/kraken/nobak/fielding/Ridgecrest/S1AB/A064/stack2/MintPy_v1/geo/geo_timeseries.h5
--------------------------------------------------
reading timeseries in block (0, 0, 9791, 3988) from timeseries.h5 ...
nearest resampling with pyresample.kd_tree using 1 CPU cores in 4 segments ...
write data in block [0, 87, 3377, 3684, 0, 9791] to file: /net/kraken/nobak/fielding/Ridgecrest/S1AB/A064/stack2/MintPy_v1/geo/geo_timeseries.h5
--------------------------------------------------
reading timeseries in block (0, 0, 9791, 3988) from timeseries.h5 ...
nearest resampling with pyresample.kd_tree using 1 CPU cores in 4 segments ...
write data in block [0, 87, 3684, 3988, 0, 9791] to file: /net/kraken/nobak/fielding/Ridgecrest/S1AB/A064/stack2/MintPy_v1/geo/geo_timeseries.h5
--------------------------------------------------
Thanks!
I should also say that I noticed that the smallbaselineApp.py script noticed that my input configuration file from August 2019 was old and automatically upgraded it, so I did not have to re-run the whole processing. Nice!
from mintpy.
hfattahi
commented on July 23, 2024
Yes probably memory issue. If you only need to geocode velocity file, then try to directly call geocode script:
geocode.py velocity.h5
from mintpy.
EJFielding
commented on July 23, 2024
Thanks @hfattahi, that works great for now.
from mintpy.
yunjunz
commented on July 23, 2024
This issue should be solved by the new geocode.py from #488 with block-by-block IO.
from mintpy.
Related Issues (20)
- tropo_gacos: can not convert NaN to integer HOT 4
- prep_isce.py KeyError HOT 2
- FileNotFoundError: [Errno 2] No such file or directory: '' (*.slc.full from isce2 is missing) HOT 1
- UTM conversion raise OutOfRangeError in `prep_hyp3.py` HOT 3
- Change Mix, Max Range of Colorbar HOT 1
- How to get full resolution result of geo_velocity.h5? HOT 1
- Load data error in opensarlab mintpy timeseries notebook HOT 2
- TypeError: Object dtype dtype('O') HOT 2
- when load GAMMA format unw file, load_data report a error HOT 4
- Index Out Of Range during correct_troposphere step HOT 1
- Release new version of MintPy to support HyP3 Burst InSAR products HOT 4
- AriaTS_setup HOT 2
- Subset HyP3 datasets and create horz and vert displacement on Jupyter notebook HOT 1
- An error occurred using GACOS data in mintpy HOT 2
- Deprecated numpy.float usage in smallbaselineApp.py breaks with numpy > 1.24.0 HOT 2
- The meaning of numTriNonzeroIntAmbiguity.h5 HOT 1
- output save_gbis.py issue HOT 1
- hyp3 + mintpy: Error in Second Step (Modify Network) HOT 1
- metadata inconsistency for UTM coordinates HOT 4
- `hyp3`: more metadata for `HDF-EOS5` support HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mintpy.