Giter Club home page Giter Club logo

licsbas's Introduction

LiCSBAS

LiCSBAS is an open-source package in Python and bash to carry out InSAR time series analysis using LiCSAR products (i.e., unwrapped interferograms and coherence) which are freely available on the COMET-LiCS web portal.

Users can easily derive the time series and velocity of the displacement if sufficient LiCSAR products are available in the area of interest. LiCSBAS also contains visualization tools to interactively display the time series of displacement to help investigation and interpretation of the results.

Unfortunately, this LiCSBAS repository cannot be updated since 2022 for a reason. There are some known issues listed here. If you encounter an error, please see the known issues or search other issues. You can also use LiCSBAS2 or COMET-version LiCSBAS which are maintained.

Demonstration Video

THIS IS RESEARCH CODE PROVIDED TO YOU "AS IS" WITH NO WARRANTIES OF CORRECTNESS. USE AT YOUR OWN RISK.

Documentation and Bug Reports

See the wiki pages and quick start.

If you have found an issue or bug, please report it on the issues page.

Sample Products and Tutorial

Citations

Morishita, Y.; Lazecky, M.; Wright, T.J.; Weiss, J.R.; Elliott, J.R.; Hooper, A. LiCSBAS: An Open-Source InSAR Time Series Analysis Package Integrated with the LiCSAR Automated Sentinel-1 InSAR Processor. Remote Sens. 2020, 12, 424, https://doi.org/10.3390/RS12030424.

Morishita, Y.: Nationwide urban ground deformation monitoring in Japan using Sentinel-1 LiCSAR products and LiCSBAS. Prog. Earth Planet. Sci. 2021, 8, 6, https://doi.org/10.1186/s40645-020-00402-7.

Lazecký, M.; Spaans, K.; González, P.J.; Maghsoudi, Y.; Morishita, Y.; Albino, F.; Elliott, J.; Greenall, N.; Hatton, E.; Hooper, A.; Juncu, D.; McDougall, A.; Walters, R.J.; Watson, C.S.; Weiss, J.R.; Wright, T.J. LiCSAR: An Automatic InSAR Tool for Measuring and Monitoring Tectonic and Volcanic Activity. Remote Sens. 2020, 12, 2430, https://doi.org/10.3390/rs12152430.

Morishita, Y., Sugimoto, R., Nakamura, R. et al. Nationwide urban ground deformation in Japan for 15 years detected by ALOS and Sentinel-1. Prog Earth Planet Sci 10, 66 (2023). https://doi.org/10.1186/s40645-023-00597-5

Acknowledgements

This work has been accomplished during Y. Morishita’s visit at University of Leeds, funded by JSPS Overseas Research Fellowship.

COMET is the UK Natural Environment Research Council's Centre for the Observation and Modelling of Earthquakes, Volcanoes and Tectonics. LiCSAR is developed as part of the NERC large grant, "Looking inside the continents from Space" (NE/K010867/1). LiCSAR contains modified Copernicus Sentinel data [2014-] analysed by the COMET. LiCSAR uses JASMIN, the UK’s collaborative data analysis environment.

The Scientific Colour Maps (Crameri, 2018) is used in LiCSBAS.

Yu Morishita (PhD)
JSPS Overseas Research Fellow (June 2018-March 2020)
Visiting Researcher, COMET, School of Earth and Environment, University of Leeds (June 2018-March 2020)
Chief Researcher, Geography and Crustal Dynamics Research Center, Geospatial Information Authority of Japan (GSI)

licsbas's People

Contributors

cemacrr avatar yumorishita avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

licsbas's Issues

Missing LiCSAR products

When trying automatic toolchain there's downloading error:

Create E.geo
No *.geo.E.tif found in GEOC
Error while downloading from http://gws-access.ceda.ac.uk/public/nceo_geohazards/LiCSAR_products/51/051D_03973_131313/metadata/051D_03973_131313.geo.E.tif

Create N.geo
No *.geo.N.tif found in GEOC
Error while downloading from http://gws-access.ceda.ac.uk/public/nceo_geohazards/LiCSAR_products/51/051D_03973_131313/metadata/051D_03973_131313.geo.N.tif

Create U.geo
No *.geo.U.tif found in GEOC
Error while downloading from http://gws-access.ceda.ac.uk/public/nceo_geohazards/LiCSAR_products/51/051D_03973_131313/metadata/051D_03973_131313.geo.U.tif

Looking at the webpage in that dataframe or similar there's no those files.
What should be in these geotiffs?
Maybe I can prepare it myself?

Dose LiCSBAS run on Windows ?

Thanks to your advice, I could run LiCSBAS on Mac OS,
Now I'm trying to install LiCSBAS on windows10.
We can install Anaconda3 on windows10, and also can install Gdal by Anaconda prompt.
But after that it dose not go well. (Commands does not work well).
Do you have any report that LiCSBAS runs on windows ?

File Not Found

For display the derived time series and velocity: I applied this command

LiCSBAS_plot_ts.py -i TS_GEOCml1clip/cum_filt.h5 &
Screenshot from 2020-11-12 16-48-41

Unfortunately I couldn't Found

No TS_GEOCml1clip/cum_filt.h5 found!

Copy baselines file

Dear
I'll trying to run in descending track but I had the error:

Copy baselines file
File "/home/LICSBAS/LiCSBAS/bin/LiCSBAS02_ml_prep.py", line 453, in
sys.exit(main())
File "/home/LICSBAS/LiCSBAS/bin/LiCSBAS02_ml_prep.py", line 370, in main
if not io_lib.read_bperp_file(bperp_file_in, imdates):
File "/home/LICSBAS/LiCSBAS/LiCSBAS_lib/LiCSBAS_io_lib.py", line 124, in read_bperp_file
bperp_dict[l.split()[1]] = l.split()[2]
IndexError: list index out of range

I've run the ascending track in the same area and it's working correctly.

Thanks

Alejandro

Gacos download and apply

Dear I run the script but in the step when download GACOS data.
Download GACOS data
No GACOS data available from 20190101 to 20200601

I'm not sure if there is no GACOS data.
How can I check?
Thank you very much.

AttributeError: module 'os' has no attribute 'sched_getaffinity'

Hi!

I tried to make a quick test if the software works. After downloading the data (running ./batch_LiCSBAS.sh) I get this Error:

Traceback (most recent call last):
File "/Users/bvicic/Documents/Seismology/Work/LiCSBAS/bin/LiCSBAS02_ml_prep.py", line 444, in
sys.exit(main())
File "/Users/bvicic/Documents/Seismology/Work/LiCSBAS/bin/LiCSBAS02_ml_prep.py", line 119, in main
n_para = len(os.sched_getaffinity(0))
AttributeError: module 'os' has no attribute 'sched_getaffinity'

From what I understand, this is a OS related issue (https://stackoverflow.com/questions/42538153/python-3-6-0-os-module-does-not-have-sched-getaffinity-method)

Is there a work around to run this on macOS/Windows?

Thanks!

Update with new interferograms

Dear

I have seen in the page of LICSAR portal that in my interest zone the last interferograms are not updated or there are cut interferograms and it does not cover the zone that I am interested in doing the temporal series. Is there any way to process the interferograms and copy them to the GEOC folders for processing?

Thank you very much.

Greetings

PE

python package ?

Hi, why not create python wheel and conda package ? I think it will be easier to use, install and manage. People who use it won't need to bother about installing dependencies and setting up environment variable.

LiCSBAS03op_GACOS.py : Is there a small problem with atmospheric difference

When using GACOS atmospheric products to perform unwrapping phase correction, the atmospheric phase difference in your script is to subtract the atmospheric phase of the master image from the atmospheric phase of the slave image. Is this the opposite of the interference phase of the GAMMA software?

How to keep more data?

Hi
I have processed a dataset with n_ifg_noloop thre=10 all the pixels have been masked, then I have changed the n_ifg_noloop there to 50 but the algorithm just kept 36% of data.
Is there any possibility to keep more data? even I changed the threshold to 70 but the result didn't change?
Best regards

calculation crashed?

Dear Prof. Morishita,

I ran the tutorial case study successfully. Then I just applied your program to the area which I am interested in. Then, it seems that Steps1(get_geotiff.py)~15(mask_ts.ps) were all successfully finished, however, when it comes to "LiCSBAS16_filt_ts.py -t TS_GEOCmllclip",
"
HP filter in time, LP filter in space
with 8 parallel processing....
0/23th image....
10/23th image....
20/23th image....
"
The program stayed in this state for 10 hours and still didn't make progress. I re-ran the program again, however, the program was still stocked in this part.
I don't know if it's because my laptop's performance is poor or because the selected area is too large.

Thanks for your assistance in the issue.
Respectfully submitted.

A question about Loop Closure

in the paper "LiCSBAS: An Open-Source InSAR Time Series Analysis Package Integrated with the LiCSAR Automated Sentinel-1 InSAR Processor" , it is said loop phase Φ123 should be close to zero if unwrapping is correct , and will usually be close to an integer multiple of 2π if one (or more) of the interferograms contains unwrapping errors.

Φ123 = φ12 + φ23 − φ13.

but in the LiCSBAS12_loop_closure.py,the cloop phase minus the n bias (2pi*n) as the final cloop phas

loop_ph = unw12+unw23-unw13
loop_2pin = int(np.round(np.nanmedian(loop_ph)/(2*np.pi)))*2*np.pi
loop_ph = loop_ph-loop_2pin #unbias 2pi x n

I can't understand why added this step, Is there any relevant paper for reference?

parameter's setting

Dear all
I'm a little bit new to python and I'm interested in SAR time series analysis. I have faced this issue, can you give me an idea to fix this problem?
I don't know where can I change the parameters in the batch (which parameters and which lines)file to get the correct result.
problem

[feedback] Pandas.core.datetools deprecated

/usr/lib/python3/dist-packages/statsmodels/compat/pandas.py:56: FutureWarning: The pandas.core.datetools module is deprecated and will be removed in a future version. Please use the pandas.tseries module instead.
from pandas.core import datetools

Xubuntu 19.10 / statsmodel 0.8.0

Gdal error

Dear Prof.,
202011202042batch_LiCSBAS_01_16.log

I am trying to install gdal, I took an error as "failed with initial frozen solve. Retrying with flexible solve". I created new environment and installed gdal. But when I run the batch_LiCSBAS.sh file, I took error as "No module named gdal".
Then I tried the second example using LiCSBAS.yml and run batch_LİCSBAS.sh file. I took an error again. Log file is attached.

Best

Question about

Hi ,

I have seen in the paper that you produced annual amplitude and phase for InSAR displacement. I was wondering if you consider harmonic parameter in SBAS inversion? I wanted to reproduce it but I couldn't find these parameter in LiCSBAS13_sb_inv.py . Would you please inform me if there is possibility to reproduce similar result using LiCSBAS?

Regarding atmospheric correction,Do you have plan to use another product like ERA5 instead of GACOS? It take very long time to request and download GACOS product.What's the main advantage of GACOS in comparison of other atmospheric model?

Best,
M

Question about the filtered result

Dear Morishita

Thanks for sharing LiCSBAS, I think it is remarkable. I met two issues when I use it, hope can get some help.

The first question is about the filtered result. I can find an obvious gap between the filtered velocity result and unfiltered velocity result, and comparing the cumulative displacements at each acquisition epoch in filter and no filter situation respectively, the difference is quite large. But in the example showed in your paper (Morishita et al., 2020), the difference is not that big. Do you have any clue about why this happened?

The second question is about the velocity map I got. Theoretically, most of the deformation should concentrate at the upper part of the map I showed, but the velocity result shows the deformation also occured at the lower part of the map. Is it because that there is not stable reference area on the unwrapped images? Is there any way we can do to force the far field deformation to zero?

Thanks very much!

Filtered_velocity

Velocity_map

202011302322batch_LiCSBAS_02_16.log

A permission denied error when running batch_LiCSBAS.sh

Thanks for updating the project! I got a "/usr/bin/env: ‘python3’: Permission denied" error when run the batch_LiCSBAS using git Bash. Could you please help me?
I've edited the bath_LiCSBAS.sh following the tutorial, and copied it to my working directory.
ps: I'm a Windows user and I prepared the environment using Anaconda3. Here is my code:

`Linya@LAPTOP-35FJC4VM MINGW64 /e/Landslides_work/licsbas_test/LiCSBAS/124D_04854_171313 (master)
$ ./batch_LiCSBAS_sample_CF.sh

Start step: 01
End step: 16
Log file: log/202007211701batch_LiCSBAS_sample_CF_01_16.log

/usr/bin/env: ‘python3’: Permission denied
(licsbas)
`

Does LiCSBAS run on Mac OS?

I might install LiCSBAS on Mac because LiCSBAS_check_install.py showed O.K.to all checking list.
When I run, It might works halfway but after that, it showed like this


LiCSBAS02_ml_prep.py ver1.7.1 20201028 Y. Morishita
LiCSBAS02_ml_prep.py -i GEOC -n 1

Create E.geo
E.geo created

Create N.geo
N.geo created

Create U.geo
U.geo created

Create slc.mli
No *.geo.mli.tif found in GEOC

Create hgt
hgt[.png] created

Create unw and cc
4 parallel processing...
multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
File "/opt/anaconda3/lib/python3.8/multiprocessing/pool.py", line 125, in worker
result = (True, func(*args, **kwds))
File "/opt/anaconda3/lib/python3.8/multiprocessing/pool.py", line 48, in mapstar
return list(map(*args))
File "/Users/inakura_imac/LiCSBAS/bin/LiCSBAS02_ml_prep.py", line 389, in convert_wrapper
ifgd = ifgdates2[i]
NameError: name 'ifgdates2' is not defined
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/Users/inakura_imac/LiCSBAS/bin/LiCSBAS02_ml_prep.py", line 449, in
sys.exit(main())
File "/Users/inakura_imac/LiCSBAS/bin/LiCSBAS02_ml_prep.py", line 284, in main
rc = p.map(convert_wrapper, range(n_ifg2))
File "/opt/anaconda3/lib/python3.8/multiprocessing/pool.py", line 364, in map
return self._map_async(func, iterable, mapstar, chunksize).get()
File "/opt/anaconda3/lib/python3.8/multiprocessing/pool.py", line 771, in get
raise self._value
NameError: name 'ifgdates2' is not defined

LiCSBAS error

Hi Dr. Dear Prof Yu, I kindly have a problem that arose:
(base) iMac-di-Sarelf: 124D_04854_171313 sarelf $ ./batch_LiCSBAS.sh

Start step: 01
End step: 16
Log file: log / 202005011608batch_LiCSBAS_01_16.log

./batch_LiCSBAS.sh: line 120: LiCSBAS01_get_geotiff.py: command not found
(base) iMac-di-Sarelf: 124D_04854_171313 sarelf $

I kindly ask you for your help. Thank you for your time and kindness. '

LiCSBAS_decomposeLOS.py

Hello again !
Would you tell me how to input LiCSBAS_decomposeLOS.py command line concretely?
(Would you show me some example like Tutorial).
Are Efile1 and Nfile1 xxxx_xxxxx_xxxxxx.geo.E.tif and xxxx_xxxxx_xxxxxx.geo.N.tif in CEOC folder
or E.geo and N.geo in CEOCml1 folder ?
Is dispfile1 made from TS_GEOCml1clip/results/vel.mskd by LiCSBAS_flt2geotiff.py ?
Sorry for very basic question.

step1-6:hope to add new function

When we want to remove the trend term, we can select the far-field area where there is no deformation to fit the trend term, instead of fitting the trend term to the entire preliminary result, so that the deformation signal is lost. Hope you can consider this request.

A question about the value of coefficient from radian to meter

As far as I am konw, the equation between the deformation δr along LOS with interferogram phese δφ is expressed as

δr = - (λ · δφ) / (4π)

So, the coefficient from radian to meter should be the - λ / (4π) from radian to meter and - 1000λ / (4π) from radian to millimeter. But in LiCSBAS coef_r2m is expressed as :

coef_r2m = -wavelength/4/np.pi*1000  # rad -> mm, positive is -LOS

I'm not sure if it was a mistake or if there were other reasons

Error in Step02

Hi,
I met a problem in the Step02:
ERROR 1:
/004D_04916_131313/GEOC/20161217_20170209/20161217_20170209.geo.unw.tif:Failed to allocate memory for to read TIFF directory (0 elements of 12 bytes each)
ERROR 1: TIFFReadDirectory:Failed to read directory at offset 28408512
20161217_20170209.geo.unw.tif cannot open. Skip
No 20170209_20170428.geo.unw.tif found. Skip
No 20170311_20170428.geo.unw.tif found. Skip
No 20170428_20170709.geo.unw.tif found. Skip
No 20180926_20181020.geo.unw.tif found. Skip
No 20181020_20181101.geo.unw.tif found. Skip
No 20181020_20181113.geo.unw.tif found. Skip
No 20181020_20181125.geo.unw.tif found. Skip
No 20181020_20181207.geo.unw.tif found. Skip
No 20190406_20190605.geo.unw.tif found. Skip
10/ 21th IFG...
No 20190418_20190617.geo.unw.tif found. Skip
No 20190430_20190629.geo.unw.tif found. Skip
No 20191214_20200131.geo.unw.tif found. Skip
No 20191226_20200131.geo.unw.tif found. Skip
No 20200107_20200131.geo.unw.tif found. Skip
No 20200119_20200131.geo.unw.tif found. Skip
No 20200131_20200212.geo.unw.tif found. Skip
No 20200131_20200224.geo.unw.tif found. Skip
No 20200131_20200307.geo.cc.tif found. Skip
No 20200131_20200319.geo.unw.tif found. Skip
20/ 21th IFG...
No 20200212_20200412.geo.unw.tif found. Skip

Copy baselines file
ERROR: bperp for 20150310 not found!
baselines file found, but not complete. Make dummy

This is the first time for me to meet this kind of error in the step02, in which runs very well and never happens before. I don't know it is because of lack of data, or something else?

Keep getting [Errno 2] No such file or directory while running batch script

Hi

I keep getting error while working with batch script. The error is happening while recreating slc.mli.png on LiCSBAS05op_clip_unw.py.
Full error message is :

Recreate slc.mli.png
Traceback (most recent call last):
File "/home/farhanmakarim/LiCSBAS/bin/LiCSBAS05op_clip_unw.py", line 286, in
sys.exit(main())
File "/home/farhanmakarim/LiCSBAS/bin/LiCSBAS05op_clip_unw.py", line 222, in main
mli = io_lib.read_img(os.path.join(out_dir, 'slc.mli'), length_c, width_c)
File "/home/farhanmakarim/LiCSBAS/LiCSBAS_lib/LiCSBAS_io_lib.py", line 134, in read_img
data = np.fromfile(file, dtype=dtype).reshape((length, width))
FileNotFoundError: [Errno 2] No such file or directory: '/home/farhanmakarim/127A_09749_121312/GEOCml1clip/slc.mli'

I'm currently using Fedora 31, and i dont have such problem in Ubuntu 19.10. Is it probably the cause?
I've attached full log below
Thanks! Love your works!

202002280238batch_LiCSBAS_01_16.log

Wrong result in LiCSBAS_plot_ts.py and LiCSBAS_flt2geotiff.py

Hi!
So I just updated to LiCSBAS v1.3.19 and try to process some scene
And I got wrong result when trying to plot with LiCSBAS_plot_ts.py as I just got 3 pixels on it:
image
The result of exporting vel.filt by LiCSBAS_flt2geotiff.py is same:
image
Even though all of the result png doesn't seem wrong:
vel filt
coh_avg

But, when I open past processed scene it shows normal result:
image

So I think the problem is in the processing algorithm?

LiCSBAS16_filt_ts.py crashes

Hi
I use the following comment:
LiCSBAS16_filt_ts.py -t TS_GEOCml1mask/ -s 4 -y 0.1 -r 1

and it crashes. Here the message:
Create png for increment with 40 parallel processing...

Find stable reference point...
Selected ref: 2847:2848/1756:1757

Calculate velocity of filtered time series...
First, solving 2929268/3958793th points with full cum...
Segmentation fault (core dumped)

I tried different values. But it crashed in all of them.

P.S: my frame ıd is 036D_04976_131313
Thanks a lot

Visualization as a KML/KMZ file

Dear Morishita,

I did the processing by the LiCSBAS and would like to see and interpret the results in google earth but I didn't find any code to convert. Could you please let me know there is any program in your package to convert to the KML/KMZ format?

Sincerely,
Sayyed

Error in "LiCSBAS_profile.py"

Dear Morishita,

Thank you so much for your awesome package. I did my processing and tried to see my results by "LiCSBAS_plot_ts.py -i TS_GEOCml1clip/cum_filt.h5 &" command. It works very well.

Then, I would like to try to get a profile between two peak points in my study area using the following command:

LiCSBAS_profile.py -i TS_GEOCml1clip/cum_filt.h5 -p TS_GEOCml1clip/info/EQA.dem_par -g 53.99,32.26/54.20,31.97

But I get the following error:

LiCSBAS_profile.py ver1.0 20190916 Y. Morishita
LiCSBAS_profile.py -i TS_GEOCml1clip/cum_filt.h5 -p TS_GEOCml1clip/info/EQA.dem_par -g 53.99,32.26/54.20,31.97
Traceback (most recent call last):
File "/application/pi/LiCSBAS/bin/LiCSBAS_profile.py", line 237, in
sys.exit(main())
File "/application/pi/LiCSBAS/bin/LiCSBAS_profile.py", line 136, in main
data = io_lib.read_img(infile, length, width, endian=endian)
File "/application/pi/LiCSBAS/LiCSBAS_lib/LiCSBAS_io_lib.py", line 146, in read_img
data = np.fromfile(file, dtype=dtype).reshape((length, width))
ValueError: cannot reshape array of size 55725585 into shape (1002,1002)

Could you please guide me to fix it? I think I have a mistake in using the "LiCSBAS_profile.py" code.

Sincerely,
Sayyed

A 'range format error', when running a 'quick start shell script'

Hi, sorry to disturb. I got a range format error while running the shell script. I edit the batch_LiCSBAS.sh following the wiki:

---Line32--- do05op_clip="y" # y/n ---Line36--- p05_clip_range_geo="14.03/14.22/40.78/40.90" # e.g. 130.11/131.12/34.34/34.6 (in deg) ---Line58-59--- p01_start_date="20160909" # default: 20141001 p01_end_date="20180508" # default: today ------

image

Should I change the line36 into "14.03:14.22/40.78:40.90" ?

Error with a GACOS file

From gpsovsicori:

Hi, fantastic scripts, I save so much time thank to you! Scripts work amazingly! Recently, I get an error with the last month GACOS files, is there any change in the format, I need to take into account?

@t OVSICORI we appreciate you and COMET work, it gives us a complementary angle to asses volcano deformation.

Here the error:
ERROR 4: `/respaldo/InSAR/LiCSAR/157D_07909_131307_rincon/GEOCml1GACOS/sltd/20200529.bil' not recognized as a supported file format.
Traceback (most recent call last):
File "/respaldo/InSAR/LiCSAR/LiCSBAS-master/bin/LiCSBAS03op_GACOS.py", line 456, in
sys.exit(main())
File "/respaldo/InSAR/LiCSAR/LiCSBAS-master/bin/LiCSBAS03op_GACOS.py", line 297, in main
ztd_geo = gdal.Warp("", bilfile, format='MEM', outputBounds=(lonw_geo, lats_geo, lone_geo, latn_geo), width=width_geo, height=length_geo, resampleAlg=resampleAlg, srcNodata=0).ReadAsArray()
File "/home/ovsicori/anaconda3/lib/python3.7/site-packages/osgeo/gdal.py", line 579, in Warp
return wrapper_GDALWarpDestName(destNameOrDestDS, srcDSTab, opts, callback, callback_data)
File "/home/ovsicori/anaconda3/lib/python3.7/site-packages/osgeo/gdal.py", line 3189, in wrapper_GDALWarpDestName
return _gdal.wrapper_GDALWarpDestName(*args)
SystemError: returned NULL without setting an error

Step LiCSBAS13 problem

Dear Prof Yu,

I was installing the LiCSBAS on Ubuntu 16.04 by using Anaconda3. I have tried to follow the steps, but I could not install the gdal module by using: conda install gdal, directly. Then I tried to use that command line after I created the conda virtual environment. In here, I can use the gdal. But I also have to install the other modules including astropy, beautifulsoup4, matplotlib, h5py, numpy, requests, and statsmodels because I cannot use the modules directly from /home.
My steps is as follows:

  1. Install the Anaconda in /home. Python version detected is Python 3.8.2
  2. install the Anaconda environment by using: conda create --name myenv. Then I activate it.
  3. In the Anaconda environment, I also install the modules required for LiCSBAS process
  4. cd <your_LiCSBAS_path>
    git clone https://github.com/yumorishita/LiCSBAS.git
  5. Make the directory which is used for the LiCSBAS processing
  6. source <your_LiCSBAS_path>/LiCSBAS/bashrc_LiCSBAS.sh
  7. setting the batch file and then run it by using: ./batch_LiCSBAS.sh

Then, I found the problem in the following text:
LiCSBAS13_sb_inv.py ver1.2 20200225 Y. Morishita
LiCSBAS13_sb_inv.py -d GEOCml1clip
In geographical coordinates

Size of image (w,l) : 202, 242

of all images : 3

of images to be used : 3

of all ifgs : 3

of ifgs to be used : 3

of removed ifgs : 0

Threshold of used unw : 3

Reference area (X/Y) : 194:195/193:194
Allowed memory size : 4000 MB
Number of patches : 1
Inversion algorism : LS
Gamma value : 0.0001

Process 242/242th line (1/1th patch)...
Reading 3 ifg's unw data...
48884/48884 points removed due to not enough ifg data...

Identifing gaps and counting n_gap...
Counting n_ifg_noloop...

Small Baseline inversion by LS...

Next, solve 0 points including nan point-by-point...

Elapsed time for 1th patch: 00h 00m 00s

Find stable reference point...
/home/bondan/anaconda3/envs/myenv/lib/python3.8/site-packages/numpy/lib/nanfunctions.py:1115: RuntimeWarning: All-NaN slice encountered
r, k = function_base._ureduce(a, func=_nanmedian, axis=axis, out=out,
/home/bondan/LiCSBAS/LiCSBAS/bin/LiCSBAS13_sb_inv.py:628: RuntimeWarning: All-NaN slice encountered
min_n_gap = np.nanmin(n_gap)
/home/bondan/LiCSBAS/LiCSBAS/bin/LiCSBAS13_sb_inv.py:634: RuntimeWarning: All-NaN slice encountered
min_rms = np.nanmin(rms_cum_wrt_med)
Traceback (most recent call last):
File "/home/bondan/LiCSBAS/LiCSBAS/bin/LiCSBAS13_sb_inv.py", line 753, in
sys.exit(main())
File "/home/bondan/LiCSBAS/LiCSBAS/bin/LiCSBAS13_sb_inv.py", line 636, in main
refy1s, refx1s = refy1s[0], refx1s[0] ## Only first index
IndexError: index 0 is out of bounds for axis 0 with size 0

error when using v1.3.20 LiCSBAS01

Hi,
I met a problem when using LiCSBAS01 in the new version of v1.3.20 code. I don't know the reasons:
Checking existing unw and cc (16 parallel, may take time)...
multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
File "/anaconda3/envs/licsbas/lib/python3.7/multiprocessing/pool.py", line 121, in worker
result = (True, func(*args, **kwds))
File "anaconda3/envs/licsbas/lib/python3.7/multiprocessing/pool.py", line 44, in mapstar
return list(map(*args))
File "/Program/LiCSBAS/bin/LiCSBAS01_get_geotiff.py", line 439, in check_exist_wrapper
rc = tools_lib.comp_size_time(url_data, path_data)
File "/Program/LiCSBAS/LiCSBAS_lib/LiCSBAS_tools_lib.py", line 69, in comp_size_time
size_remote = int(response.headers.get("Content-Length"))
TypeError: int() argument must be a string, a bytes-like object or a number, not 'NoneType'
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/LiCSBAS/bin/LiCSBAS01_get_geotiff.py", line 483, in
sys.exit(main())
File "/LiCSBAS/bin/LiCSBAS01_get_geotiff.py", line 336, in main
rc = p.map(check_exist_wrapper, args)
File "/anaconda3/envs/licsbas/lib/python3.7/multiprocessing/pool.py", line 268, in map
return self._map_async(func, iterable, mapstar, chunksize).get()
File "/anaconda3/envs/licsbas/lib/python3.7/multiprocessing/pool.py", line 657, in get
raise self._value
TypeError: int() argument must be a string, a bytes-like object or a number, not 'NoneType'

LiCSBAS_cum2vel.py error

I met a problem when run LiCSBAS_cum2vel.py. Could you help me with that?

LiCSBAS_cum2vel.py ver1.3 20200703 Y. Morishita
LiCSBAS_cum2vel.py
Traceback (most recent call last):
File "/Users/local/Program/LiCSBAS/bin/LiCSBAS_cum2vel.py", line 285, in
sys.exit(main())
File "/Users/local/Program/LiCSBAS/bin/LiCSBAS_cum2vel.py", line 154, in main
refx1, refx2, refy1, refy2 = [int(s) for s in re.split('[:/]', refarea)]
File "/Users/local/licsbas/lib/python3.7/re.py", line 213, in split
return _compile(pattern, flags).split(string, maxsplit)
TypeError: cannot use a string pattern on a bytes-like object

Thank you for consideration.

step01_get_geotiff doesn't skip download when file exist

I've been wondering why it is slow when skip download in step01. And then, i realize that it's not skipping download for geo.mli.tiff, geo.unw.tiff and geo.cc.tiff . I changed some code and found out that download_data in elif statement is the source of problem. So i changed download_data from tool_lib to be this.

def download_data(url, file):
    try:
        with requests.get(url) as res:
            res.raise_for_status()
            with open(file, "wb") as output:
                output.write(res.content)
        return True
    except requests.exceptions.RequestException as error:
        print(
            "    Error while downloading from {}".format(url),
            file=sys.stderr,
            flush=True,
        )
        raise SystemExit(error)

and i changed the elif statement to be this

        if os.path.exists(path_unw):
            print("    {}.geo.unw.tif already exist. Skip".format(ifgd), flush=True)
        else:
            tools_lib.download_data(url_unw, path_unw)

And it works as expected.

HP LP filter error

Dear doctor Morishita ,
I am tring to use LicSBAS to analyze some area , but unfortunately there are few interfeogram images there .
Due to that ,I tried to use other sofeware to generate images and import it without step-1 ,and everything ran sucessfully and export 'vel-result' except setp-16
It shows ''Exception: The kernel can't be normalized, because its sum is close to zero. The sum of the given kernel is < 0.01"
I wonder know if LicSBAS is compatible with images from other software , or any solution I can adopt
Thanl you !!!

Question about the Sentinel-1 InSAR Data coverage

Dear Prof. Morishita,

I am trying to use LiCSBAS to study the subsidence in central and eastern China. However, the corresponding LiCSAR products are not available on the COMET-LiCS web portal (https://comet.nerc.ac.uk/COMET-LiCS-portal/), also as you mentioned in your paper (Remote Sens. 2020, 12, 424) "up-to-date LiCSAR products are available primarily over the Alpine Himalayan Belt, Japan, the East African Rift".

So I would like to ask if there are any other unwrapped interferograms and coherence products like LiCSBAS that we, who are not from remote sensing field, can use directly? if possible, even the products derived based on Sentinal-2 and Sentinal-3?

Thanks for your assistance in the issue.
Respectfully submitted.

Clip error

Hi,
great work, but I meet a problem when I trying to apply on area 005D_04801_131313, in the clip step it says:
Traceback (most recent call last):
File "/home/weiyi/Desktop/LiCSBAS/bin/LiCSBAS05op_clip_unw.py", line 308, in
sys.exit(main())
File "/home/weiyi/Desktop/LiCSBAS/bin/LiCSBAS05op_clip_unw.py", line 235, in main
hgt = io_lib.read_img(os.path.join(out_dir, 'hgt'), length_c, width_c)
File "/home/weiyi/Desktop/LiCSBAS/LiCSBAS_lib/LiCSBAS_io_lib.py", line 146, in read_img
data = np.fromfile(file, dtype=dtype).reshape((length, width))
ValueError: cannot reshape array of size 9844835 into shape (952,1052)
What kind of input clip input data should I input?
I used "72.25/73.30/41.15/42.10" here.

Best reagrads.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.