Giter Club home page Giter Club logo

sen2agri / sen2agri-system Goto Github PK

View Code? Open in Web Editor NEW
113.0 25.0 40.0 244.61 MB

Sentinel-2 for Agriculture (Sen2Agri) is a software system processing high resolution satellite images for agricultural purposes funded by ESA (European Space Agency). Please register on the Sen2Agri webpage for Sen2Agri system updates and information.

Home Page: http://www.esa-sen2agri.org

License: Other

CMake 0.08% C++ 2.75% Shell 1.29% Python 1.05% QMake 0.02% PLpgSQL 0.48% HTML 78.81% XSLT 0.01% PHP 0.23% JavaScript 15.13% Makefile 0.01% CSS 0.13% Emacs Lisp 0.01% Batchfile 0.01% Scheme 0.01% GLSL 0.01% C 0.01% Dockerfile 0.01% R 0.02%
otb esa gdal agricultural

sen2agri-system's Introduction

logo

Sen4CAP - Sentinels for Common Agriculture Policy

The Sentinels for Common Agricultural Policy - Sen4CAP project aims at providing to the European and national stakeholders of the CAP validated algorithms, products, workflows and best practices for agriculture monitoring relevant for the management of the CAP. The project will pay particular attention to provide evidence how Sentinel derived information can support the modernization and simplification of the CAP in the post 2020 timeframe.

See http://esa-sen4cap.org/ for more details.

License

Please see the LICENCE.txt file and the licence directory for legal issues on the use of the software.

sen2agri-system's People

Contributors

adita76 avatar blucian avatar cosminudroiu avatar florian-popescu-at-csro avatar kraftek avatar lnicola avatar ramonamanda avatar savmickael avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

sen2agri-system's Issues

offline_l1_handler fails due to unsupported type of fake_season_start and fake_season_end

fake_seson_start and fake_season_end are here defined as "MMDD" datestring. Hoewever, this leads to the following error:

./offline_l1_handler.py -d /home/sen2agri/testproducts/ -s waldviertelTraceback (most recent call last):
  File "./offline_l1_handler.py", line 67, in <module>
    sentinel_aoi_contexts_aoi_database = sentinel_db_info.getSentinelAOI(-1, fake_season_start, fake_season_end)
  File "/usr/lib/python2.7/site-packages/sen2agri_common_db.py", line 1139, in getSentinelAOI
    return self.getAOINew(SENTINEL2_SATELLITE_ID, site_id, start_date, end_date)
  File "/usr/lib/python2.7/site-packages/sen2agri_common_db.py", line 896, in getAOINew
    currentSeasonInfo.setStartSeasonDate(start_date)
  File "/usr/lib/python2.7/site-packages/sen2agri_common_db.py", line 521, in setStartSeasonDate
    self.startSeasonDate = startSeasonDate + relativedelta(months=-self.startOfSeasonOffset)
  File "/usr/lib/python2.7/site-packages/dateutil/relativedelta.py", line 247, in __radd__
    raise TypeError, "unsupported type for add operation"
TypeError: unsupported type for add operation

When I change the type to datetime.date (and further adapt the if statement getAOINew, it works.

Output product tree does not match content of user manual

On the S2Agri VM, production tree does not match what is described into the user manual (paragraph 4.2.6 into http://www.esa-sen2agri.org/wp-content/uploads/resources/technical-documents/Sen2-Agri-Software-User-Manual-2.4.pdf).

For example on the Madagascar site, we have a production tree like:

madagascar/
├── l3a
├── l3b_lai
├── l3c_reproc
├── l3d_fitted
├── l4a
└── l4b

but the user manual says we should have:

madagascar/
├── l3a
├── l3b
├── l3c
├── l3d
├── l4a
└── l4b

Sen2agri does not download S2 products between 2016-11-30 and 2017-04-30

Hello

I issued a sen2agri job (v 1.8.3) for the period 2017-01-01 to 2017-12-31, for the tiles 35 TLK and 35TLL, excluding the rest of S2 tiles. Most of the S2 and L8 images for 2017 have been downloaded. However, the S2 images in the period 2016-11-30 to 2017-04-30 have been ignored, even though they are available in Copernicus Sentinel Hub.

In the sen2agri forum the user @kraftek suggested to update and re-query the sci-hub server. We both did, and he got 315 and I got 322 products, and in both cases the download started straight away. However, when consulting the table downloaded_history, it shows no S2 images for the period between 2017-01-01 to 2017-12-31. I have repeated the process not excluding tiles, but the outcome have been the same.

There is any way to work around this problem?

Support for MUSCATE L2A product format in the Sen2Agri processors

Hello,
I would like to insert L2A product from THEIA into database of sen2agri, as it's mentioned, that sen2agri processors support MUSCATE L2A product, but when when i used the script "insert_l2a_product_to_database, it give's :Could not get the acquisition date from the product name ../../SENTINEL2B_20191007-113225-433_L2A_T29SNR_C_V2-2/.
Do i need to do some processing on L2A Theia product before inserting into sen2agri database?

Sen2agriPlatformInstallAndConfigCore.sh is buggy

Sen2Agri-System/install_platform/sen2agriPlatformInstallAndConfigCore.sh refers to the version 1.4. Therefore the script cannot install the rpm file for processors which is named with 1.6.
Change the version number fix the issue.

Product extent different from S2 tile extent

I'm working on L3A product S2AGRI_L3A_PRD_S80_20171112T223219_V20170605 on site called "france_30tyn" from sen2agri server.

The extent inside the main metadata file S2AGRI_L3A_MTD_V20170605.xml (XML tag EXT_POS_LIST) is different from the extent of the data file (S2AGRI_L3A_PRD_S80_20171112T223219_V20170605/TILES/S2AGRI_L3A_V20170605_T30TYN/IMG_DATA/S2AGRI_L3A_SRFL_V20170605_T30TYN_10M.TIF).

It seems that the metadata file extent is a bounding box computed in EPSG:3857 from upper right and lower left corners of the S2 tile.

Here are 2 screenshots of the L3A product and the extent from the metadata file:

2018-01-09-081749_658x513_scrot

2018-01-09-081836_645x595_scrot

Composite Proceeding.py error MaskHandler

I am running the composite processing in manual mode for single time series S2 tile.
I am getting the following error.

ERROR: No value associated to the parameter : “xml”, invalid number of values 0
ERROR: Troubles loading parameter, please check your line argument…

Any idea where it went wrong?

Sen2Agri does not process downloaded L1C products into L2A

My instance of Sen2Agri is not processing downloaded L1C Sentinel-2 and Landsat 8 products into L2A products. It downloads the L1C files and fails to process them, so they don't show up on the Products tab and are not available for further processing by the higher level processors.

I attached log files for attempts to process both Landsat 8 and Sentinel-2 L1C images. I didn't paste them here because they were coming out broken

Landsat 8 demmaccs.txt
Sentinel-2 demmaccs.txt

MACCS is installed. This instance is running on CentOS 7. I can provide the shape file if necessary.

Docker image

Hi all,
I 'm a remote sensing guy from RADI, China. Could you provide a dockfile or image that we can try this system directly.

Download service does not pick up products from `local_store`

When configuring sen2agri to use the local_store mode, as described in section Appendix A.7 of the user manual, files that have been put there are not picked up in any way by sen2agri. The products section stays empty (also after restarting the services and waiting).

https://github.com/Sen2Agri/Sen2Agri-System/blob/f4b9e3eba9c6e7934638600c9dbca916f355ece3/FAQ.md#how-can-i-use-products-from-a-local-l1c-store-like-the-ipt-cloud-platform mentions to set an AWSDataSource.Sentinel2.local_archive_path parameter, which also does not have any effect on my installation.

local_store settings

grafik

local_archive folder

grafik

User manual

grafik

I tried to manually execute the L2A processor (I'm looking to create a L3B NDVI product, it seems I need to have a LAI product, which seems to be produced from the L2A processor) as described in section 4.4.1.1Executing L2A processorfrom a terminal window as the required demmaccs.py is not included in my installation.

UPDATE:

I can see
grafik

after updating the scope setting to query

Possible support for aarch64?

AWS now has substantially more affordable r6g instances that run aarch64 instead of AMD. Would be great to be able to have a build for the ARM architecture that we could run in the future. As an experiment we did manage to build Sen2Agri on ARM but we got stuck on the issue of slurm and other dependencies. it would be great to have this come from the official team though.

Unable to read metadata (l3a,l3b)

Hello,
I run L3A composite through command line:
/usr/bin/composite_processing.py --syntdate 20190901 --input "/mnt/archive/maccs_def/morocco/l2a/S2A_MSIL2A_20190813T112121_N0208_R037_T29SMS_20190813T114617.SAFE/S2A_OPER_SSC_L2VALD_29SMS____20190813.HDR " "/mnt/archive/maccs_def/morocco/l2a/S2B_MSIL2A_20190818T112119_N0208_R037_T29SMS_20190818T122949.SAFE/S2B_OPER_SSC_L2VALD_29SMS____20190818.HDR" "/mnt/archive/maccs_def/morocco/l2a/S2A_MSIL2A_20190823T112121_N0208_R037_T29SMS_20190823T114631.SAFE/S2A_OPER_SSC_L2VALD_29SMS____20190823.HDR" "/mnt/archive/maccs_def/morocco/l2a/S2A_MSIL2A_20190902T112111_N0208_R037_T29SMS_20190902T132637.SAFE/S2A_OPER_SSC_L2VALD_29SMS____20190902.HDR" "/mnt/archive/maccs_def/morocco/l2a/S2A_MSIL2A_20190912T112111_N0208_R037_T29SMS_20190912T114646.SAFE/S2A_OPER_SSC_L2VALD_29SMS____20190912.HDR" "/mnt/archive/maccs_def/morocco/l2a/S2B_MSIL2A_20190917T112119_N0208_R037_T29SMS_20190917T132014.SAFE/S2B_OPER_SSC_L2VALD_29SMS____20190917.HDR" "/mnt/archive/maccs_def/morocco/l2a/S2A_MSIL2A_20190922T112111_N0208_R037_T29SMS_20190922T114652.SAFE/S2A_OPER_SSC_L2VALD_29SMS____20190922.HDR" --res 10 --outdir "/mnt/archive/temp/20190901/29SMS/" --bands /usr/share/sen2agri/bands_mapping_s2_L8.txt --scatteringcoe /usr/share/sen2agri/scattering_coeffs_10m.txt --synthalf 25
It gave this error:
The following error occurred during application execution : /home/cudroiu/sen2agri/sen2agri-processors/ProductReaders/MetadataHelpers/src/MetadataHelperFactory.cpp:43:
itk::ERROR: MetadataHelperFactory(0x16a8810): Unable to read metadata from /mnt/archive/maccs_def/morocco/l2a/S2A_MSIL2A_20190813T112121_N0208_R037_T29SMS_20190813T114617.SAFE/S2A_OPER_SSC_L2VALD_29SMS____20190813.HDR
OTB app finished in: 0:00:04.178794
OTB application error

Please how can i overcome this issue

First login? Set a password - Security risk

Having the functionality of setting or changing your user password publicly (via the "First login" prompt) seems to me very risky from a security point of view.
You can easily access instances using the default admin user (provided not removed) giving one the ability to change the password knowing only a username and email.
A quick github search provides the default admin credentials in the source code. Is this designed to be publicly exposed ?

getProductTreeData uses too much memory

Right now, sp_get_dashboard_products returns the site footprint for each product in the result, even if it's the same for all products in a site.

This has caused memory usage issues in the past and requires us to edit php.ini to increase the memory limit. According to one user's report, setting it to 1 GB was not enough, so it's really bad and should be fixed.

The solution is to retrieve the site definitions separately and do the lookup on the client.

For anyone affected, a workaround is to update the site to a simpler footprint.

missing import of log in dem.py

There seems to be a missing import of log from sen2agri_common_db in dem.py of Sen2Agri v2.0.

Doesn't seem to be an issue if everything is ok with the input, but will fail if condition in line number 173 is True.

OTB shared libary version mismatch

The OTB version that is installed by the sen2agri installer doesn't work with the latest available libgeotiff-1.4.0-1.rhel7 rpm package which comes with libgeotiff.so.2.1.0 instead of libgeotiff.so.1.2.

Resulting in multiple otb errors:

[root@hxsc archive]# /usr/local/bin/otbApplicationLauncherCommandLine
/usr/local/bin/otbApplicationLauncherCommandLine: error while loading shared libraries: libgeotiff.so.1.2: cannot open shared object file: No such file or directory

root@hxsc archive]# /usr/local/bin/otbApplicationLauncherCommandLine
/usr/local/bin/otbApplicationLauncherCommandLine: error while loading shared libraries: libgeos-3.4.2.so: cannot open shared object file: No such file or directory

I could mitigate the problem with:

ln -sf /usr/lib64/libgeotiff.so.2.1.0 /usr/lib64/libgeotiff.so.1.2
ln -sf /usr/lib64/libgeos-3.5.0.so /usr/lib64/libgeos-3.4.2.so

But I don't know if this is going to have any side effects.

Errors and missing output log

I downloaded and successfully installed the whole system.
Then I created a new site and the system automatically started for this new created site.

However, while some downloads are in progress, there are many errors showing in the job history.
screenshot-localhost-2017-08-13-20-12-17

Also, there is no useful log when I click on the output.
screenshot-localhost-2017-08-13-20-11-53

Is this a normal behaviour?

SciHubDataSource & USGDataSource fields not present after fresh install

When using the Sen2Agri Distribution Installer and following all steps, the final message of the installer, as well as the user manual mentions to modify the SciHub & USGData credentials inside /usr/share/sen2agri/sen2agri-services/config/services.properties

However, neither are the keys available or anywhere documented, that need to be set. I was able to find the corresponding keys only by watching a youtube video about an installation procedure of sen2agri: https://www.youtube.com/watch?v=W4z6t1pUWnU

The corresponding keys should be pre-populated by the installation

Missing S2 tile in L4A classification

Hi,

I've noticed that in our cropmask, one entire S2 tile seems to be missing in the classification. You can clearly tell, because there's a sharp cut in the classified area of the adjacent tile. There's no pixel classified as crop in this specific tile (I've checked that programmatically, not only visually), even though there's insitu-data present. Is there any way to check why that happens and how I can fix it?

Here's some additional info:

S2 tile-id: 35NRH

Screenshot with classification and S2 tiling grid overlayed (white pixels == crop, yellow dots == crop reference, red == non-crop)

screenshot

Here's the MCMFLG for the tile 35 NRH:

MCMFLG

And just a random mosaic.jpg out of 70:
S2A_MSIL2A_20180314T080711_N0206_R078_T35NRH_20180314T101113 SAFE-mosaic

Thanks!

User `postgresql` does not exist

When installing Sen2Agri from scratch on centos 7 the install script will show many errors:

Executing SQL script: ./database/07-data/04.job_start_type.sql                                                                 │
su: user postgres does not exist

I can connect to psql via psql -U postgres -d sen2agri

Sen2Agri Processors installation must not modify some system files

In the CMakeLists.txt file of sen2agri-processors two system files ( /usr/lib/tmpfiles.d and /etc/security/limits.d) are modified during configuration of the project. It is not well adapted to do that here, it should be done during the installation of the system.
Can you please move it to the right place.

Strata Definition Error

Hi
I am trying to run the CropMask.py and I am getting the following error
Main mission: SENTINEL
Tiles: 1
43QDB 5
Single stratum: False
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/sen2agri_common.py", line 539, in execute
self.load_tiles()
File "/usr/lib/python2.7/site-packages/sen2agri_common.py", line 783, in load_tiles
self.strata = load_strata(self.args.filtered_strata, self.site_footprint_wgs84)
File "/usr/lib/python2.7/site-packages/sen2agri_common.py", line 382, in load_strata
raise Exception("Could not open stratum dataset", areas)
Exception: ('Could not open stratum dataset', '/mnt/data/archive/insitu/sangamner/Sangamner_p.shp')
Processor finished in 0:00:00.055471
Strata I have given here is the site polygon
Projection UTM/WGS84

Could you please help me to rectify this error
Thanks
Vijay

How to run CropMaskFused.py from output of MAJA 3.3.0

Hi!
may I ask you if it's appropriate - what particular path (file or dir) from output of MAJA (3.3.0) should be put into "-input" parameter to run CropMaskFused.py script (run L4a proccessor in manual mode) ?

Can`t visit the forum site

Hello, sorry to ask a qusetion that maybe is unrelated with this project.The forum site(https://forum.esa-sen2agri.org/) is disabled to visit since 2019/12/20.I asked some supporter(like [email protected] and [email protected] ...) by email for this but I didnt get the solution yet.They suggeted me to contact the site managers but I can`t find the contact at the homepage or other sites.If anyone knows how to contact the forum-site managers, tell me please.
Thanks a lot.
image
image

Failed to upload shape file

I tried to install Sen2Agri from source using the scripts in Sen2Agri-System/packaging which worked quit well.

Only problem I encounter was that the script doesn't check permissions on the /mnt/upload resulting in a somewhat confusing "FAILED: Failed to upload the file you selected Missing shape file due to a problem with your selected file" error in the web gui.

After checking the shape file and zip file a dozen of time I finally figured out that all I had to do to fix the problem is doing a "chown -R apache.apache /mnt/upload".

Scihub API returns `Too many requests`

When uploading a shapefile of an area of some square kilometers, with a simple rectangular shape and setting the season to include the current month until next month, I can see in journalctl, that the sentinelhub API returns too many requests. This will happen on every subsequent (scheduled) retry. There is only this single site active, the account is not used with any other tool making any requests. No download is started.

Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.736 INFO  [DefaultQuartzScheduler_Worker-9] o.e.s.scheduling.LookupJob     - Starting job 'Lookup.Lookup-s2-hetzerath'
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.746 INFO  [DefaultQuartzScheduler_Worker-10] o.e.s.scheduling.RetryJob      - Starting job 'Retry.Retry-s2-hetzerath'
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.753 DEBUG [DefaultQuartzScheduler_Worker-9] o.e.s.scheduling.LookupJob     - [site 'hetzerath',sensor 'Sentinel2'] Seasons defined: s1_2021 [2021-03-01,2021-04-01,2021-04-30]
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.762 DEBUG [DefaultQuartzScheduler_Worker-10] o.e.s.scheduling.RetryJob      - [site 'hetzerath',sensor 'Sentinel2'] Retry failed products
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.764 INFO  [DefaultQuartzScheduler_Worker-10] o.e.s.scheduling.RetryJob      - [site 'hetzerath',sensor 'Sentinel2'] No products to retry
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.764 DEBUG [DefaultQuartzScheduler_Worker-10] o.e.s.scheduling.RetryJob      - [site 'hetzerath',sensor 'Sentinel2'] Retry last chance products
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.765 DEBUG [DefaultQuartzScheduler_Worker-9] o.e.s.scheduling.LookupJob     - [site 'hetzerath',sensor 'Sentinel2'] Using start date: 2021-01-01T00:00 and end date: 2021-03-22T02:45:52.765
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.765 DEBUG [DefaultQuartzScheduler_Worker-9] o.e.s.scheduling.LookupJob     - [site 'hetzerath',sensor 'Sentinel2'] Lookup for new products in range 2021-01-01 00:00:00 - 2021-03-22 02:45:52
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.766 INFO  [DefaultQuartzScheduler_Worker-10] o.e.s.scheduling.RetryJob      - [site 'hetzerath',sensor 'Sentinel2'] No products to retry
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.766 INFO  [DefaultQuartzScheduler_Worker-10] o.e.s.scheduling.RetryJob      - Job 'Retry.Retry-s2-hetzerath' completed
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.766 DEBUG [DefaultQuartzScheduler_Worker-10] o.e.s.services.ScheduleManager - Trigger 'Retry.Retry-s2-hetzerath' completed with code 'NOOP'
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.767 TRACE [DefaultQuartzScheduler_Worker-9] o.e.s.scheduling.LookupJob     - Validating S2 tile filter for site hetzerath
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.768 TRACE [DefaultQuartzScheduler_Worker-9] o.e.s.scheduling.LookupJob     - No S2 tiles were discarded. Filter has 2 tiles.
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.769 DEBUG [DefaultQuartzScheduler_Worker-9] o.e.s.scheduling.LookupJob     - [site 'Hetzerath',sensor 'Sentinel2'] Performing query for interval 2021-01-01T00:00 - 2021-03-22T02:45:52.765
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.769 TRACE [DefaultQuartzScheduler_Worker-9] o.esa.sen2agri.commons.Config  - Requested worker for Scientific Data Hub,S2 (active workers: 0, queued tasks: 0)
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.772 TRACE [DefaultQuartzScheduler_Worker-9] o.e.s.scheduling.LookupJob     - Query timeout is set to 90000 s
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.774 DEBUG [Scientific Data Hub-S2-1] o.e.s.s.i.DownloadServiceImpl  - Querying page #1 (query 1 of 2) for {site id=9,satellite=S2}
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.775 DEBUG [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery    - Query {Scientific Data Hub-Sentinel2} has 1 subqueries: 8543375b-6369-44e0-aa0b-e50079f1736c
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.775 DEBUG [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery    - Executing query 8543375b-6369-44e0-aa0b-e50079f1736c: https://scihub.copernicus.eu/dhus/search?rows=50&start=0&q=endPosition%3A%5B2021-01-01T00%3A00%3A00.000Z%20TO%202021-03-22T02%3A45%3A52.000Z%5D%20AND%20filename%3A*31UGR*%20AND%20beginPosition%3A%5B2021-01-01T00%3A00%3A00.000Z%20TO%202021-03-22T02%3A45%3A52.000Z%5D%20AND%20productType%3AS2MSI1C%20AND%20platformName%3ASentinel-2&orderby=beginposition%20asc
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.525 INFO  [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery    - Query 8543375b-6369-44e0-aa0b-e50079f1736c page 1 returned 48 products
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.525 DEBUG [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery    - Executing query 8543375b-6369-44e0-aa0b-e50079f1736c: https://scihub.copernicus.eu/dhus/search?rows=50&start=50&q=endPosition%3A%5B2021-01-01T00%3A00%3A00.000Z%20TO%202021-03-22T02%3A45%3A52.000Z%5D%20AND%20filename%3A*31UGR*%20AND%20beginPosition%3A%5B2021-01-01T00%3A00%3A00.000Z%20TO%202021-03-22T02%3A45%3A52.000Z%5D%20AND%20productType%3AS2MSI1C%20AND%20platformName%3ASentinel-2&orderby=beginposition%20asc
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.591 INFO  [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery    - Query 8543375b-6369-44e0-aa0b-e50079f1736c page 2 returned 0 products
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.592 INFO  [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery    - Query {Scientific Data Hub-Sentinel2} returned 48 products
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.592 TRACE [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery    - Data query completed in 1818 ms.
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.592 DEBUG [Scientific Data Hub-S2-1] o.e.s.s.i.DownloadServiceImpl  - Page #1 (query 1 of 2) for {site id=9,satellite=S2} returned 48 results
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.592 DEBUG [Scientific Data Hub-S2-1] o.e.s.s.i.DownloadServiceImpl  - Querying page #2 (query 1 of 2) for {site id=9,satellite=S2}
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.593 DEBUG [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery    - Query {Scientific Data Hub-Sentinel2} has 1 subqueries: 81a722f7-b802-49f4-99cb-98c0aeeb8b22
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.593 DEBUG [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery    - Executing query 81a722f7-b802-49f4-99cb-98c0aeeb8b22: https://scihub.copernicus.eu/dhus/search?rows=50&start=50&q=endPosition%3A%5B2021-01-01T00%3A00%3A00.000Z%20TO%202021-03-22T02%3A45%3A52.000Z%5D%20AND%20filename%3A*31UGR*%20AND%20beginPosition%3A%5B2021-01-01T00%3A00%3A00.000Z%20TO%202021-03-22T02%3A45%3A52.000Z%5D%20AND%20productType%3AS2MSI1C%20AND%20platformName%3ASentinel-2&orderby=beginposition%20asc
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.695 INFO  [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery    - Query 81a722f7-b802-49f4-99cb-98c0aeeb8b22 page 2 returned 0 products
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.695 INFO  [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery    - Query {Scientific Data Hub-Sentinel2} returned 0 products
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.695 TRACE [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery    - Data query completed in 103 ms.
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.695 DEBUG [Scientific Data Hub-S2-1] o.e.s.s.i.DownloadServiceImpl  - Page #2 (query 1 of 2) for {site id=9,satellite=S2} returned 0 results
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.696 DEBUG [Scientific Data Hub-S2-1] o.e.s.s.i.DownloadServiceImpl  - Querying page #1 (query 2 of 2) for {site id=9,satellite=S2}
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.696 DEBUG [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery    - Query {Scientific Data Hub-Sentinel2} has 1 subqueries: 58d14d65-8a22-4171-b2d3-916c0def6576
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.697 DEBUG [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery    - Executing query 58d14d65-8a22-4171-b2d3-916c0def6576: https://scihub.copernicus.eu/dhus/search?rows=50&start=0&q=endPosition%3A%5B2021-01-01T00%3A00%3A00.000Z%20TO%202021-03-22T02%3A45%3A52.000Z%5D%20AND%20filename%3A*32ULA*%20AND%20beginPosition%3A%5B2021-01-01T00%3A00%3A00.000Z%20TO%202021-03-22T02%3A45%3A52.000Z%5D%20AND%20productType%3AS2MSI1C%20AND%20platformName%3ASentinel-2&orderby=beginposition%20asc
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.728 WARN  [DefaultQuartzScheduler_Worker-9] o.e.s.scheduling.LookupJob     - At least one query failed for site hetzerath (reason: ro.cs.tao.datasource.QueryException: The request
was not successful. Reason: Too Many Requests). It was saved in '/mnt/archive/dwn_def/s2/default/hetzerath/failed_queries' and will be retried later.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.