Comments (4)
Hi tim,
thanks for the heads-up. Turns out the problem is introduced on the CDS side, since it also appears for the actual request atlite
is sending:
import cdsapi
import xarray as xr
product = 'reanalysis-era5-single-levels'
request = {'product_type': 'reanalysis',
'format': 'netcdf',
'day': ['01', '02', '03', '04', '05', '06', '07', '08', '09', '10',
'11', '12', '13', '14', '15', '16', '17', '18', '19', '20', '21',
'22', '23', '24', '25', ' 26', '27', '28', '29', '30', '31'],
'time': ['00:00', '01:00', '02:00', '03:00', '04:00', '05:00',
'06:00', '07:00', '08:00', '09:00', '10:00', '11:00', '12:00',
'13:00', '14:00', '15:00', '16:00', '17:00', '18:00', '19:00',
'20:00', '21:00', '22:00', '23:00'],
'area': [71.0, -10.5, 34.5, 34.5],
'year': 2016,
'month': 1,
'variable': ['100m_u_component_of_wind',
'100m_v_component_of_wind',
'2m_temperature',
'runoff',
'soil_temperature_level_4',
'surface_net_solar_radiation',
'surface_pressure',
'surface_solar_radiation_downwards',
'toa_incident_solar_radiation',
'total_sky_direct_solar_radiation_at_surface']}
result = cdsapi.Client().retrieve(
product,
request
)
result.download("test.nc")
ds = xr.open_dataset("test.nc")
ds['ro'].to_series().describe()
## Returns
#
# count 1.979561e+07
# mean 1.617490e-05
# std 6.164426e-05
# min -4.656613e-10
# 25% -4.656613e-10
# 50% 3.972091e-07
# 75% 1.391862e-05
# max 1.303101e-02
# Name: ro, dtype: float64
The problem vanishes if I restrict my request to a single day instead of a month. Testing the exact circumstances is difficult, since the queuing time for requests is in the order of 15min.
I'll introduce a clip(min=0.)
as a workaround!
from atlite.
Oh wow, that's nasty! I always tried with one day only and so didn't recognise it was stemming from CDS.
Your workaround sounds good to me. Thanks a lot!
from atlite.
I discussed this issue with CDS support and was told that it cannot be avoided in their current processing. So I'd assume your workaround is the best one can do.
from atlite.
Thanks for the feedback!
from atlite.
Related Issues (20)
- hydro not compatible with normalize_using_yearly option HOT 2
- Add heuristic for ERA5 download chunk sizes HOT 3
- Incorrect unit conversion in hydro inflow shift
- ERA5 Solar Position Time Shift Broken for Certain Time Spans HOT 5
- Cutout AttributeError: "EntryPoints" object has no attribute get in Colab HOT 2
- Question about runoff conversion HOT 3
- Include xarray-spatial
- pad_extent leads to rasterio error for global scape
- Licence description on PyPI incorrect HOT 1
- Error cannot convert float nan to int HOT 10
- Issue with build_cutout using alite HOT 5
- reanalysis-era5-single-levels HOT 3
- Atlite errors with ESRI:540060 reprojections and Fiji HOT 4
- Read from url for `excluder.add_raster` and `excluder.add_geometry` HOT 2
- PV conversion: New model based on Bloomfield et al. (2019)
- Wind Conversion: potential bug when power curve does not end with zero after cutout speed HOT 1
- Weather/climate data variable descriptions (for alternate model data use) HOT 2
- Problems with `convert_and_aggregate` for long timespans? HOT 12
- Data type error when building cutout with SARAH v3 HOT 3
- Merging cutouts / Integrate downloaded SARAH data into existing ERA-5 cutout HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from atlite.