Comments (12)
It could be very simple, but as far as I recall from the talk, DataDeps.jl
handles two things you haven't mentioned:
- caching the data seamlessly
- referencing the material so it doesn't look like it's your data
from ecojulia.org.
WorldClim
, since that's the name of the source of the data. Do they have some kind of web API you tap into? I tend to prefer the Chelsa climatologies to the kriging-based WorldClim ones - you can download a raster, and then I have a simple raster package (https://github.com/mkborregaard/VerySimpleRasters.jl ) to extract values at coordinates.
from ecojulia.org.
They don't have an API, but it's easy to get the address to download it. I agree that Chelsa would probably be better (after having read a bit on how they reconstructed it). I also like the rasters package! I had something in progress, but it was not as full-featured.
from ecojulia.org.
I'm not sure we need to be hugely opinionated here... the official releases of Chelsa are available from DataDryad as far I'm aware, so could be accessed via DataDeps.jl, generating the script to download it using DataDepsGenerators.jl - as far as I understand those packages - and I'm sure a similar thing could be done for WorldClim. Then we could have a really useful package that could automate the process of accessing this kind of data (maybe using VerySimpleRasters.jl) called something like ClimateData.jl
perhaps? I haven't used DataDeps.jl
myself, but I saw the talk at JuliaCon last year and it looked very cool...
PS I'm not saying all of this needs to be done now for @tpoisot's immediate release, but if we thought this kind of thing was useful, it could have a more generic name, and the functionality could be slowly extended...
from ecojulia.org.
Sure - but I'm just trying to understand why that's smarter than just having a package that downloads (and possibly loads) the rasters? That could be very simple.
from ecojulia.org.
I like the idea of a function to just download the tiles, in a package called BioClimaticData.jl
-- we could have methods like data[x]
, and data[x, n]
, which would give an array of values, or the nth variable, and x
can be all sort of things (a GBIFRecord
, an EcoBase
object, an AbstractPosition
, ...)
@mkborregaard do you think VerySimpleRasters.jl
is already in a state where we can do this? This would be an important stepping stone towards very fun stuff.
from ecojulia.org.
It needs an inbuilt driver for GeoTIFF, and I don't want to depend on GDAL. That shouldn't be tough to write though. Do you know where the binary specification of the format is defined? Otherwise GDAL is MIT so I could port theirs.
How would your interface work with x
- as a trait? I feel like we might think more about inheritance, eg. linking ecobase objects and gbifrecords, possibly to AbstractPosition
. I feel like depending on the GeoInterface and having methods for AbstractPosition
and Vector{<:AbstractPosition}
and then extend GeoInterface.coordinates
so you would do data[coordinates(x)]
would be a cleaner design?
from ecojulia.org.
Ah - so GDAL simply wraps the binary geotif format, which is a binary dependency in it's own right. That would of course be nice to avoid but the format is not simple to implement: https://www.geospatialworld.net/article/geotiff-a-standard-image-file-format-for-gis-applications/ In fact the geotiff C library is fairly big. So the answer is, no, VerySimpleRasters is currently not up to this task (it's big limitation is it only supports like 2 raster formats), and for now you might be better off with using GDAL directly, like you did in the bioclim example.
BTW at the IBS there was a japanese research group telling me that they had initiated work on a comprehensive sdm package for julia.
from ecojulia.org.
chelsa doesn't have tiles :-/
from ecojulia.org.
We could ask @dirkkarger what the preferred way is to provide programmatic access to Chelsa data?
from ecojulia.org.
GeoTIFF uses a data compression we cannot memory map from Julia. So @tpoisot the best approach is probably to use your geotiff parser and accept the GDAL dep?
from ecojulia.org.
Since this repo is for the EcoJulia site, this thread can be closed.
from ecojulia.org.
Related Issues (7)
- Notebooks HOT 1
- Registry? HOT 4
- Juliacon HOT 2
- Add papers using the ecosystem HOT 1
- New publication using EcologicalNetworks HOT 1
- Update? HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ecojulia.org.