Giter Club home page Giter Club logo

Comments (12)

richardreeve avatar richardreeve commented on June 16, 2024 1

It could be very simple, but as far as I recall from the talk, DataDeps.jl handles two things you haven't mentioned:

  1. caching the data seamlessly
  2. referencing the material so it doesn't look like it's your data

from ecojulia.org.

mkborregaard avatar mkborregaard commented on June 16, 2024

WorldClim, since that's the name of the source of the data. Do they have some kind of web API you tap into? I tend to prefer the Chelsa climatologies to the kriging-based WorldClim ones - you can download a raster, and then I have a simple raster package (https://github.com/mkborregaard/VerySimpleRasters.jl ) to extract values at coordinates.

from ecojulia.org.

tpoisot avatar tpoisot commented on June 16, 2024

They don't have an API, but it's easy to get the address to download it. I agree that Chelsa would probably be better (after having read a bit on how they reconstructed it). I also like the rasters package! I had something in progress, but it was not as full-featured.

from ecojulia.org.

richardreeve avatar richardreeve commented on June 16, 2024

I'm not sure we need to be hugely opinionated here... the official releases of Chelsa are available from DataDryad as far I'm aware, so could be accessed via DataDeps.jl, generating the script to download it using DataDepsGenerators.jl - as far as I understand those packages - and I'm sure a similar thing could be done for WorldClim. Then we could have a really useful package that could automate the process of accessing this kind of data (maybe using VerySimpleRasters.jl) called something like ClimateData.jl perhaps? I haven't used DataDeps.jl myself, but I saw the talk at JuliaCon last year and it looked very cool...

PS I'm not saying all of this needs to be done now for @tpoisot's immediate release, but if we thought this kind of thing was useful, it could have a more generic name, and the functionality could be slowly extended...

from ecojulia.org.

mkborregaard avatar mkborregaard commented on June 16, 2024

Sure - but I'm just trying to understand why that's smarter than just having a package that downloads (and possibly loads) the rasters? That could be very simple.

from ecojulia.org.

tpoisot avatar tpoisot commented on June 16, 2024

I like the idea of a function to just download the tiles, in a package called BioClimaticData.jl -- we could have methods like data[x], and data[x, n], which would give an array of values, or the nth variable, and x can be all sort of things (a GBIFRecord, an EcoBase object, an AbstractPosition, ...)

@mkborregaard do you think VerySimpleRasters.jl is already in a state where we can do this? This would be an important stepping stone towards very fun stuff.

from ecojulia.org.

mkborregaard avatar mkborregaard commented on June 16, 2024

It needs an inbuilt driver for GeoTIFF, and I don't want to depend on GDAL. That shouldn't be tough to write though. Do you know where the binary specification of the format is defined? Otherwise GDAL is MIT so I could port theirs.

How would your interface work with x - as a trait? I feel like we might think more about inheritance, eg. linking ecobase objects and gbifrecords, possibly to AbstractPosition. I feel like depending on the GeoInterface and having methods for AbstractPosition and Vector{<:AbstractPosition} and then extend GeoInterface.coordinates so you would do data[coordinates(x)] would be a cleaner design?

from ecojulia.org.

mkborregaard avatar mkborregaard commented on June 16, 2024

Ah - so GDAL simply wraps the binary geotif format, which is a binary dependency in it's own right. That would of course be nice to avoid but the format is not simple to implement: https://www.geospatialworld.net/article/geotiff-a-standard-image-file-format-for-gis-applications/ In fact the geotiff C library is fairly big. So the answer is, no, VerySimpleRasters is currently not up to this task (it's big limitation is it only supports like 2 raster formats), and for now you might be better off with using GDAL directly, like you did in the bioclim example.
BTW at the IBS there was a japanese research group telling me that they had initiated work on a comprehensive sdm package for julia.

from ecojulia.org.

mkborregaard avatar mkborregaard commented on June 16, 2024

chelsa doesn't have tiles :-/

from ecojulia.org.

mkborregaard avatar mkborregaard commented on June 16, 2024

We could ask @dirkkarger what the preferred way is to provide programmatic access to Chelsa data?

from ecojulia.org.

mkborregaard avatar mkborregaard commented on June 16, 2024

GeoTIFF uses a data compression we cannot memory map from Julia. So @tpoisot the best approach is probably to use your geotiff parser and accept the GDAL dep?

from ecojulia.org.

pdimens avatar pdimens commented on June 16, 2024

Since this repo is for the EcoJulia site, this thread can be closed.

from ecojulia.org.

Related Issues (7)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.