Giter Club home page Giter Club logo

gedipy's Introduction

GEDIPy

Python tools for processing of NASA's Global Ecosystem Dynamics Investigation (GEDI) H5 data products.

Drivers for data products from NASA's ICESat-2 and LVIS missions are included for purposes of fusion and cal/val.

This code is not "official" mission code and is not used in the generation of any GEDI products. It's not actively updated, or well documented, but may have snippets or notebooks that are of interest to some.

Install GEDIPy directly from GitHub:

pip install git+https://github.com/armstonj/gedipy

gedipy's People

Contributors

armstonj avatar slumnitz avatar

Stargazers

Yuxuan Xie avatar Wei-Ting Hung avatar  avatar Shukhrat Shokirov avatar Paul Montesano avatar

Watchers

 avatar Hao Tang avatar  avatar Paul Montesano avatar Tiago de Conto avatar

gedipy's Issues

[BUG] naming conflict on pipy

As a note: The name gedipy seems to already be taken on pipy.

This means, in case this project will develop into a package we would need to distribute it under another name, or kindly ask the other team if it would be possible to get the name from them.

Distributing it via pip install gedipy is currently not an option.

[RES] dask, xarray (, numba) for gedipy

Hello @armstonj

as discussed before I took some time investigating the use of dask/ xarray for data processing and integration into gedipy.

You can find insight I gathered about the integration into the current library in this notebook and general information about data processing with h5py, xarray and dask here.

Overall I would say xarray and dask

  • could be useful for new functionality i.e. taking the output of read_shots() or with an addition for reading and writing data.
  • still also have limitations for reshaping arrays i.e. 1D waveform to 2D (or require very specific expert knowledge)
    (As a side note I have not used dask too much before and there might be better way's of going about using it. I found it very interesting to get to know it more and I think it's overall benefit shows on distributed clusters not necessarily on small machines, which I used. More in the notebooks)

Let me know if you would find it interesting to merge my experiments and I'd be happy to set up a PR. There were also a couple general additions in my dask-integration branch I could extract if they are of interest. I hope this helps the library a little.

Question: `def open(self)`

open() is a Python build in function. It is generally not recommended to use Python build in function names, like open as names for custom functions. def open() is currently used as function name in h5io.py. Is this intentional or by mistake? Maybe I can learn something new? :)

[ENH] potential class or shared functions

For documentation purposes: read_pgap_theta_z(), read_tx_waveform() and read_rx_waveform() all have very similar code.
There might be potential to create a separate class or create shareable functionality (i.e. read data, process data, write data).

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.