Giter Club home page Giter Club logo

qcpcp's Introduction

qcpcp (qcp2): quality control of precipitation observations

Space-Time Statistical Quality Control of Extreme Precipitation Observation

Goal:

  1. Transform data using Box-Cox transormation with suitable parameter (example code 1)
  2. Find outlier in precipitation data by cross-validation approach using neighboring observations (example code 2)
  3. Identified outliers (a false observation or a single event) should be verified by discharge or radar data.
  4. Repeat the procedure over several temporal aggregations (to account for advection)

DOI

Reference paper:

El Hachem, A., Seidel, J., Imbery, F., Junghänel, T., and Bárdossy, A.: Technical Note: Space-Time Statistical Quality Control of Extreme Precipitation Observations, Hydrol. Earth Syst. Sci. Discuss. [preprint], https://doi.org/10.5194/hess-2022-177, in review, 2022.

Flowchart - Procedure

flowchart_outliers_2

Example data and codes on Github

Study area

Location_case_study

Box-Cox transformation [Python code 1]

Skewness before and after transformation

Skew_before_after

Average transformation factor

Transf_factor_lambda

Identified outlier [Python code 2]

Time series target and neighbors

stn_P03231_ngbrs_2008_05_14 08_00_00

Event spatial configuration with Radar image

radar_stn_P03231_2008_05_14 08_00_00__after

Data availability:

The precipitation data and the radar data were made available by the German Weather Service (DWD) [https://opendata.dwd.de/climate_environment/CDC/]. The discharge data were made available by the environmental state of Bavaria and can be requested [https://www.lfu.bayern.de/index.htm]

Used packages for Github example code:

  1. PyKrige: Benjamin Murphy, Roman Yurchak, & Sebastian Müller. (2022). GeoStat-Framework/PyKrige: v1.7.0 (v1.7.0). Zenodo. https://doi.org/10.5281/zenodo.7008206
  2. adjusttext: https://adjusttext.readthedocs.io/en/latest/
  3. statsmodels: https://www.statsmodels.org/devel/

Note: this is an exmaple case, in the paper a modified code was used with Variogram estimation and personal kriging code. These are not updated to keep things simple.

qcpcp's People

Stargazers

avatar

Watchers

avatar avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.