Giter Club home page Giter Club logo

hisdac-es's Introduction

Historical Settlement Data Compilation for Spain (HISDAC-ES) from 1900 to 2020

The Historical Settlement Data Compilation for Spain (HISDAC-ES) contains a range of gridded surfaces in GeoTIFF format, describing physical, temporal, landuse, and multitemporal characteristics of the built environment in Spain from 1900 to 2020. HISDAC-ES has been created based on publicly available cadastral data (i.e., building footprint data + thematic attributes). The spatial resolution of the raster data is 100m, the temporal resolution of raster time series is 5 years. The dataset is available at http://doi.org/10.6084/m9.figshare.22009643. The Python code in HISDAC-ES_data_production.py allows for recreating the dataset, and provides a numpy/scipy/gdal/geopandas based strategy for efficient, large-scale geospatial data gridding (raster aggregation).

The 240+ gridded datasets in HISDAC-ES include the DEVA layer series, highlighting historical extents of developed areas:

More visualizations are available at https://doi.org/10.6084/m9.figshare.22064798.

Dataset:

Uhl, Johannes H.; Royé, Dominic; Burghardt, Keith; Aldrey Vázquez, José Antonio; Borobio Sanchiz, Manuel; Leyk, Stefan (2023): HISDAC-ES: Historical Settlement Data Compilation for Spain (1900-2020). figshare. Dataset. https://doi.org/10.6084/m9.figshare.22009643

Visualizations:

Uhl, Johannes H.; Royé, Dominic; Burghardt, Keith; Aldrey Vázquez, José Antonio; Borobio Sanchiz, Manuel; Leyk, Stefan (2023): Visualizing long-term urbanization and land development in Spain (1900-2020). figshare. Media. https://doi.org/10.6084/m9.figshare.22064798

Code usage notes:

UPDATE 08-2023: Two new scripts published, reflecting corrections and additions to the data, accelerating the rasterization process significantly.

  1. Script HISDAC-ES_data_production.py : We fixed two bugs that caused an incorrect rasterization of the multitemporal BUFA layers and of the PHYS layers (BUFA, BIA, DWEL, BUNITS sum and mean).
  2. Script: HISDAC-ES_data_aggregation_municipalities.py :
    • Creates a harmonized building centroid vector dataset (output of block "spatial_join", which is provided in the figshare repository)
    • performs a spatial join with municipality polygons
    • Calculates building and completeness statistics per municipality
    • Outputs them as CSV and GPKG format
  3. Script: HISDAC-ES_residential_layers_fast.py : Contains a revised, very fast method for rasterization, exemplified for the new residential building footprint and building indoor area layers (RESBIA, RESBUFA). While in HISDAC-ES_data_production.py, we loop through the buildings per municipality and add the raster cells per municipality to a "master" grid, in this new version, we use the country-level building centroid GeoPackage to perform the rasterization much faster, but also much more memory-intensive.

hisdac-es's People

Contributors

johannesuhl avatar

Stargazers

 avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

Forkers

jimjoker

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.