Giter Club home page Giter Club logo

demgen's People

Contributors

crusheerpl avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar

demgen's Issues

Refactor: possibility to add other countries in the future

Consider refactoring the code to be able to add ther countries easily - now it has hardcoded PL and CZ, in the future someone would add other countries. To do that, think about dividing code into classes and namespaces.

This will make project more robust, but also more scalable.


This is idea for the future, not bug

Add posibility to enter only center of map and size

It would be nice feature if we had possibility to enter only center of map, not border points.

Now user is forced to do math (with KML exporter, etc...) which can be done (from my point of view) in script.


This is idea for the future, not bug

Unable to collect elevation data from Czech Geoportal

Since some time there's a problem with elevation data collecting from Czech Geoportal – the 'getSamples' query type (used by demGen) is "forbidden by administrative rules" – so you can see 403 Forbidden instead of the data.

For example: https://ags.cuzk.cz/arcgis2/rest/services/dmr5g/ImageServer/getSamples?geometry={points%3A[[-712578.2488101454%2C-1060696.0999415524]%2C[-712576.265963167%2C-1060696.3606542302]%2C[-712574.2831160902%2C-1060696.6213661672]%2C[-712506.8662573174%2C-1060705.4851337026]]%2CspatialReference%3A{wkid%3A5514}}&geometryType=esriGeometryMultipoint&sampleDistance=&sampleCount=&mosaicRule=&pixelSize=&returnFirstValueOnly=false&f=pjson

I'm working on the big demGen update, I'll look for any solutions.

a

a

Do not use hardcoded workspace in generate scripts

As of now, scripts have hardcoded config path (demGenerator_config.txt) and workspace folder (demGen_data). It would be nice to be able to configure where to load configuraiton and where to store intermediate results (if needed). Current values can be used as defaults

Weird behaviour when generating heights (CZ)

When generating heights for the map (country=CZ), script (mod2) tends to create download peaks.

image

I would expect constant network usage when downloading heights data. Also consider bit refactor of mod2. In the script, "stupid" str.split is used to get data out of json. Thats one thing, another thing is, that in case when you will generate 4x4 map (my case), it will open ~4227136 connections just to get one number. Web protection services can detect this ammount of connections as an attack and will cause slow down for that user.

TODO:

  • In the documentation find way how to download bulk of datas
  • Refactor mod2 to be able to download just one datafile with all necesary heights

Impact:

Because of this issue, this script hard to use for large maps in czech environment.

problem

jak kończe z tymi dem generator 1 itd to ak patrze tam gdzie mają być pliki ortho to jest sam zielony ekran help

multiprocessing.pool.MaybeEncodingError

Traceback (most recent call last):
  File "C:\Users\...\Desktop\demGenerator-master\demGenerator-master\demGenerator_mod2.py", line 113, in <module>
    hstr = list(tqdm.tqdm(p.imap(getHeightPL, rqs), total=len(rqs)))
  File "C:\Python\Python37\lib\site-packages\tqdm\std.py", line 1081, in __iter__
    for obj in iterable:
  File "C:\Python\Python37\lib\multiprocessing\pool.py", line 748, in next
    raise value
multiprocessing.pool.MaybeEncodingError: Error sending result: '<multiprocessing.pool.ExceptionWithTraceback object at 0x000001EF13C26400>'. Reason: 'TypeError("cannot serialize '_io.BufferedReader' object")'

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.