connectedplacescatapult / digital-connector-python Goto Github PK

Build base case using which users could create importers through python

importers built using base importer class is not working on windows due to jars not being added to classpath

Map all the gradle tasks in recipe.py, so that users could run all the gradle tasks from script

Create method to run recipe directly from Python scipt

Currently there is no way for the user to gain feedback on what is imported when calling importer.save(). Something like xxxx number of records are importer so far... would do

Add a list of python dependencies

Currently user could only build subjects using lat and lon and convert them into geometry object.

Could build oaimporter in python that would fix this limitation

Maybe use tqdm (https://pypi.python.org/pypi/tqdm) to show a progress bar to indicate that the process is still running and downloading data.

Add documentation in the importer file

Will this be the same license as? https://github.com/FutureCitiesCatapult/TomboloDigitalConnector/blob/master/LICENSE

Build generic importer in python, which can be used some common formats of datasets

Visualise recipe structure in a more human readble way

Folders have different naming convention styles in root.

• Samples
• barking_receipts

Build test cases for importer and recipe python files

currently to download data, python importer makes a call to digital connector downloadutils function, and this adds to a huge data exchange between jvm and python.

Could add the download functionality in base importer class of python so that the call to jvm can be removed

Currently, build_recipe requires path to save the recipe, make it optional so that users could run recipe without saving it

Similar to the Tombolo project

• Issue labels
• Milestones