To run the airflow deployment, use the main deployment repository and then visit http://0.0.0.0:8080/login/
docker-compose up
Then, add a new connection in the ui with the following parameters. This must be done for the dags to run.
The name is fs_default
and of type File(path).
This dag is responsible for downloading highway geometries, saving them to disk in a database ready format, and loading them into the database.
This dag downloads the address data and then inserts it into neo4j.
Poetry is used to manage the dependencies and environment. To use, run
poetry shell
To exit, run exit
.
Before submitting code for review, lint it with the following commands
python3 -m black .
python3 -m isort .
Pull requests should be made into the develop
branch from feature branches.