OpenSidewalks data schema, and its validators

This repository is created to perform validations on the geojson files provided against OpenSideWalks Schema.

Steps to run:

Create a Virtual environment in Python
Activate virtual environment
Install the required packages to run the code

Using Pip

virtualenv opensidewalk -p /usr/bin/python3.6
source opensidewalk/bin/activate
pip3 install -r pip_reqs.txt

Using Conda Distribution

conda create -n opensidewalk python=3.8
conda activate opensidewalk
conda install --file conda_reqs.txt
pip install -r conda_pip_reqs.txt

How to run the code:

python main.py --inputPath <<input folder>> --writePath <<Output Directory to Write To>>

Example:

python main.py --inputPath TestData/input --writePath TestData/Output

Expected Input:

Input folder should contain nodes, and ways files belonging to a region with the same prefix. For example:

FileName	Data it should contain
1. Redmond_nodes.geojson	Contains all the points in that region
2. Redmond_ways.geojson	Contains all the ways in that region

Output:

The program writes the following files in the output folder

FileName	Data it contains
1. Redmond_nodes_valid.geojson	All the points in the region that adhere to OSW Schema
2. Redmond_ways_valid.geojson	All the ways in the region that are in accordance with OSW schema
3. Redmond_nodes_invalid.geojson	All the points in the region that do NOT adhere to OSW schema
4. Redmond_ways_invalid.geojson	All the ways in the region that do NOT adhere to OSW schema
5. Redmond_ways_Missing_Intersection.geojson	Shows the ways that are probably intersecting but don't have a intersecting node
6. Redmond_ways_recommended_Intersection.geojson	Recommended Potential Intersecting points for the ways in Missing_Intersection.geojson
7. Redmond_ways_connected.geojson	All the ways that are connected to atleast one another way
8. Redmond_ways_isolated.geojson	Ways that are not connected to any other ways
9. Redmond_ways_subgraph_*.geojson	Shows a connected island of the region given

How to use the output files:

For the invalid files, please look at the tag "fixme" in them to know what is the possible reason for the point or way being invalidated and take the necessary action to fix them.

Load Missing_Intersection file in QGIS to see the ways that are potentially intersecting but don't have an intersecting node.
Load Recommended_Intersection file on top of Missing_Intersection files to see recommended intersection points.

How to file issues:

Please open a GitHub issue for any for any bugs/requested features. For each issue, please provide:

Branch commit your code is based on. This could be done in a couple of ways: -- pick the 'commit' tag from the first line of the command 'git log' -- If the code you're working on is based on a release tag, provide the release tag
Provide potential test input files you used while running the code

intersectingValidation results in IndexError: list index out of range error

Running the following line on multiple different test cases results in an Index Error
python main.py --inputPath TestData/Test2/input --writePath TestData/Test2/output

Output:

Reading files from : TestData/Test2/input
Number of geojson files : 2
Processing the following files :
bell_Node.geojson
bell_Ways.geojson
ways_file split into bell_Ways_connected.geojson and bell_Ways_isolated.geojson
number of ways in the currrent file : 316

Checking whether there are any Ways without an intersecting node

[==================== ] 78% Traceback (most recent call last):
File "main.py", line 47, in
intersectLineStringInValidFormat(utildOriginal.ways_json, "brunnel", cf, ntpath.basename(ways_file))
File "/home/alisha/oswvalidators/intersectingValidation.py", line 149, in intersectLineStringInValidFormat
{"type": "Feature", "geometry": {"type": "Point", "coordinates": appendPoints[0]}})
IndexError: list index out of range

Expected Output:

Number of geojson files :
Processing the following files:
ways_file split into xxx_Ways_connected.geojson and xxx_Ways_isolated.geojson
number of ways in the currrent file : 108

Checking whether there are any Ways without an intersecting node

[==========================] 100%

eda

Number of ways in the file : 108
Number of Subgraphs/islands : 19
Number of ways not connected to any other way: 0
Number of ways that are connected to atleast one other way: 108
Number of ways in subgraph 0: 3
Number of ways in subgraph 1: 3
Number of ways in subgraph 2: 2
Number of ways in subgraph 3: 2
Number of ways in subgraph 4: 14
Number of ways in subgraph 5: 2
Number of ways in subgraph 6: 2
Number of ways in subgraph 7: 2
Number of ways in subgraph 8: 3
Number of ways in subgraph 9: 54
Number of ways in subgraph 10: 6
Number of ways in subgraph 11: 5
Number of ways in subgraph 12: 5
Number of ways in subgraph 13: 3
Number of ways in subgraph 14: 2
Number of ways in subgraph 15: 2
Number of ways in subgraph 16: 2
Number of ways in subgraph 17: 2
Number of ways in subgraph 18: 2

As a result of this error, no "recommended_intersections.geojson", "missing_intersections.geojson", or "subgraph.geojson" files are produced in the output.

sureshgaussian / oswvalidators Goto Github PK

oswvalidators's Introduction

OpenSidewalks data schema, and its validators

Steps to run:

Using Pip

Using Conda Distribution

How to run the code:

Expected Input:

Output:

How to use the output files:

How to file issues:

oswvalidators's People

Contributors

Stargazers

Watchers

Forkers

oswvalidators's Issues

Reading files from : TestData/Test2/input Number of geojson files : 2 Processing the following files : bell_Node.geojson bell_Ways.geojson ways_file split into bell_Ways_connected.geojson and bell_Ways_isolated.geojson number of ways in the currrent file : 316

Checking whether there are any Ways without an intersecting node

Number of geojson files : Processing the following files: ways_file split into xxx_Ways_connected.geojson and xxx_Ways_isolated.geojson number of ways in the currrent file : 108

Checking whether there are any Ways without an intersecting node

[==========================] 100%

eda

Recommend Projects

Recommend Topics

Recommend Org

Reading files from : TestData/Test2/input
Number of geojson files : 2
Processing the following files :
bell_Node.geojson
bell_Ways.geojson
ways_file split into bell_Ways_connected.geojson and bell_Ways_isolated.geojson
number of ways in the currrent file : 316

Number of geojson files :
Processing the following files:
ways_file split into xxx_Ways_connected.geojson and xxx_Ways_isolated.geojson
number of ways in the currrent file : 108