mapbox / osmcha Goto Github PK
View Code? Open in Web Editor NEWThis project forked from willemarcel/osmcha
Python package to detect suspicious OSM changesets
License: GNU General Public License v3.0
This project forked from willemarcel/osmcha
Python package to detect suspicious OSM changesets
License: GNU General Public License v3.0
DEPRECATED. SHOULD DELETE. ====== osmcha OSM Changeset Analyser, ``osmcha``, is a Python package to detect suspicious OSM changesets. It was designed to be used with `osmcha-django <https://github.com/willemarcel/osmcha-django>`_, but also can be used standalone or in other projects. .. image:: https://badge.fury.io/py/osmcha.svg :target: http://badge.fury.io/py/osmcha .. image:: https://travis-ci.org/willemarcel/osmcha.svg :target: https://travis-ci.org/willemarcel/osmcha .. image:: https://coveralls.io/repos/willemarcel/osmcha/badge.svg :target: https://coveralls.io/r/willemarcel/osmcha Installation ============ pip install osmcha Usage ===== Python Library -------------- You can read a `replication changeset file <https://planet.openstreetmap.org/replication/changesets/>`_ directly from the web: .. code-block:: python c = ChangesetList('https://planet.openstreetmap.org/replication/changesets/002/236/374.osm.gz') or from your local filesystem. .. code-block:: python c = ChangesetList('tests/245.osm.gz') ``c.changesets`` will return a list containing data of all the changesets listed in the file. You can filter the changesets passing a `GeoJSON` file with a polygon with your interest area to `ChangesetList` as the second argument. Finally, to analyse an especific changeset, do: .. code-block:: python ch = Analyse(changeset_id) ch.full_analysis() Customizing Detection Rules ~~~~~~~~~~~~~~~~~~~~~~~~~~~ You can customize the detection rules by defining your prefered values when initializing the ``Analyze`` class. See below the default values. .. code-block:: python ch = Analyse(changeset_id, create_threshold=200, modify_threshold=200, delete_threshold=30, percentage=0.7, top_threshold=1000, suspect_words=[...], illegal_sources=[...], excluded_words=[...]) Command Line Interface ---------------------- The command line interface can be used to verify an especific changeset directly from the terminal. Usage: ``osmcha <changeset_id>`` Detection Rules =============== ``osmcha`` works by analysing how many map features the changeset created, modified or deleted, and by verifying the presence of some suspect words in the ``comment``, ``source`` and ``imagery_used`` fields of the changeset. Furthermore, we also consider if the software editor used allows to import data or to do mass edits. We consider ``powerfull editors``: JOSM, Merkaartor, level0, QGIS and ArcGis. In the ``Usage`` section, you can see how to customize some of these detection rules. Possible Import --------------- We tag a changeset as a ``possible import`` if the number of created elements is greater than 70% of the sum of elements created, modified and deleted and if it creates more than 1000 elements or 200 elements case it used one of the ``powerfull editors``. Mass Modification ----------------- We consider a changeset as a ``mass modification`` if the number of modified elements is greater than 70% of the sum of elements created, modified and deleted and if it modifies more than 200 elements. Mass Deletion ------------- All changesets that delete more than 1000 elements are considered a ``mass deletion``. If the changeset deletes between 200 and 1000 elements and the number of deleted elements is greater than 70% of the sum of elements created, modified and deleted it's also tagged as a ``mass deletion``. Suspect words ------------- The suspect words are loaded from a `yaml file <osmcha/suspect_words.yaml>`_. You can customize the words by setting another default file with a environment variable: .. code-block:: console export SUSPECT_WORDS=<path_to_the_file> or pass a list of words to the ``Analyse`` class, more information on the section ``Customizing Detection Rules``. We use a list of illegal sources to analyse the ``source`` and ``imagery_used`` fields and another more general list to examine the comment field. We have also a list of excluded words to avoid false positives. Unknown iD instance ------------------- Verify the changesets made in iD editor to check the host instance. The trusted iD instances are: `OSM.org <http://osm.org/>`_, `Strava <https://strava.github.io/iD/>`_ and `ImproveOSM <http://improveosm.org>`_. Tests ====== To run the tests on `osmcha`: .. code-block:: console git clone https://github.com/willemarcel/osmcha.git cd osmcha pip install -e .[test] py.test -v Changelog ========= Check `CHANGELOG <CHANGELOG.rst>`_ for the version history. Contributors ============ * Wille Marcel * Sanjay Banghar * Bhargav Kowshik Testing ======= .. code-block:: bash # Setup a virtual environment to install required packages. mkvirtualenv osmcha # Install required packages in locally editable (`-e`) mode. pip install -e . # Run the tests. py.test License ======= GPLv3
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.