This repository includes different Orange Data Mining widgets to access data from Minka, Odour Collect, canAIRio, Ictio, Natusfera or Smart Citizen.

MECODA is part of Cos4Cloud, a European Horizon 2020 project to boost citizen science technologies.

To use MECODA package you need to install Orange Data Mining platform through https://orangedatamining.com/download

Once Orange is installed, inside the Options menu, it's possible to get the package using "Add-ons" category, clicking on "Add more" and searching by name "mecoda-orange". The last version of the package will be installed into Orange platform.

You can find also a "Installation Guide" and "Example of Use".

This widget collects observations from Minka API and allows filter them by:

The Minka widget integrates the Python library mecoda-minka into a visual interface. You can make any query and download two outputs, a dataframe with one observation per row and a dataframe with one photo per row. A single observation can have more than a photo.

The observations output gets a Table with the following fields:

• id: observation id
• captive: True or False
• created_at: date field.
• updated_at: date field.
• observed_on: date field.
• description: open text field.
• latitude / longitude: geo location fields.
• quality_grade: needs_id / research.
• user_login: user login name.
• num_identification_agreements / num_identification_disagreements
• identifications_count: number of identifications for a observation.
• iconic_taxon: one of the big taxonomic groups available in Minka.
• taxon_id: species taxon id.
• taxon_name: species name of observation.
• taxon fields:
  • kingdom
  • class
  • order
  • superfamily
  • family
  • genus

The observations table allows to make statistical analysis. The photos table allows image analysis.

The widget is complemented with other widgets that can take input from it or directly from Minka API:

This widget takes a Table with observations (and a column with ids from Minka) and get the photos from all of them. Works with data from Minka Widget.

The output is a Table with an image type feature that can be accessed using Image viewer.

This widget allows the user to filter Minka observations by different taxonomic levels (from kingdom to species). The levels shown are just the ones with registered observations.

The widget looks like that:

This widget allows the user to filter Minka observations by scientific or common name.

The widget splits Table of observations into two dataframes: one for marine species and other for terrestrial ones. Just gets observations with research degree.

The Odour Collect widget allows the user to get observations from Odour Collect API. The widget looks like this:

The widget has different search fields: date, annoy level, intensity level, category and type. Besides, the observations can be complemented with the distance from a Point of Interest, if this is set.

The output is a Table of observations, with this information:

The widget allows to get observations from fixed stations through CanAIRio API. The widget looks like this:

The widget filters between the different measurements and gets a dataframe with all data from fixed stations at the request moment.

When selecting data from one of the stations, it can be combined with another widget (Last Hour Fixed Station) to get data from the last recorded data of this station.

The output of Last Hour Fixed Station widget is a dataframe with last registered measurements from this station.

The widget gets observations from all the mobile stations registered by CanAIRio API.

The output can be placed in a map and colored by any parameter:

We can select one device and get the complete track of the route using Track - Mobile Station. This is the result placed in a map:

The point can be coloured by any measurement.

This example can be loaded as a workflow (.ows format) directly in Orange Canvas:

The widget analyse data from Ictio's citizen observatory for Amazon basin fish observation. The data from this Citizen Observatory is not freely available via public API nor public download, but it can be downloaded as a zip file after registration in web page.

This widget takes an Ictio_Basic zip file from ictio.org and process it using IctioPy library, created by Science For Change:

The output of this widget is a Table with this structure:

• obs_id: Unique observation ID.
• weight: Total weight in Kg reported for the given taxon.
• price_local_currency: Price per Kg in the local currency for the taxon.
• obs_comments: Comments made by the Citizen Scientist at the time of registering the observation.
• upload_date_yyyymmdd: Date of observation upload. It does not necessarily match observation date. The relevant data for analysis purposes is the observation date. num_photos: Number of photos taken with the observation. The photos are not available in the basic version of the ictio.org's database, so this field is only included as a reference.
• user_id: Anonymous, numeric ID of the user that made the observation. checklist_id: Unique checklist identifier
• protocol_name: Name of the observation protocol used. Possible values: During fishing event , After the fishing event, Market Survey and Port Survey. complete_checklist: Indicates if the checklist was completed. A complete checklist is when all taxa caught during the fishing effort are reported. In a market survey it would be all taxa observed at the market. If observation was made via app, it is assumed that user reported a complete checklist.
• fishing_duration: The duration of the fishing effort in hours. submission_method: How was data submitted? EFISH_android for mobile app or EFISH_upload for upload tool.
• app_version: Version of the mobile app or upload tool used.
• taxon_code: Species taxon code.
• scientific_name: Scientific name of the species observed.
• num_of_fishers: Number of fishers participating in fishing effort.
• number_of_fish: Number of individual fish reported for the given taxon.
• obs_year: Year of observation.
• obs_month: Month of observation.
• obs_day: Day of month of observation.
• port: This is the name of the port where data was collected and is only reported with the Port Protocol. This is not the location where fish were caught.
• location_type: Ictio has three location types: Watersheds, Ictio Hotspots, and Personal Locations. This field will identify watersheds and Ictio Hotspots. This field will be null for personal locations. A personal location is any new location added with the upload tool or based on raw GPS coordinates.
• country_code: Country Code, automatically assigned by latitude and longitude. If you assign a checklist to a watershed it will be assigned to the country where the centroid of the watershed is. If the watershed overlaps a boundary, it could be assigned to a different country from where it is being submitted.
• country_name: Country in which the observation was made.
• state_province_code: State/Province Code, automatically assigned by latitude and longitude. If you assign a checklist to a watershed it will be assigned to the State/Province where the centroid of the watershed is. If the watershed overlaps a boundary, it could be assigned to a different State/Province.
• state_province_name: State/Province name, automatically assigned by latitude and longitude. If there is a checklist assigned to a watershed, observation will be assigned to the State/Province where the centroid of the watershed is. If the watershed overlaps a boundary, it could be assigned to a different State/Province. watershed_code: Unique identifier for watershed. For Ictio hotspots and personal locations, the watershed code and watershed name are inferred based on geographic position of Citizen Scientist at the time of observation.
• watershed_name: Name of the watersed in which the osbervation was made.

This widget collects observations from Natusfera API and allows filter them by:

The Natusfera widget integrates the Python library mecoda-nat into a visual interface. You can make any query and download two outputs, a dataframe with one observation per row and a dataframe with one photo per row. A single observation can have more than a photo.

The first widget (Smart Citizen Search) collects data from the Smart Citizen API. It allows to select the device either via device ID (the number after https://smartcitizen.me/kits/[...]) or by searching the API by city, tags, or device type. The second widget (Smart Citizen Data) uses the data from the first one and collects timeseries tabular data from a device, with a defined rollup (i.e. the frequency of the readings), minimum and maximum date; as well as resample options.

Example workflow is available https://github.com/fablabbcn/smartcitizen-docs/blob/master/docs/assets/ows/example_sc.ows and documentation will be made available in https://docs.smartcitizen.me/Data/.

The widget allows to get data from Aire Ciudadano air quality stations, from the last registers or filtering by range of time.

The output is a table with these columns:

To run tests locally you'll need to have python 3.8, pip, virtualenv and git installed.

• Clone the repository and go into the directory:

git clone https://github.com/eosc-cos4cloud/mecoda-orange.git
cd mecoda-orange

• Set up the virtualenv for running tests:

virtualenv -p `which python3.8` env
source env/bin/activate

• Install mecoda-orange:

pip install -e .

• Install pytest:

pip install pytest

• Run tests from the mecoda-orange directory:

pytest

• To run only one test, use:

pytest -k <name-of-the-test>

MECODA is intented to be kept as an open source repository. It will be ensured to be maintained, at least as part of other existent repository. A version will be kept in CSIC Gitlab.

This repository is under GPLv3 license. See license for more details.