Giter Club home page Giter Club logo

worker's Introduction

hitraffic-worker

Join the chat at https://gitter.im/hitraffic/worker Fetches and stores geocoded location data. "Work" will provide geo-coordinate data to supplement data provided by Hawaii Open Data for Traffic Incidents, adding the capability to plot map locations. Data will be stored in a separate database to be utilized by mid and front end developers.

Team Members:

A = Andrew

B = Joanne

Worker Modules:

  1. [A] getIncidentData - retrieves data from Traffic API, converts to a JSON object, creates db model for raw data and inserts data.

  2. [J] processAddress - retrieves raw data and prepares valid address.

    a) [J] fixDate - converts date from epoch to local

    b) [J] processAddress - prepares valid address

    c) [J] getGeoCodes - provides valid address to Geo Code API to retrieve geo coordinates (lat=latitude, lng=longitude)

    d) [A] storeIncidents - inserts incidents with valid geo coordinates to the database

  3. [A] getRealTimeData - retrieves JSON data from HPD site and stores them on the database daily, and processed by step 2)

  4. [J] processIncidents - main program that will emply the first 4 routines. will also provide date-time conversion.

Raw Traffic API Data:

index, date, code, type, address, location, area

Source Data: https://data.honolulu.gov/api/views/ix32-iw26/rows.json?accessType=DOWNLOAD

Notes: 2 hour delay, over 163,000+ records, dates back to Aug 2012

Source Data: http://www4.honolulu.gov/hpdtraffic/ or https://twitter.com/hpdtraffic

Notes: Real-Time data, requires scrapping (later)

Source: http://open.mapquestapi.com/geocoding/

Notes: Account required (J)

Database: PostgreSQL 9.4.1

Notes: development using Mac OS X version

Production: (TBD)

database name: hitraffic

table name: incidents

index: [PK, INT, AUTO INCREMENT, UNIQUE]

number: [INT, over 160,000+]

date: [DATE/TIME]

code: [INT]

type: [STRING]

address: [STRING]

location: [STRING]

area: [STRING]

lat: [FLOAT]

lng: [FLOAT]

Note: postgis.net may provide extensive capability with geography and geometry in the future.

table name: location

Area

name: [STRING]

table name: incident_type

table name: location_type

worker's People

Contributors

jpbatz avatar champstarr avatar keokilee avatar gitter-badger avatar thgaskell avatar

Watchers

James Cloos avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.