rubyforgood / reentry Goto Github PK

Two consecutive scrapes of a particular domain should not result in any changes to the database if the source data doesn't change.

It would be nice to have this option as a fall back against failed crawls.

Lat/Long will need to be included with addresses in the Locations table.

• Admin role (manages users, has full access to domains, location and services interfaces)
• User role (add domains for scraping)

Ohana requires 1:n relationship between Location and Services for simplicity and speed. We can use our services table to pull consistent names when adding into a 1:n location_services table.

Models which can be changed by a user directly should be checked for validity before changing the database.

• Domain

Models which can be added by a scraper should be checked for validity before adding to the database.

• Location
• PhoneNumber