Giter Club home page Giter Club logo

mongo-web-scraper's Introduction

Packers News Web scraper

  • Javascript web scraper, hosted on Heroku, requiring Express, Axios, Cheeroio, Morgan, and MongoDB / Mongoose OM to handle and store data. Data is stored in an MLab database via Heroku.

ABOUT THIS APP

  • Packers News Scraper is a javascript application that pulls the latest news from the Packers.com "All News" subsection. It stores a link to the news article, the title of the article, a caption image, and brief summary.

  • The user is required to scrape the news via the "Pull the latest news" danger button. It is then stored in the MLab database and displayed on the Home Page. Users can select which articles they would like to Save, and view these articles on the "Saved Articles" page. When the user visits the Saved Articles page, they have two choices for each article; remove from Saved Articles, or comment. All comments are stored in the Mlab database for the user to view later.

  • Express is is required for running the application. Cheerio is required for scraping the data from the Packers website. Morgan is required for logging in node.js.

  • Once the data is scraped, it is then pushed to the MongoDB via Mongoose, and accessed via Axios requrests. Lastly, it is displayd on the Home page using Express-Handlebars.

Link to Heroku https://packers-scraper.herokuapp.com/

Purpose of this app

  • This app was fundamental in solidifying the programmer's (myself, Logan McNulty) knowledge of working with Cheerio, Mongoose, and Mongo DBs specifically. The rest of the required packages I was already familiar with.

Modules required, and their Documentation Links

mongo-web-scraper's People

Contributors

loganmcnulty avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.