open source intelligence project

Requires Python 3.9

Scrapes Twitter or Reddit bases on query, assesses content sentement and returns a CSV file with the results.

Twitter API Documentation: Twitter API Docs
Reddit API Documentation: Reddit API Docs
PRAW Documentation: PRAW Docs

Requires NLTK, PRAW, PANDAS, and PYYAML:

pip install nltk
pip install praw
pip install pandas
pip install pyyaml

Expects API Credentials in an auth.yaml file in this format:

reddit:
  id: *App ID*
  secret: *API SECRET*
twitter:
  key: *KEY*

Expects username and password database to be in a CredFile.txt file in this format (one pair per line):

username,*SHA512 Password Hash*

The basis for the twitter portion was made using this tutorial.

A list of all the available access points for the Twitter scraper can be found here.

Documentation and samples for sentiment analysis from here