Giter Club home page Giter Club logo

trendanalysis-and-issuetracking-in-nlp's Introduction

Trend Analysis and Issue Tracking in NLP with Python

Trend Analysis

Given a collection of newspaper articles for three years:

Find the top 10 issues for each year and rank them based on prominence and salience 
Extract issues from the article collection  
Find a ranking method that can represent the prominence of the issues within the article collection 
Extract a description out of the articles that are related to an issue 

Issue Tracking

From top issues

Pick 2 issues for analyzing  
Each issue identifying at least 10 events 
For each event, their outstanding attributes need to be extracted 
Identify two different types of events: inter-dependent and independent

Getting Started

Please make sure that you already have the dataset files under data directory before running the code.

  1. Install the Python package requirements using command pip install -r requirement.txt
OLLIE is a JAVA package which need to be placed with the same src directory. OLLIE could be found here: https://knowitall.github.io/ollie/
  1. Run the programs
Move to src directory
Trend Analysis: run the code using command
python trend_analysis.py
When you are done, the result is in src/top_ten.txt. Looking at the file, you can see each 10 issues per year.
Issue tracking: run the code using command
python issue_tracking.py 
When the program is running, you can save the plots for each topic before continuing with the next topic. 
The plot could be seen in src/temp-plot.html
The programs ask you to use available parameters to speed up or not (See Speed Booster in report for details). By accepting,
you will you the paramters from the previous run. Otherwise, you will run as normal and It will take longer time.

Prerequisites

Refer the requirement.txt for details

Authors

  • Giang. Nguyen
  • Kalkbrenner Lydia
  • Oberwegner Phillip

License

This project is licensed under the MIT License - see the LICENSE.md file for details

trendanalysis-and-issuetracking-in-nlp's People

Contributors

giangnguyen2412 avatar

Stargazers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.