Giter Club home page Giter Club logo

nlp-4-hate-speech-recognition's Introduction

NLP-4-Hate-Speech-Recognition

Problem definition:

Hate speech on social media has become a pervasive issue in recent years, causing harm to individuals and communities by perpetuating discriminatory attitudes and even sometimes inciting violence. As such, the ability to detect and classify hate speech in social media is critical in order to confront it.

Objective and success metrics:

The objective of this NLP project is to develop the skills necessary to build a model that can effectively detect and classify hate speech in social media, specifically using unstructured data โ€“ in this case, labeled Tweets. To achieve this, we will use NLP transformer models to preprocess and tokenize the tweets, applying then various supervised machine learning algorithms to analyze the text and classify it as either hate speech or not.

To evaluate the results, we will be using F1-score on positive cases as success metric, aiming to obtain a result equal or above 0.65

Challenges detected:

  • Transform unstructured data into processable inputs: Text by itself is not a valid numeric input that can be used in ML models.

  • Understand the text beyond just formal language rules: The language used on social media is filled with slang and expressions that communicate based on context, making it difficult to process the data with ML models.

  • Unbalanced dataset: Just 7.01% of the cases provided in the dataset are positive for hate speech.

Data for the project:

The data used for this project is retrived from Kaggle and consists of a CSV file containing 29,530 tweets with the following variables:

  • id: (numeric) Tweet ID
  • label: (dummy) Tweets that are positive for hate speech are marked with 1, while those that are not are marked with 0.
  • tweet: (text) Raw text from the retrived tweets.

nlp-4-hate-speech-recognition's People

Contributors

jvrapp avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.