zeeraktalat / hatespeech Goto Github PK

@wvs2 if you e-mail me I can send you the data. :)

Originally posted by @ZeerakW in #2 (comment)

[email protected]

you could make a copy of the data available because it has errors to recover?

Hey, the paper mentions that data will be uploaded in ids and labels, but there are only IDs here? Most actual hate tweets have been taken down now & the IDs left are misclassified more often than not. Do you still have the label versions?

I do not know how to get the original twitter with ids, could you share the complete twitter?

Hi, I'm doing a research project and I got only a few thousand tweets using twitter API. I think this is because user deleted that tweets or twitter removed them. So, where can I get the file with the downloaded tweets?
Thanks in Advance

Hey,

Thanks for providing the datasets!
For the file NLP+CSS_2016.csv, opening it using excel or using any default delimiter seems to put most of all labels from "amateur" participants under the first three columns. Were most of the posts labelled by participants represented by these columns, or is there a specific delimiter I need to use to see which participant labelled which post?

Thanks,
Vijay

Hello,

I am currently working on a similar project at university, using your data and paper as a comparison. I have tried to fetch all tweets from NAACL_SRW_2016.csv but a lot of tweets, in particular the racist ones, have been removed. Is there perhaps an offline version containing the tweets?

Another problem is that some tweets in the file are marked either both sexism and none or racism and none. These are not many, but does cause issues. An example is id 572340476503724032. Do you have any solution for these?

Thank you!

Best,
Filip

Hi,

I am working on an assignment which involves multiple topics, i.e. racism, profanity, alcohol abuse, etc. Creating positive and negative training data sets for binary classification is very time consuming for each topic. Is there any solution to minimize human intervention to label tweets once creating training data sets?

Hi,
I am doing a post-graduation project and I want to use this dataset but I couldn't access the full dataset. Can you please provide the full dataset with the tweets. That would be very helpful for my project.
Thank you.

Dear researchers/developers

I cannot find the annotations.tsv file which you guys had mentioned in your readme.md. Could you provide me the link to download the annotations?

@zeeraktalat I am a final year student of Computer Science at Jadavpur University . As a final year student I have chosen Hate Speech as my dissertation topic . So it is very important for me to get the dataset of fully hydreated english tweets of this repo . But i am not able to download it . So , if you provide me the csv file I will be greatful to you .

Hello,

Can you please share the full dataset? I need the data for my research where I can compare the deleted tweet.

Hi, most of the ids or the tweets were deleted by twitter as they were against their policies. If you have those tweet texts please send or upload them

While trying to fetch tweets from both files, this is what I receive as a response for most tweets:

Twitter Error [200] : [{"errors":[{"value":"551659627872415744","parameter":"ids","resource_type":"tweet","section":"data","title":"Authorization Error","detail":"Sorry, you are not authorized to see the Tweet with ids: [551659627872415744].","type":"https://api.twitter.com/2/problems/not-authorized-for-resource"}]}]

Is there any other way to get access to the data?

Thanks

Hi,

I have found many tweets ids which are available in both datasets (NAACL_SRW_2016 and NLP+CSS_2016). Some of these tweet ids are

572342978255048705
572341498827522049

Both tweet ids are labelled with "Racism" in NAACL_SRW_2016 however different label in NLP+CSS_2016 ("neither or sexism").

Please advise tackling this issue while using this dataset for classification.

Thanks,
Piush Aggarwal

I cannot find the annotations.tsv file which you guys had mentioned in your readme.md. Could you provide me the link to download the annotations?