ukplab / acl2019-bert-argument-classification-and-clustering Goto Github PK
View Code? Open in Web Editor NEWLicense: Apache License 2.0
License: Apache License 2.0
Hello,
could you kindly clarify which one is the expected ibm dataset? Is this one "Expert Stance" ?
Thank you
Hi!
I tried to reproduce the performance of Glove Embeddings on the AFS dataset, but I failed.
The Pearson correlation and Spearman's rank correlation are .3240 and .3400 in the original paper, but I got around .15 ~.20 on both metrics with 10-fold CV.
Am I have to weight the embedding of each token by IDF, or follow additional details to reproduce the same result?
I also tried to reproduce the performance of Infersent(both of Glove and FastText) and their performance is same with paper.
Thank you!
Hi,
thanks for sharing this work.
I tried to run one of the scripts, but seems that datasets are missing, so I take the following error
Traceback (most recent call last):
File "train.py", line 711, in
main()
File "train.py", line 571, in main
train_sampler = RandomSampler(train_data)
File "/home/ant/anaconda3/envs/pytorch_full/lib/python3.7/site-packages/torch/utils/data/sampler.py", line 94, in init
"value, but got num_samples={}".format(self.num_samples))
ValueError: num_samples should be a positive integer value, but got num_samples=0
From where I am supposed to download the data?
Thanks,
Antonis
Hi,
for UKP ASPECT Corpus there are 4 labels:
DTORCD: Different Topic/Can’t decide
HS : High Similarity
NS : No Similarity
SS : Some Similarity
Would it be beneficial to use -1,0,1,2 instead?
Is this treated as a regression problem? Where is the transition takes place?
Hello,
I find there is no File (make_splits.py)
Hi,
Thanks for sharing the codebase. I am trying to execute the following script: argument-similarity/evaluation_with_clustering.py. However, it is throwing an error at the following lines (the error being no such files are found):
dev_sim_scorer = PairwisePredictionSimilarityScorer("%s/%d/dev_predictions_epoch_%d.tsv" % (bert_experiment, split, epoch))
test_sim_scorer = PairwisePredictionSimilarityScorer("%s/%d/test_predictions_epoch_%d.tsv" % (bert_experiment, split, epoch))
How can I generate these files?
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.