This is an unofficial pytorch implementation of R-BERT model described paper Enriching Pre-trained Language Model with Entity Information for Relation Classification.

In addition to the SemEval 2010 dataset tested in the original paper, I aslo test implementation on the more recent TACRED dataset

• Python version >= 3.6
• Pytorch version >= 1.1
• Transformer library version >= 2.5.1

$ https://github.com/mickeystroller/R-BERT
$ cd R-BERT

The SemEval-2010 dataset is already included in this repo and you can directly run:

CUDA_VISIBLE_DEVICES=0 python r_bert.py --config config.ini

You need to first download TACRED dataset from LDC, which due to the license issue I cannot put in this repo. Then, you can directly run:

CUDA_VISIBLE_DEVICES=0 python r_bert.py --config config_tacred.ini

We use the official script for SemEval 2010 task-8

$ cd eval
$ bash test.sh
$ cat res.txt

First, we generate prediction file tac_res.txt

$ python eval_tacred.py

You may change test file/model path in the eval_tacred.py file

Then, we use the official scoring script for TACRED dataset

$ python ./eval/score.py -gold_file <TACRED_DIR/data/gold/test.gold> -pred_file ./eval/tac_res.txt

Below is the Macro-F1 score

Below is the evaluation result

1. https://github.com/wang-h/bert-relation-classification

2. Enriching Pre-trained Language Model with Entity Information for Relation Classification.