Comments (6)
Part of the reason is in the justification part of readme.md in pfn-nested folder.
Also, since head to head and tail to tail are coming for different results, using the same feature might not be optimal.
We learn that lesson from the previous works where people simply use the same feature for ner and re.
Empirically speaking, switching them leads to faster convergence In our experiment. So we stick with this formula.
from pfn.
Thank you for your prompt response. In terms of best performance, is there a significant difference between the two settings? And if yes, can you please elaborate?
from pfn.
Here is the thing, industry people used pfn on their Chinese dataset and the result is super low because there are so many head-overlap triples in their dataset. so I provided them with pfn-nested, the result got normal under pfn-nested. All in all, pfn-nested is designed mainly to cover the issue of nested triple prediction.
As for performance in current dataset, I only used it on scierc, the result is displayed in the main page though. I did try to use it on ace05, but I ran into oom error with batch size 20.
There is no systematic evaluation of pfn-nested though, you can verify the performance yourself if you’re interested.
from pfn.
Thank you. This answers my questions.
from pfn.
And by the way, this work is indeed truly impressive. Best wishes on further explorations!
from pfn.
ok, thanks a lot.
from pfn.
Related Issues (20)
- Small inconsistency, or not? HOT 1
- question about eval_metric HOT 1
- When training model, is it necessary to set args.do_eval=True?
- FileNotFoundError: [Errno 2] No such file or directory: 'data/data/NYT/ner2idx.json' HOT 1
- OOM for my own bigger datasets HOT 2
- Question about entity extraction of out-of-triples HOT 1
- chinese custom dataset HOT 2
- evaluate the model with customized input HOT 2
- 请问消融实验的编码模式encoding scheme应该怎么设置呀 HOT 2
- Nest下的处理 HOT 2
- SEMEVAL dataset HOT 1
- 为什么PFN-nested model在关系训练时候可以利用实体tail信息呢? HOT 2
- 你好,能否提供适用于nested-pfn的inference.py呢?感谢! HOT 1
- 关于头尾实体特征和关系特征的问题 HOT 5
- 关于实验结果复现的问题 HOT 2
- 关于实体抽取和关系抽取F1分数问题 HOT 2
- 关于OOT(Out-of-triple)数据集问题 HOT 2
- why use albert-xxlarge instead of bert-base when training on some datasets? HOT 2
- 有一个报错问题,不知道是环境不对还是, HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pfn.