Comments (6)
Hi,
Thanks for raising this issue. This is just to acknowledge that I'm on it. This is part of my PhD code, that really needs attention. I will get back to you with some examples later on. I suspect part of the code is missing here.
Sasho
from bratutils.
Hi,
your example should be working now. I had forgotten to rename the attribute postag_list
to tags
in some cases. PyCharm's refactoring is sometimes very sneaky. I've also added some examples on how to use the agreement module. Hope that helps. Let me know if there is anything else.
Sasho
from bratutils.
Hey,
I appreciate the fast reply. And thanks for fixing and improving the project.
As an improvement suggestion, I think it would be nice to have this in the README in order to understand the statistics metrics better.
However, I'm now questioning about the logic of the program. I'm running the sample with doc
and doc2
pointing to the same file. So, it should be expected to have precision
and recall
of 1
. Right?
It's not the case, though. The following code:
from bratutils import agreement as a
doc = a.Document('res/samples/A/data-sample-1.ann')
doc2 = a.Document('res/samples/A/data-sample-1.ann')
doc.make_gold()
statistics = doc2.compare_to_gold(doc)
print statistics
Results in the following statistics:
-------------------MUC-Table--------------------
------------------------------------------------
pos:158
act:158
cor:130
par:0
inc:28
mis:0
spu:0
------------------------------------------------
pre:0.822784810127
rec:0.822784810127
fsc:0.822784810127
------------------------------------------------
und:0.0
ovg:0.0
sub:0.177215189873
------------------------------------------------
bor:158
ibo:0
------------------------------------------------
------------------------------------------------
I guess the 28 incorrect
counter is not being correctly calculated.
from bratutils.
That's the moment I take a real look at my PhD code and I pull my hair. I'll need some time to fix this properly.
from bratutils.
Ok, thanks.
I'll also try to give a look at the source code and see if I can help with it.
However, there should be some easy and trustable way to test the results (with smaller samples with manual calculations, I guess).
from bratutils.
Yeah, part of it should really be writing tests for it.
from bratutils.
Related Issues (11)
- Apply to attributes and relations too HOT 3
- Relations and attributes crash the parsing function HOT 1
- Relations support HOT 2
- Attribute support
- The merging of documents methods seem to be in broken
- Incorrect value of spurious tags when no overlapping HOT 2
- Relations not supported HOT 2
- Discontinuous Annotations HOT 3
- relations not supported still HOT 1
- typo coinsiding > coinciding HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bratutils.