Giter Club home page Giter Club logo

Comments (6)

savkov avatar savkov commented on July 20, 2024 1

Hi,

Thanks for raising this issue. This is just to acknowledge that I'm on it. This is part of my PhD code, that really needs attention. I will get back to you with some examples later on. I suspect part of the code is missing here.

Sasho

from bratutils.

savkov avatar savkov commented on July 20, 2024 1

Hi,

your example should be working now. I had forgotten to rename the attribute postag_list to tags in some cases. PyCharm's refactoring is sometimes very sneaky. I've also added some examples on how to use the agreement module. Hope that helps. Let me know if there is anything else.

Sasho

from bratutils.

HugoSousa avatar HugoSousa commented on July 20, 2024

Hey,

I appreciate the fast reply. And thanks for fixing and improving the project.
As an improvement suggestion, I think it would be nice to have this in the README in order to understand the statistics metrics better.

However, I'm now questioning about the logic of the program. I'm running the sample with doc and doc2 pointing to the same file. So, it should be expected to have precision and recall of 1. Right?

It's not the case, though. The following code:

from bratutils import agreement as a

doc = a.Document('res/samples/A/data-sample-1.ann')
doc2 = a.Document('res/samples/A/data-sample-1.ann')

doc.make_gold()
statistics = doc2.compare_to_gold(doc)

print statistics

Results in the following statistics:

-------------------MUC-Table--------------------
------------------------------------------------
pos:158
act:158
cor:130
par:0
inc:28
mis:0
spu:0
------------------------------------------------
pre:0.822784810127
rec:0.822784810127
fsc:0.822784810127
------------------------------------------------
und:0.0
ovg:0.0
sub:0.177215189873
------------------------------------------------
bor:158
ibo:0
------------------------------------------------

------------------------------------------------

I guess the 28 incorrect counter is not being correctly calculated.

from bratutils.

savkov avatar savkov commented on July 20, 2024

That's the moment I take a real look at my PhD code and I pull my hair. I'll need some time to fix this properly.

from bratutils.

HugoSousa avatar HugoSousa commented on July 20, 2024

Ok, thanks.

I'll also try to give a look at the source code and see if I can help with it.

However, there should be some easy and trustable way to test the results (with smaller samples with manual calculations, I guess).

from bratutils.

savkov avatar savkov commented on July 20, 2024

Yeah, part of it should really be writing tests for it.

from bratutils.

Related Issues (11)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.