Comments (5)
I'd be interested in resolving this issue too. I got the same result as the previous commenter and here are the underlying scores:
{u'pair_scores': {0: {}, 1: {0: -1.8137825597308108}, 2: {0: -1.738390801732288, 1: -1.6511597972712726}, 3: {0: 6.5473994047601911, 1: -0.57869067045464151, 2: -1.6598056098030169}, 4: {0: -1.8103805461400377, 1: -1.5256500224140488, 2: -1.5399936662599227, 3: -1.6966305608918302}, 5: {0: -2.2999057893775179, 1: -1.7149788666508408, 2: 0.68513795195160965, 3: -2.0966374729906301, 4: -1.8540071211764726}, 6: {0: -1.9504528157206593, 1: -1.8210641784028945, 2: -1.8300293314203429, 3: -1.8767248759882404, 4: -1.6296482123249305, 5: -1.9901970079817037}}, u'single_scores': {0: None, 1: 1.5870258214636452, 2: 1.6899656734067761, 3: 1.5896249109319895, 4: 1.8004470287030618, 5: 1.5748515581318938, 6: 1.6261232857954271}}
from neuralcoref.
Hi @bea-alex, @kleinias, after trying the new version it still seems to be different between our production setup (online demo) and the open-sourced version.
My guess is that it is related to a difference in spacy model. In our production setup we selected a large spacy 1 model with a higher parsing accuracy.
I will investigate further and keep up updated.
from neuralcoref.
Ok more investigation indicated it's indeed an issue with the accuracy of the spacy model you use.
Parsing the sentence I hear Sandy breathing.
with the default spacy 2 en_core_web_sm
model incorrectly label Sandy
as an ADJ.
The most simple solution is to use the larger model en_core_web_lg which label this example correctly.
Currently spacy model is hard coded to en_core_web_sm
, you can overcome it by passing an nlp object to coref constructor. In the next version I will release in a few days I will make it easier to use any spacy model.
from neuralcoref.
We are now on release v3.0 so I am closing this old issue.
Feel free to open it again (or a new one) if you are experiencing some issues with the new release.
from neuralcoref.
Hi,
I am using the en_core_web_lg model, but am still having the issue:
with this sentence:
Once upon a time a lion lived in a forest. One day after a heavy meal it was sleeping. After a while, a mouse came and it started to play. Suddenly the lion got up with anger and looked for those who disturbed it's nice sleep. Then it saw a small mouse standing trembling with fear. The lion jumped on it. The mouse begged the lion to forgive it. The lion felt pity and left. The mouse ran away. On another day, the lion was caught in a net.
One day after a heavy meal IT was sleeping, is replaced by
One day after a heavy meal ONE DAY AFTER A HEAVY MEAL was sleeping
and it is replaced correctly in the web version.
Do you have any idea on how to solve this issue?
thank you very much for open-sourcing this project!
https://huggingface.co/coref/my_story
from neuralcoref.
Related Issues (20)
- Wrong average embedding during inference due to a small bug in neuracoref.pyx
- Missing implementation of doc embeddings during inference
- Wrong Mention Type one-hot vectors during training due to a small bug in dataset.py
- Training Dataset Format
- Can't install neuralcoref, keep getting this error: C:\\Program Files (x86)\\Microsoft Visual Studio\\2019\\BuildTools\\VC\\Tools\\MSVC\\14.29.30133\\bin\\HostX86\\x64\\cl.exe' failed with exit code 2 HOT 4
- Error in training without changing anything from the default instructions
- GPU support - cuda 11.1 - TypeError: Unsupported type <class 'numpy.ndarray'>
- (base) C:\Users\sk136\neuralcoref>python -m neuralcoref.train.learn --train ./data/train/ --eval ./data/dev/ facing problem while executing.. this command
- Results completely differ from web-demo
- Compatibility with Spacy 3+ HOT 7
- Regarding finetuning neuralcoref
- dels HOT 1
- neuralcoref not supporting python 3.9 version HOT 1
- spacy.strings.StringStore size changed, may indicate binary incompatibility HOT 5
- Dependency Problem HOT 1
- I can't install neuralcoref HOT 7
- Unresolved dependencies?
- Kernel crashes when trying to run demo code HOT 1
- Process finished with exit code -1073741819 (0xC0000005)
- installation failed with HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from neuralcoref.