Comments (2)
wangxinyu0922
commented on June 7, 2024
Hi, I want to reproduce the NER score reported in BERT paper as well. Did you use the document level context for the NER model? How did you split the document context (Based on -DOCSTART- in the dataset?)? Could you provide some detailed hyperparamters or training script for me?
By the way, I got the same score as the original dataset with the converted dataset with truecase
from bert-ner.
ghaddarAbs
commented on June 7, 2024
@wangxinyu0922 the experiments above are for fine-tuning
I fed the examples at the sentence level, didn't concatenate the sentences to form a document.
these are the main HP game-changer in my experiments:
"very small learning rate (5e-6) \ large batch size (128) \ high epoch num (>40)"
from bert-ner.
Related Issues (20)
- How to convert all cpp,header files to DLL file? HOT 1
- Error index out of range in self when trying to predict for text of close to 5000 characters HOT 1
- how convert bin to two part model? HOT 1
- How to predict on test dataset after training? HOT 1
- What is the data your model trained on? HOT 2
- small error in the source code HOT 1
- Detokenizing the words HOT 1
- KeyError: '' HOT 1
- How can i make fine tuning with new entities/labels? HOT 1
- CUDA Runtime Error: Which Cuda version is compatible to run NER task using BERT-NER
- Key error 0 on evaluation set HOT 1
- RuntimeError : during model.predict() HOT 1
- Train your own model (colab)
- Pre-processing steps
- After training and saved the models, I got a valid accuracy, while got an error(bad) result based on loading the saved model. HOT 1
- How to show only the keywords in inference?
- How can i use this project in Chinese NER? HOT 1
- Understanding the Evaluation Code HOT 1
- Model training does not work on CPU HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bert-ner.