Comments (2)
Hi, thanks for working with our repo! please find the numerical results of CoFi on Roberta here. Unfortunately, we ran minimal experiments with Roberta at the time and could not provide more results.
from cofipruning.
Thanks for your reply! This really helps a lot.
from cofipruning.
Related Issues (20)
- Maybe confusing description of the distillation constraint HOT 1
- training error about qnli HOT 4
- How to prune the model from the very begigning? HOT 4
- Experimental results HOT 2
- How to get the loss of `lagrangian_regularization` HOT 5
- Where can i see the detail of distillation?
- Error in finetune with pruned model--AttributeError: 'NoneType' object has no attribute 'forward'` HOT 3
- layer-distillation: teacher layer sets selection? HOT 4
- Removing the already-pruned parts in the model may cause some changes in the outputs HOT 3
- Generating predictions with CoFi models HOT 2
- An issue when reproducing the efficiency evaluation HOT 1
- Discrepancy between my evaluation results and README for MNLI in evaluation.py HOT 4
- What's the model I should prepare and the training process? HOT 3
- Something wrong with run_FT.sh and data_dir
- problem of loading from_pretrained('princeton-nlp/CoFi-XXX') HOT 2
- [Typo]: argument names in run_qa_prune.py seems not updated HOT 1
- The pre-request and training process HOT 2
- Performance reproduction
- Is this method applicable to LLAMA? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cofipruning.