Comments (11)
Hi Alex, I am afraid we can't share the output summaries because of some limitation. Please run the model and produce the outputs. Sorry for the inconvenience.
from pegasus.
Thanks for coming back to me. Just trying to do this now and I have some follow up questions:
- Is the model fine-tuned on CNN-DM available for download?
- If answer to above is no, how long does fine-tuning take?
- How do I get the model to write output summaries?
Thanks!
from pegasus.
The fine-tuned models of all 12 datasets including CNN/DM are available. Please follow the README and download.
from pegasus.
Thanks for your help so far.
I have got everything set up and am running eval on the test set. It is running slow, even with GPU. It is taking 30s per sample and this doesn't fall if I increase batch size. Is this normal?
from pegasus.
I suspect the model may actually run on CPU. Please run nvidia-smi
and check if the model uses GPU. The model should take at least 10000MB GPU memory (or whole GPU memory).
Others may be worth checking:
- CUDA 10.0
tensorflow-gpu
is installed instead oftensorflow
- Check the printout log of the model and see if anything unexpected regarding GPU.
from pegasus.
All looks to be using the GPU normally... Do you have an estimate for how long running an eval loop should take?
And the following logs on loading:
CUDA: release 10.0, V10.0.130
I have both Tensorflow and Tensorflow-gpu installed but it seems to be importing tf-gpu
from pegasus.
FYI, I used batch_size=8
and it took around 10min for 100 CNN/DM examples on a single TITAN X.
from pegasus.
Hmmm, weird how it's taking 5x as long for me as it did for you. Have had a bit of a look but nothing obvious I can see. I will have to park this now and move on.
from pegasus.
Gave this one final try on a different GPU machine and it is working much better so am closing the issue. Thanks for your help!
from pegasus.
@alexgaskell10 out of curiosity, what were the specs of the new GPU machine you tested this on? I am running into a similar issue, and it takes quite a while to run an eval loop on CNN/DM, even increasing batch_size doesn't help.
from pegasus.
So the slow version was using Azure's NC6 series (believe they are Tesla K80s) and the faster version was using GeForce GTX TITAN X. Both have 12Gb RAM. This made it much quicker but was still only half the speed Jingqing was reporting.
from pegasus.
Related Issues (20)
- how to get summary of more than 1 line? HOT 1
- ValueError: Name 'aeslc_transformer' is not registered. Registered names are .
- New Named Entities generated in summary
- Pegasus
- Max input length.
- Why is BigBird Pegasus/Pegasus Repeating the Same Sentence for Summarization? HOT 2
- delete it please
- Can anyone recommend a course or book
- Gap Sentences Generation
- Training Time HOT 1
- make it work keeping HTML tags from text
- unable to use pegasus-x checkpoints
- how does fine tuning change the original transformer language model?
- mask token id == 3 during pretraining?
- 2 HOT 1
- www.%20%20%20%20%20http.com//www.apache.org/licenses/LICENSE-2.0
- How to pre-train the pegasus language model?
- Usage as extractive summarizer
- PEGASUS-X in JAX/Flax requirements
- Version of Jax and Flax
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pegasus.