nayeon7lee / bert-summarization Goto Github PK

Bert uses word piece embedding which covers almost any text data. Why did the concept of OOV come here?

In the train_one_batch function, you call the self.generate_refinement_output.
This function has torch.no_grad() in side. Does that mean you do not track gradients during training?

Sorry, but i do not understand how to get news_data_reader.py file. Can you help me?

I was wondering if you could reproduce the paper's results with your implementation.

Is it possible for you to share your results ?

when i use python3,how could i deal with this problem?

Where is your news_data_reader.py?
Thank you~

When config.test is True, this part will be invoked.
However, the Transformer is not defined or imported, this is very confusing.
Besides, the data_loader_test is not defined, I this it should have been test_dl given the context.

I'm running your code on Colab's GPU, but the training is very slow, even using your debug configuration :

Any tip to run the training under 12h ?

Update

I have the same problem with my local GPU (using the same debug config as you). I'm using CNN Dailymail dataset.

Any thoughts on that @nayeon7lee ?