Description to use "just text files". about electra_pytorch HOT 4 CLOSED

Yes, I just mean I won't add feature to directly train on text files without huggingface/datasets.

from electra_pytorch.

Well - I think this is the solution: https://huggingface.co/docs/datasets/loading_datasets.html#text-files

from electra_pytorch.

Hi PhilipMay

This is a repo for my personal research and there is no plan of adding feature to train or finetune on only text files.
And yes, the link you pasted is the only solution currently.

from electra_pytorch.

there is no plan of adding feature to train or finetune on only text files.

I would like to understand what you exactly mean by this. As far as I understand I could use the solution from above to load a textfile as data and continue pretraining from a stored checkpoint. Is that right?

from electra_pytorch.