nhatkhangcs / hlb-gpt Goto Github PK
View Code? Open in Web Editor NEWThis project forked from tysam-code/hlb-gpt
Minimalistic, fast, and experimentation-friendly researcher's toolbench for GPT-like models in <350 lines of code. Reaches <3.8 validation loss on wikitext-103 on a single A100 in just over 6 minutes.
License: Apache License 2.0