holman57 / grokfast Goto Github PK
View Code? Open in Web Editor NEWThis project forked from ironjr/grokfast
Official repository for the paper "Grokfast: Accelerated Grokking by Amplifying Slow Gradients"
Home Page: https://arxiv.org/abs/2405.20233
License: MIT License