Fanchao Chen's Projects
Github Pages template for academic personal websites, forked from mmistakes/minimal-mistakes
This repository provides an original implementation of Detecting Pretraining Data from Large Language Models by *Weijia Shi, *Anirudh Ajith, Mengzhou Xia, Yangsibo Huang, Daogao Liu , Terra Blevins , Danqi Chen , Luke Zettlemoyer.
A modified LaTex Template of Recommendation/Reference Letter for Fudan University
LLM training in simple, raw C/CUDA
Ongoing research training transformer models at scale
A crude RLHF layer on top of nanoGPT with Gumbel-Softmax trick
A resilient distributed training framework