huthlab / igf Goto Github PK
View Code? Open in Web Editor NEWInformation Gain Filtration (IGF) is a method for filtering domain-specific data during language model finetuning. IGF shows significant improvements over baseline fine-tuning without data filtration.
License: MIT License