spellcraftai / hfl Goto Github PK

hfl is a single-file static configuration pipeline tool for HF.

hfl only works with common NLP tasks & is configured with PyTorch.

This is currently experimental (WIP).

This section is incomplete.

• Basic pipelines.
• Inherited checkpoints (model & tokenizer).
• Multi-sequence tokenization.
• Training on train datasets (local & AWS SageMaker).
• Deploying fine-tuned models (push_to_hub).
• Localized metrics from test sets.
• Specifying custom preprocessor scripts.
• Integration with custom training loops.

Target a global pip installation to this repository.

You can either make create_env_win_cmd or if you require to change the execution policy then make create_env_win_pow followed by the relevant load target.

This section is incomplete.