roadwon / sllm Goto Github PK

This Repo is not for use sLLM, just Research and Developing sLLM logics

all files doesn't include model like safetensor type file or json

just only code and jupyter notebook's output results

if you try some fine-tuning in sLLM using GPU(Nvidia-A100), you can follow this 3steps.

Step 1.

load dataset and tokenizer and model

Step 2.

Arguments

Step 3.

Train