[Question] Getting the model after one epoch is too long. Is there any way to save the model in between 1 epoch? about llava HOT 4 OPEN

go for
--save_strategy "steps"
--save_steps .2
--save_total_limit 1
if decimal it will save at 20% of total steps , save_total_limit will make ensure only running loss weights are saved , int his way u can save intemediate, try this this works for me

from llava.

--save_strategy "epoch"
--save_steps .3 \

from llava.

@Jayantverma2
Thank you for your response.
But in my fine_tune_task_lora.sh

--save_strategy "steps" \
--save_steps 50000 \
--save_total_limit 1 \

to

--save_strategy "epoch" \
--save_steps .3 \
--save_total_limit 3 \

and It didn't save while the training was still in progress, but after the training was over, the checkpoints were split and saved.

Is there any way to get it to save while the lesson is in progress?

from llava.

from llava.eval.run_llava import eval_model
from llava.mm_utils import get_model_name_from_path

args = type('Args', (), {
    "model_path": model_path,
    "model_base": model_base,
    "model_name": get_model_name_from_path(model_path),
    "query": prompt,
    "conv_mode": None,
    "image_file": image_file,
    "sep": ",",
    "temperature": 0,
    "top_p": None,
    "num_beams": 1,
    "max_new_tokens": 512
})()

inference = eval_model(args)

OSError: llava-v1.5-7b-task-lora-13/checkpoint-6 does not appear to have a file named config.json. Checkout 'https://huggingface.co//llava-v1.5-7b-task-lora-13/checkpoint-6/main' for available files.

I tried to fix the problem by roughly copying the "config.json", but the "non_lora_trainables.bin" file is not in the folder, so I get the another error

HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name':

@Jayantverma2 Sorry.

I am getting an error when running the inference with the above code because the "config.json" and "non_lora_trainables.bin" file is not saved in the checkpoint folder saved with the above settings.

My purpose is to inference with checkpoints saved during training

Does anyone know how to fix this issue?

from llava.