[Question] How to use the pretrain checkpoint about llava HOT 3 OPEN

I have the same question...

from llava.

You can use the load_pretrained_model function. Check here.

You need to:

1. pass a model-base argument, which is the base language model you used for your llava model.
2. pass a model-path argument, which is where your pretrained weights' folder is.

This way, you can load the pretrained weight into a base llava model.

from llava.

Is it possible to use the pretrained checkpoints with SGLang?

from llava.