[Usage]: 'InternVLChatConfig' object has no attribute 'num_attention_heads' about vllm HOT 4 OPEN

@wangdong1992 does your model have a valid config.json in the folder you are using? vLLM needs to read the config.json to know how to construct the model. Here is an example from a HF checkpoint https://huggingface.co/OpenGVLab/InternVL-Chat-V1-5/blob/main/config.json

from vllm.

@wangdong1992 does your model have a valid config.json in the folder you are using? vLLM needs to read the config.json to know how to construct the model. Here is an example from a HF checkpoint https://huggingface.co/OpenGVLab/InternVL-Chat-V1-5/blob/main/config.json
I confirmed that there is a valid config.json in my model. Does vllm support internvl 1.5 now?

from vllm.

Does vllm support InternVL-Chat-V1-5 now?

from vllm.

I also reported the same error as you

from vllm.