ValueError: Cannot use apply_chat_template() because tokenizer.chat_template is not set about transformers HOT 4 CLOSED

Yes, you're right about the cause! Rather than trying to merge a proper chat template for Blenderbot (which is very obsolete by now), I'll just rewrite the doc to use a different model.

from transformers.

@Rocketknight1 I'm getting the same error when I try to use some models like gemma. I can try to use the template parameter but not sure what the format is for gemma model (I can look it up in the tokenizer_config.json right?). Is this pretty much what we now have to do when we get this error? manually set the template? for models that dont accept "role":"system" what wwould be the work around?

from transformers.

Hi @PhilipAmadasun, the most likely cause is that you're loading the base gemma models, like gemma-2-2b, instead of the models that are "instruction tuned" for chat, like gemma-2-2b-it. The base models are just simple language models and don't support chat, and therefore don't have a chat template. If you use a model trained for chat, it should work!

from transformers.

Also @NielsRogge, fix has now been merged

from transformers.