Bug: The elements of the batch contain different keys. Cannot batch them ... about transformers HOT 2 OPEN

cc @ylacombe

from transformers.

Hello I found the root of the problem:

I used atransformers pipelinewith a WhisperForConditionalGeneration model and explicitly set the batch_size parameter.
However when you set the batch_size parameter without settingchunk_length_sthis error occurs. After setting chunk_length_s to some value the error did not appear anymore.

I thinks this should not be the case right? From what I understood not using the chunk_length_s parameter should result in using default sequential batching: https://huggingface.co/blog/asr-chunking

Or is this only true for the ASR pipeline? Should I use that instead of the vanilla pipeline or isnt ASR inferred by the model type anyway?

from transformers.