TypeError: Cannot convert a MPS Tensor to float64 dtype as the MPS framework doesn't support float64. Please use float32 instead. about transformers HOT 3 CLOSED

cc @qubvel if you have bandwidth to give it a look

from transformers.

Hi @byrkbrk thank you for the issue!

It seems like you can just remove the line with the torch.float64 casting and reinstall the modified repo (in case you need a quick fix).

See #31071

from transformers.

Hello @qubvel,

Casting to torch.float32 rather than torch.float64 solves the problem indeed, thanks.
However, such forcefully casting can have some side effects; that is, it changes the type regardless of the value of the argument torch_dtype passed to pipeline object.
Anyhow, it is not in the scope of the current issue.

from transformers.