Matmul example (error: tile with more than one element cannot be casted to scalar) about triton HOT 4 CLOSED

Sorry for the delayed answer, I've been quite busy and missed this. The documentation is not up to date, so I will fix this, let you know and update it!

from triton.

The correct use of matrix multiplication is indeed @. The other issue is that the kernel is designed for row-major matrices, but the values of lda are assuming column-major ordering.

Changing to:

lda = K
ldb = N
ldc = N

Seems to solve the issue. I would also use torch.allclose() for comparing two FP32 tensors as torch may not do the FMA in the same order as the Triton kernel.

from triton.

AH thank you I don't know why I didn't consider that the kernel was assuming row-major accesses.

I think I understand everything now, so if you'd like I'd be happy to run through the documentation and make sure the example kernels are compilable/working.

Thanks again!

from triton.

Yes, that would be very cool! Another thing is that triton.empty and triton.shape are no longer necessary. One can simply use torch.empty

from triton.