Support for HIP backend / AMD GPUs about triton HOT 6 OPEN

We are in the process of upstreaming ROCm support. See the list of PRs relating to ROCm. https://github.com/openai/triton/pulls?q=is%3Apr+rocm+

For the recent PyTorch 2.0 release, we were using a fork of triton. https://github.com/ROCmSoftwarePlatform/triton/releases/tag/pytorch-triton-rocm-v2.0.1.

This v2.0.1 tag corresponds to the wheels that can be downloaded from pypi.
https://pypi.org/project/pytorch-triton-rocm/2.0.1/#files

from triton.

Since the community is quite small at this point, I can probably provide direct support for any question that you may have. Feel free to contact me at [email protected] with your e-mail address and I could invite you to our #triton slack channel :)

I will also try to add a README.md for the driver/ directory soon.

from triton.

I have thought about it. At some point in the not-so-distant past I had an AMD backend working through the AMDGPU LLVM target and the OpenCL runtime. It would be a fairly low amount of work to bring this back to life, though it would be preferrable to replace OpenCL by HIP.

I am working full-time on Triton at OpenAI, and mostly focused on A100 at the moment. That said, I would be down to spend some time reviving AMD support in the Triton compiler (though it would not support newer matrix instructions) if someone was willing to help with runtime support -- that is, updating https://github.com/ptillet/triton/tree/master/lib/driver to have hip_{buffer,module,device,etc} classes that parallel cu_{buffer,module,device,etc.}. Happy to chat more about it if this is something AMD is willing to help with :)

from triton.

cc @jeffdaily @sunway513

from triton.

Yes, we can help with that. I'll start taking a look at https://github.com/ptillet/triton/tree/master/lib/driver. Any more specifics that you'd like to share?

from triton.

Any progress on this issue? AMD HIP support would be much appreciated.

from triton.