Comments (6)
We are in the process of upstreaming ROCm support. See the list of PRs relating to ROCm. https://github.com/openai/triton/pulls?q=is%3Apr+rocm+
For the recent PyTorch 2.0 release, we were using a fork of triton. https://github.com/ROCmSoftwarePlatform/triton/releases/tag/pytorch-triton-rocm-v2.0.1.
This v2.0.1 tag corresponds to the wheels that can be downloaded from pypi.
https://pypi.org/project/pytorch-triton-rocm/2.0.1/#files
from triton.
Since the community is quite small at this point, I can probably provide direct support for any question that you may have. Feel free to contact me at [email protected] with your e-mail address and I could invite you to our #triton slack channel :)
I will also try to add a README.md for the driver/ directory soon.
from triton.
I have thought about it. At some point in the not-so-distant past I had an AMD backend working through the AMDGPU LLVM target and the OpenCL runtime. It would be a fairly low amount of work to bring this back to life, though it would be preferrable to replace OpenCL by HIP.
I am working full-time on Triton at OpenAI, and mostly focused on A100 at the moment. That said, I would be down to spend some time reviving AMD support in the Triton compiler (though it would not support newer matrix instructions) if someone was willing to help with runtime support -- that is, updating https://github.com/ptillet/triton/tree/master/lib/driver to have hip_{buffer,module,device,etc} classes that parallel cu_{buffer,module,device,etc.}. Happy to chat more about it if this is something AMD is willing to help with :)
from triton.
from triton.
Yes, we can help with that. I'll start taking a look at https://github.com/ptillet/triton/tree/master/lib/driver. Any more specifics that you'd like to share?
from triton.
Any progress on this issue? AMD HIP support would be much appreciated.
from triton.
Related Issues (20)
- Trivial outputs on MacOS using TRITON_INTERPRET=1 HOT 7
- 导入default_dump_dir报错
- What is the use of calling `propagateIfChanged` in `ConstantAnalysis::visit`
- Flash Attention benchmarks fail on AMD Instinct MI210 (`gfx90a`) HOT 2
- [OPS] AttributeError: module 'triton.language.math' has no attribute 'round' HOT 3
- Why is the documentation not versioned like other Read The Docs sites?
- Core dumped without "os.environ["TRITON_INTERPRET"] = "1"
- torch 2.4.0 requires triton==3.0.0; HOT 7
- Triton trying to download llvm even if self built, and build failed
- Seems mistake in setup.py HOT 1
- bfloat16 of fused attention seems have bug HOT 2
- Possible to use WMMA `.b1` instructions? HOT 1
- AttributeError("'AnnAssign' object has no attribute 'targets'") HOT 1
- [Bug] Compiler error in 06-fused-attention.py
- Fused Attention FP8 correctness on L20(Ada GPU) HOT 1
- What impact does changing the kernel shape's divisibility value have?
- Does Triton have a roadmap plan? HOT 1
- FP8 Casting Tensor Size Alignment Error on AMD MI210 HOT 1
- Output dtype of 09-persistent-matmul.py
- Worse performance on `H100` than `RTX3090`
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from triton.