Comments (5)
Oh, the triton-ops branch is not merged in yet. I will remove the C++ tests when I merge it into master and move all the tests/benchmarks to pytest :)
from triton.
Oh, the triton-ops branch is not merged in yet. I will remove the C++ tests when I merge it into master and move all the tests/benchmarks to pytest :)
Sometimes, We need to call operator in c++. So I suggest to keep the operator defines in c file. and parse them in python.
from triton.
I think you are right. My goal eventually is to have a .c file for each triton op defined in Python. I think right now there is an issue that prevents from having multiple kernels in the same .c file, but I will fix that.
PS: I have created a Slack workspace for Triton by the way. Feel free to e-mail me at [email protected] if you want an invite.
from triton.
I write a method, you can reference it.
from triton.
Thanks for your comment and suggestion. Everything is now more modular and includes .c file for the kernels in the python tree. It is also now possible to select by name which kernel to read from the source file as shown here https://github.com/ptillet/triton/blob/master/python/triton/ops/blocksparse/softmax.py . This is done in the C++ binding here https://github.com/ptillet/triton/blob/master/python/src/bindings.cc#L119 .
Closing the issue for now, but feel free to reopen if you have any related comment
from triton.
Related Issues (20)
- https://github.com/Cecil500 HOT 3
- triton cache does not invalidate cache correctly when dynamically choosing a function to call HOT 10
- Why change the order of make_block_ptr when V.dtype.element_ty == tl.float8e5?
- Print statements inside kernel print incorrect value of int64 tensors HOT 4
- batched matrix multiplication within a program HOT 2
- urllib.error.HTTPError: HTTP Error 404: Not Found HOT 1
- Question about memory coalescing HOT 1
- For small size M, like the shape M=1 K=5120 N=1792, how to improve the performance with triton? HOT 3
- github tag is not consistent with pypi version
- Calling torch.compile fails when Triton kernel arguments include triton.language.dtype HOT 1
- tl.cumsum seems emitting an internal error. HOT 1
- How to perform a store operation on a part of a Tensor? HOT 1
- Question regarding stride HOT 1
- [AMD] Undefined behavior sanitizer invalid-bool-load in optimize_epilogue.mlir HOT 5
- int8 x bfloat16 matmul tests fail on 4090s due to numerical error
- Incorrect result with threadsPerWarp of [2, 2, 8] for a thread block of [2, 2, 32] HOT 16
- M2 Mac Build from Source Failure: MLIR Configuration Error HOT 1
- RuntimeError: Triton Error [HIP]: Code: 1, Messsage: invalid argument HOT 2
- StackTrace handler on python module does not allow signal to propagate. HOT 5
- Associative scan with non-scalar inputs
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from triton.