Comments (5)
Yep, Triton will compile LLVM 11.0 from scratch and link against it. I've been meaning to embed pre-compiled static libraries instead, but ran into some issues. I've compiled Triton successfully on all my linux machines, with GCC 7.5+.
Alternatively, you can also just install the latest wheel. pip install -U --pre triton
from triton.
I appreciate the reply. I am having a bit trouble to compile 11.0 from scratch, but I do have binary distribution of 11.0 available. Is there a way I can bypass the download and recompile, and use the existing compiler distribution? Thanks
from triton.
Replacing llvm-src by pre-compiled static libraries is actually something I've been meaning to do for a while. My current plan is to do it in ~2 weeks. The only solution I can think of would be to hack the CMakeLists.txt so that it links against LLVM without compiling it. As long as the the include_dir is there and the proper libraries are linked against triton, then it should be good
from triton.
I made some progress: I was able to compile successfully C++ interface with python module ON
, with downloaded llvm 11, the last few snippet is:
[ 96%] Built target LLVMLibDriver
[ 97%] Built target LLVMXRay
[100%] Built target triton
[100%] Built target LLVMHello_exports
[100%] Built target LLVMHello
and I have libtriton.so
in triton/build
directory. Then, I went to triton/python
directory, and hope to build out the python module: python setup.py build
, but I ran into bunch of errors, see below:
...
-- Targeting NVPTX
-- Adding Python module
--
-- Configuring done
-- Generating done
...
71%] Linking CXX static library ../../libLLVMInstrumentation.a
[ 71%] Built target LLVMInstrumentation
c++: internal compiler error: Killed (program cc1plus)
Please submit a full bug report,
with preprocessed source if appropriate.
See <https://gcc.gnu.org/bugs/> for instructions.
gmake[2]: *** [/tmp/llvm-release/llvm-build/lib/Transforms/Scalar/CMakeFiles/LLVMScalarOpts.dir/RewriteStatepointsForGC.cpp.o] Error 4
gmake[2]: *** Waiting for unfinished jobs....
c++: internal compiler error: Killed (program cc1plus)
Please submit a full bug report,
with preprocessed source if appropriate.
See <https://gcc.gnu.org/bugs/> for instructions.
gmake[2]: *** [/tmp/llvm-release/llvm-build/lib/Transforms/Scalar/CMakeFiles/LLVMScalarOpts.dir/StructurizeCFG.cpp.o] Error 4
c++: internal compiler error: Killed (program cc1plus)
Please submit a full bug report,
with preprocessed source if appropriate.
See <https://gcc.gnu.org/bugs/> for instructions.
gmake[2]: *** [/tmp/llvm-release/llvm-build/lib/Transforms/Scalar/CMakeFiles/LLVMScalarOpts.dir/SROA.cpp.o] Error 4
c++: internal compiler error: Killed (program cc1plus)
It seems this step (appearing to be building llvm again?) failed at various places, I am not sure how the build process works - if I have C++ interface with python enabled, I imagine it should be relatively straightforward process to get a python extension built, any suggestions? thanks!
Oliver
from triton.
Actually, I think I got the errors due to high cpu count and setup.py
is trying to use them all, causing severe resource contentions. Once I dial down the count, I am able to have a python build. Thanks again for your help.
from triton.
Related Issues (20)
- https://github.com/Cecil500 HOT 3
- triton cache does not invalidate cache correctly when dynamically choosing a function to call HOT 10
- Why change the order of make_block_ptr when V.dtype.element_ty == tl.float8e5?
- Print statements inside kernel print incorrect value of int64 tensors HOT 4
- batched matrix multiplication within a program HOT 2
- urllib.error.HTTPError: HTTP Error 404: Not Found HOT 1
- Question about memory coalescing HOT 1
- For small size M, like the shape M=1 K=5120 N=1792, how to improve the performance with triton? HOT 3
- github tag is not consistent with pypi version
- Calling torch.compile fails when Triton kernel arguments include triton.language.dtype HOT 1
- tl.cumsum seems emitting an internal error. HOT 1
- How to perform a store operation on a part of a Tensor? HOT 1
- Question regarding stride HOT 1
- [AMD] Undefined behavior sanitizer invalid-bool-load in optimize_epilogue.mlir HOT 5
- int8 x bfloat16 matmul tests fail on 4090s due to numerical error
- Incorrect result with threadsPerWarp of [2, 2, 8] for a thread block of [2, 2, 32] HOT 16
- M2 Mac Build from Source Failure: MLIR Configuration Error HOT 1
- RuntimeError: Triton Error [HIP]: Code: 1, Messsage: invalid argument
- StackTrace handler on python module does not allow signal to propagate. HOT 5
- Associative scan with non-scalar inputs
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from triton.