facebookincubator / aitemplate Goto Github PK
View Code? Open in Web Editor NEWAITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.
License: Apache License 2.0