kshitizgupta21 Goto Github PK

ec2-nvidia-driver

README for installing nvidia driver on AWS EC2 Ubuntu AMI

enc_dec_triton_trtllm

Example of serving TRT-LLM optimized encoder-decoder models like T5/BART through Triton python backend

fil_triton_sagemaker

fraud-notebooks

ft_pytorch_t5

Code to benchmark FT PyTorch T5

ft_t5_demo

ft_triton_t5

Code for benchmarking FT Triton T5 model with random weights

generativeaiexamples

Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

gentrl

Generative Tensorial Reinforcement Learning (GENTRL) model

llama3_triton_trtllm

Llama-3 deployment on Triton TRT-LLM

mme-gpu-blog

moses

Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Models

nim-deploy

A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deployment.

nim_on_sagemaker

Notebook Examples for NVIDIA NIM for LLMs on Amazon SageMaker

raft_benchmark

transaction_graph_poc

triton-mme-gtc23

triton-trt-oss

Example showing Triton hosting of TensorRT HuggingFace T5 and BART models

triton_trtllm_guide

Installation and usage guide for Triton TRT-LLM

tutorials

This repository contains tutorials and examples for Triton Inference Server