jiangshancode Goto Github PK

augmented-traffic-control

Augmented Traffic Control: A tool to simulate network conditions

awesome-mixture-of-experts-papers

A curated reading list of research in Mixture-of-Experts(MoE).

aws-cv-task2vec

Official code for the paper "Task2Vec: Task Embedding for Meta-Learning" (https://arxiv.org/abs/1902.03545, ICCV 2019)

bone-point

cloud-gaming-video-dataset

cudatutorial

A CUDA tutorial to make people learn CUDA program from 0

cutlass

CUDA Templates for Linear Algebra Subroutines

cutlass-kernels

Library of CUTLASS kernels targeting Large Language Models (LLM).

distributed-llama

Run LLMs on weak devices or make powerful devices even more powerful by distributing the workload and dividing the RAM usage.

fp6_llm

An efficient GPU support for LLM inference with 6-bit quantization (FP6).

grace

GRACE: Loss-Resilient Real-Time Video through Neural Codecs (https://www.usenix.org/system/files/nsdi24-cheng.pdf)

how_to_optimize_in_gpu

This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several basic kernel optimizations, including: elementwise, reduce, sgemv, sgemm, etc. The performance of these kernels is basically at or near the theoretical limit.

jiangshancode

MyBlog

llama.cpp

LLM inference in C/C++

llm.c

LLM training in simple, raw C/CUDA

myblogimages

MyBlogImages

nanopyc

ncnn-examples

C program of NCNN

nn-cuda-example

Several simple examples for popular neural network toolkits calling custom CUDA operators.

nnfusion

A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

simsiam

Pytorch implementation of the paper Exploring Simple Siamese Representation Learning.

triton

Development repository for the Triton language and compiler

vehicle-recognition

Vehicle recognition

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

xgboost

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow