ht-zhou Goto Github PK

ai_lib

awesome-auto-parallelism

A baseline repository of Auto-Parallelism in Training Neural Networks

awesome-rlhf

collecting RLHF papers

best-readme-template

An awesome README template to jumpstart your projects!

binary-bert

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

binary-quantization-meta

Code repo for the paper BiT Robustly Binarized Multi-distilled Transformer

bitsandbytes

8-bit CUDA functions for PyTorch

colobloom

colossalai

Colossal-AI: A Unified Deep Learning System for Big Model Era

colossalai-bloom

colossalai-examples

Examples of training models with hybrid parallelism using ColossalAI

deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch

energonai

Large-scale model inference.

fq-vit

[IJCAI 2022] FQ-ViT: Post-Training Quantization for Fully Quantized Vision Transformer

ht-zhou

ht-zhou.github.io

Github Pages template for academic personal websites, forked from mmistakes/minimal-mistakes

infiagent.github.io

InfiAgent website

int8tp

irsend_fpga

IRsend && Bluetooth Connecting on FPGA

leecode

lightllm

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

lightseq

LightSeq: A High Performance Library for Sequence Processing and Generation

mnn

MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba

model-quantization

A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.

nonuniform-to-uniform-quantization

Nonuniform-to-Uniform Quantization: Towards Accurate Quantization via Generalized Straight-Through Estimation. In CVPR 2022.

parallelformers

Parallelformers: An Efficient Model Parallelization Toolkit for Deployment

prm800k

800,000 step-level correctness labels on LLM solutions to MATH problems

smoothquant

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

stable-baselines3

PyTorch version of Stable Baselines, reliable implementations of reinforcement learning algorithms.