csy0225 Goto Github PK

awesome-llm-inference

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

awesomecpp

---AWESOME--- C++学习笔记和常见面试知识点，C++11特性，包括智能指针、四种强制转换、function和bind、移动语义、完美转发、tuple、多态原理、虚表、友元函数、符号重载、函数指针、深浅拷贝、struct内存对齐、volatile以及union\static等各种关键字的用法等等

benchmark

cmake-examples

Useful CMake Examples

cplusplusthings

C++那些事

deepspeedexamples

Example models using DeepSpeed

openvino

OpenVINO™ Toolkit repository

paddle

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

paddle-lite

Multi-platform high performance deep learning inference engine (『飞桨』多平台高性能深度学习预测引擎）

paddle-lite-demo

lib, demo, model, data

paddlelite-generic-demo

Paddle Lite classic demo for AI accelerators

patchelf

A small utility to modify the dynamic linker and RPATH of ELF executables

sgi-stl

剖析 STL 是一种享受的过程！

study-notes

tengine

Tengine is a lite, high performance, modular inference engine for embedded device

tensorflow

An Open Source Machine Learning Framework for Everyone

tnn

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.

work_tools