kanehui Goto Github PK

aarch64-explore

applegpu

Apple G13 GPU architecture docs and tools

archprobe

A profiler to disclose and quantify hardware features on GPUs.

asitop

Perf monitoring CLI tool for Apple Silicon

audiogpt

AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head

basiccuda

cformers

SoTA Transformers with C-backend for fast inference on your CPU.

dl-framework-tutorial

Create a Deep Learning Framework from scratch

gpt4-pdf-chatbot-langchain

GPT4 & LangChain Chatbot for large PDF docs

gptq-for-llama

4 bits quantization of LLaMA using GPTQ

gpu-benches

collection of benchmarks to measure basic GPU capabilities

gpumembench

A GPU benchmark suite for assessing on-chip GPU memory bandwidth

hellosilicon

An introduction to ARM64 assembly on Apple Silicon Macs

incubator-tvm

Open deep learning compiler stack for cpu, gpu and specialized accelerators

insn_bench_aarch64

Instruction latency & throughput profiler for AArch64

langchain

⚡ Building applications with LLMs through composability ⚡

llama.cpp

Port of Facebook's LLaMA model in C/C++

llm-viz

3D Visualization of an GPT-style LLM

llvm-project

The LLVM Project is a collection of modular and reusable compiler and toolchain technologies. Note: the repository does not accept github pull requests at this moment. Please submit your patches at http://reviews.llvm.org.

llvm_for_cpu0

This is a tutorial to learn LLVM, I realize a backend to compiler machine code for cpu0 which is a simple RISC cpu.

makefile_example_cuda_cpp_to_executable

Example Makefile for CUDA and C++ source files in a standard project layout.

medusa

Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

ml-compiler-opt

Infrastructure for Machine Learning Guided Optimization (MLGO) in LLVM.

mmdnn

MMdnn is a set of tools to help users inter-operate among different deep learning frameworks. E.g. model conversion and visualization. Convert models between Caffe, Keras, MXNet, Tensorflow, CNTK, PyTorch Onnx and CoreML.

mnn

MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba

moss

An open-source tool-augmented conversational language model from Fudan University

netron

Visualizer for neural network, deep learning and machine learning models

nnlib

cloned from https://source.codeaurora.org/quic/hexagon_nn/nnlib/

nvidia_sgemm_practice

Step-by-step optimization of CUDA SGEMM

os-tutorial

How to create an OS from scratch