alexkoff88 Goto Github PK

autogptq

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

bitsandbytes

LLM.int8() paper: 8-bit CUDA functions for PyTorch

caffe

This fork of BVLC/Caffe is dedicated to improving performance of this deep learning framework when running on CPU, in particular Intel® Xeon processors (HSW+) and Intel® Xeon Phi processors

clip_benchmark

CLIP-like model evaluation

cvpr24_samples

NNCF Model Optimization examples for CPVR 2024 workshop

examples

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

gsoc2022-openvino

Development of a DL model for synthetic data generation for model optimization using OpenVINO's Post-training Optimization Toolkit.

h2o

[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.

intel_caffe_ssd

langchain

🦜🔗 Build context-aware reasoning applications

llama.cpp

Port of Facebook's LLaMA model in C/C++

lm-evaluation-harness

A framework for few-shot evaluation of autoregressive language models.

lpot

Intel® Low Precision Optimization Tool, targeting to provide a unified low precision inference interface cross different deep learning frameworks, and support auto-tune with specified accuracy criterion to find out best quantized model.

mobilenetv2_food101

Training of MobileNet v2 from Torchvision on Food-101 dataset

model_api

OpenVINO Model API

nncf_pytorch

Neural Network Compression Framework for PyTorch*

nncf_tensorrt

Experiments for NNCF quantization and inference with TensorRT

nncf_timm

NNCF scaling proposal based on the PyTorch Timm project

onnx

Open standard for machine learning interoperability

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

open_clip

An open source implementation of CLIP.

open_model_zoo

Pre-trained Deep Learning models and samples (high quality and extremely fast)

opencv-dnn-demo

Repository with samples of OpenCV DNN module usage

openvino

OpenVINO™ Toolkit - Deep Learning Deployment Toolkit repository

openvino.genai

openvino_contrib

Repository for OpenVINO's extra modules

openvino_notebooks

📚 A collection of Jupyter notebooks for learning and experimenting with OpenVINO 👓

openvino_training_extensions

Trainable models and NN optimization tools

openvino_tutorial_configs

optimum

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools