jgbrblmd Goto Github PK

alpaca_lora_4bit

chat-with-phi-3-vision

Chat with Phi-3-vision-128k-instruct

chatgpt-adapter

1.集成了openai-api、openai-web、claude for slack、bing 多款AI的API库。2.聊天接口适配到 OpenAI API 标准接口服务端。

comfyui-postto

post comfyui workflow and its dependant nodes info to bluegazing server.

comfyui-saveasscript

A powerful tool that translates ComfyUI workflows into executable Python code - now as a UI button.

exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs

fastchat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

fooocus

Focus on prompting and generating

free-one-api

ChatGPT 逆向工程接口管理 | 通过标准 OpenAI API 访问 revChatGPT / gpt4free / Bard / Claude / HuggingChat / 通义千问 等 AI 的破解版 || ChatGPT reverse engineering API management | Access all reverse engineered LLM libs by standard OpenAI API format || 免费 ChatGPT Free GPT LLM API | 逆向工程 转 OpenAI API | converts all llm libs to OpenAI API

iim-sdk

智元 IIM 是一款开源的网页版即时聊天系统, 同时拥有AI聊天对话功能, 支持ChatGPT、Midjourney、文心一言、讯飞星火、通义千问等AI助手功能

inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

llm_finetuning

Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes)

one-api

OpenAI 接口管理 & 分发系统，支持 Azure、Anthropic Claude、Google PaLM 2、智谱 ChatGLM、百度文心一言、讯飞星火认知、阿里通义千问、360 智脑以及腾讯混元，可用于二次分发管理 key，仅单可执行文件，已打包好 Docker 镜像，一键部署，开箱即用. OpenAI key management & redistribution system, using a single API for all LLMs, and features an English UI.

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

tabbyapi

An OAI compatible exllamav2 API that's both lightweight and fast

text-generation-webui

A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

tun2socks

tun2socks - powered by gVisor TCP/IP stack