Comments (5)
SirlyDreamer
commented on September 22, 2024
官方文档：https://huggingface.co/docs/text-generation-inference/quicktour
from one-api.
RexWzh
commented on September 22, 2024
TGI 文档：https://huggingface.co/docs/text-generation-inference/messages_api
这里提到支持 OpenAI 了：
Text Generation Inference (TGI) now supports the Messages API, which is fully compatible with the OpenAI Chat Completion API. This feature is available starting from version 1.4.0. You can use OpenAI’s client libraries or third-party libraries expecting OpenAI schema to interact with TGI’s Messages API. Below are some examples of how to utilize this compatibility.
Note: The Messages API is supported from TGI version 1.4.0 and above. Ensure you are using a compatible version to access this feature.
from one-api.
SirlyDreamer
commented on September 22, 2024
I will close this issue.
from one-api.
ENg-122
commented on September 22, 2024
one-api好像还不能支持连接Huggingface TGI 推理框架 API吧？
from one-api.
USTCcgg
commented on September 22, 2024
one-api好像还不能支持连接Huggingface TGI 推理框架 API吧？
一样的问题，发现one-api不支持TGI
from one-api.
Related Issues (20)
- Unreasonable cogview-3 prompt length limit
- Ollama填写地址成功调用后，但是仍出现404现象 HOT 1
- 是不是目前只能支持langchain的chat模式，llm模型不支持呢
- 建议增加更多运营功能
- 请求接入dify知识库 HOT 5
- 希望增加新的知识库 MaxKB
- docker.io 不能访问 HOT 3
- [开源合作] 请求添加VChart引用 HOT 3
- 对接本地模型的openai接口，stream模式下没有返回 HOT 12
- 关于将本项目转成组织项目的想法 HOT 17
- 关于项目镜像完善建议
- 调用讯飞星火Spark Pro/Max Function Call 不能按预期返回 Function Call 形式的结果，只会返回普通对话形式的结果
- 隔离网环境oneapi代理功能无法使用
- gpt-4o计价存在问题 HOT 8
- docker版启动后，可能得等一阵子才能用api HOT 3
- 对于报错传递给上游的转发客户端“xx无可用渠道”应该进行禁用 HOT 1
- minimax模型不能正确记录log HOT 2
- cloudflare Workers AI 文本生成图像模型支持 HOT 4
- LM Studio API, Open Web UI API
- oneapi报错 HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from one-api.