Giter Club home page Giter Club logo

Comments (9)

JamesFlare1212 avatar JamesFlare1212 commented on September 25, 2024 2

groq的API兼容openai格式,渠道API地址写 https://api.groq.com/openai 即可

from one-api.

jiz4oh avatar jiz4oh commented on September 25, 2024 1
image

@KrabsWong 像这样即可,在使用的时候在对应的客户端填入 custom model name mixtral-8x7b-32768

from one-api.

jtsang4 avatar jtsang4 commented on September 25, 2024

groq的API兼容openai格式,渠道API地址写 https://api.groq.com/openai 即可

👍 确实可以用,估记我昨天测试的时候填错了

from one-api.

KrabsWong avatar KrabsWong commented on September 25, 2024

groq的API兼容openai格式,渠道API地址写 https://api.groq.com/openai 即可

请问是选择自定义渠道然后设置 baseUrl 为 https://api.grpq.com/openai 吗?
我试了下这个方案,测试接口提示

错误:status code 404: The model gpt-3.5-turbo does not exist or you do not have access to it.

也尝试了直接选择 openai 的渠道类型,然后代理地址设置为 https://api.groq.com/openai 也是报一样错误。
是不是那里设置不太对呀?

from one-api.

jtsang4 avatar jtsang4 commented on September 25, 2024

groq的API兼容openai格式,渠道API地址写 https://api.groq.com/openai 即可

请问是选择自定义渠道然后设置 baseUrl 为 https://api.grpq.com/openai 吗? 我试了下这个方案,测试接口提示

错误:status code 404: The model gpt-3.5-turbo does not exist or you do not have access to it.

也尝试了直接选择 openai 的渠道类型,然后代理地址设置为 https://api.groq.com/openai 也是报一样错误。 是不是那里设置不太对呀?

你需要配置模型为 mixtral-8x7b-32768llama2-70b-4096

from one-api.

KrabsWong avatar KrabsWong commented on September 25, 2024

groq的API兼容openai格式,渠道API地址写 https://api.groq.com/openai 即可

请问是选择自定义渠道然后设置 baseUrl 为 https://api.grpq.com/openai 吗? 我试了下这个方案,测试接口提示

错误:status code 404: The model gpt-3.5-turbo does not exist or you do not have access to it.

也尝试了直接选择 openai 的渠道类型,然后代理地址设置为 https://api.groq.com/openai 也是报一样错误。 是不是那里设置不太对呀?

你需要配置模型为 mixtral-8x7b-32768llama2-70b-4096

对的,配置了这个模型。下面截图是尝试的两种方式的配置。
image

image

from one-api.

KrabsWong avatar KrabsWong commented on September 25, 2024
image @KrabsWong 像这样即可,在使用的时候在对应的客户端填入 custom model name `mixtral-8x7b-32768`

明白了,感谢

from one-api.

yonmnm avatar yonmnm commented on September 25, 2024
image @KrabsWong 像这样即可,在使用的时候在对应的客户端填入 custom model name `mixtral-8x7b-32768`

@jiz4oh 使用第三方客户端,出现这样的错误:(直接填写Groq的key到客户端就能正常使用)
"error": {
"message": "tools is not supported with this model (request id: 2024030808155972780750603165139)",
"type": "invalid_request_error",
"param": "",
"code": null

from one-api.

ImYrS avatar ImYrS commented on September 25, 2024

@jiz4oh 使用第三方客户端,出现这样的错误:(直接填写Groq的key到客户端就能正常使用) "error": { "message": "tools is not supported with this model (request id: 2024030808155972780750603165139)", "type": "invalid_request_error", "param": "", "code": null

Groq 使用的 mixtral 和 llama2 不支持插件调用

from one-api.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.