Giter Club home page Giter Club logo

Comments (5)

songquanpeng avatar songquanpeng commented on September 24, 2024 2

已经支持了

from one-api.

songquanpeng avatar songquanpeng commented on September 24, 2024

是的,这个是之后要解决的问题,做到针对某个 key 只返回该 key 可用的模型列表。

from one-api.

ChiayenGu avatar ChiayenGu commented on September 24, 2024

是的,这个是之后要解决的问题,做到针对某个 key 只返回该 key 可用的模型列表。

您好,请问这个目前有计划解决吗?

from one-api.

GalileoFe avatar GalileoFe commented on September 24, 2024

是的,这个是之后要解决的问题,做到针对某个 key 只返回该 key 可用的模型列表。

您好,如果我提交一个有关这个功能的PR可以得到通过吗?

from one-api.

RexWzh avatar RexWzh commented on September 24, 2024

@ChiayenGu 我也想提这个问题,这块需求确实挺多的。

我看去年六月 @ckt1031 提到下边这段代码,用这个逻辑能直接得到模型列表,但比较低效暂不考虑。

channel, err = model.CacheGetRandomSatisfiedChannel(userGroup, modelRequest.Model, false)

比起调模型跑数据,调用 v1/models 的次数非常非常少,尽管低效但不影响使用。

是的,这个是之后要解决的问题,做到针对某个 key 只返回该 key 可用的模型列表。

@songquanpeng 大佬可以考虑先用简单方法填上,后续再做更加系统的处理?


补充下使用场景和原因:

  1. 基于 OneAPI 的项目需主动编写 API 手册,用户才能知道模型列表,而无法直接通过代码获取(比如 https://4.0.wokaai.com/about
  2. 个人搭建给实验室内部用,陆续将本地模型添加到 OneAPI 中,如果成员能通过 v1/models 获知支持列表会更方便
  3. 接口返回 OneAPI 支持的所有模型,这对维护者有帮助,但对使用者用处不大
  4. 有不少 Issue 也提到这个问题了:

from one-api.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.