Giter Club home page Giter Club logo

[Bug]: Although the model working, got below error, "autogen.oai.client: 06-16 16:42:50] {294} WARNING - Model ollama_chat/llama3 is not found. The cost will be 0. In your config_list, add field {"price" : [prompt_price_per_1k, completion_token_price_per_1k]} for customized pricing." about autogen HOT 4 CLOSED

inoue0426 avatar inoue0426 commented on August 21, 2024 1
[Bug]: Although the model working, got below error, "autogen.oai.client: 06-16 16:42:50] {294} WARNING - Model ollama_chat/llama3 is not found. The cost will be 0. In your config_list, add field {"price" : [prompt_price_per_1k, completion_token_price_per_1k]} for customized pricing."

from autogen.

Comments (4)

qingyun-wu avatar qingyun-wu commented on August 21, 2024 1

@qingyun-wu Thank you for your information! Got it!

@inoue0426 You are welcome. If you haven't done so, you are welcome to directly ask questions on our Discord server: https://discord.com/invite/Yb5gwGVkE5

from autogen.

inoue0426 avatar inoue0426 commented on August 21, 2024

If I set the price, the warning is removed.
I don't know why...

llm_config = {
    "config_list": [
        {
            "model": "NA",  # NotRequired, Loaded with LiteLLM command
            "api_key": "NA",  # NotRequired, Not needed
            "base_url": "http://0.0.0.0:4000",  # Your LiteLLM URL
            "price": [0, 0]
        }
    ],
    "cache_seed": None,  # Turns off caching, useful for testing different models
}

from autogen.

qingyun-wu avatar qingyun-wu commented on August 21, 2024

Hi @inoue0426, thank you for asking the question. AutoGen has the price information for some commonly used models, such as GPT models, and uses this information to estimate the cost for you. If the model you provided is not among them, a warning will be issued. However, if you provide the price information, AutoGen will use that to calculate the cost and will not show the warning.

And closing this issue as I guess it is not a bug. You can re-open it if you still have questions. Thank you!

from autogen.

inoue0426 avatar inoue0426 commented on August 21, 2024

@qingyun-wu Thank you for your information! Got it!

from autogen.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.