Comments (4)
done
from litellm.
if somebody used us assuming we'd return a stream (generator object i believe) and we returned a dict, we'd break in code for them.
from litellm.
Does this need a separate model flag, e.g., supports_streaming = True
, to distinguish?
from litellm.
Not really - we already have a customstreamwrapper, we can just add this as default logic and send all model results there if stream=true
from litellm.
Related Issues (20)
- [Bug]: I get error litellm' has no attribute 'validate_environment' HOT 3
- [Feature]: NVIDIA NIM provider HOT 2
- [Feature]: Track costs for each chat completion choice (n>1) HOT 1
- [Feature]: Allow list of string in mock_response HOT 4
- [Feature]: Support `include_usage` for bedrock HOT 4
- [Bug]: Streaming broken for Gemini? HOT 1
- [Bug]: UnboundLocalError: cannot access local variable 'exception_provider' HOT 3
- [Bug]: Custom template prompt for Bedrock
- [Bug]: Discrepancy between `tool_choice="required"/"any"` prevents me from using the proxy HOT 11
- [Bug]: Azure OpenAI attempts to reuse Azure AD token after it expires HOT 2
- [Bug]: LiteLLM Proxy Traceparent header is not forwarded to backends HOT 7
- [Feature]: Support Vertex Imagen2 HOT 1
- How to pass access token/authorization key to run ollama through litellm
- [Bug]: Azure, OpenAI Proxy embeddings not using OpenAI client initialized on litellm.Router
- [Bug]: Stream requests failing for openai compatible endpoints. HOT 1
- [Feature]: Add codestral pricing to litellm model cost map HOT 1
- [Bug]: Amazon Bedrock Llama3 throws exception HOT 1
- [Bug]: Completion tokens are incorrectly calculated HOT 1
- [Bug]: Overly strict validation of chunks results in missing tool name HOT 1
- [Bug]: Giving Gemini an image whose URL does not end with an extension causes a 500 error HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from litellm.