Comments (4)
dosubot
commented on June 12, 2024
2
It appears there might be several factors contributing to the issue you're experiencing with the Gemini and Claude online model APIs. For the Gemini API, the problem could stem from dependencies like fastchat for conversation handling, httpx for HTTP requests, or issues with the external service itself at https://generativelanguage.googleapis.com/v1beta/models/gemini-pro:generateContent. Any downtime, rate limiting, or API changes with this external service could lead to the blocking behavior you've observed.
For the Claude online model, recent updates indicated by headers such as 'anthropic-beta' with the value 'messages-2023-12-15' suggest there have been changes that could potentially affect API behavior. Both models require specific configurations, including API keys and model names, which if not correctly set, could also cause issues.
The provided code does include logging, especially if log_verbose is set to True, which could offer more insights into the request being made and help in debugging the issue. Checking the logs for any error messages or unusual behavior during the API call could be a good starting point.
If you're still facing issues, ensuring that all configurations are correctly set according to the latest documentation and checking for any updates or known issues with the external services or dependencies could help resolve the problem.
Details
Sources
- server/model_workers/gemini.py
- server/model_workers/claude.py
- configs/server_config.py.example
- configs/model_config.py.example
About Dosu
This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.
Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.
To continue the conversation, mention @dosu.
from langchain-chatchat.
JesseXYF
commented on June 12, 2024
你是不是搭建的有什么问题，我搭建的在线模型 Gemini 还在正常使用
from langchain-chatchat.
starry-sky-domain
commented on June 12, 2024
的确还是不行。我重新拉取了代码，重新安装文档进行配置。依旧不行。经过我的排查，是在GeminiWorker那里，如果直接使用一个demo案例直接请求Gemini的话，是可以的。通过项目去请求就不行。麻烦大佬们看看，谢谢。
莫失莫忘
…------------------ 原始邮件 ------------------
发件人: "chatchat-space/Langchain-Chatchat" ***@***.***>;
发送时间: 2024年4月28日(星期天) 中午11:50
***@***.***>;
***@***.******@***.***>;
主题: Re: [chatchat-space/Langchain-Chatchat] [BUG] 简洁阐述问题 / Concise description of the issue (Issue #3907)
你是不是搭建的有什么问题，我搭建的在线模型 Gemini 还在正常使用
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you were mentioned.Message ID: ***@***.***>
from langchain-chatchat.
JesseXYF
commented on June 12, 2024
邮件已收到，谢谢。
from langchain-chatchat.
Related Issues (20)
- The request client is not a secure context and the resource is in more-private address space。特殊跨域问题如何解决。
- 求助：python startup.py -a 报错assert r.status_code == 200 AssertionError HOT 1
- 求助：如何不使用api，批量进行预测 HOT 2
- 启动startup.py,即便显卡不存在运行进程，依然显示报错：torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 134.00 MiB. GPU 0 has a total capacty of 21.99 GiB of which 119.06 MiB is free HOT 2
- [BUG] 知识库名称使用中文出现错误 HOT 1
- 0.2.10版本，知识库，不能基于上次回答的内容连续对话。
- 0.2.10版本，知识库内容拆分，指定特殊分割符，没有效果。
- 0.2.10版本，知识库对话，多个问题回答不了。
- [BUG] glm-4-9b-chat模型运行问题 HOT 9
- 自动生成测试用例
- bge-m3无法检索到内容
- 项目首页底下 微信交流群二维码失效了
- embedding 模型可以换成在线的API吗，怎么换成在线的API
- 能支持glm-4-9b-chat吗模型配置文件里面好像没有
- 大模型问答用户输入问题 冒号后面的英文被自动去除格式也错乱了
- [FEATURE] agent对话时，使用工具如何让用户确认是否执行工具呢？
- [BUG] 使用qwen-api在线模型报错ERROR: RemoteProtocolError: Caught exception: peer closed connection without sending complete message body (incomplete chunked read)
- [BUG] 容器化项目，添加文件到知识库卡住，一直running,成功上传，但是没有添加到向量库 HOT 2
- langchain agents executor throws: assert generation is not None #22585 HOT 1
- 0.2.10版本无法与Qwen2正常对话 HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from langchain-chatchat.