Comments (3)
Bot detected the issue body's language is not English, translate it automatically.
Title: [Feature Request]: Suggestions on max_tokens usage
Problem Description
The max_tokens parameter of different models is used in different ways. In some models, if the value passed in max_tokens is inappropriate, the request will be rejected or the enunciation will be interrupted. Adding additional settings of max_tokens to the visual model is due to this problem. Regarding whether max_tokens should be passed or not. There are also many issues discussed.
Solution Description
I would like to give a suggestion for this. You can set a toggle button on the front end to control whether the current conversation passes the max_tokens parameter to the model. This can appropriately reduce the hard coding work in the program when adapting to the new model, because in addition to the determination of isVisionModel, the user can directly pass max_tokens through the front-end control. I think this design can effectively reduce the conversation trouble caused by the max_tokens parameter.
Alternatives Considered
No response
Additional Context
No response
from chatgpt-next-web.
非常同意你对max_tokens的看法,目前看,max_tokens和具体模型是强关联的,因此,在新版本中,我们将会把max_tokens作为具体模型的参数,支持用户对于模型的max_tokens进行自定义
from chatgpt-next-web.
Bot detected the issue body's language is not English, translate it automatically.
I very much agree with your view on max_tokens. At present, max_tokens is strongly related to the specific model. Therefore, in the new version, we will use max_tokens as a parameter of the specific model to support users to customize the max_tokens of the model.
from chatgpt-next-web.
Related Issues (20)
- [Bug] No git or not from git repo HOT 13
- [Bug] 部署在netlify,响应流中断 HOT 2
- [Feature Request]: Support for Multiple NextChat Windows with Different Server Configurations
- [Bug] v2.12.14版本添加代理后无法访问 HOT 20
- [Feature Request]: Open API 07.09 断供会影响使用吗 HOT 3
- [Feature Request]: 云端同步 HOT 1
- [Bug] 会遇到触发finish_reason为stop的情况。 HOT 3
- 在mac图标风格统一的问题[Bug] HOT 3
- [Bug] Auto generate title doesn't work when using a mask
- [Feature Request]: Add a bookmark for a single conversation.
- [Feature Request]: 希望早日支持插件功能 HOT 1
- 请问本地部署以后怎么才能外网访问呢? HOT 3
- [Bug] 自定义api仅仅可以再localhost中使用 HOT 1
- [Bug] docker 镜像更新到latest还是提示v2.12.3,网页端还是提示升级。 HOT 3
- [Feature Request]: 可以支持huggingface吗?
- [Feature Request]: V2.12.4 之后使用claude 3.5 模型会强制走claude API,是否可以兼容Open API,可以使用中转平台的key呢。 HOT 11
- [Feature Request]: 能不能加一个”继续生成“的选项。接着前一条没有输出完整的对话继续生成。 HOT 1
- [Bug] Docker 版无法使用 DEFAULT_INPUT_TEMPLATE 参数 HOT 1
- [Bug] PR #4902 locked, unable to fix issues suggested by CodeRabbit HOT 1
- Docker部署,环境变量不生效 HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from chatgpt-next-web.