Bug Deion Chinese：使用gpt-4o模型发送信息会显示：<br

[Bug] 使用gpt-4o模型时会出现错误 about chatgpt-next-web HOT 5 CLOSED

Dreamry2C commented on June 19, 2024

[Bug] 使用gpt-4o模型时会出现错误

from chatgpt-next-web.

Comments (5)

SpiralTower commented on June 19, 2024 1

ChatGPT-Next-Web/app/client/platforms/openai.ts

Lines 119 to 134 in f55f04a

 const requestPayload: RequestPayload = { 

 messages, 

 stream: options.config.stream, 

 model: modelConfig.model, 

 temperature: modelConfig.temperature, 

 presence_penalty: modelConfig.presence_penalty, 

 frequency_penalty: modelConfig.frequency_penalty, 

 top_p: modelConfig.top_p, 

 // max_tokens: Math.max(modelConfig.max_tokens, 1024), 

 // Please do not ask me why not send max_tokens, no reason, this param is just shit, I dont want to explain anymore. 

 }; 

 // add max_tokens to vision model 

 if (visionModel && modelConfig.model.includes("preview")) { 

 requestPayload["max_tokens"] = Math.max(modelConfig.max_tokens, 4000); 

 }

上传的请求不包含max_tokens可能导致此问题，aiproxy.io在不包含此值的情况下可能会冻结最大参数。
aiproxy文档
我的临时解决办法是模仿L131的vision model添加一个针对4o的max_tokens。
if (modelConfig.model.includes("4o")) { requestPayload["max_tokens"] = Math.max(modelConfig.max_tokens, 4000); }

from chatgpt-next-web.

Issues-translate-bot commented on June 19, 2024 1

Bot detected the issue body's language is not English, translate it automatically.

ChatGPT-Next-Web/app/client/platforms/openai.ts

Lines 119 to 134 in f55f04a

 const requestPayload: RequestPayload = { 

 messages, 

 stream: options.config.stream, 

 model: modelConfig.model, 

 temperature: modelConfig.temperature, 

 presence_penalty: modelConfig.presence_penalty, 

 frequency_penalty: modelConfig.frequency_penalty, 

 top_p: modelConfig.top_p, 

 // max_tokens: Math.max(modelConfig.max_tokens, 1024), 

 // Please do not ask me why not send max_tokens, no reason, this param is just shit, I dont want to explain anymore. 

 }; 

 // add max_tokens to vision model 

 if (visionModel && modelConfig.model.includes("preview")) { 

 requestPayload["max_tokens"] = Math.max(modelConfig.max_tokens, 4000); 

 }

Uploading requests not containing max_tokens may cause this issue, aiproxy.io may freeze the max parameters without including this value https://docs.aiproxy.io/guide/deduction.
My temporary solution is to imitate the vision model of L131 and add a max_tokens for 4o.
if (modelConfig.model.includes("4o")) { requestPayload["max_tokens"] = Math.max(modelConfig.max_tokens, 4000); }

from chatgpt-next-web.

Issues-translate-bot commented on June 19, 2024

Bot detected the issue body's language is not English, translate it automatically.

Title: [Bug] An error occurs when using the gpt-4o model

from chatgpt-next-web.

Dean-YZG commented on June 19, 2024

感谢反馈！max_tokens应该是与具体模型绑定在一起的参数，我们也意识到了这个问题，并将在下个大版本中提供给用户自定义模型的能力，支持自定义每个模型的max_tokens，但是，在目前这个版本上我们不打算修改回早期时在chat接口中传递max_tokens参数，原因是，对于大模型来说，这个参数是非必传参数，传递了这个参数返回会限制和影响很多大模型返回新消息的准确性和完整性

from chatgpt-next-web.

Issues-translate-bot commented on June 19, 2024

Bot detected the issue body's language is not English, translate it automatically.

Thanks for the feedback! max_tokens should be a parameter bound to a specific model. We are also aware of this problem and will provide users with the ability to customize models in the next major version, supporting the customization of max_tokens for each model. However, at present, this In terms of version, we do not plan to change back to the early days of passing the max_tokens parameter in the chat interface. The reason is that for large models, this parameter is a mandatory parameter. Passing this parameter will limit and affect the accuracy of new messages returned by many large models. sex and integrity

from chatgpt-next-web.

[Bug] 使用gpt-4o模型时会出现错误 about chatgpt-next-web HOT 5 CLOSED

Comments (5)

Related Issues (20)

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent

	const requestPayload: RequestPayload = {
	messages,
	stream: options.config.stream,
	model: modelConfig.model,
	temperature: modelConfig.temperature,
	presence_penalty: modelConfig.presence_penalty,
	frequency_penalty: modelConfig.frequency_penalty,
	top_p: modelConfig.top_p,
	// max_tokens: Math.max(modelConfig.max_tokens, 1024),
	// Please do not ask me why not send max_tokens, no reason, this param is just shit, I dont want to explain anymore.
	};

	// add max_tokens to vision model
	if (visionModel && modelConfig.model.includes("preview")) {
	requestPayload["max_tokens"] = Math.max(modelConfig.max_tokens, 4000);
	}