可以支持stream吗？ about cf-openai-azure-proxy HOT 10 CLOSED

其实他是支持stream的, 只是Azure OpenAI service 会积累一段信息再返回.

你在azure试试它的playground, 结果应该和你在opencat上看到的一样

from cf-openai-azure-proxy.

根据
Chanzhaoyu/chatgpt-web#831
这个issue，Azure和OpenAI在stream模式下还是有区别的，需要在最后加一个/n结尾，
否则客户端就接受不到结束的标志，不知道Cloudflare这里能不能做相应的对应。

from cf-openai-azure-proxy.

👍 加换行符 让会话STOP 应该可以, 我明天调调看.

from cf-openai-azure-proxy.

Besides the issue with the stream answer is not ending through the proxy. I also got the issue that all answers are individual and it's not related even in the same chat session. Is this normal? Or this is because of some other reason?
https://i.imgur.com/L6RpJBn.png

from cf-openai-azure-proxy.

Support stream now, please update code and try

from cf-openai-azure-proxy.

Hi @haibbo, thank you for the update. I tested the latest code and the stream is working now. The printer effect has also been achieved, but there is one problem, the code block is no longer highlighted. Did something go wrong when parsing the data?

from cf-openai-azure-proxy.

Hi @haibbo, thank you for the update. I tested the latest code and the stream is working now. The printer effect has also been achieved, but there is one problem, the code block is no longer highlighted. Did something go wrong when parsing the data?

which client do you use?

from cf-openai-azure-proxy.

Hi @haibbo, thank you for the update. I tested the latest code and the stream is working now. The printer effect has also been achieved, but there is one problem, the code block is no longer highlighted. Did something go wrong when parsing the data?

The code block is working on my case with this client. I think you need to check on the client side.

from cf-openai-azure-proxy.

I am currently using ChatGPT Next Web and will check the client side code.

from cf-openai-azure-proxy.

Support stream now, please update code and try

非常感谢，现在在opencat体验良好，送上star

from cf-openai-azure-proxy.