[BUG] Ollama long running generate error about unsaged HOT 5 OPEN

Is this different from #55?

from unsaged.

Yes and no, the problem in #55 was the fact that the /api/models call had a timeout. But the /api/chat call has the same problem when using Ollama. Everything longer then just a "Test" is taking to long to respond and result into the error I have described here.
The example "Why is the sky blue?" was the prompt that wasn't working here so nothing special.

from unsaged.

Have you been able to narrow down the cause of this?

from unsaged.

No not now, I will try to create a more powerfull server with a gpu, maybe that will make ollama more reliable.

from unsaged.

I just saw this, I guess it's fixed here now: #81

Please give it a try it should be working now.

from unsaged.