Inferkit prompt not defined, InferKit API Error: 500 about koboldai-client HOT 4 CLOSED

Hi, thanks for the report. I just pushed a bugfix to the Git that should resolve this, you should only need to update aiserver.py. Give it a shot and let me know if it works for you.

from koboldai-client.

That fixed the prompt is undefined error, but the InferKit API Error: 500 is still happening. I think it has to do with having a large amount of world entries, or maybe world entries that are too long? I'm not seeing the error at all in a story using the exact same prompt/memory/author's note, but without world info.

from koboldai-client.

After messing around a little bit, I found that inferkit doesn't like submissions longer than 3000 characters. I made some tweaks to how the text is built and I think a better solution is to add the world info last, adding as many entries that fit in the remaining characters before the 3000 cap.

from koboldai-client.

Ah, I'm guessing I don't have a cap on the number of tokens/characters WI is allowed to inject, that would make sense. I'll look into adding it.

from koboldai-client.