Moving towards a dedicated multiplayer server implementation about koboldai-client HOT 3 OPEN

Give our new 0.16 version a spin, its not 100% multiplayer compatible so ill leave this issue open. But its the closest we can currently get. World Info still needs improvements, it does work but not if multiple people are editing it at once.

As far as your checklist goes i can make the following comments :

• Remove the TK UI, not fully implemented yet. But we do allow command line options and an official --remote mode now that removes the buttons that do not work remotely (Like the colab's do).

• Implemented, see -h for all the command line options.

• If you use --remote it will do this now, but on top of that it will also automatically generate and use a cloudflare link for easy sharing even if you are behind a firewall. Its up to the user which link they end up using, direct or randomized link.

• Not sure if this was an issue, because it did already work like that unless someone did a commit i am not aware off.

• Nothing on this front as of yet, its something i will have to keep in mind if models require this. The best way to currently do it is write things as a sentence "Jake attacks the dragon with his sword" anyone can do this replacing You with their own name. As long as one player plays the story as You so the AI understands who You is.

• Ended up being broadcast=true, but this is implemented now.

• Probably not something we will do ourselves because for 99% of people this is out of their needs and we have no interest in fronting the hosting costs while Colab can be used for free. If this is something you want to mess with for hosting and want to contribute scripts back to make it easier feel free to share with the community how to set this up properly.

• Docker works for the AMD side, for NVidia i can't test it myself.

• What options are missing?

If you want to discuss the development side of things i recommend joining the discord so you can have active conversations with the others working on the project https://discord.gg/UCyXV7NssH

from koboldai-client.

In the upcoming release that is available on my github we switched to eventlet, let me know if that meets your WSGI wish.
Because of the changes it no longer hangs during generation, so i ticked that box in advance since its confirmed to be in the next release.

from koboldai-client.

Great work! The 0.16 update added a lot of functionality I was missing.

Remove the TK UI, not fully implemented yet

The --remote works great for me, without any window system.

server process completely non-interactive

Great work on that one, manually selecting everything at every start was cumbersome.

automatically generate and use a cloudflare link

I chose to disable the Cloudflare integration, instead using my own solution. But I can see it being usable.

open the socket on the correct host
broadcast=true

This works perfectly now.

Dedicated WSGI deployment
Probably not something we will do ourselves

Fair point, the development server works great for me so I'll keep it as it is for now.

Docker works for the AMD side

Can confirm, works out of the box.

What options are missing?

• I disabled the Cloudflare integration. You could consider making the this integration optional (opt-out?), but still enabling all the other --remote features.
• Since my network ultimately serves the website under a different domain name, CORS has to be relaxed or reconfigured. You could consider adding an option to configure the cors_allowed_origins argument in the SocketIO constructor.

All in all, fantastic work!

from koboldai-client.