Add Session Management Feat. about redis-vl-python HOT 4 CLOSED

It's under development and should be available soon.

from redis-vl-python.

@ajac-zero work is available on this branch/PR
#141
Your feedback is welcomed.

from redis-vl-python.

Awesome! The semantic session manager is really interesting.

I noticed each exchange is expected to be a pair of strings, would this limit the use of tool messages? Due to most providers returning tool/function calls as dicts. I suppose the simplest solution would be to stringify the response dicts before storing them, although this might require additional parsing. Alternatively using json mode would work fine already if available.

Also, there are situations where a single exchange could involve more than 2 messages. Like when a llm uses tools before generating a response.

user query message -> assistant tool call message -> tool result message -> assistant response message

For cases like these it could be useful to provide the option to store messages individually to allow greater flexibility.

from redis-vl-python.

Hi @ajac-zero. The session managers do have a convenience store method to add a prompt and response texts in one call. This is meant for typical prompt->response->prompt->... chats. You can also call add_message to add messages individually in the form of dicts and these include tool call messages. Can you let us know if that meets your needs?

from redis-vl-python.