bryan-pakulski / litty-llm Goto Github PK
View Code? Open in Web Editor NEWThis project is build off of the lit-llama project found here: https://github.com/Lightning-AI/lit-llama The main functionality improvment is encapsulating the LLAMA into a docker container with a client / server message queue for interaction.