Add RAG? about llamazing HOT 2 OPEN

Hi Jim.

Thank you. I tried to make a simple frontend that I would like to use (while LM Studio is more advanced, I do not like that much the looks of it at the moment). I also prefer Svelte and had to learn React in order to do this app because there are already some components for it I could use.

I have been thinking as well on adding retrieval-augmented generation, but I did not jump yet into any implementation. I incline to think that this is more of a feature Ollama should support (similar to vision).

Otherwise such an extension will require extra stuff to be installed, which is not something users may be accustomed or willing to doing.

In my view, ideally all of this would be bundled with Ollama and easily accessible via their API (eg. send "files" array in addition to "images" and, in addition, have a dedicated ingestion/management API for the files)

For me, at the moment, it's mostly a problem of bundling/distributing/standardizing the app and its requirements than coding.

Frankly, I would extend the Ollama code directly, add something like Weviate to it which I think is also written in Go and once I have the Ollama side working I would use it in a simple way in LLaMazing.

If this works, other Ollama users can benefit, not just the LLaMazing users.

Anyway, since both LLaMazing and Ollama are open source, of course you are free to try and see where this leads to :) I suggest you start by forking the project. In principle, the hook idea is good and flexible.

I am definitely interested, but at the moment still ruminating :)

from llamazing.

Cool. I hadn't considered contributing RAG support to ollama, but perhaps I should. Unfortunately, except for brief flirtation with Go 11 years ago I have no experience with it. I'm also motivate right now to do some relatively modest prototype before I take on something as ambitious as becoming an ollama contributor for a significant feature. I'll let you know if I fork this repo and add RAG via the hook interface.

from llamazing.