Project is Not Completely Local Nor Private about freeaskinternet HOT 7 OPEN

actually I already complete design the whole new UI and about to complete dev. With new web UI you can set system using local running llm .

from freeaskinternet.

I apologize if our description has caused any misunderstanding. You are right that relying on an external web API, in this case, OpenAI's, negates the notion of being entirely local and private.

This project was initially conceived as a proof-of-concept or experimental endeavor, with only 3 hour coding and opensourced. The original privacy concern is mostly on search, so I using online Free GPT3.5 to make most of using can running this without fancy hardware.

I'm working diligently to improve the project and plan to introduce more configuration options in the near future. This will allow users to choose whether they want to utilize a local deployment of LLM ( like llama.cpp or ollama) for increased privacy and localization.

Thx for your remind, I'll keep update and improve this project .

from freeaskinternet.

Why not just use Flowise + Ollama? Flowise itself already has web scraping / searching ability, and Ollama can host any LLM including Mistal, Gemma, etc.

I don't see what this project is doing that those two together cannot already.

from freeaskinternet.

Yes please suppoer LLAMA and Mistral! Open models ASAP! I will not use openai because I want to seaarch anything!

from freeaskinternet.

@nashsu

Can you add a guide on running it without Docker?

from freeaskinternet.

Why not just use Flowise + Ollama? Flowise itself already has web scraping / searching ability, and Ollama can host any LLM including Mistal, Gemma, etc.

I don't see what this project is doing that those two together cannot already.

Flowise is so confusing compared to simple clean python API's ! But if you say so I will now learn FlowWise !

from freeaskinternet.

Why not just use Flowise + Ollama? Flowise itself already has web scraping / searching ability, and Ollama can host any LLM including Mistal, Gemma, etc.
I don't see what this project is doing that those two together cannot already.

Flowise is so confusing compared to simple clean python API's ! But if you say so I will now learn FlowWise !

Hm not sure, I guess an opinion. Here is the exact docs on doing a Web Scrape QnA in Flowise, just swap the ChatGPT LLM with Ollama or LocalAI and you're good:

https://docs.flowiseai.com/use-cases/web-scrape-qna

Same flow is in the 'marketplace' in Flowise, and there are videos documenting how to do it too.

from freeaskinternet.