Comments (2)
ipty
commented on August 28, 2024
1
you can change the settings in /app/config.tsx
https://github.com/developersdigest/llm-answer-engine/blob/main/app/config.tsx
line 12: embeddingsModel
hope it helps
erik
from llm-answer-engine.
developersdigest
commented on August 28, 2024
thanks for the rely @ipty , @AltayYuzeir I can confirm that nomic and local embeddings do work. If you are going to use local embedding models while also using a local chat completions, time-to-first-token can increase considerably depending on your machine. I recommend decreasing the values associated with the RAG process at the bottom of the config when using local inference. cheers!
from llm-answer-engine.
Related Issues (20)
- Can I only use GPT's API? HOT 3
- Free embedding alternative? HOT 1
- Local File Search
- nodejs error HOT 14
- Which all are the APIs for which entire web crawl will come as input or output Tokens ? HOT 1
- Hello, Im having some issues with my openai api key HOT 1
- close
- Does this work with local VectorDB data sources ? HOT 3
- how to use my own openai proxy? HOT 1
- Can it access to the whole conversation?
- How can one add their own agent and tools? HOT 3
- Open source embeddings HOT 3
- Remote Agentic AI Backend with LangServe, LangGraph consumed as RemoteRunnable in NextJS with AI/RSC HOT 2
- run on vps and domain
- UPSTASH_VECTOR_REST_TOKEN is missing Error HOT 1
- The OPENAI_API_KEY environment variable is missing or empty when deploy the project on vercel
- [feature request] export chats/searches
- searXNG
- [UpstashError]: Embedding data for this index is not allowed. The index must be created with an embedding model to use it.
- lots of errors getting this to run
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from llm-answer-engine.