A small vector API service for generating quantized instructor-large vectors. This is used in various other projects under my github repos
pip install -r requirements.txt
or
pip3 install -r requirements.txt
uvicorn main:app --host 0.0.0.0 --port 3005
or using python3
python3 -m uvicorn main:app --host 0.0.0.0 --port 3005
Warning: The first run will be VERY slow to load
Visit http://localhost:3005/docs in a browser once it's loaded
Call it in python like this:
# Function to call the text embedder
def embed(text):
response = requests.get(embedder["embedding_endpoint"], params={"text":text, "instruction": "Represent this text for retrieval:" }, headers={"accept": "application/json"})
vector_embedding = response.json()
return vector_embedding
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent