A unified platform to build apps with AI.
- Supported AI Providers:
- Conversation Controls
- Token Management + Limits
- Simple RAG
go get github.com/ztkent/ai-util
client, _ := aiutil.NewAIClient("openai", "gpt-3.5-turbo", 0.5)
conversation := aiutil.NewConversation("You are an example assistant.", 100000, true)
response, _ := client.SendCompletionRequest(CtxWithTimeout, conversation, "Say hello!")
| Service |
Environment Variable |
| OpenAI |
OPENAI_API_KEY |
| Anyscale |
ANYSCALE_ENDPOINT_TOKEN |
| Replicate |
REPLICATE_API_TOKEN |
| Model Name |
Model Identifier |
Cost (IN/OUT per 1M tokens) |
| GPT-3.5 Turbo |
gpt-3.5-turbo |
$0.50 / $1.50 |
| GPT-4 |
gpt-4 |
$30.00 / $60.00 |
| GPT-4 Turbo |
gpt-4-turbo |
$10.00 / $30.00 |
| Model Name |
Model Identifier |
Cost (IN/OUT per 1M tokens) |
| Meta Llama 2-13b Chat |
meta-llama/Llama-2-13b-chat-hf |
$0.25 / $0.25 |
| Meta Llama 2-70b Chat |
meta-llama/Llama-2-70b-chat-hf |
$1.00 / $1.00 |
| Meta Llama 3-8b Chat |
meta-llama/Llama-3-8b-chat-hf |
$0.15 / $0.15 |
| Meta Llama 3-70b Chat |
meta-llama/Llama-3-70b-chat-hf |
$1.00 / $1.00 |
| Mistral 7B Instruct |
mistralai/Mistral-7B-Instruct-v0.1 |
$0.15 / $0.15 |
| Mixtral 8x7B Instruct |
mistralai/Mixtral-8x7B-Instruct-v0.1 |
$0.50 / $0.50 |
| Code Llama 70b |
codellama/CodeLlama-70b-Instruct-hf |
$1.00 / $1.00 |
| Model Name |
Model Identifier |
Cost (IN/OUT per 1M tokens) |
| Meta Llama 2-70b |
meta/llama-2-70b |
$0.65 / $2.75 |
| Meta Llama 2-13b |
meta/llama-2-13b |
$0.10 / $0.50 |
| Meta Llama 2-7b |
meta/llama-2-7b |
$0.05 / $0.25 |
| Meta Llama 2-13b Chat |
meta/llama-2-13b-chat |
$0.10 / $0.50 |
| Meta Llama 2-70b Chat |
meta/llama-2-70b-chat |
$0.65 / $2.75 |
| Meta Llama 2-7b Chat |
meta/llama-2-7b-chat |
$0.05 / $0.25 |
| Meta Llama 3-8b |
meta/meta-llama-3-8b |
$0.05 / $0.25 |
| Meta Llama 3-70b |
meta/meta-llama-3-70b |
$0.65 / $2.75 |
| Meta Llama 3-8b Instruct |
meta/meta-llama-3-8b-instruct |
$0.05 / $0.25 |
| Meta Llama 3-70b Instruct |
meta/meta-llama-3-70b-instruct |
$0.65 / $2.75 |
| Mistral 7B |
mistralai/mistral-7b-v0.1 |
$0.05 / $0.25 |
| Mistral 7B Instruct |
mistralai/mistral-7b-instruct-v0.2 |
$0.05 / $0.25 |
| Mixtral 8x7B Instruct |
mistralai/mixtral-8x7b-instruct-v0.1 |
$0.30 / $1.00 |
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent