Comments (5)
👋 Hi, thanks for submitting an issue -- I don't know much about Azure OpenAI so I'm curious as to how it's different than the vanilla OpenAI API. What problems would this solve for you?
from butterfish.
👋 Hi, thanks for submitting an issue -- I don't know much about Azure OpenAI so I'm curious as to how it's different than the vanilla OpenAI API. What problems would this solve for you?
There is no difference in function between azure openai and official one, but it is easier to request gpt4 model in azure openai.
The API is as same as OpenAI, just different in API endpoint
(Sorry for that I am poor at English.
from butterfish.
#Note: The openai-python library support for Azure OpenAI is in preview.
import os
import openai
openai.api_type = "azure"
openai.api_base = "https://xxx.openai.azure.com/"
openai.api_version = "2023-07-01-preview"
openai.api_key = os.getenv("OPENAI_API_KEY")
response = openai.ChatCompletion.create(
engine="GPT4-32k",
messages = [],
temperature=0.7,
max_tokens=800,
top_p=0.95,
frequency_penalty=0,
presence_penalty=0,
stop=None)
There is the example given by auzre openai portal.
(Note that api base vary from users.
from butterfish.
Hey @Dreamail , I've just pushed a change that enables you to set a Base URL for the model API. In other words, this allows you to point butterfish at a different server than the OpenAI api. I haven't had a chance to test this with Azure yet, but it might work, will follow up.
If you want to try this, you can install butterfish from the latest commit (I haven't yet released), and then set the Base URL. Something like:
go install github.com/bakks/butterfish/cmd/butterfish@latest
$(go env GOPATH)/bin/butterfish shell -u http://localhost:1234/v1 -A
from butterfish.
Thx, I will try it if I have time later this day.
from butterfish.
Related Issues (20)
- Feature Request: Safe Retrieval Plugin
- Error: [404:invalid_request_error] The model: `gpt-4` does not exist HOT 7
- Error: system message is required for full chat completion on summarize request HOT 3
- Feature Request: Enhanced Multiline and Clipboard Input in `butterfish prompt` HOT 13
- Feature Request: Shell Specific Shortcuts HOT 1
- LLM prompts get interpreted as commands with zsh/prezto HOT 3
- text-generation-webui label:question HOT 4
- Bugs with text in bash/gnome terminal HOT 5
- Question: Is this compatible with atuin HOT 4
- Feature Request: fish shell support HOT 3
- Prompt mode context HOT 1
- Feature request: offer ti runa command after `gencmd` suggestion
- Feature request: option to remove all timeouts/deadlines for slow local LLMs
- please close
- [nit] When specifying a locally hosted api endpoint, butterfish still demands an API token for OpenAI
- [Feature Request] Enable using other AI sources as a first class citizen
- [Bug] panic on interface conversion when using the verbose log option HOT 4
- using a local llm HOT 1
- How to install on Linux?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from butterfish.