Comments (20)
zigabrencic
commented on July 22, 2024
2
Hey.
As discussed in the meeting today. My proposal would be to to sync the Azur part with same approach we use open models and Open router. For example (from here):
export OPENAI_API_BASE="https://openrouter.ai/api/v1"
export OPENAI_API_KEY="sk-key-from-open-router"
export MODEL_NAME="meta-llama/llama-3-8b-instruct:extended"
gpte <project_dir> $MODEL_NAME --lite --temperature 0.1
Instead of using custom --azure flag.
@captivus what do you think? I don't know their hosting specs so I'm not sure if it's doable.
from gpt-engineer.
viborc
commented on July 22, 2024
1
Hey @JiaCYu, we have our community meeting today, and I'll make sure we discuss this topic with the team and get back to you!
from gpt-engineer.
captivus
commented on July 22, 2024
1
@viborc I have a meeting conflict with today's dev meeting, but I can speak more about this if the issue isn't resolved during the meeting today.
from gpt-engineer.
captivus
commented on July 22, 2024
1
Looking at this further, I think the bug may be ours and due to the way that we implement the model version in an opinionated way:
gpt-engineer/gpt_engineer/core/ai.py
Line 349 in 6698656
Let's discuss in our dev meeting.
from gpt-engineer.
JiaCYu
commented on July 22, 2024
I just reread the instructions and I realized that the Azure Deployment Name should be the model name as well. Which kind of sucks because there are a bunch of projects dependent on that deployment name and a lot refactoring would have to be done.
from gpt-engineer.
captivus
commented on July 22, 2024
If I understand the issue you're reporting correctly, this is due to the parameters that OpenAI expects for Azure deployments of its model and is not a GPTE-specific issue.
from gpt-engineer.
viborc
commented on July 22, 2024
Sounds good @captivus! I might assign you to this one if we don't figure it out during the meeting!
from gpt-engineer.
viborc
commented on July 22, 2024
We decided to use your very generous offer to help us with this @captivus and @zigabrencic mentioned that he'll add some comments here, too!
from gpt-engineer.
captivus
commented on July 22, 2024
More thoughts here. @JiaCYu can you please set the OPENAI_API_VERSION environment variable with your deployment's version and try again? The internals I've linked to above show how we handle environment variable when it is not set, and is consistent with the error messages you've provided. Without knowing more about your specific deployment, it's difficult to advise specifically what this value should be.
This documentation may be helpful. This issue resolution may also prove helpful.
Please try and feedback!
from gpt-engineer.
Related Issues (20)
- example improve file_selection.toml be rewritten the Initialization status HOT 2
- No chance to input and answer the gpte three question on generate complex application HOT 4
- Error while improving the project: '/dev/null' HOT 3
- How to use Anthropic models HOT 1
- Investigate/document how to use with OpenRouter HOT 6
- Ollama Multithreaded UI integration, issue with code testing below python 3.10 HOT 2
- upload the debug_log_file.txt According to project prompts HOT 1
- Getting "Could not resolve authentication method" – without a stacktrace HOT 3
- Missing support for the vision capabilities in the new model gpt-4-turbo HOT 5
- TypeError: Object of type Prompt is not JSON serializable – uploading learning HOT 2
- Error while improving the project: 'ascii' codec can't encode character '\u2019' in position 7: ordinal not in range(128) HOT 3
- Urgent - all PRs blocked because of failing tests HOT 4
- Applying diffs failing silently HOT 7
- keep getting error message when trying to run in terminal with all necessary items installed HOT 3
- The Video demo on the Main Repo is Corrupted HOT 4
- Docker build is broken HOT 30
- Add GPTE CLI argument to output system information HOT 10
- how to set gpt-4o HOT 3
- Can't run poetry install. Greenlet not supporting PEP 517 builds. HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gpt-engineer.