Comments (6)
Hi, the AWQ thing looks like its specific to AWQ. I don't have any good ideas w.r.t. that.
Note that GGUF and AWQ are independent. If you are finding AWQ sometimes works, probably some race/bug in AWQ. Please check their repo: https://github.com/casper-hansen/AutoAWQ and post an issue if you can just follow their basic instructions.
If you find their basic instructions work but h2oGPT does not, I can look again.
from h2ogpt.
I don't think set "PIP_EXTRA_INDEX_URL=https://download.pytorch.org/whl/cu118"
is correct, it probably makes it use non-cuda torch and then since AWQ only supports cuda then it would fail, might explain your situation.
Closing for now until get evidence that not AWQ issue.
from h2ogpt.
I'm sure about:
F:\h2oGPT\installer_files\env\lib\site-packages\gradio\components\dropdown.py:231: UserWarning: The value passed into gr.Dropdown() is not in the list of choices. Please update the list of choices to include: or set allow_custom_value=True.
warnings.warn(
Got prompt_type 1:
Can you explain exactly what you did to hit this?
from h2ogpt.
I'm sure about:
F:\h2oGPT\installer_files\env\lib\site-packages\gradio\components\dropdown.py:231: UserWarning: The value passed into gr.Dropdown() is not in the list of choices. Please update the list of choices to include: or set allow_custom_value=True. warnings.warn( Got prompt_type 1:
Can you explain exactly what you did to hit this?
If I remember correctly I loaded and then unloaded, with the relative buttons, the same model
from h2ogpt.
I don't think
set "PIP_EXTRA_INDEX_URL=https://download.pytorch.org/whl/cu118"
is correct, it probably makes it use non-cuda torch and then since AWQ only supports cuda then it would fail, might explain your situation.Closing for now until get evidence that not AWQ issue.
I mean in the readme for Windows it said:
Line 58 in 89a56df
but then looking at the pip command response it seems to have loaded the url with quotes.
Writing instead:
set "PIP_EXTRA_INDEX_URL=https://download.pytorch.org/whl/cu118"
brings back the intended url.
from h2ogpt.
I'm sure about:
F:\h2oGPT\installer_files\env\lib\site-packages\gradio\components\dropdown.py:231: UserWarning: The value passed into gr.Dropdown() is not in the list of choices. Please update the list of choices to include: or set allow_custom_value=True. warnings.warn( Got prompt_type 1:
Can you explain exactly what you did to hit this?
If I remember correctly I loaded and then unloaded, with the relative buttons, the same model
I noticed now that in the list of models the same one appears twice, but I don't see it downloaded in any folder.
from h2ogpt.
Related Issues (20)
- question regarding model_lock HOT 2
- Executing small model but missing config.json error with microsoft/Phi-3-mini-4k-instruct-gguf HOT 1
- Q and A not working for Youtube HOT 7
- sentence transformer version HOT 2
- Logging/Saving Settings and Instructions for Inference Jobs HOT 6
- Youtube ingestion doesn't work HOT 3
- Youtube chat does not work HOT 1
- Timestamps issue in Youtube Chat
- Document Content Presentation Difference Between Built-In UI and Custom UI using Gradio client HOT 1
- Change AutoGPT Agent Embeddings Model HOT 5
- Question:extracting preference data of clients' response HOT 3
- Does h2o have assistant API HOT 1
- Consider switching to Coqui TTS from new repo
- Can I use existing llama.cpp server as inference server? HOT 1
- Is there a plan to incorporate a Knowledge Graph RAG Query Engine? HOT 1
- Option to place relavent documents chunks in system prompt instead of user prompt
- AutoGPT issue running on Local LLM HOT 3
- Running H2ogpt with Ollama inference Server HOT 2
- Unable to Programmatically Receive Sources with Prompts & Responses HOT 1
- h2o Windows installer "Web Search" and "Q/A" HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from h2ogpt.