Comments (2)
Any idea how to fix this issue?
Thanks,
from h2ogpt.
The installed version of bitsandbytes was compiled without GPU support
suggests that something is wrong with the base CUDA installation.
We updated the instructions, make sure to follow all steps: https://github.com/h2oai/h2ogpt/blob/main/INSTALL-DOCKER.md
Also, 12GB VRAM and older generation cards might not work, we develop and test on 3090/4090/A6000/A6000Ada/A100 only.
from h2ogpt.
Related Issues (20)
- final HYDE shows duplicate answer and html tags HOT 10
- Mismatch Between Query Response and Source Document Ordering in a Captive Network with Multiple Documents HOT 7
- DocTR OCR not working HOT 1
- Feature request - to allow to persist parameters configuration HOT 2
- I ran h2ogpt on ubuntu, and after preparing it, I uploaded ubuntu to the server... but h2ogpt does not work on the server? HOT 1
- No GPU Detected - AMD GPU Radeon Instinct MI25 MxGPU Discrete HOT 1
- Reading documents content: File not allowed HOT 11
- Why does it take time to load the form? HOT 4
- Why does it take time to load the form? HOT 1
- offline mode still fail: connection huggingface error HOT 1
- Feature request - to add support for nomic-ai/nomic-embed-text-v1 embeddings. HOT 19
- Updated version causes error with TGI HOT 4
- Enable Vision Models window in the UI via docker HOT 5
- How to connect to vLLM endpoint using HTTPS (SSL/TLS) HOT 8
- Concern regarding headers changes in repo HOT 1
- feature request - pdf portfolio support HOT 2
- Default install fails starting webserver HOT 3
- how can use type gemma model of google in h2ogpt? HOT 3
- Installer on MacOS M2 not working (Error -1) HOT 5
- AttributeError: module 'psutil' has no attribute 'RLIMIT_AS' HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from h2ogpt.