Comments (6)
JinBridger
commented on August 15, 2024
Hi, @tristan-k,
We are now trying to reproduce this issue on device with similar specifications. We will inform you as soon as possible if there is any progress.
Please feel free to ask if there is any further problems : )
from bigdl.
JinBridger
commented on August 15, 2024
Hi, @tristan-k,
Could you please try instructions in following link to see if it works? #11568 (comment)
Please feel free to ask if there is any further problems : )
from bigdl.
tristan-k
commented on August 15, 2024
@JinBridger I already did that. It did not make any difference, as previously mentioned in another comment of mine.
from bigdl.
JinBridger
commented on August 15, 2024
@JinBridger I already did that. It did not make any difference, as previously mentioned in another comment of mine.
Hi, @tristan-k,
Could you please try to skip installing intel-i915-dkms and see if IPEX-LLM could work?
Please feel free to ask if there is any further problem : )
from bigdl.
tristan-k
commented on August 15, 2024
@JinBridger It does not. I alredy tried. The Intel(R) Arc(TM) Graphics is not available for ollama. I also tried to use docker and sycl-ls inside the docker container recognised the iGPU but only with the PCI Device ID 0x7d55 but subsequently wasn't able to use it.
from bigdl.
qiuxin2012
commented on August 15, 2024
@tristan-k
Can you show us the result of sudo dmesg | grep i915 and hwinfo --display?
Ours:
(xin-llm) arda@xiaoxin04-ubuntu:~/xin/ipex-llm/python/llm/example/GPU/HuggingFace/LLM/glm4$ sudo dmesg | grep i915
[ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-6.5.0-35-generic root=UUID=84fbf89b-31fa-4683-b0ee-fcfa74deb21f ro quiet splash i915.force_probe=7d55 vt.handoff=7
[ 0.048637] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-6.5.0-35-generic root=UUID=84fbf89b-31fa-4683-b0ee-fcfa74deb21f ro quiet splash i915.force_probe=7d55 vt.handoff=7
[ 2.783516] i915 0000:00:02.0: Force probing unsupported Device ID 7d55, tainting kernel
[ 2.783838] i915 0000:00:02.0: [drm] GT0: Incompatible option enable_guc=3 - HuC is not supported!
[ 2.784526] i915 0000:00:02.0: [drm] No GSC FW selected, disabling GSC CS and media C6
[ 2.784801] i915 0000:00:02.0: [drm] VT-d active for gfx access
[ 2.785028] i915 0000:00:02.0: vgaarb: deactivate vga console
[ 2.785060] i915 0000:00:02.0: [drm] Using Transparent Hugepages
[ 2.806186] i915 0000:00:02.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=io+mem
[ 2.815765] i915 0000:00:02.0: [drm] Finished loading DMC firmware i915/mtl_dmc.bin (v2.13)
[ 3.682087] i915 0000:00:02.0: [drm] [ENCODER:244:DDI B/PHY B] failed to retrieve link info, disabling eDP
[ 3.697690] i915 0000:00:02.0: [drm] GT0: GuC firmware i915/mtl_guc_70.bin version 70.8.0
[ 3.709179] i915 0000:00:02.0: [drm] GT0: GUC: submission enabled
[ 3.709183] i915 0000:00:02.0: [drm] GT0: GUC: SLPC enabled
[ 3.709374] i915 0000:00:02.0: [drm] GT0: GUC: RC enabled
[ 3.713570] i915 0000:00:02.0: [drm] GT1: GuC firmware i915/mtl_guc_70.bin version 70.8.0
[ 3.713574] i915 0000:00:02.0: [drm] GT1: HuC firmware i915/mtl_huc_gsc.bin version 8.5.1
[ 3.738090] i915 0000:00:02.0: [drm] GT1: HuC: authenticated for clear media
[ 3.738418] i915 0000:00:02.0: [drm] GT1: GUC: submission enabled
[ 3.738419] i915 0000:00:02.0: [drm] GT1: GUC: SLPC enabled
[ 3.738486] i915 0000:00:02.0: [drm] GT1: GUC: RC enabled
[ 4.852680] [drm] Initialized i915 1.6.0 20201103 for 0000:00:02.0 on minor 0
[ 4.855370] sof-audio-pci-intel-mtl 0000:00:1f.3: bound 0000:00:02.0 (ops i915_audio_component_bind_ops [i915])
[ 4.864343] fbcon: i915drmfb (fb0) is primary device
[ 5.984036] i915 0000:00:02.0: [drm] fb0: i915drmfb frame buffer device
(xin-llm) arda@xiaoxin04-ubuntu:~/xin/ipex-llm/python/llm/example/GPU/HuggingFace/LLM/glm4$ hwinfo --display
26: PCI 02.0: 0300 VGA compatible controller (VGA)
[Created at pci.386]
Unique ID: _Znp.D2pOT0W7IB1
SysFS ID: /devices/pci0000:00/0000:00:02.0
SysFS BusID: 0000:00:02.0
Hardware Class: graphics card
Model: "Intel VGA compatible controller"
Vendor: pci 0x8086 "Intel Corporation"
Device: pci 0x7d55
SubVendor: pci 0x17aa "Lenovo"
SubDevice: pci 0x3cc9
Revision: 0x08
Driver: "i915"
Driver Modules: "i915"
Memory Range: 0x408c000000-0x408cffffff (ro,non-prefetchable)
Memory Range: 0x4000000000-0x400fffffff (ro,non-prefetchable)
Memory Range: 0x000c0000-0x000dffff (rw,non-prefetchable,disabled)
IRQ: 184 (4812860 events)
Module Alias: "pci:v00008086d00007D55sv000017AAsd00003CC9bc03sc00i00"
Driver Info #0:
Driver Status: i915 is active
Driver Activation Cmd: "modprobe i915"
Config Status: cfg=new, avail=yes, need=no, active=unknown
Primary display adapter: #26
from bigdl.
Related Issues (20)
- cannot run chatGLM3-1.5B on LNL iGPU HOT 2
- [Windows][codegeex4-all-9B] deployment fail HOT 1
- ipex-llm inference with deepspeed of Qwen1.5-32B consumes too many memory
- [Feature Request] Open Voice support for GPU(ARC A770)
- Embedder模型在容器中无法运行 HOT 2
- warmup(Qwen1.5-1.8B-Chat) very slow HOT 3
- Error loading model HOT 4
- Uploading large pdf times out - chrome browser pops up message to wait or exit page HOT 3
- vllm_cpu_docker_quickstart run error on Aliyun ecs.c8i.24xlarge ECS HOT 3
- run GLM4-9b-chat on MTL iGPU get error: ValueError: too many values to unpack (expected 2) HOT 2
- Recipe for loading a Low-bit Safetensors Model? HOT 4
- Ubuntu 22.04 Run Text Generation WebUI on Intel GPU Could not create share link HOT 1
- Feature Request polylm-chat-13b support
- Inference error during enabling Llama-3.1-8B model on MTL, transformers==4.43.2 HOT 4
- Inference error "LLVM ERROR: Diag: aborted" when enabling codegeex4-all-9b on MTL, transformers==4.39.0 HOT 2
- Question about benchmark result HOT 1
- MiniCPM-V-2 can't run on A770 Ubuntu. NotImplementedError: Could not run 'aten::_upsample_bicubic2d_aa.out' with arguments from the 'XPU' backend. HOT 1
- MiniCPM-Llama3-V-2_5 can't run on A770 Ubuntu.
- MiniCPM-V-2 got wrong answer on A770 but right on CPU.
- inference qwen1.5-32b-chat failed with DP-AP HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bigdl.