Comments (3)
please use pip install -vvv vllm
to get more info .
from vllm.
please use
pip install -vvv vllm
to get more info .
Thanks for your reply. Here are detailed output of pip install -vvv vllm
creating /tmp/pip-modern-metadata-i6noz1gk/vllm.egg-info
writing /tmp/pip-modern-metadata-i6noz1gk/vllm.egg-info/PKG-INFO
writing dependency_links to /tmp/pip-modern-metadata-i6noz1gk/vllm.egg-info/dependency_links.txt
writing requirements to /tmp/pip-modern-metadata-i6noz1gk/vllm.egg-info/requires.txt
writing top-level names to /tmp/pip-modern-metadata-i6noz1gk/vllm.egg-info/top_level.txt
writing manifest file '/tmp/pip-modern-metadata-i6noz1gk/vllm.egg-info/SOURCES.txt'
reading manifest file '/tmp/pip-modern-metadata-i6noz1gk/vllm.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
adding license file 'LICENSE'
writing manifest file '/tmp/pip-modern-metadata-i6noz1gk/vllm.egg-info/SOURCES.txt'
creating '/tmp/pip-modern-metadata-i6noz1gk/vllm-0.4.1.dist-info'
Preparing metadata (pyproject.toml) ... done
Source in /tmp/pip-install-j494k9p6/vllm_258e44343b2741a8aeb78607febf0bdb has version 0.4.1, which satisfies requirement vllm from https://pypi.tuna.tsinghua.edu.cn/packages/b6/59/21a037891a7855cae232ee4add3aee9d891f5b4f49f0d86795835270fb57/vllm-0.4.1.tar.gz
Removed vllm from https://pypi.tuna.tsinghua.edu.cn/packages/b6/59/21a037891a7855cae232ee4add3aee9d891f5b4f49f0d86795835270fb57/vllm-0.4.1.tar.gz from build tracker '/tmp/pip-build-tracker-ldw8yzf0'
Created temporary directory: /tmp/pip-unpack-lrb7rgl2
Found index url https://pypi.tuna.tsinghua.edu.cn/simple/
Looking up "https://pypi.tuna.tsinghua.edu.cn/packages/91/5e/157e46eccdc168b0a42cafb12ad0a9f992ff8fbee25cc97bc2464bd71bcf/vllm-0.3.3.tar.gz" in the cache
Current age based on date: 3882
https://pypi.tuna.tsinghua.edu.cn:443 "GET /packages/91/5e/157e46eccdc168b0a42cafb12ad0a9f992ff8fbee25cc97bc2464bd71bcf/vllm-0.3.3.tar.gz HTTP/1.1" 304 0
Using cached https://pypi.tuna.tsinghua.edu.cn/packages/91/5e/157e46eccdc168b0a42cafb12ad0a9f992ff8fbee25cc97bc2464bd71bcf/vllm-0.3.3.tar.gz (315 kB)
Added vllm from https://pypi.tuna.tsinghua.edu.cn/packages/91/5e/157e46eccdc168b0a42cafb12ad0a9f992ff8fbee25cc97bc2464bd71bcf/vllm-0.3.3.tar.gz to build tracker '/tmp/pip-build-tracker-ldw8yzf0'
Created temporary directory: /tmp/pip-build-env-eqcqrlor
Running command pip subprocess to install build dependencies
Using pip 24.0 from /hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip (python 3.12)
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Collecting ninja
Using cached https://pypi.tuna.tsinghua.edu.cn/packages/6d/92/8d7aebd4430ab5ff65df2bfee6d5745f95c004284db2d8ca76dcbfd9de47/ninja-1.11.1.1-py2.py3-none-manylinux1_x86_64.manylinux_2_5_x86_64.whl (307 kB)
Collecting packaging
Using cached https://pypi.tuna.tsinghua.edu.cn/packages/08/aa/cc0199a5f0ad350994d660967a8efb233fe0416e4639146c089643407ce6/packaging-24.1-py3-none-any.whl (53 kB)
Collecting setuptools>=49.4.0
Using cached https://pypi.tuna.tsinghua.edu.cn/packages/de/88/70c5767a0e43eb4451c2200f07d042a4bcd7639276003a9c54a68cfcc1f8/setuptools-70.0.0-py3-none-any.whl (863 kB)
ERROR: Could not find a version that satisfies the requirement torch==2.1.2 (from versions: 2.2.0, 2.2.1, 2.2.2, 2.3.0, 2.3.1)
ERROR: No matching distribution found for torch==2.1.2
error: subprocess-exited-with-error
× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
full command: /hpc2hdd/home/zxu674/anaconda3/envs/acd/bin/python /hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/__pip-runner__.py install --ignore-installed --no-user --prefix /tmp/pip-build-env-eqcqrlor/overlay --no-warn-script-location -v --no-binary :none: --only-binary :none: -i https://pypi.tuna.tsinghua.edu.cn/simple --trusted-host mirrors.aliyun.com -- ninja packaging 'setuptools >= 49.4.0' 'torch == 2.1.2' wheel
cwd: [inherit]
Installing build dependencies ... error
error: subprocess-exited-with-error
× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
Exception information:
Traceback (most recent call last):
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_internal/cli/base_command.py", line 180, in exc_logging_wrapper
status = run_func(*args)
^^^^^^^^^^^^^^^
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_internal/cli/req_command.py", line 245, in wrapper
return func(self, options, args)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_internal/commands/install.py", line 377, in run
requirement_set = resolver.resolve(
^^^^^^^^^^^^^^^^^
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_internal/resolution/resolvelib/resolver.py", line 95, in resolve
result = self._result = resolver.resolve(
^^^^^^^^^^^^^^^^^
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_vendor/resolvelib/resolvers.py", line 546, in resolve
state = resolution.resolve(requirements, max_rounds=max_rounds)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_vendor/resolvelib/resolvers.py", line 427, in resolve
failure_causes = self._attempt_to_pin_criterion(name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_vendor/resolvelib/resolvers.py", line 237, in _attempt_to_pin_criterion
for candidate in criterion.candidates:
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 143, in <genexpr>
return (c for c in iterator if id(c) not in self._incompatible_ids)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 47, in _iter_built
candidate = func()
^^^^^^
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_internal/resolution/resolvelib/factory.py", line 182, in _make_candidate_from_link
base: Optional[BaseCandidate] = self._make_base_candidate_from_link(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_internal/resolution/resolvelib/factory.py", line 228, in _make_base_candidate_from_link
self._link_candidate_cache[link] = LinkCandidate(
^^^^^^^^^^^^^^
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 290, in __init__
super().__init__(
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 156, in __init__
self.dist = self._prepare()
^^^^^^^^^^^^^^^
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 222, in _prepare
dist = self._prepare_distribution()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 301, in _prepare_distribution
return preparer.prepare_linked_requirement(self._ireq, parallel_builds=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_internal/operations/prepare.py", line 525, in prepare_linked_requirement
return self._prepare_linked_requirement(req, parallel_builds)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_internal/operations/prepare.py", line 640, in _prepare_linked_requirement
dist = _get_prepared_distribution(
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_internal/operations/prepare.py", line 71, in _get_prepared_distribution
abstract_dist.prepare_distribution_metadata(
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_internal/distributions/sdist.py", line 44, in prepare_distribution_metadata
self._prepare_build_backend(finder)
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_internal/distributions/sdist.py", line 76, in _prepare_build_backend
self.req.build_env.install_requirements(
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_internal/build_env.py", line 217, in install_requirements
self._install_requirements(
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_internal/build_env.py", line 275, in _install_requirements
call_subprocess(
File "/hpc2hdd/home/zxu674/anaconda3/envs/acd/lib/python3.12/site-packages/pip/_internal/utils/subprocess.py", line 224, in call_subprocess
raise error
pip._internal.exceptions.InstallationSubprocessError: pip subprocess to install build dependencies exited with 1
Remote version of pip: 24.0
Local version of pip: 24.0
Was pip installed by pip? False
Removed vllm from https://pypi.tuna.tsinghua.edu.cn/packages/91/5e/157e46eccdc168b0a42cafb12ad0a9f992ff8fbee25cc97bc2464bd71bcf/vllm-0.3.3.tar.gz from build tracker '/tmp/pip-build-tracker-ldw8yzf0'
Removed build tracker: '/tmp/pip-build-tracker-ldw8yzf0'
from vllm.
creating '/tmp/pip-modern-metadata-i6noz1gk/vllm-0.4.1.dist-info'
You are installing 0.4.1.
Try pip install vllm==0.5.0.post1
?
from vllm.
Related Issues (20)
- [Feature]: asymmetric tensor parallel
- [Bug]: prefix-caching: inconsistent completions HOT 5
- [Bug]: Distribute Tests PR test fails
- [Bug]: llava-v1.6-mistral-7b-hf prompt template handling error HOT 3
- [Bug]: RuntimeError: CUDA error: no kernel image is available for execution on the device HOT 1
- [Bug]: OOM when setting prompt_logprobs=1 HOT 3
- [RFC]: Refactor Worker and ModelRunner to consolidate control plane communication HOT 13
- [Bug]: Using tensor-parallel-size 4 fails for some models with pyo3_runtime.PanicException: The global thread pool has not been initialized.: ThreadPoolBuildError {"Resource temporarily unavailable" })
- [RFC]: Implement KV cache transferring mechanism in vLLM HOT 8
- [Performance] [Speculative decoding] Speed up autoregressive proposal methods by making sampler CPU serialization optional HOT 3
- [Bug]: Speculative decoding server: `ValueError: could not broadcast input array from shape (513,) into shape (512,)` HOT 13
- [Bug]: Regression in LoRA Adapter loading speed between vllm 0.4.3 and 0.5.0 HOT 3
- [RFC]: Branch based version control, and development version
- [Usage]: how to use marlin kernel for GPTQ model HOT 9
- [Performance]:
- [Bug]: BitsandBytes quantization is not working as expected HOT 6
- [Usage]: Using VLLM with Langchain for RAG purposes HOT 2
- [Bug]: chunked prefill scheudler uses up swap on many n>=2 requests HOT 4
- [Bug]: Mixtral8x7B very high spikes for Inter Token Latency (ITL) HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from vllm.