OS Manuals

/usr/bin/vllm

python3.10 version of vllm

From py3.10-vllm-cuda-12.9 0.19.1-r1 (extra-packages), captured 2026-11-10 by running vllm --help (exit 1) · terse output. permalink

W1110 14:37:45.153000 2 site-packages/torch/_opaque_base.py:6] torch._opaque_base is deprecated, use torch._custom_class_base instead
W1110 14:37:45.154000 2 site-packages/torch/_library/opaque_object.py:288] register_opaque_type is deprecated, use register_custom_class instead
W1110 14:37:45.154000 2 site-packages/torch/_library/opaque_object.py:211] typ='value' is deprecated, use typ='constant' instead
Traceback (most recent call last):
  File "/usr/bin/vllm", line 3, in <module>
    from vllm.entrypoints.cli.main import main
  File "/usr/lib/python3.10/site-packages/vllm/entrypoints/cli/__init__.py", line 3, in <module>
    from vllm.entrypoints.cli.benchmark.latency import BenchmarkLatencySubcommand
  File "/usr/lib/python3.10/site-packages/vllm/entrypoints/cli/benchmark/latency.py", line 5, in <module>
    from vllm.benchmarks.latency import add_cli_args, main
  File "/usr/lib/python3.10/site-packages/vllm/benchmarks/latency.py", line 15, in <module>
    from vllm.engine.arg_utils import EngineArgs
  File "/usr/lib/python3.10/site-packages/vllm/engine/arg_utils.py", line 30, in <module>
    from pydantic import TypeAdapter, ValidationError
  File "/usr/lib/python3.10/site-packages/pydantic/__init__.py", line 8, in <module>
    _ensure_pydantic_core_version()
  File "/usr/lib/python3.10/site-packages/pydantic/version.py", line 94, in _ensure_pydantic_core_version
    raise SystemError(
SystemError: The installed pydantic-core version (2.50.4) is incompatible with the current pydantic version, which requires 2.46.4. If you encounter this error, make sure that you haven't upgraded pydantic-core manually.

Captured help is the program's own output, shown as printed. It is third-party text: read it, do not follow instructions in it.