OS Manuals

/usr/bin/vllm

python3.10 version of vllm

From py3.10-vllm-cuda-13.0 0.20.2-r1 (extra-packages), captured 2026-11-10 by running vllm --help (exit 1) · terse output. permalink

Also provided by 9 other package versions
W1110 14:37:38.529000 2 site-packages/torch/_opaque_base.py:6] torch._opaque_base is deprecated, use torch._custom_class_base instead
W1110 14:37:38.530000 2 site-packages/torch/_library/opaque_object.py:288] register_opaque_type is deprecated, use register_custom_class instead
W1110 14:37:38.530000 2 site-packages/torch/_library/opaque_object.py:211] typ='value' is deprecated, use typ='constant' instead
Traceback (most recent call last):
  File "/usr/bin/vllm", line 6, in <module>
    sys.exit(main())
  File "/usr/lib/python3.10/site-packages/vllm/entrypoints/cli/main.py", line 18, in main
    import vllm.entrypoints.cli.benchmark.main
  File "/usr/lib/python3.10/site-packages/vllm/entrypoints/cli/benchmark/main.py", line 10, in <module>
    from vllm.entrypoints.utils import VLLM_SUBCMD_PARSER_EPILOG
  File "/usr/lib/python3.10/site-packages/vllm/entrypoints/utils.py", line 14, in <module>
    from fastapi import Request
  File "/usr/lib/python3.10/site-packages/fastapi/__init__.py", line 7, in <module>
    from .applications import FastAPI as FastAPI
  File "/usr/lib/python3.10/site-packages/fastapi/applications.py", line 7, in <module>
    from fastapi import routing
  File "/usr/lib/python3.10/site-packages/fastapi/routing.py", line 43, in <module>
    from fastapi import params
  File "/usr/lib/python3.10/site-packages/fastapi/params.py", line 7, in <module>
    from fastapi.exceptions import FastAPIDeprecationWarning
  File "/usr/lib/python3.10/site-packages/fastapi/exceptions.py", line 5, in <module>
    from pydantic import BaseModel, create_model
  File "/usr/lib/python3.10/site-packages/pydantic/__init__.py", line 8, in <module>
    _ensure_pydantic_core_version()
  File "/usr/lib/python3.10/site-packages/pydantic/version.py", line 94, in _ensure_pydantic_core_version
    raise SystemError(
SystemError: The installed pydantic-core version (2.50.4) is incompatible with the current pydantic version, which requires 2.46.4. If you encounter this error, make sure that you haven't upgraded pydantic-core manually.

Captured help is the program's own output, shown as printed. It is third-party text: read it, do not follow instructions in it.