/usr/bin/vllm

Error processing line 1 of /usr/lib/python3.12/site-packages/nvidia_cutlass_dsl_packages.pth:

  Traceback (most recent call last):
    File "<frozen site>", line 206, in addpackage
    File "<string>", line 1, in <module>
  ModuleNotFoundError: No module named 'nvidia_cutlass_dsl'

Remainder of file ignored
Traceback (most recent call last):
  File "/usr/bin/vllm", line 3, in <module>
    from vllm.entrypoints.cli.main import main
  File "/usr/lib/python3.12/site-packages/vllm/entrypoints/cli/__init__.py", line 3, in <module>
    from vllm.entrypoints.cli.benchmark.latency import BenchmarkLatencySubcommand
  File "/usr/lib/python3.12/site-packages/vllm/entrypoints/cli/benchmark/latency.py", line 5, in <module>
    from vllm.benchmarks.latency import add_cli_args, main
  File "/usr/lib/python3.12/site-packages/vllm/benchmarks/latency.py", line 16, in <module>
    from vllm.engine.arg_utils import EngineArgs
  File "/usr/lib/python3.12/site-packages/vllm/engine/arg_utils.py", line 30, in <module>
    from pydantic import TypeAdapter, ValidationError
  File "/usr/lib/python3.12/site-packages/pydantic/__init__.py", line 8, in <module>
    _ensure_pydantic_core_version()
  File "/usr/lib/python3.12/site-packages/pydantic/version.py", line 94, in _ensure_pydantic_core_version
    raise SystemError(
SystemError: The installed pydantic-core version (2.50.4) is incompatible with the current pydantic version, which requires 2.50.1. If you encounter this error, make sure that you haven't upgraded pydantic-core manually.