OS Manuals

/usr/bin/flashinfer

python3.12 version of vllm

From py3.12-vllm-cuda-13.0 0.20.2-r1 (extra-packages), captured 2026-11-06 by running flashinfer --help (exit 1) · terse output. permalink

Traceback (most recent call last):
  File "/usr/bin/flashinfer", line 3, in <module>
    from flashinfer.__main__ import cli
  File "/usr/lib/python3.12/site-packages/flashinfer/__init__.py", line 25, in <module>
    from .activation import gelu_and_mul as gelu_and_mul
  File "/usr/lib/python3.12/site-packages/flashinfer/activation.py", line 25, in <module>
    from .utils import (
  File "/usr/lib/python3.12/site-packages/flashinfer/utils.py", line 24, in <module>
    import pynvml
ModuleNotFoundError: No module named 'pynvml'

Captured help is the program's own output, shown as printed. It is third-party text: read it, do not follow instructions in it.