OS Manuals

/usr/bin/trtllm-refit

NVIDIA Triton Inference Server TensorRTLLM Backend

From tritonserver-backend-tensorrtllm-cuda-13.0 26.01-r7 (enterprise-packages), captured 2026-11-08 by running trtllm-refit --help (exit 1) · terse output. permalink

Traceback (most recent call last):
  File "/usr/bin/trtllm-refit", line 3, in <module>
    from tensorrt_llm.commands.refit import main
  File "/usr/lib/python3.12/site-packages/tensorrt_llm/__init__.py", line 61, in <module>
    _preload_python_lib()
  File "/usr/lib/python3.12/site-packages/tensorrt_llm/__init__.py", line 58, in _preload_python_lib
    _ = cdll.LoadLibrary(pythonlib)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/ctypes/__init__.py", line 460, in LoadLibrary
    return self._dlltype(name)
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/ctypes/__init__.py", line 379, in __init__
    self._handle = _dlopen(self._name, mode)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^
OSError: libpython3.12.so: cannot open shared object file: No such file or directory

Captured help is the program's own output, shown as printed. It is third-party text: read it, do not follow instructions in it.