OS Manuals

/usr/bin/gguf-set-metadata

python3.12 version of vllm

From py3.12-vllm-cuda-12.9 0.19.1-r1 (extra-packages), captured 2026-11-06 by running gguf-set-metadata --help (exit 1) · terse output. permalink

Traceback (most recent call last):
  File "/usr/bin/gguf-set-metadata", line 3, in <module>
    from gguf.scripts.gguf_set_metadata import main
  File "/usr/lib/python3.12/site-packages/gguf/__init__.py", line 7, in <module>
    from .vocab import *
  File "/usr/lib/python3.12/site-packages/gguf/vocab.py", line 17, in <module>
    from mistral_common.tokens.tokenizers.mistral import MistralTokenizer # type: ignore[import-not-found, ty:unresolved-import]
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/site-packages/mistral_common/tokens/tokenizers/mistral.py", line 8, in <module>
    from mistral_common.protocol.fim.request import FIMRequest
  File "/usr/lib/python3.12/site-packages/mistral_common/protocol/fim/request.py", line 1, in <module>
    from mistral_common.protocol.base import BaseCompletionRequest
  File "/usr/lib/python3.12/site-packages/mistral_common/protocol/base.py", line 1, in <module>
    from pydantic import Field
  File "/usr/lib/python3.12/site-packages/pydantic/__init__.py", line 8, in <module>
    _ensure_pydantic_core_version()
  File "/usr/lib/python3.12/site-packages/pydantic/version.py", line 94, in _ensure_pydantic_core_version
    raise SystemError(
SystemError: The installed pydantic-core version (2.50.4) is incompatible with the current pydantic version, which requires 2.46.4. If you encounter this error, make sure that you haven't upgraded pydantic-core manually.

Captured help is the program's own output, shown as printed. It is third-party text: read it, do not follow instructions in it.