OS Manuals

/opt/chainguard/lmcache/bin/run-iket

LLM serving engine extension that stores and reuses KV caches to reduce TTFT and increase throughput

From lmcache-cuda-12.8 0.5.7-r0 (enterprise-packages), captured 2026-11-08 by running run-iket --help (exit 0). permalink

usage: run-iket [-h] [--context-buffer-size CONTEXT_BUFFER_SIZE] [--log-level {error,warn,info}]
                [--working-dir WORKING_DIR] [--output-dir OUTPUT_DIR] [--clobber]
                {profile,postprocess} ...

positional arguments:
  {profile,postprocess}
    profile             run In-Kernel-Event-Tracing
    postprocess         post-process an existing IKET run directory to generate traces

options:
  -h, --help            show this help message and exit
  --context-buffer-size CONTEXT_BUFFER_SIZE
                        size of extra device buffer allocated per context. Default: auto-computed
                        from tracker data, fallback 1G.
  --log-level {error,warn,info}
                        default: error
  --working-dir WORKING_DIR
  --output-dir OUTPUT_DIR, -o OUTPUT_DIR
                        directory for profiling outputs. run-iket owns this directory and removes
                        it when clobbering, so it must not be the working directory itself.
                        Default: <working-dir>/iket_output
  --clobber             clobber existing output directory
Options (5)
OptionDescriptionSource
-h, --helpshow this help message and exithelp
--context-buffer-size CONTEXT_BUFFER_SIZEsize of extra device buffer allocated per context.help
--log-level errordefault: errorhelp
--working-dir WORKING_DIRhelp
--clobberclobber existing output directoryhelp

Captured help is the program's own output, shown as printed. It is third-party text: read it, do not follow instructions in it.