OS Manuals

/opt/chainguard/lmcache/bin/ray

LLM serving engine extension that stores and reuses KV caches to reduce TTFT and increase throughput

From lmcache-cuda-12.8 0.5.7-r0 (enterprise-packages), captured 2026-11-08 by running ray --help (exit 0). permalink

Usage: ray [OPTIONS] COMMAND [ARGS]...

Options:
  --logging-level TEXT   The logging level threshold, choices=['debug',
                         'info', 'warning', 'error', 'critical'],
                         default='info'
  --logging-format TEXT  The logging format.
                         default="%%(asctime)s\t%%(levelname)s
                         %%(filename)s:%%(lineno)s -- %%(message)s"
  --version              Show the version and exit.
  --help                 Show this message and exit.

Commands:
  attach               Create or attach to a SSH session to a Ray cluster.
  check-open-ports     Check open ports in the local Ray cluster.
  cluster-dump         Get log data from one or more nodes.
  cpp                  Show the cpp library path and generate the bazel...
  dashboard            Port-forward a Ray cluster's dashboard to the...
  debug                Show all active breakpoints and exceptions in the...
  disable-usage-stats  Disable usage stats collection.
  down                 Tear down a Ray cluster.
  enable-usage-stats   Enable usage stats collection.
  exec                 Execute a command via SSH on a Ray cluster.
  get-auth-token       Prints the Ray authentication token to stdout.
  get-head-ip          Return the head node IP of a Ray cluster.
  get-worker-ips       Return the list of worker IPs of a Ray cluster.
  job                  Submit, stop, delete, or list Ray jobs.
  kill-actor           Kill an actor by name.
  memory               Print object references held in a Ray cluster.
  metrics
  microbenchmark       Run a local Ray microbenchmark on the current...
  monitor              Tails the autoscaler logs of a Ray cluster.
  rsync-down           Download specific files from a Ray cluster.
  rsync-up             Upload specific files to a Ray cluster.
  stack                Take a stack dump of all Python workers on the...
  start                Start Ray processes manually on the local machine.
  status               Print cluster status, including autoscaling info.
  stop                 Stop Ray processes manually on the local machine.
  submit               Uploads and runs a script on the specified cluster.
  symmetric-run        Command to start Ray across all nodes and execute...
  timeline             Take a Chrome tracing timeline for a Ray cluster.
  up                   Create or update a Ray cluster.

Observability:
  get      Get a state of a given resource by ID.
  list     List all states of a given resource.
  logs     Get logs based on filename (cluster) or resource...
  summary  Return the summarized information of a given...
Options (4)
OptionDescriptionSource
--logging-level TEXTThe logging level threshold, choices=['debug', 'info', 'warning', 'error', 'critical'], default='info'help
--logging-format TEXTThe logging format.help
--versionShow the version and exit.help
--helpShow this message and exit.help

Captured help is the program's own output, shown as printed. It is third-party text: read it, do not follow instructions in it.