OS Manuals

/opt/airflow/bin/litellm

Platform to programmatically author, schedule, and monitor workflows

From airflow-2 2.11.2-r28 (enterprise-packages), captured 2026-11-09 by running litellm --help (exit 0). permalink

14:31:29 - LiteLLM:WARNING: get_model_cost_map.py:271 - LiteLLM: Failed to fetch remote model cost map from https://raw.githubusercontent.com/BerriAI/litellm/main/model_prices_and_context_window.json: [Errno -3] Temporary failure in name resolution. Falling back to local backup.
Usage: litellm [OPTIONS]

Options:
  --host TEXT                     Host for the server to listen on.
  --port INTEGER                  Port to bind the server to.
  --num_workers INTEGER           Number of uvicorn / gunicorn workers to spin
                                  up. Default is 1 (from
                                  DEFAULT_NUM_WORKERS_LITELLM_PROXY)
  --api_base TEXT                 API base URL.
  --api_version TEXT              For azure - pass in the api version.
  -m, --model TEXT                The model name to pass to litellm expects
  --alias TEXT                    The alias for the model - use this to give a
                                  litellm model name (e.g. "huggingface/codell
                                  ama/CodeLlama-7b-Instruct-hf") a more user-
                                  friendly name ("codellama")
  --add_key TEXT                  The model name to pass to litellm expects
  --headers TEXT                  headers for the API call
  --save                          Save the model-specific config
  --debug                         To debug the input
  --detailed_debug                To view detailed debug logs
  --use_queue                     To use celery workers for async endpoints
  --temperature FLOAT             Set temperature for the model
  --max_tokens INTEGER            Set max tokens for the model
  --request_timeout INTEGER       Set timeout in seconds for completion calls
  --drop_params                   Drop any unmapped params
  --add_function_to_prompt        If function passed but unsupported, pass it
                                  as prompt
  -c, --config TEXT               Path to the proxy configuration file (e.g.
                                  config.yaml). Usage `litellm --config
                                  config.yaml`
  --max_budget FLOAT              Set max budget for API calls - works for
                                  hosted models like OpenAI, TogetherAI,
                                  Anthropic, etc.`
  --telemetry BOOLEAN             Helps us know if people are using this
                                  feature. Turn this off by doing `--telemetry
                                  False`
  --log_config TEXT               Path to the logging configuration file
  --setup                         Run the interactive setup wizard to
                                  configure providers and generate a config
                                  file
  -v, --version                   Print LiteLLM version
  --health                        Make a chat/completions request to all llms
                                  in config.yaml
  --test                          proxy chat completions url to make a test
                                  request to
  --test_async                    Calls async endpoints /queue/requests and
                                  /queue/response
  --iam_token_db_auth             Connects to RDS DB with IAM token
  --num_requests INTEGER          Number of requests to hit async endpoint
                                  with
  --run_gunicorn                  Starts proxy via gunicorn, instead of
                                  uvicorn (better for managing multiple
                                  workers)
  --run_hypercorn                 Starts proxy via hypercorn, instead of
                                  uvicorn (supports HTTP/2)
  --ssl_keyfile_path TEXT         Path to the SSL keyfile. Use this when you
                                  want to provide SSL certificate when
                                  starting proxy
  --ssl_certfile_path TEXT        Path to the SSL certfile. Use this when you
                                  want to provide SSL certificate when
                                  starting proxy
  --ciphers TEXT                  Ciphers to use for the SSL setup.
  --use_prisma_db_push            Use prisma db push instead of prisma migrate
                                  for database schema updates
  --local                         for local debugging
  --skip_server_startup           Skip starting the server after setup (useful
                                  for migrations only)
  --keepalive_timeout INTEGER     Set the uvicorn keepalive timeout in seconds
                                  (uvicorn timeout_keep_alive parameter)
  --timeout_worker_healthcheck INTEGER
                                  Set the uvicorn worker health-check timeout
                                  in seconds (uvicorn
                                  timeout_worker_healthcheck parameter).
                                  Requires uvicorn>=0.37.0. Only applies when
                                  running uvicorn directly with
                                  --num_workers>1; ignored under
                                  --run_gunicorn / --run_hypercorn.
  --max_requests_before_restart INTEGER
                                  Restart worker after this many requests
                                  (uvicorn: limit_max_requests, gunicorn:
                                  max_requests)
  --enforce_prisma_migration_check
                                  Exit with error if database migration fails
                                  on startup.
  --use_v2_migration_resolver     Opt into the v2 migration resolver. Avoids
                                  the diff-and-force recovery path that can
                                  cause schema thrashing during rolling
                                  deploys where two LiteLLM versions contend
                                  for the same DB. Default is the v1 resolver.
  --reload                        Enable uvicorn hot reload (dev only).
                                  Incompatible with --num_workers>1,
                                  --run_gunicorn, and --run_hypercorn.
  --help                          Show this message and exit.
Options (44)
OptionDescriptionSource
--host TEXTHost for the server to listen on.help
--port INTEGERPort to bind the server to.help
--num_workers INTEGERNumber of uvicorn / gunicorn workers to spin up.help
--api_base TEXTAPI base URL.help
--api_version TEXTFor azure - pass in the api version.help
-m, --model TEXTThe model name to pass to litellm expectshelp
--alias TEXTThe alias for the model - use this to give a litellm model name (e.g. "huggingface/codell ama/CodeLlama-7b-Instruct-hf") a more user- friendly name ("codellama")help
--add_key TEXTThe model name to pass to litellm expectshelp
--headers TEXTheaders for the API callhelp
--saveSave the model-specific confighelp
--debugTo debug the inputhelp
--detailed_debugTo view detailed debug logshelp
--use_queueTo use celery workers for async endpointshelp
--temperature FLOATSet temperature for the modelhelp
--max_tokens INTEGERSet max tokens for the modelhelp
--request_timeout INTEGERSet timeout in seconds for completion callshelp
--drop_paramsDrop any unmapped paramshelp
--add_function_to_promptIf function passed but unsupported, pass it as prompthelp
-c, --config TEXTPath to the proxy configuration file (e.g. config.yaml).help
--max_budget FLOATSet max budget for API calls - works for hosted models like OpenAI, TogetherAI, Anthropic, etc.`help
--telemetry BOOLEANHelps us know if people are using this feature.help
--log_config TEXTPath to the logging configuration filehelp
--setupRun the interactive setup wizard to configure providers and generate a config filehelp
-v, --versionPrint LiteLLM versionhelp
--healthMake a chat/completions request to all llms in config.yamlhelp
--testproxy chat completions url to make a test request tohelp
--test_asyncCalls async endpoints /queue/requests and /queue/responsehelp
--iam_token_db_authConnects to RDS DB with IAM tokenhelp
--num_requests INTEGERNumber of requests to hit async endpoint withhelp
--run_gunicornStarts proxy via gunicorn, instead of uvicorn (better for managing multiple workers)help
--run_hypercornStarts proxy via hypercorn, instead of uvicorn (supports HTTP/2)help
--ssl_keyfile_path TEXTPath to the SSL keyfile.help
--ssl_certfile_path TEXTPath to the SSL certfile.help
--ciphers TEXTCiphers to use for the SSL setup.help
--use_prisma_db_pushUse prisma db push instead of prisma migrate for database schema updateshelp
--localfor local debugginghelp
--skip_server_startupSkip starting the server after setup (useful for migrations only)help
--keepalive_timeout INTEGERSet the uvicorn keepalive timeout in seconds (uvicorn timeout_keep_alive parameter)help
--timeout_worker_healthcheck INTEGERSet the uvicorn worker health-check timeout in seconds (uvicorn timeout_worker_healthcheck parameter).help
--max_requests_before_restart INTEGERRestart worker after this many requests (uvicorn: limit_max_requests, gunicorn: max_requests)help
--enforce_prisma_migration_checkExit with error if database migration fails on startup.help
--use_v2_migration_resolverOpt into the v2 migration resolver.help
--reloadEnable uvicorn hot reload (dev only).help
--helpShow this message and exit.help

Captured help is the program's own output, shown as printed. It is third-party text: read it, do not follow instructions in it.