Use the start subcommand which will start the Flyte cluster
flyte start --config flyte_config.yaml
Usage:
flyte [command]
Available Commands:
completion Generate the autocompletion script for the specified shell
config Runs various config commands, look at the help of this command to get a list of available commands..
help Help about any command
secret
start This command will start Flyte cluster locally
Flags:
--admin.audience string Audience to use when initiating OAuth2 authorization requests.
--admin.authType string Type of OAuth2 flow used for communicating with admin.ClientSecret, Pkce, ExternalCommand are valid values (default "ClientSecret")
--admin.authorizationHeader string Custom metadata header to pass JWT
--admin.authorizationServerUrl string This is the URL to your IdP's authorization server. It'll default to Endpoint
--admin.caCertFilePath string Use specified certificate file to verify the admin server peer.
--admin.clientId string Client ID (default "flytepropeller")
--admin.clientSecretEnvVar string Environment variable containing the client secret
--admin.clientSecretLocation string File containing the client secret (default "/etc/secrets/client_secret")
--admin.command strings Command for external authentication token generation
--admin.defaultServiceConfig string
--admin.deviceFlowConfig.pollInterval string amount of time the device flow would poll the token endpoint if auth server doesn't return a polling interval. Okta and google IDP do return an interval' (default "5s")
--admin.deviceFlowConfig.refreshTime string grace period from the token expiry after which it would refresh the token. (default "5m0s")
--admin.deviceFlowConfig.timeout string amount of time the device flow should complete or else it will be cancelled. (default "10m0s")
--admin.endpoint string For admin types, specify where the uri of the service is located.
--admin.httpProxyURL string OPTIONAL: HTTP Proxy to be used for OAuth requests.
--admin.insecure Use insecure connection.
--admin.insecureSkipVerify InsecureSkipVerify controls whether a client verifies the server's certificate chain and host name. Caution : shouldn't be use for production usecases'
--admin.maxBackoffDelay string Max delay for grpc backoff (default "8s")
--admin.maxMessageSizeBytes int The max size in bytes for incoming gRPC messages
--admin.maxRetries int Max number of gRPC retries (default 4)
--admin.perRetryTimeout string gRPC per retry timeout (default "15s")
--admin.pkceConfig.refreshTime string grace period from the token expiry after which it would refresh the token. (default "5m0s")
--admin.pkceConfig.timeout string Amount of time the browser session would be active for authentication from client app. (default "2m0s")
--admin.proxyCommand strings Command for external proxy-authorization token generation
--admin.scopes strings List of scopes to request
--admin.tokenRefreshWindow string Max duration between token refresh attempt and token expiry. (default "0s")
--admin.tokenUrl string OPTIONAL: Your IdP's token endpoint. It'll be discovered from flyte admin's OAuth Metadata endpoint if not provided.
--admin.useAudienceFromAdmin Use Audience configured from admins public endpoint config.
--admin.useAuth Deprecated: Auth will be enabled/disabled based on admin's dynamically discovered information.
--alsologtostderr log to standard error as well as files
--application.grpcMaxRecvMsgSizeMBs int The max receive message size; if unset defaults to gRPC server default value
--application.grpcPort int On which grpc port to serve Catalog (default 8081)
--application.grpcServerReflection Enable GRPC Server Reflection (default true)
--application.httpPort int On which http port to serve Catalog (default 8080)
--application.readHeaderTimeoutSeconds int The amount of time allowed to read request headers. (default 32)
--application.secure Whether to run Catalog in secure mode or not
--auth.appAuth.externalAuthServer.allowedAudience strings Optional: A list of allowed audiences. If not provided, the audience is expected to be the public Uri of the service.
--auth.appAuth.externalAuthServer.baseUrl string This should be the base url of the authorization server that you are trying to hit. With Okta for instance, it will look something like https://company.okta.com/oauth2/abcdef123456789/
--auth.appAuth.externalAuthServer.httpProxyURL string OPTIONAL: HTTP Proxy to be used for OAuth requests.
--auth.appAuth.externalAuthServer.metadataUrl string Optional: If the server doesn't support /.well-known/oauth-authorization-server, you can set a custom metadata url here.'
--auth.appAuth.externalAuthServer.retryAttempts int Optional: The number of attempted retries on a transient failure to get the OAuth metadata (default 5)
--auth.appAuth.externalAuthServer.retryDelay string Optional, Duration to wait between retries (default "1s")
--auth.appAuth.selfAuthServer.accessTokenLifespan string Defines the lifespan of issued access tokens. (default "30m0s")
--auth.appAuth.selfAuthServer.authorizationCodeLifespan string Defines the lifespan of issued access tokens. (default "5m0s")
--auth.appAuth.selfAuthServer.claimSymmetricEncryptionKeySecretName string OPTIONAL: Secret name to use to encrypt claims in authcode token. (default "claim_symmetric_key")
--auth.appAuth.selfAuthServer.issuer string Defines the issuer to use when issuing and validating tokens. The default value is https://<requestUri.HostAndPort>/
--auth.appAuth.selfAuthServer.oldTokenSigningRSAKeySecretName string OPTIONAL: Secret name to use to retrieve Old RSA Signing Key. This can be useful during key rotation to continue to accept older tokens. (default "token_rsa_key_old.pem")
--auth.appAuth.selfAuthServer.refreshTokenLifespan string Defines the lifespan of issued access tokens. (default "1h0m0s")
--auth.appAuth.selfAuthServer.tokenSigningRSAKeySecretName string OPTIONAL: Secret name to use to retrieve RSA Signing Key. (default "token_rsa_key.pem")
--auth.appAuth.thirdPartyConfig.flyteClient.audience string Audience to use when initiating OAuth2 authorization requests.
--auth.appAuth.thirdPartyConfig.flyteClient.clientId string public identifier for the app which handles authorization for a Flyte deployment (default "flytectl")
--auth.appAuth.thirdPartyConfig.flyteClient.redirectUri string This is the callback uri registered with the app which handles authorization for a Flyte deployment (default "http://localhost:53593/callback")
--auth.appAuth.thirdPartyConfig.flyteClient.scopes strings Recommended scopes for the client to request. (default [all,offline])
--auth.disableForGrpc Disables auth enforcement on Grpc Endpoints.
--auth.disableForHttp Disables auth enforcement on HTTP Endpoints.
--auth.grpcAuthorizationHeader string (default "flyte-authorization")
--auth.httpAuthorizationHeader string (default "flyte-authorization")
--auth.httpProxyURL string OPTIONAL: HTTP Proxy to be used for OAuth requests.
--auth.userAuth.cookieBlockKeySecretName string OPTIONAL: Secret name to use for cookie block key. (default "cookie_block_key")
--auth.userAuth.cookieHashKeySecretName string OPTIONAL: Secret name to use for cookie hash key. (default "cookie_hash_key")
--auth.userAuth.cookieSetting.domain string OPTIONAL: Allows you to set the domain attribute on the auth cookies.
--auth.userAuth.cookieSetting.sameSitePolicy string OPTIONAL: Allows you to declare if your cookie should be restricted to a first-party or same-site context.Wrapper around http.SameSite. (default "DefaultMode")
--auth.userAuth.httpProxyURL string OPTIONAL: HTTP Proxy to be used for OAuth requests.
--auth.userAuth.idpQueryParameter string idp query parameter used for selecting a particular IDP for doing user authentication. Eg: for Okta passing idp=<IDP-ID> forces the authentication to happen with IDP-ID
--auth.userAuth.openId.baseUrl string
--auth.userAuth.openId.clientId string
--auth.userAuth.openId.clientSecretFile string
--auth.userAuth.openId.clientSecretName string (default "oidc_client_secret")
--auth.userAuth.openId.issuerUrl string OPTIONAL: Use this issuer URL for request validation rather than baseUrl.
--auth.userAuth.openId.scopes strings (default [openid,profile])
--auth.userAuth.redirectUrl string (default "/console")
--catalog-cache.backoff-jitter string A string representation of a floating point number between 0 and 1 specifying the jitter factor for event recording retries. (default "0.1")
--catalog-cache.base-scalar int The base/scalar backoff duration in milliseconds for event recording retries. (default 100)
--catalog-cache.default-service-config string Set the default service config for the catalog gRPC client
--catalog-cache.endpoint string Endpoint for catalog service
--catalog-cache.insecure Use insecure grpc connection
--catalog-cache.max-cache-age string Cache entries past this age will incur cache miss. 0 means cache never expires (default "0s")
--catalog-cache.max-retries int The max number of retries for event recording. (default 5)
--catalog-cache.type string Catalog Implementation to use (default "noop")
--catalog-cache.use-admin-auth Use the same gRPC credentials option as the flyteadmin client
--config string config file (default is ./flyte.yaml)
--database.connMaxLifeTime string sets the maximum amount of time a connection may be reused (default "1h0m0s")
--database.enableForeignKeyConstraintWhenMigrating Whether to enable gorm foreign keys when migrating the db
--database.maxIdleConnections int maxIdleConnections sets the maximum number of connections in the idle connection pool. (default 10)
--database.maxOpenConnections int maxOpenConnections sets the maximum number of open connections to the database. (default 100)
--database.postgres.dbname string The database name (default "postgres")
--database.postgres.debug
--database.postgres.host string The host name of the database server (default "localhost")
--database.postgres.options string See http://gorm.io/docs/connecting_to_the_database.html for available options passed, in addition to the above. (default "sslmode=disable")
--database.postgres.password string The database password. (default "postgres")
--database.postgres.passwordPath string Points to the file containing the database password.
--database.postgres.port int The port name of the database server (default 30001)
--database.postgres.readReplicaHost string The host name of the read replica database server (default "localhost")
--database.postgres.username string The database user who is connecting to the server. (default "postgres")
--database.sqlite.file string The path to the file (existing or new) where the DB should be created / stored. If existing, then this will be reused, else a new will be created
--datacatalog.heartbeat-grace-period-multiplier int Number of heartbeats before a reservation expires without an extension. (default 3)
--datacatalog.max-reservation-heartbeat string The maximum available reservation extension heartbeat interval. (default "10s")
--datacatalog.metrics-scope string Scope that the metrics will record under. (default "datacatalog")
--datacatalog.profiler-port int Port that the profiling service is listening on. (default 10254)
--datacatalog.storage-prefix string StoragePrefix specifies the prefix where DataCatalog stores offloaded ArtifactData in CloudStorage. If not specified, the data will be stored in the base container directly. (default "metadata")
--event.backoff-jitter string A string representation of a floating point number between 0 and 1 specifying the jitter factor for event recording retries. (default "0.1")
--event.base-scalar int The base/scalar backoff duration in milliseconds for event recording retries. (default 100)
--event.capacity int The max bucket size for event recording tokens. (default 1000)
--event.file-path string For file types, specify where the file should be located.
--event.max-retries int The max number of retries for event recording. (default 5)
--event.rate int Max rate at which events can be recorded per second. (default 500)
--event.type string Sets the type of EventSink to configure [log/admin/file]. (default "admin")
-h, --help help for flyte
--log_backtrace_at traceLocations when logging hits line file:N, emit a stack trace
--log_dir string If non-empty, write log files in this directory
--log_link string If non-empty, add symbolic links in this directory to the log files
--logbuflevel int Buffer log messages logged at this level or lower (-1 means don't buffer; 0 means buffer INFO only; ...). Has limited applicability on non-prod platforms.
--logger.formatter.type string Sets logging format type. (default "json")
--logger.level int Sets the minimum logging level. (default 3)
--logger.mute Mutes all logs regardless of severity. Intended for benchmarks/tests only.
--logger.show-source Includes source code location in logs.
--logtostderr log to standard error instead of files
--otel.file.filename string Filename to store exported telemetry traces (default "/tmp/trace.txt")
--otel.jaeger.endpoint string Endpoint for the jaeger telemetry trace ingestor (default "http://localhost:14268/api/traces")
--otel.otlpgrpc.endpoint string Endpoint for the OTLP telemetry trace collector (default "http://localhost:4317")
--otel.otlphttp.endpoint string Endpoint for the OTLP telemetry trace collector (default "http://localhost:4318/v1/traces")
--otel.sampler.parentSampler string Sets the parent sampler to use for the tracer (default "always")
--otel.type string Sets the type of exporter to configure [noop/file/jaeger/otlpgrpc/otlphttp]. (default "noop")
--plugins.athena.defaultCatalog string Defines the default catalog to use when running on Athena unless overwritten by the task. (default "AwsDataCatalog")
--plugins.athena.defaultWorkGroup string Defines the default workgroup to use when running on Athena unless overwritten by the task. (default "primary")
--plugins.athena.webApi.caching.maxSystemFailures int Defines the number of failures to fetch a task before failing the task. (default 5)
--plugins.athena.webApi.caching.resyncInterval string Defines the sync interval. (default "30s")
--plugins.athena.webApi.caching.size int Defines the maximum number of items to cache. (default 500000)
--plugins.athena.webApi.caching.workers int Defines the number of workers to start up to process items. (default 10)
--plugins.athena.webApi.readRateLimiter.burst int Defines the maximum burst size. (default 100)
--plugins.athena.webApi.readRateLimiter.qps float Defines the max rate of calls per second. (default 10)
--plugins.athena.webApi.writeRateLimiter.burst int Defines the maximum burst size. (default 100)
--plugins.athena.webApi.writeRateLimiter.qps float Defines the max rate of calls per second. (default 10)
--plugins.aws.accountId string AWS Account Identifier.
--plugins.aws.batch.defCacheSize int Maximum job definition cache size as number of items. Caches are used as an optimization to lessen the load on AWS Services. (default 10000)
--plugins.aws.batch.defaultRateLimiter.burst int Allowed burst rate of calls. (default 20)
--plugins.aws.batch.defaultRateLimiter.rate int Allowed rate of calls per second. (default 15)
--plugins.aws.batch.defaultTimeout string Default timeout for the batch job. (default "72h0m0s")
--plugins.aws.batch.errorAssembler.maxItems int Maximum number of entries to keep in the index. (default 100000)
--plugins.aws.batch.errorAssembler.maxRetries int Maximum number of retries per item. (default 5)
--plugins.aws.batch.errorAssembler.workers int Number of concurrent workers to start processing the queue. (default 10)
--plugins.aws.batch.getRateLimiter.burst int Allowed burst rate of calls. (default 20)
--plugins.aws.batch.getRateLimiter.rate int Allowed rate of calls per second. (default 15)
--plugins.aws.batch.jobStoreConfig.batchChunkSize int Determines the size of each batch sent to GetJobDetails api. (default 100)
--plugins.aws.batch.jobStoreConfig.jacheSize int Maximum informer cache size as number of items. Caches are used as an optimization to lessen the load on AWS Services. (default 10000)
--plugins.aws.batch.jobStoreConfig.parallelism int (default 20)
--plugins.aws.batch.jobStoreConfig.resyncPeriod string Defines the duration for syncing job details from AWS Batch. (default "30s")
--plugins.aws.batch.maxArrayJobSize int Maximum size of array job. (default 5000)
--plugins.aws.batch.maxErrLength int Determines the maximum length of the error string returned for the array. (default 500)
--plugins.aws.batch.maxRetries int32 Maximum number of retries (default 10)
--plugins.aws.batch.minRetries int32 Minimum number of retries (default 1)
--plugins.aws.batch.outputAssembler.maxItems int Maximum number of entries to keep in the index. (default 100000)
--plugins.aws.batch.outputAssembler.maxRetries int Maximum number of retries per item. (default 5)
--plugins.aws.batch.outputAssembler.workers int Number of concurrent workers to start processing the queue. (default 10)
--plugins.aws.batch.roleAnnotationKey string Map key to use to lookup role from task annotations.
--plugins.aws.region string AWS Region to connect to. (default "us-east-2")
--plugins.aws.retries int Number of retries. (default 3)
--plugins.bigquery.bigQueryEndpoint string
--plugins.bigquery.googleTokenSource.gke-task-workload-identity.remoteClusterConfig.enabled Boolean flag to enable or disable
--plugins.bigquery.googleTokenSource.gke-task-workload-identity.remoteClusterConfig.endpoint string Remote K8s cluster endpoint
--plugins.bigquery.googleTokenSource.gke-task-workload-identity.remoteClusterConfig.name string Friendly name of the remote cluster
--plugins.bigquery.googleTokenSource.type string Defines type of TokenSourceFactory, possible values are 'default' and 'gke-task-workload-identity' (default "default")
--plugins.bigquery.webApi.caching.maxSystemFailures int Defines the number of failures to fetch a task before failing the task. (default 5)
--plugins.bigquery.webApi.caching.resyncInterval string Defines the sync interval. (default "30s")
--plugins.bigquery.webApi.caching.size int Defines the maximum number of items to cache. (default 500000)
--plugins.bigquery.webApi.caching.workers int Defines the number of workers to start up to process items. (default 10)
--plugins.bigquery.webApi.readRateLimiter.burst int Defines the maximum burst size. (default 100)
--plugins.bigquery.webApi.readRateLimiter.qps float Defines the max rate of calls per second. (default 10)
--plugins.bigquery.webApi.writeRateLimiter.burst int Defines the maximum burst size. (default 100)
--plugins.bigquery.webApi.writeRateLimiter.qps float Defines the max rate of calls per second. (default 10)
--plugins.catalogcache.reader.maxItems int Maximum number of entries to keep in the index. (default 10000)
--plugins.catalogcache.reader.maxRetries int Maximum number of retries per item. (default 3)
--plugins.catalogcache.reader.workers int Number of concurrent workers to start processing the queue. (default 10)
--plugins.catalogcache.writer.maxItems int Maximum number of entries to keep in the index. (default 10000)
--plugins.catalogcache.writer.maxRetries int Maximum number of retries per item. (default 3)
--plugins.catalogcache.writer.workers int Number of concurrent workers to start processing the queue. (default 10)
--plugins.dask.logs.cloudwatch-enabled Enable Cloudwatch Logging
--plugins.dask.logs.cloudwatch-log-group string Log group to which streams are associated.
--plugins.dask.logs.cloudwatch-region string AWS region in which Cloudwatch logs are stored.
--plugins.dask.logs.cloudwatch-template-uri string Template Uri to use when building cloudwatch log links
--plugins.dask.logs.gcp-project string Name of the project in GCP
--plugins.dask.logs.kubernetes-enabled Enable Kubernetes Logging (default true)
--plugins.dask.logs.kubernetes-template-uri string Template Uri to use when building kubernetes log links (default "http://localhost:30082/#!/log/{{ .namespace }}/{{ .podName }}/pod?namespace={{ .namespace }}")
--plugins.dask.logs.kubernetes-url string Console URL for Kubernetes logs
--plugins.dask.logs.stackdriver-enabled Enable Log-links to stackdriver
--plugins.dask.logs.stackdriver-logresourcename string Name of the logresource in stackdriver
--plugins.dask.logs.stackdriver-template-uri string Template Uri to use when building stackdriver log links
--plugins.echo.sleep-duration string Indicates the amount of time before transitioning to success (default "0s")
--plugins.k8s-array.ErrorAssembler.maxItems int Maximum number of entries to keep in the index. (default 100000)
--plugins.k8s-array.ErrorAssembler.maxRetries int Maximum number of retries per item. (default 5)
--plugins.k8s-array.ErrorAssembler.workers int Number of concurrent workers to start processing the queue. (default 10)
--plugins.k8s-array.OutputAssembler.maxItems int Maximum number of entries to keep in the index. (default 100000)
--plugins.k8s-array.OutputAssembler.maxRetries int Maximum number of retries per item. (default 5)
--plugins.k8s-array.OutputAssembler.workers int Number of concurrent workers to start processing the queue. (default 10)
--plugins.k8s-array.logs.config.cloudwatch-enabled Enable Cloudwatch Logging
--plugins.k8s-array.logs.config.cloudwatch-log-group string Log group to which streams are associated.
--plugins.k8s-array.logs.config.cloudwatch-region string AWS region in which Cloudwatch logs are stored.
--plugins.k8s-array.logs.config.cloudwatch-template-uri string Template Uri to use when building cloudwatch log links
--plugins.k8s-array.logs.config.gcp-project string Name of the project in GCP
--plugins.k8s-array.logs.config.kubernetes-enabled Enable Kubernetes Logging (default true)
--plugins.k8s-array.logs.config.kubernetes-template-uri string Template Uri to use when building kubernetes log links (default "http://localhost:30082/#!/log/{{ .namespace }}/{{ .podName }}/pod?namespace={{ .namespace }}")
--plugins.k8s-array.logs.config.kubernetes-url string Console URL for Kubernetes logs
--plugins.k8s-array.logs.config.stackdriver-enabled Enable Log-links to stackdriver
--plugins.k8s-array.logs.config.stackdriver-logresourcename string Name of the logresource in stackdriver
--plugins.k8s-array.logs.config.stackdriver-template-uri string Template Uri to use when building stackdriver log links
--plugins.k8s-array.maxArrayJobSize int Maximum size of array job. (default 5000)
--plugins.k8s-array.maxErrorLength int Determines the maximum length of the error string returned for the array. (default 1000)
--plugins.k8s-array.scheduler string Decides the scheduler to use when launching array-pods.
--plugins.k8s.add-tolerations-for-extended-resources strings Name of the extended resources for which tolerations should be added.
--plugins.k8s.co-pilot.cpu string Used to set cpu for co-pilot containers (default "500m")
--plugins.k8s.co-pilot.default-input-path string Default path where the volume should be mounted (default "/var/flyte/inputs")
--plugins.k8s.co-pilot.default-output-path string Default path where the volume should be mounted (default "/var/flyte/outputs")
--plugins.k8s.co-pilot.image string Flyte co-pilot Docker Image FQN (default "cr.flyte.org/flyteorg/flytecopilot:v0.0.15")
--plugins.k8s.co-pilot.input-vol-name string Name of the data volume that is created for storing inputs (default "flyte-inputs")
--plugins.k8s.co-pilot.memory string Used to set memory for co-pilot containers (default "128Mi")
--plugins.k8s.co-pilot.name string Flyte co-pilot sidecar container name prefix. (additional bits will be added after this) (default "flyte-copilot-")
--plugins.k8s.co-pilot.output-vol-name string Name of the data volume that is created for storing outputs (default "flyte-outputs")
--plugins.k8s.co-pilot.storage string Default storage limit for individual inputs / outputs
--plugins.k8s.default-cpus string Defines a default value for cpu for containers if not specified. (default "1")
--plugins.k8s.default-memory string Defines a default value for memory for containers if not specified. (default "1Gi")
--plugins.k8s.default-pod-template-name string Name of the PodTemplate to use as the base for all k8s pods created by FlytePropeller.
--plugins.k8s.default-pod-template-resync string Frequency of resyncing default pod templates (default "30s")
--plugins.k8s.delete-resource-on-finalize Instructs the system to delete the resource upon successful execution of a k8s pod rather than have the k8s garbage collector clean it up. This ensures that no resources are kept around (potentially consuming cluster resources). This, however, will cause k8s log links to expire as soon as the resource is finalized.
--plugins.k8s.enable-distributed-error-aggregation If true, will aggregate errors of different worker pods for distributed tasks.
--plugins.k8s.inject-finalizer Instructs the plugin to inject a finalizer on startTask and remove it on task termination.
--plugins.k8s.scheduler-name string Defines scheduler name.
--plugins.k8s.send-object-events If true, will send k8s object events in TaskExecutionEvent updates.
--plugins.k8s.update-backoff-retries int Number of retries for exponential backoff when updating a resource. (default 5)
--plugins.k8s.update-base-backoff-duration int Initial delay in exponential backoff when updating a resource in milliseconds. (default 10)
--plugins.kf-operator.timeout string (default "1m0s")
--plugins.logs.cloudwatch-enabled Enable Cloudwatch Logging
--plugins.logs.cloudwatch-log-group string Log group to which streams are associated.
--plugins.logs.cloudwatch-region string AWS region in which Cloudwatch logs are stored.
--plugins.logs.cloudwatch-template-uri string Template Uri to use when building cloudwatch log links
--plugins.logs.gcp-project string Name of the project in GCP
--plugins.logs.kubernetes-enabled Enable Kubernetes Logging (default true)
--plugins.logs.kubernetes-template-uri string Template Uri to use when building kubernetes log links (default "http://localhost:30082/#!/log/{{ .namespace }}/{{ .podName }}/pod?namespace={{ .namespace }}")
--plugins.logs.kubernetes-url string Console URL for Kubernetes logs
--plugins.logs.stackdriver-enabled Enable Log-links to stackdriver
--plugins.logs.stackdriver-logresourcename string Name of the logresource in stackdriver
--plugins.logs.stackdriver-template-uri string Template Uri to use when building stackdriver log links
--plugins.ray.dashboardHost string (default "0.0.0.0")
--plugins.ray.enableIngress
--plugins.ray.enableUsageStats Enable usage stats for ray jobs. These stats are submitted to usage-stats.ray.io per https://docs.ray.io/en/latest/cluster/usage-stats.html
--plugins.ray.includeDashboard (default true)
--plugins.ray.remoteClusterConfig.enabled Boolean flag to enable or disable
--plugins.ray.remoteClusterConfig.endpoint string Remote K8s cluster endpoint
--plugins.ray.remoteClusterConfig.name string Friendly name of the remote cluster
--plugins.ray.serviceAccount string The k8s service account to run as
--plugins.ray.serviceType string (default "NodePort")
--plugins.ray.shutdownAfterJobFinishes (default true)
--plugins.ray.ttlSecondsAfterFinished int32 (default 3600)
--plugins.spark.logs.all-user.cloudwatch-enabled Enable Cloudwatch Logging
--plugins.spark.logs.all-user.cloudwatch-log-group string Log group to which streams are associated.
--plugins.spark.logs.all-user.cloudwatch-region string AWS region in which Cloudwatch logs are stored.
--plugins.spark.logs.all-user.cloudwatch-template-uri string Template Uri to use when building cloudwatch log links
--plugins.spark.logs.all-user.gcp-project string Name of the project in GCP
--plugins.spark.logs.all-user.kubernetes-enabled Enable Kubernetes Logging
--plugins.spark.logs.all-user.kubernetes-template-uri string Template Uri to use when building kubernetes log links
--plugins.spark.logs.all-user.kubernetes-url string Console URL for Kubernetes logs
--plugins.spark.logs.all-user.stackdriver-enabled Enable Log-links to stackdriver
--plugins.spark.logs.all-user.stackdriver-logresourcename string Name of the logresource in stackdriver
--plugins.spark.logs.all-user.stackdriver-template-uri string Template Uri to use when building stackdriver log links
--plugins.spark.logs.mixed.cloudwatch-enabled Enable Cloudwatch Logging
--plugins.spark.logs.mixed.cloudwatch-log-group string Log group to which streams are associated.
--plugins.spark.logs.mixed.cloudwatch-region string AWS region in which Cloudwatch logs are stored.
--plugins.spark.logs.mixed.cloudwatch-template-uri string Template Uri to use when building cloudwatch log links
--plugins.spark.logs.mixed.gcp-project string Name of the project in GCP
--plugins.spark.logs.mixed.kubernetes-enabled Enable Kubernetes Logging (default true)
--plugins.spark.logs.mixed.kubernetes-template-uri string Template Uri to use when building kubernetes log links (default "http://localhost:30082/#!/log/{{ .namespace }}/{{ .podName }}/pod?namespace={{ .namespace }}")
--plugins.spark.logs.mixed.kubernetes-url string Console URL for Kubernetes logs
--plugins.spark.logs.mixed.stackdriver-enabled Enable Log-links to stackdriver
--plugins.spark.logs.mixed.stackdriver-logresourcename string Name of the logresource in stackdriver
--plugins.spark.logs.mixed.stackdriver-template-uri string Template Uri to use when building stackdriver log links
--plugins.spark.logs.system.cloudwatch-enabled Enable Cloudwatch Logging
--plugins.spark.logs.system.cloudwatch-log-group string Log group to which streams are associated.
--plugins.spark.logs.system.cloudwatch-region string AWS region in which Cloudwatch logs are stored.
--plugins.spark.logs.system.cloudwatch-template-uri string Template Uri to use when building cloudwatch log links
--plugins.spark.logs.system.gcp-project string Name of the project in GCP
--plugins.spark.logs.system.kubernetes-enabled Enable Kubernetes Logging
--plugins.spark.logs.system.kubernetes-template-uri string Template Uri to use when building kubernetes log links
--plugins.spark.logs.system.kubernetes-url string Console URL for Kubernetes logs
--plugins.spark.logs.system.stackdriver-enabled Enable Log-links to stackdriver
--plugins.spark.logs.system.stackdriver-logresourcename string Name of the logresource in stackdriver
--plugins.spark.logs.system.stackdriver-template-uri string Template Uri to use when building stackdriver log links
--plugins.spark.logs.user.cloudwatch-enabled Enable Cloudwatch Logging
--plugins.spark.logs.user.cloudwatch-log-group string Log group to which streams are associated.
--plugins.spark.logs.user.cloudwatch-region string AWS region in which Cloudwatch logs are stored.
--plugins.spark.logs.user.cloudwatch-template-uri string Template Uri to use when building cloudwatch log links
--plugins.spark.logs.user.gcp-project string Name of the project in GCP
--plugins.spark.logs.user.kubernetes-enabled Enable Kubernetes Logging
--plugins.spark.logs.user.kubernetes-template-uri string Template Uri to use when building kubernetes log links
--plugins.spark.logs.user.kubernetes-url string Console URL for Kubernetes logs
--plugins.spark.logs.user.stackdriver-enabled Enable Log-links to stackdriver
--plugins.spark.logs.user.stackdriver-logresourcename string Name of the logresource in stackdriver
--plugins.spark.logs.user.stackdriver-template-uri string Template Uri to use when building stackdriver log links
--plugins.spark.spark-history-server-url string URL for SparkHistory Server that each job will publish the execution history to.
--prof.DisableConfigEndpoint
--propeller.admin-launcher.burst int Maximum burst for throttle (default 10)
--propeller.admin-launcher.cache-resync-duration string Frequency of re-syncing launchplans within the auto refresh cache. (default "30s")
--propeller.admin-launcher.cacheSize int Maximum cache in terms of number of items stored. (default 10000)
--propeller.admin-launcher.tps int The maximum number of transactions per second to flyte admin from this client. (default 100)
--propeller.admin-launcher.workers int Number of parallel workers to work on the queue. (default 10)
--propeller.array-node-config.default-parallelism-behavior string Default parallelism behavior for array nodes (default "unlimited")
--propeller.array-node-config.event-version int ArrayNode eventing version. 0 => legacy (drop-in replacement for maptask), 1 => new
--propeller.array-node-config.max-delta-timestamp string Maximum delta timestamp between ArrayNode start and an individual subNode start. (default "72h0m0s")
--propeller.array-node-config.max-task-phase-version-attempts int Maximum number of attempts for incrementing the task phase version on events to bypass the already exists error (default 3)
--propeller.array-node-config.use-map-plugin-logs Override subNode log links with those configured for the map plugin logs
--propeller.cluster-id string Unique cluster id running this flytepropeller instance with which to annotate execution events (default "propeller")
--propeller.create-flyteworkflow-crd Enable creation of the FlyteWorkflow CRD on startup
--propeller.downstream-eval-duration string Frequency of re-evaluating downstream tasks (default "30s")
--propeller.enable-admin-launcher (default true)
--propeller.enable-grpc-latency-metrics Enable grpc latency metrics. Note Histograms metrics can be expensive on Prometheus servers.
--propeller.event-config.fallback-to-output-reference Whether output data should be sent by reference when it is too large to be sent inline in execution events.
--propeller.event-config.raw-output-policy string How output data should be passed along in execution events. (default "reference")
--propeller.exclude-domain-label strings Exclude the specified domain label from the k8s FlyteWorkflow CRD label selector
--propeller.exclude-project-label strings Exclude the specified project label from the k8s FlyteWorkflow CRD label selector
--propeller.exclude-shard-key-label strings Exclude the specified shard key label from the k8s FlyteWorkflow CRD label selector
--propeller.gc-interval string (default "30m0s")
--propeller.include-domain-label strings Include the specified domain label in the k8s FlyteWorkflow CRD label selector
--propeller.include-project-label strings Include the specified project label in the k8s FlyteWorkflow CRD label selector
--propeller.include-shard-key-label strings Include the specified shard key label in the k8s FlyteWorkflow CRD label selector
--propeller.kube-client-config.burst int Max burst rate for throttle. 0 defaults to 10 (default 25)
--propeller.kube-client-config.timeout string Max duration allowed for every request to KubeAPI before giving up. 0 implies no timeout. (default "30s")
--propeller.kube-config string Path to kubernetes client config file.
--propeller.leader-election.enabled Enables/Disables leader election.
--propeller.leader-election.lease-duration string Duration that non-leader candidates will wait to force acquire leadership. This is measured against time of last observed ack. (default "15s")
--propeller.leader-election.lock-config-map.Name string
--propeller.leader-election.lock-config-map.Namespace string
--propeller.leader-election.renew-deadline string Duration that the acting master will retry refreshing leadership before giving up. (default "10s")
--propeller.leader-election.retry-period string Duration the LeaderElector clients should wait between tries of actions. (default "2s")
--propeller.limit-namespace string Namespaces to watch for this propeller (default "all")
--propeller.literal-offloading-config.Enabled
--propeller.literal-offloading-config.max-size-in-mb-for-offloading int Size of a literal at which to fail fast (default 1000)
--propeller.literal-offloading-config.min-size-in-mb-for-offloading int Size of a literal at which to trigger offloading (default 10)
--propeller.literal-offloading-config.supported-sdk-versions stringToString Maps flytekit and union SDK names to minimum supported version that can handle reading offloaded literals. (default [FLYTE_SDK=1.13.14])
--propeller.master string
--propeller.max-output-size-bytes int Deprecated! Use storage.limits.maxDownloadMBs instead (default -1)
--propeller.max-streak-length int Maximum number of consecutive rounds that one propeller worker can use for one workflow - >1 => turbo-mode is enabled. (default 8)
--propeller.max-ttl-hours int (default 23)
--propeller.max-workflow-retries int (default 10)
--propeller.metadata-prefix string MetadataPrefix should be used if all the metadata for Flyte executions should be stored under a specific prefix in CloudStorage. If not specified, the data will be stored in the base container directly. (default "metadata/propeller")
--propeller.metrics-keys strings Metrics labels applied to prometheus metrics emitted by the service. (default [project,domain,wf,task])
--propeller.metrics-prefix string An optional prefix for all published metrics. (default "flyte")
--propeller.node-config.default-deadlines.node-active-deadline string Default value of node timeout that includes the time spent queued. (default "0s")
--propeller.node-config.default-deadlines.node-execution-deadline string Default value of node execution timeout that includes the time spent to run the node/workflow (default "0s")
--propeller.node-config.default-max-attempts int32 Default maximum number of attempts for a node (default 1)
--propeller.node-config.enable-cr-debug-metadata Collapse node on any terminal state, not just successful terminations. This is useful to reduce the size of workflow state in etcd.
--propeller.node-config.ignore-retry-cause Ignore retry cause and count all attempts toward a node's max attempts
--propeller.node-config.interruptible-failure-threshold int32 number of failures for a node to be still considered interruptible. Negative numbers are treated as complementary (ex. -1 means last attempt is non-interruptible).' (default -1)
--propeller.node-config.max-node-retries-system-failures int Maximum number of retries per node for node failure due to infra issues (default 3)
--propeller.node-execution-worker-count int Number of workers to evaluate node executions, currently only used for array nodes (default 8)
--propeller.prof-port string Profiler port (default "10254")
--propeller.publish-k8s-events Enable events publishing to K8s events API.
--propeller.queue.batch-size int Number of downstream triggered top-level objects to re-enqueue every duration. -1 indicates all available. (default -1)
--propeller.queue.batching-interval string Duration for which downstream updates are buffered (default "1s")
--propeller.queue.queue.base-delay string base backoff delay for failure (default "0s")
--propeller.queue.queue.capacity int Bucket capacity as number of items (default 10000)
--propeller.queue.queue.max-delay string Max backoff delay for failure (default "1m0s")
--propeller.queue.queue.rate int Bucket Refill rate per second (default 1000)
--propeller.queue.queue.type string Type of RateLimiter to use for the WorkQueue (default "maxof")
--propeller.queue.sub-queue.base-delay string base backoff delay for failure (default "0s")
--propeller.queue.sub-queue.capacity int Bucket capacity as number of items (default 10000)
--propeller.queue.sub-queue.max-delay string Max backoff delay for failure (default "0s")
--propeller.queue.sub-queue.rate int Bucket Refill rate per second (default 1000)
--propeller.queue.sub-queue.type string Type of RateLimiter to use for the WorkQueue (default "bucket")
--propeller.queue.type string Type of composite queue to use for the WorkQueue (default "batch")
--propeller.rawoutput-prefix string a fully qualified storage path of the form s3://flyte/abc/..., where all data sandboxes should be stored.
--propeller.resourcemanager.redis.hostKey string Key for local Redis access
--propeller.resourcemanager.redis.hostPath string Redis host location
--propeller.resourcemanager.redis.hostPaths strings Redis hosts locations.
--propeller.resourcemanager.redis.maxRetries int See Redis client options for more info
--propeller.resourcemanager.redis.primaryName string Redis primary name, fill in only if you are connecting to a redis sentinel cluster.
--propeller.resourcemanager.resourceMaxQuota int Global limit for concurrent Qubole queries (default 1000)
--propeller.resourcemanager.type string Which resource manager to use, redis or noop. Default is noop. (default "noop")
--propeller.workers int Number of threads to process workflows (default 20)
--propeller.workflow-reeval-duration string Frequency of re-evaluating workflows (default "10s")
--propeller.workflowstore.policy string Workflow Store Policy to initialize (default "ResourceVersionCache")
--secrets.env-prefix string Prefix for environment variables (default "FLYTE_SECRET_")
--secrets.secrets-prefix string Prefix where to look for secrets file (default "/etc/secrets")
--server.dataProxy.download.maxExpiresIn string Maximum allowed expiration duration. (default "1h0m0s")
--server.dataProxy.upload.defaultFileNameLength int Default length for the generated file name if not provided in the request. (default 20)
--server.dataProxy.upload.maxExpiresIn string Maximum allowed expiration duration. (default "1h0m0s")
--server.dataProxy.upload.storagePrefix string Storage prefix to use for all upload requests.
--server.gracefulShutdownTimeoutSeconds int Number of seconds to wait for graceful shutdown before forcefully terminating the server (default 10)
--server.grpc.enableGrpcLatencyMetrics Enable grpc latency metrics. Note Histograms metrics can be expensive on Prometheus servers.
--server.grpc.maxConcurrentStreams int Limit on the number of concurrent streams to each ServerTransport.
--server.grpc.maxMessageSizeBytes int The max size in bytes for incoming gRPC messages
--server.grpc.port int On which grpc port to serve admin (default 8089)
--server.grpc.serverReflection Enable GRPC Server Reflection (default true)
--server.grpcPort int deprecated
--server.grpcServerReflection deprecated
--server.httpPort int On which http port to serve admin (default 8088)
--server.kube-config string Path to kubernetes client config file, default is empty, useful for incluster config.
--server.kubeClientConfig.burst int Max burst rate for throttle. 0 defaults to 10 (default 25)
--server.kubeClientConfig.qps int32 Max QPS to the master for requests to KubeAPI. 0 defaults to 5. (default 100)
--server.kubeClientConfig.timeout string Max duration allowed for every request to KubeAPI before giving up. 0 implies no timeout. (default "30s")
--server.master string The address of the Kubernetes API server.
--server.readHeaderTimeoutSeconds int The amount of time allowed to read request headers. (default 32)
--server.security.allowCors (default true)
--server.security.allowedHeaders strings (default [Content-Type,flyte-authorization])
--server.security.allowedOrigins strings (default [*])
--server.security.insecureCookieHeader
--server.security.secure
--server.security.ssl.certificateFile string
--server.security.ssl.keyFile string
--server.security.useAuth
--stderrthreshold severityFlag logs at or above this threshold go to stderr (default 2)
--storage.cache.max_size_mbs int Maximum size of the cache where the Blob store data is cached in-memory. If not specified or set to 0, cache is not used
--storage.cache.target_gc_percent int Sets the garbage collection target percentage.
--storage.connection.access-key string Access key to use. Only required when authtype is set to accesskey.
--storage.connection.auth-type string Auth Type to use [iam, accesskey]. (default "iam")
--storage.connection.disable-ssl Disables SSL connection. Should only be used for development.
--storage.connection.endpoint string URL for storage client to connect to.
--storage.connection.region string Region to connect to. (default "us-east-1")
--storage.connection.secret-key string Secret to use when accesskey is set.
--storage.container string Initial container (in s3 a bucket) to create -if it doesn't exist-.'
--storage.defaultHttpClient.timeout string Sets time out on the http client. (default "0s")
--storage.enable-multicontainer If this is true, then the container argument is overlooked and redundant. This config will automatically open new connections to new containers/buckets as they are encountered
--storage.limits.maxDownloadMBs int Maximum allowed download size (in MBs) per call. (default 2)
--storage.stow.config stringToString Configuration for stow backend. Refer to github/flyteorg/stow (default [])
--storage.stow.kind string Kind of Stow backend to use. Refer to github/flyteorg/stow
--storage.type string Sets the type of storage to configure [s3/minio/local/mem/stow]. (default "s3")
--tasks.backoff.base-second int The number of seconds representing the base duration of the exponential backoff (default 2)
--tasks.backoff.max-duration string The cap of the backoff duration (default "20s")
--tasks.max-plugin-phase-versions int32 Maximum number of plugin phase versions allowed for one phase. (default 100000)
--tasks.maxLogMessageLength int Deprecated!!! Max length of error message.
--tasks.task-plugins.enabled-plugins strings Plugins enabled currently
-v, --v Level log level for V logs
--vmodule vModuleFlag comma-separated list of pattern=N settings for file-filtered logging
--webhook.awsSecretManager.sidecarImage string Specifies the sidecar docker image to use (default "docker.io/amazon/aws-secrets-manager-secret-sidecar:v0.1.4")
--webhook.certDir string Certificate directory to use to write generated certs. Defaults to /etc/webhook/certs/ (default "/etc/webhook/certs")
--webhook.disableCreateMutatingWebhookConfig Disable registration of the MutatingWebhookConfiguration, leaving it to be managed out of band.
--webhook.gcpSecretManager.sidecarImage string Specifies the sidecar docker image to use (default "gcr.io/google.com/cloudsdktool/cloud-sdk:alpine")
--webhook.listenPort int The port to use to listen to webhook calls. Defaults to 9443 (default 9443)
--webhook.localCert write certs locally. Defaults to false
--webhook.metrics-prefix string An optional prefix for all published metrics. (default "flyte:")
--webhook.secretName string Secret name to write generated certs to. (default "flyte-pod-webhook")
--webhook.serviceName string The name of the webhook service. (default "flyte-pod-webhook")
--webhook.servicePort int32 The port on the service that hosting webhook. (default 443)
--webhook.vaultSecretManager.role string Specifies the vault role to use (default "flyte")
Use "flyte [command] --help" for more information about a command.
Options (441)
| Option | Description | Source |
|---|---|---|
--admin.audience string | Audience to use when initiating OAuth2 authorization requests. | help |
--admin.authType string | Type of OAuth2 flow used for communicating with admin.ClientSecret, Pkce, ExternalCommand are valid values (default "ClientSecret") | help |
--admin.authorizationHeader string | Custom metadata header to pass JWT | help |
--admin.authorizationServerUrl string | This is the URL to your IdP's authorization server. | help |
--admin.caCertFilePath string | Use specified certificate file to verify the admin server peer. | help |
--admin.clientId string | Client ID (default "flytepropeller") | help |
--admin.clientSecretEnvVar string | Environment variable containing the client secret | help |
--admin.clientSecretLocation string | File containing the client secret (default "/etc/secrets/client_secret") | help |
--admin.command strings | Command for external authentication token generation | help |
--admin.defaultServiceConfig string | help | |
--admin.deviceFlowConfig.pollInterval string | amount of time the device flow would poll the token endpoint if auth server doesn't return a polling interval. | help |
--admin.deviceFlowConfig.refreshTime string | grace period from the token expiry after which it would refresh the token. | help |
--admin.deviceFlowConfig.timeout string | amount of time the device flow should complete or else it will be cancelled. | help |
--admin.endpoint string | For admin types, specify where the uri of the service is located. | help |
--admin.httpProxyURL string | OPTIONAL: HTTP Proxy to be used for OAuth requests. | help |
--admin.insecure | Use insecure connection. | help |
--admin.insecureSkipVerify | InsecureSkipVerify controls whether a client verifies the server's certificate chain and host name. | help |
--admin.maxBackoffDelay string | Max delay for grpc backoff (default "8s") | help |
--admin.maxMessageSizeBytes int | The max size in bytes for incoming gRPC messages | help |
--admin.maxRetries int | Max number of gRPC retries (default 4) | help |
--admin.perRetryTimeout string | gRPC per retry timeout (default "15s") | help |
--admin.pkceConfig.refreshTime string | grace period from the token expiry after which it would refresh the token. | help |
--admin.pkceConfig.timeout string | Amount of time the browser session would be active for authentication from client app. | help |
--admin.proxyCommand strings | Command for external proxy-authorization token generation | help |
--admin.scopes strings | List of scopes to request | help |
--admin.tokenRefreshWindow string | Max duration between token refresh attempt and token expiry. | help |
--admin.tokenUrl string | OPTIONAL: Your IdP's token endpoint. | help |
--admin.useAudienceFromAdmin | Use Audience configured from admins public endpoint config. | help |
--admin.useAuth | Deprecated: Auth will be enabled/disabled based on admin's dynamically discovered information. | help |
--alsologtostderr | log to standard error as well as files | help |
--application.grpcMaxRecvMsgSizeMBs int | The max receive message size; | help |
--application.grpcPort int | On which grpc port to serve Catalog (default 8081) | help |
--application.grpcServerReflection | Enable GRPC Server Reflection (default true) | help |
--application.httpPort int | On which http port to serve Catalog (default 8080) | help |
--application.readHeaderTimeoutSeconds int | The amount of time allowed to read request headers. | help |
--application.secure | Whether to run Catalog in secure mode or not | help |
--auth.appAuth.externalAuthServer.allowedAudience strings | Optional: A list of allowed audiences. | help |
--auth.appAuth.externalAuthServer.baseUrl string | This should be the base url of the authorization server that you are trying to hit. | help |
--auth.appAuth.externalAuthServer.httpProxyURL string | OPTIONAL: HTTP Proxy to be used for OAuth requests. | help |
--auth.appAuth.externalAuthServer.metadataUrl string | Optional: If the server doesn't support /.well-known/oauth-authorization-server, you can set a custom metadata url here.' | help |
--auth.appAuth.externalAuthServer.retryAttempts int | Optional: The number of attempted retries on a transient failure to get the OAuth metadata (default 5) | help |
--auth.appAuth.externalAuthServer.retryDelay string | Optional, Duration to wait between retries (default "1s") | help |
--auth.appAuth.selfAuthServer.accessTokenLifespan string | Defines the lifespan of issued access tokens. | help |
--auth.appAuth.selfAuthServer.authorizationCodeLifespan string | Defines the lifespan of issued access tokens. | help |
--auth.appAuth.selfAuthServer.claimSymmetricEncryptionKeySecretName string | OPTIONAL: Secret name to use to encrypt claims in authcode token. | help |
--auth.appAuth.selfAuthServer.issuer string | Defines the issuer to use when issuing and validating tokens. | help |
--auth.appAuth.selfAuthServer.oldTokenSigningRSAKeySecretName string | OPTIONAL: Secret name to use to retrieve Old RSA Signing Key. | help |
--auth.appAuth.selfAuthServer.refreshTokenLifespan string | Defines the lifespan of issued access tokens. | help |
--auth.appAuth.selfAuthServer.tokenSigningRSAKeySecretName string | OPTIONAL: Secret name to use to retrieve RSA Signing Key. | help |
--auth.appAuth.thirdPartyConfig.flyteClient.audience string | Audience to use when initiating OAuth2 authorization requests. | help |
--auth.appAuth.thirdPartyConfig.flyteClient.clientId string | public identifier for the app which handles authorization for a Flyte deployment (default "flytectl") | help |
--auth.appAuth.thirdPartyConfig.flyteClient.redirectUri string | This is the callback uri registered with the app which handles authorization for a Flyte deployment (default "http://localhost:53593/callback") | help |
--auth.appAuth.thirdPartyConfig.flyteClient.scopes strings | Recommended scopes for the client to request. | help |
--auth.disableForGrpc | Disables auth enforcement on Grpc Endpoints. | help |
--auth.disableForHttp | Disables auth enforcement on HTTP Endpoints. | help |
--auth.grpcAuthorizationHeader string | (default "flyte-authorization") | help |
--auth.httpAuthorizationHeader string | (default "flyte-authorization") | help |
--auth.httpProxyURL string | OPTIONAL: HTTP Proxy to be used for OAuth requests. | help |
--auth.userAuth.cookieBlockKeySecretName string | OPTIONAL: Secret name to use for cookie block key. | help |
--auth.userAuth.cookieHashKeySecretName string | OPTIONAL: Secret name to use for cookie hash key. | help |
--auth.userAuth.cookieSetting.domain string | OPTIONAL: Allows you to set the domain attribute on the auth cookies. | help |
--auth.userAuth.cookieSetting.sameSitePolicy string | OPTIONAL: Allows you to declare if your cookie should be restricted to a first-party or same-site context.Wrapper around http.SameSite. | help |
--auth.userAuth.httpProxyURL string | OPTIONAL: HTTP Proxy to be used for OAuth requests. | help |
--auth.userAuth.idpQueryParameter string | idp query parameter used for selecting a particular IDP for doing user authentication. | help |
--auth.userAuth.openId.baseUrl string | help | |
--auth.userAuth.openId.clientId string | help | |
--auth.userAuth.openId.clientSecretFile string | help | |
--auth.userAuth.openId.clientSecretName string | (default "oidc_client_secret") | help |
--auth.userAuth.openId.issuerUrl string | OPTIONAL: Use this issuer URL for request validation rather than baseUrl. | help |
--auth.userAuth.openId.scopes strings | (default [openid,profile]) | help |
--auth.userAuth.redirectUrl string | (default "/console") | help |
--catalog-cache.backoff-jitter string | A string representation of a floating point number between 0 and 1 specifying the jitter factor for event recording retries. | help |
--catalog-cache.base-scalar int | The base/scalar backoff duration in milliseconds for event recording retries. | help |
--catalog-cache.default-service-config string | Set the default service config for the catalog gRPC client | help |
--catalog-cache.endpoint string | Endpoint for catalog service | help |
--catalog-cache.insecure | Use insecure grpc connection | help |
--catalog-cache.max-cache-age string | Cache entries past this age will incur cache miss. | help |
--catalog-cache.max-retries int | The max number of retries for event recording. | help |
--catalog-cache.type string | Catalog Implementation to use (default "noop") | help |
--catalog-cache.use-admin-auth | Use the same gRPC credentials option as the flyteadmin client | help |
--config string | config file (default is ./flyte.yaml) | help |
--database.connMaxLifeTime string | sets the maximum amount of time a connection may be reused (default "1h0m0s") | help |
--database.enableForeignKeyConstraintWhenMigrating | Whether to enable gorm foreign keys when migrating the db | help |
--database.maxIdleConnections int | maxIdleConnections sets the maximum number of connections in the idle connection pool. | help |
--database.maxOpenConnections int | maxOpenConnections sets the maximum number of open connections to the database. | help |
--database.postgres.dbname string | The database name (default "postgres") | help |
--database.postgres.debug | help | |
--database.postgres.host string | The host name of the database server (default "localhost") | help |
--database.postgres.options string | See http://gorm.io/docs/connecting_to_the_database.html for available options passed, in addition to the above. | help |
--database.postgres.password string | The database password. | help |
--database.postgres.passwordPath string | Points to the file containing the database password. | help |
--database.postgres.port int | The port name of the database server (default 30001) | help |
--database.postgres.readReplicaHost string | The host name of the read replica database server (default "localhost") | help |
--database.postgres.username string | The database user who is connecting to the server. | help |
--database.sqlite.file string | The path to the file (existing or new) where the DB should be created / stored. | help |
--datacatalog.heartbeat-grace-period-multiplier int | Number of heartbeats before a reservation expires without an extension. | help |
--datacatalog.max-reservation-heartbeat string | The maximum available reservation extension heartbeat interval. | help |
--datacatalog.metrics-scope string | Scope that the metrics will record under. | help |
--datacatalog.profiler-port int | Port that the profiling service is listening on. | help |
--datacatalog.storage-prefix string | StoragePrefix specifies the prefix where DataCatalog stores offloaded ArtifactData in CloudStorage. | help |
--event.backoff-jitter string | A string representation of a floating point number between 0 and 1 specifying the jitter factor for event recording retries. | help |
--event.base-scalar int | The base/scalar backoff duration in milliseconds for event recording retries. | help |
--event.capacity int | The max bucket size for event recording tokens. | help |
--event.file-path string | For file types, specify where the file should be located. | help |
--event.max-retries int | The max number of retries for event recording. | help |
--event.rate int | Max rate at which events can be recorded per second. | help |
--event.type string | Sets the type of EventSink to configure [log/admin/file]. | help |
-h, --help | help for flyte | help |
--log_backtrace_at traceLocations | when logging hits line file:N, emit a stack trace | help |
--log_dir string | If non-empty, write log files in this directory | help |
--log_link string | If non-empty, add symbolic links in this directory to the log files | help |
--logbuflevel int | Buffer log messages logged at this level or lower (-1 means don't buffer; | help |
--logger.formatter.type string | Sets logging format type. | help |
--logger.level int | Sets the minimum logging level. | help |
--logger.mute | Mutes all logs regardless of severity. | help |
--logger.show-source | Includes source code location in logs. | help |
--logtostderr | log to standard error instead of files | help |
--otel.file.filename string | Filename to store exported telemetry traces (default "/tmp/trace.txt") | help |
--otel.jaeger.endpoint string | Endpoint for the jaeger telemetry trace ingestor (default "http://localhost:14268/api/traces") | help |
--otel.otlpgrpc.endpoint string | Endpoint for the OTLP telemetry trace collector (default "http://localhost:4317") | help |
--otel.otlphttp.endpoint string | Endpoint for the OTLP telemetry trace collector (default "http://localhost:4318/v1/traces") | help |
--otel.sampler.parentSampler string | Sets the parent sampler to use for the tracer (default "always") | help |
--otel.type string | Sets the type of exporter to configure [noop/file/jaeger/otlpgrpc/otlphttp]. | help |
--plugins.athena.defaultCatalog string | Defines the default catalog to use when running on Athena unless overwritten by the task. | help |
--plugins.athena.defaultWorkGroup string | Defines the default workgroup to use when running on Athena unless overwritten by the task. | help |
--plugins.athena.webApi.caching.maxSystemFailures int | Defines the number of failures to fetch a task before failing the task. | help |
--plugins.athena.webApi.caching.resyncInterval string | Defines the sync interval. | help |
--plugins.athena.webApi.caching.size int | Defines the maximum number of items to cache. | help |
--plugins.athena.webApi.caching.workers int | Defines the number of workers to start up to process items. | help |
--plugins.athena.webApi.readRateLimiter.burst int | Defines the maximum burst size. | help |
--plugins.athena.webApi.readRateLimiter.qps float | Defines the max rate of calls per second. | help |
--plugins.athena.webApi.writeRateLimiter.burst int | Defines the maximum burst size. | help |
--plugins.athena.webApi.writeRateLimiter.qps float | Defines the max rate of calls per second. | help |
--plugins.aws.accountId string | AWS Account Identifier. | help |
--plugins.aws.batch.defCacheSize int | Maximum job definition cache size as number of items. | help |
--plugins.aws.batch.defaultRateLimiter.burst int | Allowed burst rate of calls. | help |
--plugins.aws.batch.defaultRateLimiter.rate int | Allowed rate of calls per second. | help |
--plugins.aws.batch.defaultTimeout string | Default timeout for the batch job. | help |
--plugins.aws.batch.errorAssembler.maxItems int | Maximum number of entries to keep in the index. | help |
--plugins.aws.batch.errorAssembler.maxRetries int | Maximum number of retries per item. | help |
--plugins.aws.batch.errorAssembler.workers int | Number of concurrent workers to start processing the queue. | help |
--plugins.aws.batch.getRateLimiter.burst int | Allowed burst rate of calls. | help |
--plugins.aws.batch.getRateLimiter.rate int | Allowed rate of calls per second. | help |
--plugins.aws.batch.jobStoreConfig.batchChunkSize int | Determines the size of each batch sent to GetJobDetails api. | help |
--plugins.aws.batch.jobStoreConfig.jacheSize int | Maximum informer cache size as number of items. | help |
--plugins.aws.batch.jobStoreConfig.parallelism int | (default 20) | help |
--plugins.aws.batch.jobStoreConfig.resyncPeriod string | Defines the duration for syncing job details from AWS Batch. | help |
--plugins.aws.batch.maxArrayJobSize int | Maximum size of array job. | help |
--plugins.aws.batch.maxErrLength int | Determines the maximum length of the error string returned for the array. | help |
--plugins.aws.batch.maxRetries int32 | Maximum number of retries (default 10) | help |
--plugins.aws.batch.minRetries int32 | Minimum number of retries (default 1) | help |
--plugins.aws.batch.outputAssembler.maxItems int | Maximum number of entries to keep in the index. | help |
--plugins.aws.batch.outputAssembler.maxRetries int | Maximum number of retries per item. | help |
--plugins.aws.batch.outputAssembler.workers int | Number of concurrent workers to start processing the queue. | help |
--plugins.aws.batch.roleAnnotationKey string | Map key to use to lookup role from task annotations. | help |
--plugins.aws.region string | AWS Region to connect to. | help |
--plugins.aws.retries int | Number of retries. | help |
--plugins.bigquery.bigQueryEndpoint string | help | |
--plugins.bigquery.googleTokenSource.gke-task-workload-identity.remoteClusterConfig.enabled | Boolean flag to enable or disable | help |
--plugins.bigquery.googleTokenSource.gke-task-workload-identity.remoteClusterConfig.endpoint string | Remote K8s cluster endpoint | help |
--plugins.bigquery.googleTokenSource.gke-task-workload-identity.remoteClusterConfig.name string | Friendly name of the remote cluster | help |
--plugins.bigquery.googleTokenSource.type string | Defines type of TokenSourceFactory, possible values are 'default' and 'gke-task-workload-identity' (default "default") | help |
--plugins.bigquery.webApi.caching.maxSystemFailures int | Defines the number of failures to fetch a task before failing the task. | help |
--plugins.bigquery.webApi.caching.resyncInterval string | Defines the sync interval. | help |
--plugins.bigquery.webApi.caching.size int | Defines the maximum number of items to cache. | help |
--plugins.bigquery.webApi.caching.workers int | Defines the number of workers to start up to process items. | help |
--plugins.bigquery.webApi.readRateLimiter.burst int | Defines the maximum burst size. | help |
--plugins.bigquery.webApi.readRateLimiter.qps float | Defines the max rate of calls per second. | help |
--plugins.bigquery.webApi.writeRateLimiter.burst int | Defines the maximum burst size. | help |
--plugins.bigquery.webApi.writeRateLimiter.qps float | Defines the max rate of calls per second. | help |
--plugins.catalogcache.reader.maxItems int | Maximum number of entries to keep in the index. | help |
--plugins.catalogcache.reader.maxRetries int | Maximum number of retries per item. | help |
--plugins.catalogcache.reader.workers int | Number of concurrent workers to start processing the queue. | help |
--plugins.catalogcache.writer.maxItems int | Maximum number of entries to keep in the index. | help |
--plugins.catalogcache.writer.maxRetries int | Maximum number of retries per item. | help |
--plugins.catalogcache.writer.workers int | Number of concurrent workers to start processing the queue. | help |
--plugins.dask.logs.cloudwatch-enabled | Enable Cloudwatch Logging | help |
--plugins.dask.logs.cloudwatch-log-group string | Log group to which streams are associated. | help |
--plugins.dask.logs.cloudwatch-region string | AWS region in which Cloudwatch logs are stored. | help |
--plugins.dask.logs.cloudwatch-template-uri string | Template Uri to use when building cloudwatch log links | help |
--plugins.dask.logs.gcp-project string | Name of the project in GCP | help |
--plugins.dask.logs.kubernetes-enabled | Enable Kubernetes Logging (default true) | help |
--plugins.dask.logs.kubernetes-template-uri string | Template Uri to use when building kubernetes log links (default "http://localhost:30082/#!/log/{{ .namespace }}/{{ .podName }}/pod?namespace={{ .namespace }}") | help |
--plugins.dask.logs.kubernetes-url string | Console URL for Kubernetes logs | help |
--plugins.dask.logs.stackdriver-enabled | Enable Log-links to stackdriver | help |
--plugins.dask.logs.stackdriver-logresourcename string | Name of the logresource in stackdriver | help |
--plugins.dask.logs.stackdriver-template-uri string | Template Uri to use when building stackdriver log links | help |
--plugins.echo.sleep-duration string | Indicates the amount of time before transitioning to success (default "0s") | help |
--plugins.k8s-array.ErrorAssembler.maxItems int | Maximum number of entries to keep in the index. | help |
--plugins.k8s-array.ErrorAssembler.maxRetries int | Maximum number of retries per item. | help |
--plugins.k8s-array.ErrorAssembler.workers int | Number of concurrent workers to start processing the queue. | help |
--plugins.k8s-array.OutputAssembler.maxItems int | Maximum number of entries to keep in the index. | help |
--plugins.k8s-array.OutputAssembler.maxRetries int | Maximum number of retries per item. | help |
--plugins.k8s-array.OutputAssembler.workers int | Number of concurrent workers to start processing the queue. | help |
--plugins.k8s-array.logs.config.cloudwatch-enabled | Enable Cloudwatch Logging | help |
--plugins.k8s-array.logs.config.cloudwatch-log-group string | Log group to which streams are associated. | help |
--plugins.k8s-array.logs.config.cloudwatch-region string | AWS region in which Cloudwatch logs are stored. | help |
--plugins.k8s-array.logs.config.cloudwatch-template-uri string | Template Uri to use when building cloudwatch log links | help |
--plugins.k8s-array.logs.config.gcp-project string | Name of the project in GCP | help |
--plugins.k8s-array.logs.config.kubernetes-enabled | Enable Kubernetes Logging (default true) | help |
--plugins.k8s-array.logs.config.kubernetes-template-uri string | Template Uri to use when building kubernetes log links (default "http://localhost:30082/#!/log/{{ .namespace }}/{{ .podName }}/pod?namespace={{ .namespace }}") | help |
--plugins.k8s-array.logs.config.kubernetes-url string | Console URL for Kubernetes logs | help |
--plugins.k8s-array.logs.config.stackdriver-enabled | Enable Log-links to stackdriver | help |
--plugins.k8s-array.logs.config.stackdriver-logresourcename string | Name of the logresource in stackdriver | help |
--plugins.k8s-array.logs.config.stackdriver-template-uri string | Template Uri to use when building stackdriver log links | help |
--plugins.k8s-array.maxArrayJobSize int | Maximum size of array job. | help |
--plugins.k8s-array.maxErrorLength int | Determines the maximum length of the error string returned for the array. | help |
--plugins.k8s-array.scheduler string | Decides the scheduler to use when launching array-pods. | help |
--plugins.k8s.add-tolerations-for-extended-resources strings | Name of the extended resources for which tolerations should be added. | help |
--plugins.k8s.co-pilot.cpu string | Used to set cpu for co-pilot containers (default "500m") | help |
--plugins.k8s.co-pilot.default-input-path string | Default path where the volume should be mounted (default "/var/flyte/inputs") | help |
--plugins.k8s.co-pilot.default-output-path string | Default path where the volume should be mounted (default "/var/flyte/outputs") | help |
--plugins.k8s.co-pilot.image string | Flyte co-pilot Docker Image FQN (default "cr.flyte.org/flyteorg/flytecopilot:v0.0.15") | help |
--plugins.k8s.co-pilot.input-vol-name string | Name of the data volume that is created for storing inputs (default "flyte-inputs") | help |
--plugins.k8s.co-pilot.memory string | Used to set memory for co-pilot containers (default "128Mi") | help |
--plugins.k8s.co-pilot.name string | Flyte co-pilot sidecar container name prefix. | help |
--plugins.k8s.co-pilot.output-vol-name string | Name of the data volume that is created for storing outputs (default "flyte-outputs") | help |
--plugins.k8s.co-pilot.storage string | Default storage limit for individual inputs / outputs | help |
--plugins.k8s.default-cpus string | Defines a default value for cpu for containers if not specified. | help |
--plugins.k8s.default-memory string | Defines a default value for memory for containers if not specified. | help |
--plugins.k8s.default-pod-template-name string | Name of the PodTemplate to use as the base for all k8s pods created by FlytePropeller. | help |
--plugins.k8s.default-pod-template-resync string | Frequency of resyncing default pod templates (default "30s") | help |
--plugins.k8s.delete-resource-on-finalize | Instructs the system to delete the resource upon successful execution of a k8s pod rather than have the k8s garbage collector clean it up. | help |
--plugins.k8s.enable-distributed-error-aggregation | If true, will aggregate errors of different worker pods for distributed tasks. | help |
--plugins.k8s.inject-finalizer | Instructs the plugin to inject a finalizer on startTask and remove it on task termination. | help |
--plugins.k8s.scheduler-name string | Defines scheduler name. | help |
--plugins.k8s.send-object-events | If true, will send k8s object events in TaskExecutionEvent updates. | help |
--plugins.k8s.update-backoff-retries int | Number of retries for exponential backoff when updating a resource. | help |
--plugins.k8s.update-base-backoff-duration int | Initial delay in exponential backoff when updating a resource in milliseconds. | help |
--plugins.kf-operator.timeout string | (default "1m0s") | help |
--plugins.logs.cloudwatch-enabled | Enable Cloudwatch Logging | help |
--plugins.logs.cloudwatch-log-group string | Log group to which streams are associated. | help |
--plugins.logs.cloudwatch-region string | AWS region in which Cloudwatch logs are stored. | help |
--plugins.logs.cloudwatch-template-uri string | Template Uri to use when building cloudwatch log links | help |
--plugins.logs.gcp-project string | Name of the project in GCP | help |
--plugins.logs.kubernetes-enabled | Enable Kubernetes Logging (default true) | help |
--plugins.logs.kubernetes-template-uri string | Template Uri to use when building kubernetes log links (default "http://localhost:30082/#!/log/{{ .namespace }}/{{ .podName }}/pod?namespace={{ .namespace }}") | help |
--plugins.logs.kubernetes-url string | Console URL for Kubernetes logs | help |
--plugins.logs.stackdriver-enabled | Enable Log-links to stackdriver | help |
--plugins.logs.stackdriver-logresourcename string | Name of the logresource in stackdriver | help |
--plugins.logs.stackdriver-template-uri string | Template Uri to use when building stackdriver log links | help |
--plugins.ray.dashboardHost string | (default "0.0.0.0") | help |
--plugins.ray.enableIngress | help | |
--plugins.ray.enableUsageStats | Enable usage stats for ray jobs. | help |
--plugins.ray.includeDashboard | (default true) | help |
--plugins.ray.remoteClusterConfig.enabled | Boolean flag to enable or disable | help |
--plugins.ray.remoteClusterConfig.endpoint string | Remote K8s cluster endpoint | help |
--plugins.ray.remoteClusterConfig.name string | Friendly name of the remote cluster | help |
--plugins.ray.serviceAccount string | The k8s service account to run as | help |
--plugins.ray.serviceType string | (default "NodePort") | help |
--plugins.ray.shutdownAfterJobFinishes | (default true) | help |
--plugins.ray.ttlSecondsAfterFinished int32 | (default 3600) | help |
--plugins.spark.logs.all-user.cloudwatch-enabled | Enable Cloudwatch Logging | help |
--plugins.spark.logs.all-user.cloudwatch-log-group string | Log group to which streams are associated. | help |
--plugins.spark.logs.all-user.cloudwatch-region string | AWS region in which Cloudwatch logs are stored. | help |
--plugins.spark.logs.all-user.cloudwatch-template-uri string | Template Uri to use when building cloudwatch log links | help |
--plugins.spark.logs.all-user.gcp-project string | Name of the project in GCP | help |
--plugins.spark.logs.all-user.kubernetes-enabled | Enable Kubernetes Logging | help |
--plugins.spark.logs.all-user.kubernetes-template-uri string | Template Uri to use when building kubernetes log links | help |
--plugins.spark.logs.all-user.kubernetes-url string | Console URL for Kubernetes logs | help |
--plugins.spark.logs.all-user.stackdriver-enabled | Enable Log-links to stackdriver | help |
--plugins.spark.logs.all-user.stackdriver-logresourcename string | Name of the logresource in stackdriver | help |
--plugins.spark.logs.all-user.stackdriver-template-uri string | Template Uri to use when building stackdriver log links | help |
--plugins.spark.logs.mixed.cloudwatch-enabled | Enable Cloudwatch Logging | help |
--plugins.spark.logs.mixed.cloudwatch-log-group string | Log group to which streams are associated. | help |
--plugins.spark.logs.mixed.cloudwatch-region string | AWS region in which Cloudwatch logs are stored. | help |
--plugins.spark.logs.mixed.cloudwatch-template-uri string | Template Uri to use when building cloudwatch log links | help |
--plugins.spark.logs.mixed.gcp-project string | Name of the project in GCP | help |
--plugins.spark.logs.mixed.kubernetes-enabled | Enable Kubernetes Logging (default true) | help |
--plugins.spark.logs.mixed.kubernetes-template-uri string | Template Uri to use when building kubernetes log links (default "http://localhost:30082/#!/log/{{ .namespace }}/{{ .podName }}/pod?namespace={{ .namespace }}") | help |
--plugins.spark.logs.mixed.kubernetes-url string | Console URL for Kubernetes logs | help |
--plugins.spark.logs.mixed.stackdriver-enabled | Enable Log-links to stackdriver | help |
--plugins.spark.logs.mixed.stackdriver-logresourcename string | Name of the logresource in stackdriver | help |
--plugins.spark.logs.mixed.stackdriver-template-uri string | Template Uri to use when building stackdriver log links | help |
--plugins.spark.logs.system.cloudwatch-enabled | Enable Cloudwatch Logging | help |
--plugins.spark.logs.system.cloudwatch-log-group string | Log group to which streams are associated. | help |
--plugins.spark.logs.system.cloudwatch-region string | AWS region in which Cloudwatch logs are stored. | help |
--plugins.spark.logs.system.cloudwatch-template-uri string | Template Uri to use when building cloudwatch log links | help |
--plugins.spark.logs.system.gcp-project string | Name of the project in GCP | help |
--plugins.spark.logs.system.kubernetes-enabled | Enable Kubernetes Logging | help |
--plugins.spark.logs.system.kubernetes-template-uri string | Template Uri to use when building kubernetes log links | help |
--plugins.spark.logs.system.kubernetes-url string | Console URL for Kubernetes logs | help |
--plugins.spark.logs.system.stackdriver-enabled | Enable Log-links to stackdriver | help |
--plugins.spark.logs.system.stackdriver-logresourcename string | Name of the logresource in stackdriver | help |
--plugins.spark.logs.system.stackdriver-template-uri string | Template Uri to use when building stackdriver log links | help |
--plugins.spark.logs.user.cloudwatch-enabled | Enable Cloudwatch Logging | help |
--plugins.spark.logs.user.cloudwatch-log-group string | Log group to which streams are associated. | help |
--plugins.spark.logs.user.cloudwatch-region string | AWS region in which Cloudwatch logs are stored. | help |
--plugins.spark.logs.user.cloudwatch-template-uri string | Template Uri to use when building cloudwatch log links | help |
--plugins.spark.logs.user.gcp-project string | Name of the project in GCP | help |
--plugins.spark.logs.user.kubernetes-enabled | Enable Kubernetes Logging | help |
--plugins.spark.logs.user.kubernetes-template-uri string | Template Uri to use when building kubernetes log links | help |
--plugins.spark.logs.user.kubernetes-url string | Console URL for Kubernetes logs | help |
--plugins.spark.logs.user.stackdriver-enabled | Enable Log-links to stackdriver | help |
--plugins.spark.logs.user.stackdriver-logresourcename string | Name of the logresource in stackdriver | help |
--plugins.spark.logs.user.stackdriver-template-uri string | Template Uri to use when building stackdriver log links | help |
--plugins.spark.spark-history-server-url string | URL for SparkHistory Server that each job will publish the execution history to. | help |
--prof.DisableConfigEndpoint | help | |
--propeller.admin-launcher.burst int | Maximum burst for throttle (default 10) | help |
--propeller.admin-launcher.cache-resync-duration string | Frequency of re-syncing launchplans within the auto refresh cache. | help |
--propeller.admin-launcher.cacheSize int | Maximum cache in terms of number of items stored. | help |
--propeller.admin-launcher.tps int | The maximum number of transactions per second to flyte admin from this client. | help |
--propeller.admin-launcher.workers int | Number of parallel workers to work on the queue. | help |
--propeller.array-node-config.default-parallelism-behavior string | Default parallelism behavior for array nodes (default "unlimited") | help |
--propeller.array-node-config.event-version int | ArrayNode eventing version. | help |
--propeller.array-node-config.max-delta-timestamp string | Maximum delta timestamp between ArrayNode start and an individual subNode start. | help |
--propeller.array-node-config.max-task-phase-version-attempts int | Maximum number of attempts for incrementing the task phase version on events to bypass the already exists error (default 3) | help |
--propeller.array-node-config.use-map-plugin-logs | Override subNode log links with those configured for the map plugin logs | help |
--propeller.cluster-id string | Unique cluster id running this flytepropeller instance with which to annotate execution events (default "propeller") | help |
--propeller.create-flyteworkflow-crd | Enable creation of the FlyteWorkflow CRD on startup | help |
--propeller.downstream-eval-duration string | Frequency of re-evaluating downstream tasks (default "30s") | help |
--propeller.enable-admin-launcher | (default true) | help |
--propeller.enable-grpc-latency-metrics | Enable grpc latency metrics. | help |
--propeller.event-config.fallback-to-output-reference | Whether output data should be sent by reference when it is too large to be sent inline in execution events. | help |
--propeller.event-config.raw-output-policy string | How output data should be passed along in execution events. | help |
--propeller.exclude-domain-label strings | Exclude the specified domain label from the k8s FlyteWorkflow CRD label selector | help |
--propeller.exclude-project-label strings | Exclude the specified project label from the k8s FlyteWorkflow CRD label selector | help |
--propeller.exclude-shard-key-label strings | Exclude the specified shard key label from the k8s FlyteWorkflow CRD label selector | help |
--propeller.gc-interval string | (default "30m0s") | help |
--propeller.include-domain-label strings | Include the specified domain label in the k8s FlyteWorkflow CRD label selector | help |
--propeller.include-project-label strings | Include the specified project label in the k8s FlyteWorkflow CRD label selector | help |
--propeller.include-shard-key-label strings | Include the specified shard key label in the k8s FlyteWorkflow CRD label selector | help |
--propeller.kube-client-config.burst int | Max burst rate for throttle. | help |
--propeller.kube-client-config.timeout string | Max duration allowed for every request to KubeAPI before giving up. | help |
--propeller.kube-config string | Path to kubernetes client config file. | help |
--propeller.leader-election.enabled | Enables/Disables leader election. | help |
--propeller.leader-election.lease-duration string | Duration that non-leader candidates will wait to force acquire leadership. | help |
--propeller.leader-election.lock-config-map.Name string | help | |
--propeller.leader-election.lock-config-map.Namespace string | help | |
--propeller.leader-election.renew-deadline string | Duration that the acting master will retry refreshing leadership before giving up. | help |
--propeller.leader-election.retry-period string | Duration the LeaderElector clients should wait between tries of actions. | help |
--propeller.limit-namespace string | Namespaces to watch for this propeller (default "all") | help |
--propeller.literal-offloading-config.Enabled | help | |
--propeller.literal-offloading-config.max-size-in-mb-for-offloading int | Size of a literal at which to fail fast (default 1000) | help |
--propeller.literal-offloading-config.min-size-in-mb-for-offloading int | Size of a literal at which to trigger offloading (default 10) | help |
--propeller.literal-offloading-config.supported-sdk-versions stringToString | Maps flytekit and union SDK names to minimum supported version that can handle reading offloaded literals. | help |
--propeller.master string | help | |
--propeller.max-output-size-bytes int | Deprecated! Use storage.limits.maxDownloadMBs instead (default -1) | help |
--propeller.max-streak-length int | Maximum number of consecutive rounds that one propeller worker can use for one workflow - >1 => turbo-mode is enabled. | help |
--propeller.max-ttl-hours int | (default 23) | help |
--propeller.max-workflow-retries int | (default 10) | help |
--propeller.metadata-prefix string | MetadataPrefix should be used if all the metadata for Flyte executions should be stored under a specific prefix in CloudStorage. | help |
--propeller.metrics-keys strings | Metrics labels applied to prometheus metrics emitted by the service. | help |
--propeller.metrics-prefix string | An optional prefix for all published metrics. | help |
--propeller.node-config.default-deadlines.node-active-deadline string | Default value of node timeout that includes the time spent queued. | help |
--propeller.node-config.default-deadlines.node-execution-deadline string | Default value of node execution timeout that includes the time spent to run the node/workflow (default "0s") | help |
--propeller.node-config.default-max-attempts int32 | Default maximum number of attempts for a node (default 1) | help |
--propeller.node-config.enable-cr-debug-metadata | Collapse node on any terminal state, not just successful terminations. | help |
--propeller.node-config.ignore-retry-cause | Ignore retry cause and count all attempts toward a node's max attempts | help |
--propeller.node-config.interruptible-failure-threshold int32 | number of failures for a node to be still considered interruptible. | help |
--propeller.node-config.max-node-retries-system-failures int | Maximum number of retries per node for node failure due to infra issues (default 3) | help |
--propeller.node-execution-worker-count int | Number of workers to evaluate node executions, currently only used for array nodes (default 8) | help |
--propeller.prof-port string | Profiler port (default "10254") | help |
--propeller.publish-k8s-events | Enable events publishing to K8s events API. | help |
--propeller.queue.batch-size int | Number of downstream triggered top-level objects to re-enqueue every duration. | help |
--propeller.queue.batching-interval string | Duration for which downstream updates are buffered (default "1s") | help |
--propeller.queue.queue.base-delay string | base backoff delay for failure (default "0s") | help |
--propeller.queue.queue.capacity int | Bucket capacity as number of items (default 10000) | help |
--propeller.queue.queue.max-delay string | Max backoff delay for failure (default "1m0s") | help |
--propeller.queue.queue.rate int | Bucket Refill rate per second (default 1000) | help |
--propeller.queue.queue.type string | Type of RateLimiter to use for the WorkQueue (default "maxof") | help |
--propeller.queue.sub-queue.base-delay string | base backoff delay for failure (default "0s") | help |
--propeller.queue.sub-queue.capacity int | Bucket capacity as number of items (default 10000) | help |
--propeller.queue.sub-queue.max-delay string | Max backoff delay for failure (default "0s") | help |
--propeller.queue.sub-queue.rate int | Bucket Refill rate per second (default 1000) | help |
--propeller.queue.sub-queue.type string | Type of RateLimiter to use for the WorkQueue (default "bucket") | help |
--propeller.queue.type string | Type of composite queue to use for the WorkQueue (default "batch") | help |
--propeller.rawoutput-prefix string | a fully qualified storage path of the form s3://flyte/abc/..., where all data sandboxes should be stored. | help |
--propeller.resourcemanager.redis.hostKey string | Key for local Redis access | help |
--propeller.resourcemanager.redis.hostPath string | Redis host location | help |
--propeller.resourcemanager.redis.hostPaths strings | Redis hosts locations. | help |
--propeller.resourcemanager.redis.maxRetries int | See Redis client options for more info | help |
--propeller.resourcemanager.redis.primaryName string | Redis primary name, fill in only if you are connecting to a redis sentinel cluster. | help |
--propeller.resourcemanager.resourceMaxQuota int | Global limit for concurrent Qubole queries (default 1000) | help |
--propeller.resourcemanager.type string | Which resource manager to use, redis or noop. | help |
--propeller.workers int | Number of threads to process workflows (default 20) | help |
--propeller.workflow-reeval-duration string | Frequency of re-evaluating workflows (default "10s") | help |
--propeller.workflowstore.policy string | Workflow Store Policy to initialize (default "ResourceVersionCache") | help |
--secrets.env-prefix string | Prefix for environment variables (default "FLYTE_SECRET_") | help |
--secrets.secrets-prefix string | Prefix where to look for secrets file (default "/etc/secrets") | help |
--server.dataProxy.download.maxExpiresIn string | Maximum allowed expiration duration. | help |
--server.dataProxy.upload.defaultFileNameLength int | Default length for the generated file name if not provided in the request. | help |
--server.dataProxy.upload.maxExpiresIn string | Maximum allowed expiration duration. | help |
--server.dataProxy.upload.storagePrefix string | Storage prefix to use for all upload requests. | help |
--server.gracefulShutdownTimeoutSeconds int | Number of seconds to wait for graceful shutdown before forcefully terminating the server (default 10) | help |
--server.grpc.enableGrpcLatencyMetrics | Enable grpc latency metrics. | help |
--server.grpc.maxConcurrentStreams int | Limit on the number of concurrent streams to each ServerTransport. | help |
--server.grpc.maxMessageSizeBytes int | The max size in bytes for incoming gRPC messages | help |
--server.grpc.port int | On which grpc port to serve admin (default 8089) | help |
--server.grpc.serverReflection | Enable GRPC Server Reflection (default true) | help |
--server.grpcPort int | deprecated | help |
--server.grpcServerReflection | deprecated | help |
--server.httpPort int | On which http port to serve admin (default 8088) | help |
--server.kube-config string | Path to kubernetes client config file, default is empty, useful for incluster config. | help |
--server.kubeClientConfig.burst int | Max burst rate for throttle. | help |
--server.kubeClientConfig.qps int32 | Max QPS to the master for requests to KubeAPI. | help |
--server.kubeClientConfig.timeout string | Max duration allowed for every request to KubeAPI before giving up. | help |
--server.master string | The address of the Kubernetes API server. | help |
--server.readHeaderTimeoutSeconds int | The amount of time allowed to read request headers. | help |
--server.security.allowCors | (default true) | help |
--server.security.allowedHeaders strings | (default [Content-Type,flyte-authorization]) | help |
--server.security.allowedOrigins strings | (default [*]) | help |
--server.security.insecureCookieHeader | help | |
--server.security.secure | help | |
--server.security.ssl.certificateFile string | help | |
--server.security.ssl.keyFile string | help | |
--server.security.useAuth | help | |
--stderrthreshold severityFlag | logs at or above this threshold go to stderr (default 2) | help |
--storage.cache.max_size_mbs int | Maximum size of the cache where the Blob store data is cached in-memory. | help |
--storage.cache.target_gc_percent int | Sets the garbage collection target percentage. | help |
--storage.connection.access-key string | Access key to use. | help |
--storage.connection.auth-type string | Auth Type to use [iam, accesskey]. | help |
--storage.connection.disable-ssl | Disables SSL connection. | help |
--storage.connection.endpoint string | URL for storage client to connect to. | help |
--storage.connection.region string | Region to connect to. | help |
--storage.connection.secret-key string | Secret to use when accesskey is set. | help |
--storage.container string | Initial container (in s3 a bucket) to create -if it doesn't exist-.' | help |
--storage.defaultHttpClient.timeout string | Sets time out on the http client. | help |
--storage.enable-multicontainer | If this is true, then the container argument is overlooked and redundant. | help |
--storage.limits.maxDownloadMBs int | Maximum allowed download size (in MBs) per call. | help |
--storage.stow.config stringToString | Configuration for stow backend. | help |
--storage.stow.kind string | Kind of Stow backend to use. | help |
--storage.type string | Sets the type of storage to configure [s3/minio/local/mem/stow]. | help |
--tasks.backoff.base-second int | The number of seconds representing the base duration of the exponential backoff (default 2) | help |
--tasks.backoff.max-duration string | The cap of the backoff duration (default "20s") | help |
--tasks.max-plugin-phase-versions int32 | Maximum number of plugin phase versions allowed for one phase. | help |
--tasks.maxLogMessageLength int | Deprecated!!! Max length of error message. | help |
--tasks.task-plugins.enabled-plugins strings | Plugins enabled currently | help |
-v, --v Level | log level for V logs | help |
--vmodule vModuleFlag | comma-separated list of pattern=N settings for file-filtered logging | help |
--webhook.awsSecretManager.sidecarImage string | Specifies the sidecar docker image to use (default "docker.io/amazon/aws-secrets-manager-secret-sidecar:v0.1.4") | help |
--webhook.certDir string | Certificate directory to use to write generated certs. | help |
--webhook.disableCreateMutatingWebhookConfig | Disable registration of the MutatingWebhookConfiguration, leaving it to be managed out of band. | help |
--webhook.gcpSecretManager.sidecarImage string | Specifies the sidecar docker image to use (default "gcr.io/google.com/cloudsdktool/cloud-sdk:alpine") | help |
--webhook.listenPort int | The port to use to listen to webhook calls. | help |
--webhook.localCert | write certs locally. | help |
--webhook.metrics-prefix string | An optional prefix for all published metrics. | help |
--webhook.secretName string | Secret name to write generated certs to. | help |
--webhook.serviceName string | The name of the webhook service. | help |
--webhook.servicePort int32 | The port on the service that hosting webhook. | help |
--webhook.vaultSecretManager.role string | Specifies the vault role to use (default "flyte") | help |