/usr/bin/metaconvert is a tool to update meta.json files to conform to Mimir requirements.
Flags:
-alsologtostderr
log to standard error as well as files
-azure.account-key value
Azure storage account key. If unset, Azure managed identities will be used for authentication instead.
-azure.account-name string
Azure storage account name
-azure.connection-string connection-string
If connection-string is set, the value of `endpoint-suffix` will not be used. Use this method over `account-key` if you need to authenticate via a SAS token. Or if you use the Azurite emulator.
-azure.container-name string
Azure storage container name
-azure.endpoint-suffix string
Azure storage endpoint suffix without schema. The account name will be prefixed to this value to create the FQDN. If set to empty string, default endpoint suffix is used.
-azure.expect-continue-timeout duration
The time to wait for a server's first response headers after fully writing the request headers if the request has an Expect header. Set to 0 to send the request body immediately. (default 1s)
-azure.http.idle-conn-timeout duration
The time an idle connection remains idle before closing. (default 1m30s)
-azure.http.insecure-skip-verify
If the client connects to object storage via HTTPS and this option is enabled, the client accepts any certificate and hostname.
-azure.http.response-header-timeout duration
The amount of time the client waits for a server's response headers. (default 2m0s)
-azure.http.tls-ca-path string
Path to the Certificate Authority (CA) certificates to validate the server certificate. If not set, the host's root CA certificates are used.
-azure.http.tls-cert-path string
Path to the client certificate, which is used for authenticating with the server. This setting also requires you to configure the key path.
-azure.http.tls-key-path string
Path to the key for the client certificate. This setting also requires you to configure the client certificate.
-azure.http.tls-server-name string
Override the expected name on the server certificate.
-azure.max-connections-per-host int
Maximum number of connections per host. Set to 0 for no limit.
-azure.max-idle-connections int
Maximum number of idle (keep-alive) connections across all hosts. Set to 0 for no limit. (default 100)
-azure.max-idle-connections-per-host int
Maximum number of idle (keep-alive) connections to keep per-host. Set to 0 to use a built-in default value of 2. (default 100)
-azure.max-retries int
Number of retries for recoverable errors (default 20)
-azure.tls-handshake-timeout duration
Maximum time to wait for a TLS handshake. Set to 0 for no limit. (default 10s)
-azure.user-assigned-id string
User assigned managed identity. If empty, then System assigned identity is used.
-backend string
Backend storage to use. Supported backends are: s3, gcs, azure, swift, filesystem. (default "filesystem")
-dry-run
Don't make changes; only report what needs to be done
-filesystem.dir string
Local filesystem storage directory.
-gcs.bucket-name string
GCS bucket name
-gcs.expect-continue-timeout duration
The time to wait for a server's first response headers after fully writing the request headers if the request has an Expect header. Set to 0 to send the request body immediately. (default 1s)
-gcs.http.idle-conn-timeout duration
The time an idle connection remains idle before closing. (default 1m30s)
-gcs.http.insecure-skip-verify
If the client connects to object storage via HTTPS and this option is enabled, the client accepts any certificate and hostname.
-gcs.http.response-header-timeout duration
The amount of time the client waits for a server's response headers. (default 2m0s)
-gcs.http.tls-ca-path string
Path to the Certificate Authority (CA) certificates to validate the server certificate. If not set, the host's root CA certificates are used.
-gcs.http.tls-cert-path string
Path to the client certificate, which is used for authenticating with the server. This setting also requires you to configure the key path.
-gcs.http.tls-key-path string
Path to the key for the client certificate. This setting also requires you to configure the client certificate.
-gcs.http.tls-server-name string
Override the expected name on the server certificate.
-gcs.max-connections-per-host int
Maximum number of connections per host. Set to 0 for no limit.
-gcs.max-idle-connections int
Maximum number of idle (keep-alive) connections across all hosts. Set to 0 for no limit. (default 100)
-gcs.max-idle-connections-per-host int
Maximum number of idle (keep-alive) connections to keep per-host. Set to 0 to use a built-in default value of 2. (default 100)
-gcs.service-account value
JSON either from a Google Developers Console client_credentials.json file, or a Google Developers service account key. Needs to be valid JSON, not a filesystem path.
-gcs.tls-handshake-timeout duration
Maximum time to wait for a TLS handshake. Set to 0 for no limit. (default 10s)
-log.format string
Output log messages in the given format. Valid formats: [logfmt, json] (default "logfmt")
-log.level value
Only log messages with the given severity or above. Valid levels: [debug, info, warn, error] (default info)
-log_backtrace_at value
when logging hits line file:N, emit a stack trace
-log_dir string
If non-empty, write log files in this directory
-log_link string
If non-empty, add symbolic links in this directory to the log files
-logbuflevel int
Buffer log messages logged at this level or lower (-1 means don't buffer; 0 means buffer INFO only; ...). Has limited applicability on non-prod platforms.
-logtostderr
log to standard error instead of files
-s3.access-key-id string
S3 access key ID
-s3.bucket-lookup-type value
Bucket lookup style type, used to access bucket in S3-compatible service. Default is auto. Supported values are: auto, path, virtual-hosted.
-s3.bucket-name string
S3 bucket name
-s3.dualstack-enabled
When enabled, direct all AWS S3 requests to the dual-stack IPv4/IPv6 endpoint for the configured region. (default true)
-s3.endpoint string
The S3 bucket endpoint. It could be an AWS S3 endpoint listed at https://docs.aws.amazon.com/general/latest/gr/s3.html or the address of an S3-compatible service in hostname:port format.
-s3.expect-continue-timeout duration
The time to wait for a server's first response headers after fully writing the request headers if the request has an Expect header. Set to 0 to send the request body immediately. (default 1s)
-s3.http.idle-conn-timeout duration
The time an idle connection remains idle before closing. (default 1m30s)
-s3.http.insecure-skip-verify
If the client connects to object storage via HTTPS and this option is enabled, the client accepts any certificate and hostname.
-s3.http.response-header-timeout duration
The amount of time the client waits for a server's response headers. (default 2m0s)
-s3.http.tls-ca-path string
Path to the Certificate Authority (CA) certificates to validate the server certificate. If not set, the host's root CA certificates are used.
-s3.http.tls-cert-path string
Path to the client certificate, which is used for authenticating with the server. This setting also requires you to configure the key path.
-s3.http.tls-key-path string
Path to the key for the client certificate. This setting also requires you to configure the client certificate.
-s3.http.tls-server-name string
Override the expected name on the server certificate.
-s3.insecure
If enabled, use http:// for the S3 endpoint instead of https://. This could be useful in local dev/test environments while using an S3-compatible backend storage, like Minio.
-s3.list-objects-version string
Use a specific version of the S3 list object API. Supported values are v1 or v2. Default is unset.
-s3.max-connections-per-host int
Maximum number of connections per host. Set to 0 for no limit.
-s3.max-idle-connections int
Maximum number of idle (keep-alive) connections across all hosts. Set to 0 for no limit. (default 100)
-s3.max-idle-connections-per-host int
Maximum number of idle (keep-alive) connections to keep per-host. Set to 0 to use a built-in default value of 2. (default 100)
-s3.native-aws-auth-enabled
If enabled, it will use the default authentication methods of the AWS SDK for go based on known environment variables and known AWS config files.
-s3.part-size uint
The minimum file size in bytes used for multipart uploads. If 0, the value is optimally computed for each object.
-s3.region string
S3 region. If unset, the client will issue a S3 GetBucketLocation API call to autodetect it.
-s3.secret-access-key value
S3 secret access key
-s3.send-content-md5
If enabled, a Content-MD5 header is sent with S3 Put Object requests. Consumes more resources to compute the MD5, but may improve compatibility with object storage services that do not support checksums.
-s3.session-token value
S3 session token
-s3.signature-version string
The signature version to use for authenticating against S3. Supported values are: v4, v2. (default "v4")
-s3.sse.kms-encryption-context string
KMS Encryption Context used for object encryption. It expects JSON formatted string.
-s3.sse.kms-key-id string
KMS Key ID used to encrypt objects in S3
-s3.sse.type string
Enable AWS Server Side Encryption. Supported values: SSE-KMS, SSE-S3.
-s3.storage-class string
The S3 storage class to use, not set by default. Details can be found at https://aws.amazon.com/s3/storage-classes/. Supported values are: STANDARD, REDUCED_REDUNDANCY, STANDARD_IA, ONEZONE_IA, INTELLIGENT_TIERING, GLACIER, DEEP_ARCHIVE, OUTPOSTS, GLACIER_IR, SNOW, EXPRESS_ONEZONE, FSX_OPENZFS, FSX_ONTAP
-s3.sts-endpoint string
Accessing S3 resources using temporary, secure credentials provided by AWS Security Token Service.
-s3.tls-handshake-timeout duration
Maximum time to wait for a TLS handshake. Set to 0 for no limit. (default 10s)
-s3.trace.enabled
When enabled, low-level S3 HTTP operation information is logged at the debug level.
-stderrthreshold value
logs at or above this threshold go to stderr (default 2)
-storage-prefix string
Prefix for all objects stored in the backend storage. For simplicity, it may only contain digits and English alphabet letters.
-swift.application-credential-id string
OpenStack Swift application credential id
-swift.application-credential-name string
OpenStack Swift application credential name
-swift.application-credential-secret value
OpenStack Swift application credential secret
-swift.auth-url string
OpenStack Swift authentication URL
-swift.auth-version int
OpenStack Swift authentication API version. 0 to autodetect.
-swift.connect-timeout duration
Time after which a connection attempt is aborted. (default 10s)
-swift.container-name string
Name of the OpenStack Swift container to put chunks in.
-swift.domain-id string
OpenStack Swift user's domain ID.
-swift.domain-name string
OpenStack Swift user's domain name.
-swift.max-retries int
Max retries on requests error. (default 3)
-swift.password value
OpenStack Swift API key.
-swift.project-domain-id string
ID of the OpenStack Swift project's domain (v3 auth only), only needed if it differs the from user domain.
-swift.project-domain-name string
Name of the OpenStack Swift project's domain (v3 auth only), only needed if it differs from the user domain.
-swift.project-id string
OpenStack Swift project ID (v2,v3 auth only).
-swift.project-name string
OpenStack Swift project name (v2,v3 auth only).
-swift.region-name string
OpenStack Swift Region to use (v2,v3 auth only).
-swift.request-timeout duration
Time after which an idle request is aborted. The timeout watchdog is reset each time some data is received, so the timeout triggers after X time no data is received on a request. (default 5s)
-swift.user-domain-id string
OpenStack Swift user's domain ID.
-swift.user-domain-name string
OpenStack Swift user's domain name.
-swift.user-id string
OpenStack Swift user ID.
-swift.username string
OpenStack Swift username.
-tenant string
Tenant to process
-v value
log level for V logs
-vmodule value
comma-separated list of pattern=N settings for file-filtered logging
Options (102)
| Option | Description | Source |
|---|---|---|
-alsologtostderr | log to standard error as well as files | help |
-azure.account-key value | Azure storage account key. | help |
-azure.account-name string | Azure storage account name | help |
-azure.connection-string connection-string | If connection-string is set, the value of `endpoint-suffix` will not be used. | help |
-azure.container-name string | Azure storage container name | help |
-azure.endpoint-suffix string | Azure storage endpoint suffix without schema. | help |
-azure.expect-continue-timeout duration | The time to wait for a server's first response headers after fully writing the request headers if the request has an Expect header. | help |
-azure.http.idle-conn-timeout duration | The time an idle connection remains idle before closing. | help |
-azure.http.insecure-skip-verify | If the client connects to object storage via HTTPS and this option is enabled, the client accepts any certificate and hostname. | help |
-azure.http.response-header-timeout duration | The amount of time the client waits for a server's response headers. | help |
-azure.http.tls-ca-path string | Path to the Certificate Authority (CA) certificates to validate the server certificate. | help |
-azure.http.tls-cert-path string | Path to the client certificate, which is used for authenticating with the server. | help |
-azure.http.tls-key-path string | Path to the key for the client certificate. | help |
-azure.http.tls-server-name string | Override the expected name on the server certificate. | help |
-azure.max-connections-per-host int | Maximum number of connections per host. | help |
-azure.max-idle-connections int | Maximum number of idle (keep-alive) connections across all hosts. | help |
-azure.max-idle-connections-per-host int | Maximum number of idle (keep-alive) connections to keep per-host. | help |
-azure.max-retries int | Number of retries for recoverable errors (default 20) | help |
-azure.tls-handshake-timeout duration | Maximum time to wait for a TLS handshake. | help |
-azure.user-assigned-id string | User assigned managed identity. | help |
-backend string | Backend storage to use. | help |
-dry-run | Don't make changes; | help |
-filesystem.dir string | Local filesystem storage directory. | help |
-gcs.bucket-name string | GCS bucket name | help |
-gcs.expect-continue-timeout duration | The time to wait for a server's first response headers after fully writing the request headers if the request has an Expect header. | help |
-gcs.http.idle-conn-timeout duration | The time an idle connection remains idle before closing. | help |
-gcs.http.insecure-skip-verify | If the client connects to object storage via HTTPS and this option is enabled, the client accepts any certificate and hostname. | help |
-gcs.http.response-header-timeout duration | The amount of time the client waits for a server's response headers. | help |
-gcs.http.tls-ca-path string | Path to the Certificate Authority (CA) certificates to validate the server certificate. | help |
-gcs.http.tls-cert-path string | Path to the client certificate, which is used for authenticating with the server. | help |
-gcs.http.tls-key-path string | Path to the key for the client certificate. | help |
-gcs.http.tls-server-name string | Override the expected name on the server certificate. | help |
-gcs.max-connections-per-host int | Maximum number of connections per host. | help |
-gcs.max-idle-connections int | Maximum number of idle (keep-alive) connections across all hosts. | help |
-gcs.max-idle-connections-per-host int | Maximum number of idle (keep-alive) connections to keep per-host. | help |
-gcs.service-account value | JSON either from a Google Developers Console client_credentials.json file, or a Google Developers service account key. | help |
-gcs.tls-handshake-timeout duration | Maximum time to wait for a TLS handshake. | help |
-log.format string | Output log messages in the given format. | help |
-log.level value | Only log messages with the given severity or above. | help |
-log_backtrace_at value | when logging hits line file:N, emit a stack trace | help |
-log_dir string | If non-empty, write log files in this directory | help |
-log_link string | If non-empty, add symbolic links in this directory to the log files | help |
-logbuflevel int | Buffer log messages logged at this level or lower (-1 means don't buffer; | help |
-logtostderr | log to standard error instead of files | help |
-s3.access-key-id string | S3 access key ID | help |
-s3.bucket-lookup-type value | Bucket lookup style type, used to access bucket in S3-compatible service. | help |
-s3.bucket-name string | S3 bucket name | help |
-s3.dualstack-enabled | When enabled, direct all AWS S3 requests to the dual-stack IPv4/IPv6 endpoint for the configured region. | help |
-s3.endpoint string | The S3 bucket endpoint. | help |
-s3.expect-continue-timeout duration | The time to wait for a server's first response headers after fully writing the request headers if the request has an Expect header. | help |
-s3.http.idle-conn-timeout duration | The time an idle connection remains idle before closing. | help |
-s3.http.insecure-skip-verify | If the client connects to object storage via HTTPS and this option is enabled, the client accepts any certificate and hostname. | help |
-s3.http.response-header-timeout duration | The amount of time the client waits for a server's response headers. | help |
-s3.http.tls-ca-path string | Path to the Certificate Authority (CA) certificates to validate the server certificate. | help |
-s3.http.tls-cert-path string | Path to the client certificate, which is used for authenticating with the server. | help |
-s3.http.tls-key-path string | Path to the key for the client certificate. | help |
-s3.http.tls-server-name string | Override the expected name on the server certificate. | help |
-s3.insecure | If enabled, use http:// for the S3 endpoint instead of https://. | help |
-s3.list-objects-version string | Use a specific version of the S3 list object API. | help |
-s3.max-connections-per-host int | Maximum number of connections per host. | help |
-s3.max-idle-connections int | Maximum number of idle (keep-alive) connections across all hosts. | help |
-s3.max-idle-connections-per-host int | Maximum number of idle (keep-alive) connections to keep per-host. | help |
-s3.native-aws-auth-enabled | If enabled, it will use the default authentication methods of the AWS SDK for go based on known environment variables and known AWS config files. | help |
-s3.part-size uint | The minimum file size in bytes used for multipart uploads. | help |
-s3.region string | S3 region. | help |
-s3.secret-access-key value | S3 secret access key | help |
-s3.send-content-md5 | If enabled, a Content-MD5 header is sent with S3 Put Object requests. | help |
-s3.session-token value | S3 session token | help |
-s3.signature-version string | The signature version to use for authenticating against S3. | help |
-s3.sse.kms-encryption-context string | KMS Encryption Context used for object encryption. | help |
-s3.sse.kms-key-id string | KMS Key ID used to encrypt objects in S3 | help |
-s3.sse.type string | Enable AWS Server Side Encryption. | help |
-s3.storage-class string | The S3 storage class to use, not set by default. | help |
-s3.sts-endpoint string | Accessing S3 resources using temporary, secure credentials provided by AWS Security Token Service. | help |
-s3.tls-handshake-timeout duration | Maximum time to wait for a TLS handshake. | help |
-s3.trace.enabled | When enabled, low-level S3 HTTP operation information is logged at the debug level. | help |
-stderrthreshold value | logs at or above this threshold go to stderr (default 2) | help |
-storage-prefix string | Prefix for all objects stored in the backend storage. | help |
-swift.application-credential-id string | OpenStack Swift application credential id | help |
-swift.application-credential-name string | OpenStack Swift application credential name | help |
-swift.application-credential-secret value | OpenStack Swift application credential secret | help |
-swift.auth-url string | OpenStack Swift authentication URL | help |
-swift.auth-version int | OpenStack Swift authentication API version. | help |
-swift.connect-timeout duration | Time after which a connection attempt is aborted. | help |
-swift.container-name string | Name of the OpenStack Swift container to put chunks in. | help |
-swift.domain-id string | OpenStack Swift user's domain ID. | help |
-swift.domain-name string | OpenStack Swift user's domain name. | help |
-swift.max-retries int | Max retries on requests error. | help |
-swift.password value | OpenStack Swift API key. | help |
-swift.project-domain-id string | ID of the OpenStack Swift project's domain (v3 auth only), only needed if it differs the from user domain. | help |
-swift.project-domain-name string | Name of the OpenStack Swift project's domain (v3 auth only), only needed if it differs from the user domain. | help |
-swift.project-id string | OpenStack Swift project ID (v2,v3 auth only). | help |
-swift.project-name string | OpenStack Swift project name (v2,v3 auth only). | help |
-swift.region-name string | OpenStack Swift Region to use (v2,v3 auth only). | help |
-swift.request-timeout duration | Time after which an idle request is aborted. | help |
-swift.user-domain-id string | OpenStack Swift user's domain ID. | help |
-swift.user-domain-name string | OpenStack Swift user's domain name. | help |
-swift.user-id string | OpenStack Swift user ID. | help |
-swift.username string | OpenStack Swift username. | help |
-tenant string | Tenant to process | help |
-v value | log level for V logs | help |
-vmodule value | comma-separated list of pattern=N settings for file-filtered logging | help |