/opt/chainguard/nemo-rl/venvs/base/bin/accelerate-merge-weights

usage: accelerate-merge-weights [-h] [--unsafe_serialization] [--remove_checkpoint_dir]
                                checkpoint_directory output_path

Utility to merge the weights from multiple FSDP checkpoints into a single combined checkpoint.
Should be used if `SHARDED_STATE_DICT` was used for the model. Weights will be saved to
`{output_path}`. This is a CPU-bound process and requires enough RAM to load the entire model
state dict.

positional arguments:
  checkpoint_directory  A directory containing sharded weights saved by FSDP.
  output_path           The path to save the merged weights. Defaults to the current directory.

options:
  -h, --help            show this help message and exit
  --unsafe_serialization, --unsafe-serialization
                        Whether to save the merged weights as `.bin` rather than `.safetensors`
                        (not recommended).
  --remove_checkpoint_dir, --remove-checkpoint-dir
                        Whether to remove the checkpoint directory after merging.