Hf checkpoint conversion for distributed checkpoints#424

Open

BlueCrescent wants to merge 29 commits intomainfrom

hf_checkpoint_conversion_for_fsdp2

Commits on Nov 27, 2025

feat(config): Added OmegaConf based serializer save_yaml_config_dict().
BlueCrescent
committed
feat(huggingface): Added conversion of distributed gpt2 checkpoints to huggingface format.
BlueCrescent
committed

Commits on Nov 28, 2025

chore: Merge branch 'fix_rotary_transform_deferred_init' into hf_checkpoint_conversion_for_fsdp2
BlueCrescent
committed
refactor: More robust parent directory path handling.

BlueCrescent
and
Copilot
authored
docs: better dcp to torch conversion docstring

BlueCrescent
and
Copilot
authored
fix: Added handling for missing directory.

BlueCrescent
and
Copilot
authored
fix: use Path instead of string

BlueCrescent
and
Copilot
authored
fix: use cpu device for dcp to torch converted checkpoints

BlueCrescent
and
Copilot
authored
fix: error handling if wrong model key is set in checkpoint conversion

BlueCrescent
and
Copilot
authored

Commits on Dec 2, 2025

feat(utility): Moved MultiProcessingCudaEnv from tests to modalities.
BlueCrescent
committed

Commits on Dec 8, 2025

Commits on Dec 9, 2025