Skip to content
This repository was archived by the owner on Aug 7, 2024. It is now read-only.

[DISCUSSION] fix float8 all-gather in FSDP2 + TP: DTensor(WeightWithDynamicFloat8CastTensor) #326

Draft
weifengpy wants to merge 10 commits into
base: main
Choose a base branch
from

tested successfully

7fbb867
Select commit
Loading
Failed to load commit list.
Draft

[DISCUSSION] fix float8 all-gather in FSDP2 + TP: DTensor(WeightWithDynamicFloat8CastTensor) #326

tested successfully
7fbb867
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs