diff --git a/README.md b/README.md index 7f2a74c..3ef0a81 100644 --- a/README.md +++ b/README.md @@ -43,6 +43,7 @@ ATorch is an extension library of PyTorch developed by Ant Group's AI Infrastruc * Transformer ops * High-performance MOE * sub-graph compilation + * [Local SGD/EDiT](docs/README-EDiT.md) * Checkpointing * Mixed precision * Communication optimization @@ -109,7 +110,7 @@ python -m atorch.distributed.run --nproc_per_node 2 train.py --model_type llam [WSAM optimizer](docs/README-WSAM.md) - +[Local SGD/EDiT](docs/README-EDiT.md) ## Contributing diff --git a/atorch/local_sgd/README.md b/atorch/local_sgd/README.md index a58a16c..5c270da 100644 --- a/atorch/local_sgd/README.md +++ b/atorch/local_sgd/README.md @@ -1,3 +1,3 @@ # Unified Local SGD (EDiT) Support -We atorch, we support local sgd (EDiT) integration with mainstream parallelism strategies. For detail, refer to [EDiT](../../docs/README-EDIT.md) \ No newline at end of file +ATorch supports local sgd (EDiT) integration with mainstream parallelism strategies. For detail, refer to [EDiT](../../docs/README-EDiT.md)