Skip to content

SD2 inference pass mesh for flahattention with spmd#12

Merged
zpcore merged 4 commits intopytorch-tpu:mainfrom
ManfeiBai:patch-1
Jan 28, 2025
Merged

SD2 inference pass mesh for flahattention with spmd#12
zpcore merged 4 commits intopytorch-tpu:mainfrom
ManfeiBai:patch-1

Conversation

@ManfeiBai
Copy link
Contributor

@ManfeiBai ManfeiBai commented Jan 28, 2025

What does this PR do?

SD2 inference pass mesh for flahattention with spmd

tested log: https://gist.github.com/ManfeiBai/bc97938b94b7b8b2264e6d9dcbae0f26

Before submitting

@ManfeiBai ManfeiBai requested a review from zpcore January 28, 2025 21:46
@zpcore
Copy link
Collaborator

zpcore commented Jan 28, 2025

Can you run ruff check --fix src to fix the format? Thanks

@ManfeiBai
Copy link
Contributor Author

ManfeiBai commented Jan 28, 2025

Can you run ruff check --fix src to fix the format? Thanks

thanks, updated

@ManfeiBai ManfeiBai requested a review from zpcore January 28, 2025 22:09
@ManfeiBai
Copy link
Contributor Author

hi, @zpcore, current CI failure in https://github.com/pytorch-tpu/diffusers/actions/runs/13020451508/job/36320882664?pr=12 and https://github.com/pytorch-tpu/diffusers/actions/runs/13020451508/job/36320882664?pr=12 are due to code-not-used or format issue from other not-related code file;

to avoid touch unrelated project in this simple PR, will propose to merge PR with these CI failure

Copy link
Collaborator

@zpcore zpcore left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thanks for fixing

@zpcore zpcore merged commit 637da5a into pytorch-tpu:main Jan 28, 2025
4 of 6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants