Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DispatchCreation] Add support for hoisting Flow ops. #20346

Open
wants to merge 5 commits into
base: main
Choose a base branch
from

Conversation

hanhanW
Copy link
Contributor

@hanhanW hanhanW commented Mar 21, 2025

The revision enables the hoisting of constants and weights for data-tiling. It also fixes a bug in hoisting the constants.

The DispatchWorkgroupCountOp is marked as unhoistable. It happens in custom_dispatch, which is not on regular path, so new tests are not added.

hanhanW added 3 commits March 21, 2025 14:41
Signed-off-by: hanhanW <hanhan0912@gmail.com>
Signed-off-by: hanhanW <hanhan0912@gmail.com>
Signed-off-by: hanhanW <hanhan0912@gmail.com>
@hanhanW hanhanW force-pushed the hoist-flow-tensor-encode branch from 9640357 to 5cd8ce5 Compare March 21, 2025 21:43
@hanhanW hanhanW enabled auto-merge (squash) March 21, 2025 21:59
Signed-off-by: hanhanW <hanhan0912@gmail.com>
@hanhanW hanhanW requested a review from benvanik as a code owner March 21, 2025 22:37
@hanhanW hanhanW disabled auto-merge March 21, 2025 22:37
@hanhanW hanhanW dismissed MaheshRavishankar’s stale review March 21, 2025 22:42

Remove the approval because there is a new issue in custom_dispatch.

Signed-off-by: hanhanW <hanhan0912@gmail.com>
@hanhanW hanhanW changed the title [DT] Add support for hoisting flow.tensor.encode ops. [DispatchCreation] Add support for hoisting Flow ops. Mar 24, 2025
Comment on lines +505 to +506
UnhoistableOpInterfaceHelper<
IREE::Flow::DispatchWorkgroupCountOp>::registerOpInterface(context);
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It turns out that I just need to add the op to unhoistable list, which makes sense to me.

@hanhanW
Copy link
Contributor Author

hanhanW commented Mar 24, 2025

@MaheshRavishankar can I get a review from you? I dismissed the approval because I thought there are more things to do. It turns out that I just need to add the workgroup count op to unhoistable list.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants