Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AMD] Predicate tt.dot to override select in pipeline epilogue #4694

Merged
merged 3 commits into from
Sep 10, 2024

Conversation

sjw36
Copy link
Contributor

@sjw36 sjw36 commented Sep 10, 2024

This change puts tt.dot in a predicated scf.if based on pipeline peeled iteration.
The result is that the final stage is conditional and the peeling select is optimized away in the backend.

@@ -543,6 +543,21 @@ createStreamOps(scf::ForOp &forOp, tt::CoarseSchedule &schedule,
return allocs;
}

static Operation *streamPredication(RewriterBase &rewriter, Operation *op,
Value pred) {
// Predicate dot so select will be removed (reduces register pressure)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe this comment could use a bit more context

@antiagainst antiagainst merged commit 845d75a into triton-lang:main Sep 10, 2024
7 checks passed
@antiagainst antiagainst deleted the sjw/predicate-dot branch September 10, 2024 22:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants