Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[GPU]Improve sdpa_opt kernel by skipping computes of causal mask #28260

Open
wants to merge 16 commits into
base: master
Choose a base branch
from
Open

[GPU]Improve sdpa_opt kernel by skipping computes of causal mask #28260

wants to merge 16 commits into from
+137 −134

Conversation

ceciliapeng2011
Copy link
Contributor

Details:

  • skip computes of causal mask
  • ...

Tickets:

  • 151857

ceciliapeng2011 and others added 14 commits December 11, 2024 14:35
@ceciliapeng2011 ceciliapeng2011 requested review from a team as code owners January 3, 2025 07:13
@github-actions github-actions bot added the category: GPU OpenVINO GPU plugin label Jan 3, 2025
@ceciliapeng2011 ceciliapeng2011 changed the title Cecilia/causal mask [GPU]Improve sdpa_opt kernel by skipping computes of causal mask Jan 3, 2025
@ceciliapeng2011
Copy link
Contributor Author

This PR is based on #28013.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@riverlijunjie riverlijunjie Awaiting requested review from riverlijunjie

@sshlyapn sshlyapn Awaiting requested review from sshlyapn

At least 1 approving review is required to merge this pull request.

Assignees

@sshlyapn sshlyapn

Labels
category: GPU OpenVINO GPU plugin
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@ceciliapeng2011 @sshlyapn @peterchen-intel