Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Snippets][CPU] Enabled dynamic INT8,BF16,FP16 MHA tokenization #28276

Merged
merged 1 commit into from
Jan 9, 2025
Merged

[Snippets][CPU] Enabled dynamic INT8,BF16,FP16 MHA tokenization #28276

merged 1 commit into from
Jan 9, 2025

Conversation

a-sidorova
Copy link
Contributor

@a-sidorova a-sidorova commented Jan 6, 2025 •
edited
Loading

Details:

  • Updated tokenization callback in CPU Plugin to enable dynamic INT8,BF16,FP16 MHA tokenization
  • Attached the perf validation results to the ticket: 147260

Tickets:

  • 150840
  • 150842
  • 147260

Prerequisites:

@a-sidorova a-sidorova added this to the 2025.0 milestone Jan 6, 2025
@github-actions github-actions bot added category: IE Tests OpenVINO Test: plugins and common category: CPU OpenVINO CPU plugin labels Jan 6, 2025
@a-sidorova a-sidorova force-pushed the feature/snippets/dynamism/dynamic_i8_bf16_mha_token branch from 1c45612 to dffb85e Compare January 8, 2025 16:22
@a-sidorova a-sidorova marked this pull request as ready for review January 8, 2025 16:22
@a-sidorova a-sidorova requested review from a team as code owners January 8, 2025 16:22
@github-actions github-actions bot removed the category: IE Tests OpenVINO Test: plugins and common label Jan 8, 2025
@a-sidorova a-sidorova requested a review from v-Golubev January 8, 2025 16:23
@a-sidorova
Copy link
Contributor Author

@v-Golubev @IvanNovoselov hey guys! Only one step is left! Please take a look at these changes 😊

@IvanNovoselov IvanNovoselov added this pull request to the merge queue Jan 9, 2025
Merged via the queue into openvinotoolkit:master with commit 753bbfc Jan 9, 2025
181 checks passed
@IvanNovoselov IvanNovoselov deleted the feature/snippets/dynamism/dynamic_i8_bf16_mha_token branch January 9, 2025 11:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@IvanNovoselov IvanNovoselov IvanNovoselov approved these changes

@v-Golubev v-Golubev v-Golubev approved these changes

Assignees

@v-Golubev v-Golubev

@IvanNovoselov IvanNovoselov

Labels
category: CPU OpenVINO CPU plugin
Projects
None yet
Milestone
2025.0
Development

Successfully merging this pull request may close these issues.
3 participants
@a-sidorova @v-Golubev @IvanNovoselov