-
Notifications
You must be signed in to change notification settings - Fork 2.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[GPU] fix memory conflict for multi iteration in loop. #28487
Conversation
Run perf test on bs=2 on TF_Mask_RCNN_Inception_ResNet_v2_atrous_coco w/ changes: [ INFO ] Count: 16 iterations w/o changes: No performance drop observed. |
build_jenkins |
5d250d7
to
031a5be
Compare
@artanokhov Done, rebased from master. |
This PR is a continuation of the previous PR #28056. |
build_jenkins |
### Details: - backport of #28487 ### Tickets: - 158017 Co-authored-by: Xu, Jia3 <[email protected]>
Cause is shown in graph below.
The black, green, and dotted line donates the primitive dependency, memory buffer reuse, and memory conflict (at the second iteration) respectively.
The body of the loop is compiled as a separate model and is not aware the data reuse in backedge in multiple iteration.
Tickets:
CVS-158017