You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
When I run the code in this repository using directml, I get the following warnings and error:
2024-08-28 12:12:55.3413627 [W:onnxruntime:onnxruntime-genai, inference_session.cc:1934 onnxruntime::InferenceSession::Initialize] This model has shape massaging nodes that will execute on CPU. Use the graph capture feature with caution. As long as the intermediate shapes produced in the model using the representative input used to capture the graph, will match the shapes produced in the model for other inputs of the same shape as the representative input (common case), it is safe to use the graph capture feature.
2024-08-28 12:12:55.3512674 [W:onnxruntime:onnxruntime-genai, session_state.cc:1166 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-08-28 12:12:55.3568076 [W:onnxruntime:onnxruntime-genai, session_state.cc:1168 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
Question: How old is Luca?
Answer:
2024-08-28 12:12:57.6011809 [E:onnxruntime:onnxruntime-genai, sequential_executor.cc:516 onnxruntime::ExecuteKernel] Non-zero status code returned while running DmlFusedNode_0_0 node. Name:'DmlFusedNode_0_0' Status Message: D:\a_work\1\s\onnxruntime\core\providers\dml\DmlExecutionProvider\src\DmlGraphFusionHelper.cpp(353)\onnxruntime.DLL!00007FFEA707254C: (caller: 00007FFEA706B7CF) Exception(1) tid(6354) 80070057 The parameter is incorrect.
The code, instead, works perfectly when using cpu.
Describe the bug
When I run the code in this repository using directml, I get the following warnings and error:
2024-08-28 12:12:55.3413627 [W:onnxruntime:onnxruntime-genai, inference_session.cc:1934 onnxruntime::InferenceSession::Initialize] This model has shape massaging nodes that will execute on CPU. Use the graph capture feature with caution. As long as the intermediate shapes produced in the model using the representative input used to capture the graph, will match the shapes produced in the model for other inputs of the same shape as the representative input (common case), it is safe to use the graph capture feature.
2024-08-28 12:12:55.3512674 [W:onnxruntime:onnxruntime-genai, session_state.cc:1166 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-08-28 12:12:55.3568076 [W:onnxruntime:onnxruntime-genai, session_state.cc:1168 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
Question: How old is Luca?
Answer:
2024-08-28 12:12:57.6011809 [E:onnxruntime:onnxruntime-genai, sequential_executor.cc:516 onnxruntime::ExecuteKernel] Non-zero status code returned while running DmlFusedNode_0_0 node. Name:'DmlFusedNode_0_0' Status Message: D:\a_work\1\s\onnxruntime\core\providers\dml\DmlExecutionProvider\src\DmlGraphFusionHelper.cpp(353)\onnxruntime.DLL!00007FFEA707254C: (caller: 00007FFEA706B7CF) Exception(1) tid(6354) 80070057 The parameter is incorrect.
The code, instead, works perfectly when using cpu.
To Reproduce
Clone the following repository: https://github.com/darcome/testonnx
My laptop has an NVIDIA RTX 3080, which I don't know if it's being used, but that's another story :)
The text was updated successfully, but these errors were encountered: