Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Non-zero status code returned while running DmlFusedNode_0_0 node error running directml phi3. #848

Open
darcome opened this issue Aug 28, 2024 · 2 comments
Labels

Comments

@darcome
Copy link

darcome commented Aug 28, 2024

Describe the bug
When I run the code in this repository using directml, I get the following warnings and error:

2024-08-28 12:12:55.3413627 [W:onnxruntime:onnxruntime-genai, inference_session.cc:1934 onnxruntime::InferenceSession::Initialize] This model has shape massaging nodes that will execute on CPU. Use the graph capture feature with caution. As long as the intermediate shapes produced in the model using the representative input used to capture the graph, will match the shapes produced in the model for other inputs of the same shape as the representative input (common case), it is safe to use the graph capture feature.
2024-08-28 12:12:55.3512674 [W:onnxruntime:onnxruntime-genai, session_state.cc:1166 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
2024-08-28 12:12:55.3568076 [W:onnxruntime:onnxruntime-genai, session_state.cc:1168 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
Question: How old is Luca?
Answer:
2024-08-28 12:12:57.6011809 [E:onnxruntime:onnxruntime-genai, sequential_executor.cc:516 onnxruntime::ExecuteKernel] Non-zero status code returned while running DmlFusedNode_0_0 node. Name:'DmlFusedNode_0_0' Status Message: D:\a_work\1\s\onnxruntime\core\providers\dml\DmlExecutionProvider\src\DmlGraphFusionHelper.cpp(353)\onnxruntime.DLL!00007FFEA707254C: (caller: 00007FFEA706B7CF) Exception(1) tid(6354) 80070057 The parameter is incorrect.

The code, instead, works perfectly when using cpu.

To Reproduce
Clone the following repository: https://github.com/darcome/testonnx

My laptop has an NVIDIA RTX 3080, which I don't know if it's being used, but that's another story :)

@darcome
Copy link
Author

darcome commented Aug 28, 2024

I haven't downloaded the file cause I suspect it's a virus. I don't know how to report the message...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants
@darcome and others