You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Traceback (most recent call last):
compile_to_tensorrt()
File "reproduce.py", line 37, in compile_to_tensorrt
_trt_graph_module = torch_tensorrt.compile(
^^^^^^^^^^^^^^^^^^^^^^^
File "site-packages/torch_tensorrt/_compile.py", line 249, in compile
trt_graph_module = dynamo_compile(
^^^^^^^^^^^^^^^
File "site-packages/torch_tensorrt/dynamo/_compiler.py", line 230, in compile
trt_gm = compile_module(gm, inputs, settings)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "site-packages/torch_tensorrt/dynamo/_compiler.py", line 365, in compile_module
for node in submodule.graph.nodes
^^^^^^^^^^^^^^^
File "site-packages/torch/nn/modules/module.py", line 1729, in __getattr__
raise AttributeError(f"'{type(self).__name__}' object has no attribute '{name}'")
AttributeError: 'Module' object has no attribute 'graph'
The text was updated successfully, but these errors were encountered:
seymurkafkas
changed the title
global partitioner does not work while compiling with dynamo
[Bug] global partitioner does not work while compiling with dynamo
Sep 13, 2024
seymurkafkas
changed the title
[Bug] global partitioner does not work while compiling with dynamo
🐛 [Bug] global partitioner does not work while compiling with dynamo
Sep 13, 2024
It seems like the gm.named_children() function returns both the original module (as an nn.Module that doesn't have the attribute graph) and the fused fx.GraphModules. But even by filtering out the original Module, you can't save the exported model because fuse_partitions inserts call_module nodes and that is not compilant with the IR Spec (See this).
upd: filtering the unfused child module and saving the model with torchscript works
Hi all! Trying to use global partitioning fails with the dynamo backend, and couldn't pinpoint why (tried various compilation parameters).
How to Reproduce:
System:
Dependencies (wheels):
Script to reproduce:
Error and TraceBack:
The text was updated successfully, but these errors were encountered: