ValueError: Invalid input type <class 'NoneType'> encountered in the dynamo_compile input parsing

[KumoLiu]

[2024-11-14T19:28:21.224Z] ======================================================================

[2024-11-14T19:28:21.224Z] ERROR: test_handler (tests.test_trt_compile.TestTRTCompile)

[2024-11-14T19:28:21.224Z] ----------------------------------------------------------------------

[2024-11-14T19:28:21.224Z] Traceback (most recent call last):

[2024-11-14T19:28:21.224Z]   File "/home/jenkins/agent/workspace/Monai-latest-image/tests/test_trt_compile.py", line 82, in test_handler

[2024-11-14T19:28:21.224Z]     net1.forward(torch.tensor([[0.0, 1.0], [1.0, 2.0]], device="cuda"))

[2024-11-14T19:28:21.224Z]   File "/home/jenkins/agent/workspace/Monai-latest-image/monai/networks/trt_compiler.py", line 598, in trt_forward

[2024-11-14T19:28:21.224Z]     return self._trt_compiler.forward(self, argv, kwargs)

[2024-11-14T19:28:21.224Z]   File "/home/jenkins/agent/workspace/Monai-latest-image/monai/networks/trt_compiler.py", line 451, in forward

[2024-11-14T19:28:21.224Z]     raise e

[2024-11-14T19:28:21.224Z]   File "/home/jenkins/agent/workspace/Monai-latest-image/monai/networks/trt_compiler.py", line 442, in forward

[2024-11-14T19:28:21.224Z]     self._build_and_save(model, build_args)

[2024-11-14T19:28:21.224Z]   File "/home/jenkins/agent/workspace/Monai-latest-image/monai/networks/trt_compiler.py", line 540, in _build_and_save

[2024-11-14T19:28:21.224Z]     engine_bytes = torch_tensorrt.convert_method_to_trt_engine(

[2024-11-14T19:28:21.224Z]   File "/usr/local/lib/python3.10/dist-packages/torch_tensorrt/_compile.py", line 351, in convert_method_to_trt_engine

[2024-11-14T19:28:21.224Z]     torchtrt_inputs = prepare_inputs(inputs)

[2024-11-14T19:28:21.224Z]   File "/usr/local/lib/python3.10/dist-packages/torch_tensorrt/dynamo/utils.py", line 176, in prepare_inputs

[2024-11-14T19:28:21.224Z]     torchtrt_input = prepare_inputs(

[2024-11-14T19:28:21.224Z]   File "/usr/local/lib/python3.10/dist-packages/torch_tensorrt/dynamo/utils.py", line 199, in prepare_inputs

[2024-11-14T19:28:21.224Z]     raise ValueError(

[2024-11-14T19:28:21.224Z] ValueError: Invalid input type <class 'NoneType'> encountered in the dynamo_compile input parsing. Allowed input types: {torch_tensorrt.Input, torch.Tensor, list, tuple, dict}

The error occurred on container 24.08

[KumoLiu]

cc @borisfom

[borisfom]

24.08 is very old container - dynamo is changing really fast and only the latest containers work.