Torch-TensorRT #653
Jonathan-v-S
started this conversation in
Ideas
Torch-TensorRT
#653
Replies: 2 comments 1 reply
-
|
@CodeHeroJo it can feel free to raise a PR if you can implement that. |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
It certainly can https://developer.nvidia.com/blog/speeding-up-text-to-speech-diffusion-models-by-distillation/ |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
This isn't the use of Torch-TensorRT though, this is distillation of the DDPM. |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Can Torch-TenorRT improve performance of Tortoise-TTs?
https://developer.nvidia.com/blog/accelerating-inference-up-to-6x-faster-in-pytorch-with-torch-tensorrt/
Beta Was this translation helpful? Give feedback.
All reactions