Release 10.5-GA
Key Features and Updates:
- Demo changes
- Added Flux.1-dev pipeline
- Sample changes
- None
- Plugin changes
- Migrated
IPluginV2
-descendent versions ofbertQKVToContextPlugin
(1, 2, 3) to newer versions (4, 5, 6 respectively) which implementIPluginV3
. - Note:
- The newer versions preserve the attributes and I/O of the corresponding older plugin version
- The older plugin versions are deprecated and will be removed in a future release
- Migrated
- Quickstart guide
- None
- Parser changes
- Added support for real-valued
STFT
operations - Improved error handling in
IParser
- Added support for real-valued
Known issues:
- Demos:
- TensorRT engine might not be build successfully when using
--fp8
flag on H100 GPUs.
- TensorRT engine might not be build successfully when using