Slow chunk loading with Nvidium especially

[SPINZ1]

Describe the bug
Chunk loading speed is slightly slower, but is relatively even worse with the mod Nvidium enabled.

To Reproduce
Steps to reproduce the behavior:

1. Create an instance of the Fabulously Optimized modpack and add Nvidium to it.
2. Join/create a world and wait for all chunks to load.
3. Reload chunks, repeat for combinations of nvidium or dynamic lights being enabled/disabled.
4. Observe the difference in chunk loading speed, mainly when both dynamic lights and Nvidium are enabled.

Expected behavior
Slightly reduced chunk loading speed on its own is understandable, but I would expect it to be almost the same with Nvidium added.

Screenshots
With neither dynamic lights nor Nvidium enabled:
https://github.com/user-attachments/assets/28ef58e0-9462-47a2-b20a-50e974f246bd
With only dynamic lights enabled:
https://github.com/user-attachments/assets/fd9b6d9b-aa3b-4361-8320-774efd7d30ef
With only Nvidium enabled:
https://github.com/user-attachments/assets/fa9a4417-f0c9-431a-90f2-467a5359b69b
With both Nvidium and dynamic lights enabled:
https://github.com/user-attachments/assets/b7d1d7f3-6222-41a5-8da8-a8a9889f4342

Desktop (please complete the following information):

• OS: Windows 11
• Minecraft 1.20.4
• Fabric Loader 0.15.11
• Mods: animatica-0.6+1.20, bettermounthud-1.2.2, capes-1.5.3+1.20.2-fabric, citresewn-1.1.5+1.20.4, cloth-config-13.0.121-fabric, continuity-3.0.0-beta.4+1.20.2, Controlify-2.0.0-beta.3+1.20.4, cubes-without-borders-1.1.0+1.20, Debugify-1.20.4+1.1, dynamic-fps-3.4.2+minecraft-1.20.4-fabric, e4mc-4.0.1+1.19.4-fabric, enhancedblockentities-0.9.1+1.20.2, entity_model_features_fabric_1.20.4-1.3, entity_texture_features_fabric_1.20.4-5.2.3, entityculling-fabric-1.6.4-mc1.20.4, fabric-api-0.97.0+1.20.4, fabric-language-kotlin-1.10.19+kotlin.1.9.23, fabricskyboxes-0.7.3+mc1.20.2, fabrishot-1.12.1, fastquit-3.0.0+1.20.4, ferritecore-6.0.3-fabric, fsb-interop-1.3.6+mc1.20.2-build.52, ImmediatelyFast-Fabric-1.2.11+1.20.4, indium-1.0.30+mc1.20.4, iris-mc1.20.4-1.6.17, lambdynamiclights-2.3.4+1.20.4, language-reload-1.5.10+1.20.3, lithium-fabric-mc1.20.4-0.12.1, main-menu-credits-1.1.2, mixintrace-1.1.1+1.17, ModDetectionPreventer+1.20.4-1.2.0, modelfix-1.14-fabric, modernfix-fabric-5.16.1+mc1.20.4, modmenu-9.0.0, morechathistory-1.3.0, moreculling-1.20.4-0.23.1, NoChatReports-FABRIC-1.20.4-v2.5.0, nvidium-0.2.6-beta, optigui-2.1.7, paginatedadvancements-2.4.2, polytone-1.20.4-1.18.5-fabric, puzzle-1.6.1+1.20.4, reeses_sodium_options-1.7.2+mc1.20.4-build.102, rrls-4.0.3+mc1.20.4-fabric, sodium-extra-0.5.4+mc1.20.4-build.116, sodium-fabric-0.5.8+mc1.20.4, yet-another-config-lib-fabric-3.3.2+1.20.4, yosbr-0.1.2, Zoomify-2.13.2
• Version 2.3.4
• Branch 1.20.4

Additional context
Add any other context about the problem here.

[LambdAurora]

Not sure what the hell is happening and I don't currently have an NVIDIA GPU to test theories.