Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Split platform-specific binaries for NuGet backends #957

Merged
merged 3 commits into from
Oct 19, 2024

Conversation

m0nsky
Copy link
Contributor

@m0nsky m0nsky commented Oct 17, 2024

This PR refactors the NuGet package structure for the LLamaSharp.Backend.Cuda11, LLamaSharp.Backend.Cuda12 and LLamaSharp.Backend.Vulkan packages by splitting the platform-specific binaries (Windows and Linux) into separate packages, and adds them as dependencies on the main packages. This way we can work around the 250MB limit for NuGet which broke the latest release.

Package Name File Size Before (MB) File Size After (MB)
LLamaSharp.Backend.Cuda11 286.36 MB 0.032 MB
LLamaSharp.Backend.Cuda11.Windows N/A 142.56 MB
LLamaSharp.Backend.Cuda11.Linux N/A 143.82 MB
LLamaSharp.Backend.Cuda12 284.33 MB 0.032 MB
LLamaSharp.Backend.Cuda12.Windows N/A 141.62 MB
LLamaSharp.Backend.Cuda12.Linux N/A 142.74 MB
LLamaSharp.Backend.Vulkan 3.49 MB 0.032 MB
LLamaSharp.Backend.Vulkan.Windows N/A 1.54 MB
LLamaSharp.Backend.Vulkan.Linux N/A 1.98 MB

@m0nsky
Copy link
Contributor Author

m0nsky commented Oct 18, 2024

I tested installing the CUDA & Vulkan packages today and it seems to be working fine.

@m0nsky m0nsky marked this pull request as ready for review October 18, 2024 08:56
@martindevans martindevans merged commit 3875611 into SciSharp:master Oct 19, 2024
6 checks passed
@m0nsky m0nsky deleted the split-nuspec branch October 19, 2024 19:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants