Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Neuron based GPUs for AL2023 #1561

Open
flostadler opened this issue Dec 24, 2024 · 0 comments
Open

Support Neuron based GPUs for AL2023 #1561

flostadler opened this issue Dec 24, 2024 · 0 comments
Labels
kind/enhancement Improvements or new features

Comments

@flostadler
Copy link
Contributor

Currently, the AMI selection in pulumi-eks is only architecture-aware (x86_64, ARM64). However, AWS has recently released EKS-optimized AMIs specifically for Neuron-based instances (trn1, inf1, etc.). To properly support these instance types, the AMI selection logic needs to be extended to be instance type-aware.

Going forward, the AMI selection should consider the instance type when choosing the appropriate AMI
For Neuron-capable instances (trn1, inf1), it should select the Neuron-optimized AMI, otherwise when GPU support is enabled it should select the NVIDIA-based AMI and for all other instances it should use the regular EKS optimized AMIs.

For more details, see AWS docs.

@flostadler flostadler added the kind/enhancement Improvements or new features label Dec 24, 2024
@pulumi-bot pulumi-bot added the needs-triage Needs attention from the triage team label Dec 24, 2024
@flostadler flostadler removed the needs-triage Needs attention from the triage team label Dec 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/enhancement Improvements or new features
Projects
None yet
Development

No branches or pull requests

2 participants