Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use AWS accelerated AMIs #46

Merged
merged 2 commits into from
Oct 15, 2024
Merged

Use AWS accelerated AMIs #46

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
541541f
use aws accelerated amis
bd-g Oct 15, 2024
3c0d68a
update eks accelerated ami ref link
bd-g Oct 15, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions charts/deepgram-self-hosted/CHANGELOG.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,10 @@ The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/),

## [Unreleased]

### Changed

- AWS samples updated to take advantage of new [EKS accelerated AMIs](https://github.com/awslabs/amazon-eks-ami/releases/tag/v20240928), which bundle the required NVIDIA driver and toolkit instead of being installed by the NVIDIA GPU operator
jkroll-deepgram marked this conversation as resolved.
Show resolved Hide resolved

jkroll-deepgram marked this conversation as resolved.
Show resolved Hide resolved
## [0.6.0] - 2024-09-27

### Added
Expand Down
6 changes: 3 additions & 3 deletions charts/deepgram-self-hosted/samples/01-basic-setup-aws.cluster-config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ managedNodeGroups:
desiredCapacity: 0
maxSize: 8
instanceType: g6.2xlarge
amiFamily: Ubuntu2204
amiFamily: AmazonLinux2023
labels:
k8s.deepgram.com/node-type: engine
k8s.amazonaws.com/accelerator: nvidia-l4
Expand All @@ -58,7 +58,7 @@ managedNodeGroups:
desiredCapacity: 0
maxSize: 2
instanceType: c5n.xlarge
amiFamily: Ubuntu2204
amiFamily: AmazonLinux2023
labels:
k8s.deepgram.com/node-type: api
iam:
Expand All @@ -70,7 +70,7 @@ managedNodeGroups:
desiredCapacity: 0
maxSize: 2
instanceType: t3.large
amiFamily: Ubuntu2204
amiFamily: AmazonLinux2023
labels:
k8s.deepgram.com/node-type: license-proxy
iam:
Expand Down
12 changes: 12 additions & 0 deletions charts/deepgram-self-hosted/samples/01-basic-setup-aws.values.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -140,3 +140,15 @@ cluster-autoscaler:
autoDiscovery:
clusterName: "deepgram-self-hosted-cluster"
awsRegion: "us-west-2"

gpu-operator:
enabled: true

# If using EKS accelerated AMIs based on Amazon Linux 2023 (default with Deepgram guides as of Oct 2024),
# driver and toolkit come bundled with the AMI.
#
# If using other AMIs, such as Ubuntu, you should re-enable the driver and toolkit below.
driver:
enabled: false
toolkit:
enabled: false
Loading