Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

new: Deploy and monitor ML models with GPUs on Amazon EKS #1020

Open
wants to merge 10 commits into
base: main
Choose a base branch
from
Open

new: Deploy and monitor ML models with GPUs on Amazon EKS #1020

Show file tree
Hide file tree
Changes from 4 commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
33bbed9
deploy-monitor-genai-model lab first commit
shivkumr Jul 16, 2024
2e1e6f7
updated the syntax error in the kuberay install command
shivkumr Jul 16, 2024
3b750b6
fixed all the module test errors
shivkumr Jul 27, 2024
96ca496
Moved Karpenter installation into the preinstall script
shivkumr Sep 11, 2024
f818d9a
Merge branch 'main' into main
niallthomson Sep 26, 2024
dca61f4
Update index.md
niallthomson Sep 26, 2024
a69cba7
Require intro update for consistency, fixed spelling in file name
niallthomson Sep 27, 2024
b9995fe
Various fixes to bring lab in line with rest of the workshop
niallthomson Oct 29, 2024
3021994
Fix describe permissions
niallthomson Oct 29, 2024
c729b67
Merge branch 'main' into main
niallthomson Nov 6, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion cluster/eksctl/cluster.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ vpc:
publicAccess: true
addons:
- name: vpc-cni
version: 1.16.0
version: 1.18.3
configurationValues: '{"env":{"ENABLE_PREFIX_DELEGATION":"true", "ENABLE_POD_ENI":"true", "POD_SECURITY_GROUP_ENFORCING_MODE":"standard"},"enableNetworkPolicy": "true"}'
resolveConflicts: overwrite
managedNodeGroups:
Expand Down
3 changes: 2 additions & 1 deletion manifests/.workshop/terraform/outputs.tf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,4 +5,5 @@ output "environment" {
export ${k}='${v}'
%{endfor}
EOF
}
sensitive = true
}
1 change: 1 addition & 0 deletions manifests/manifests
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
/manifests
15 changes: 15 additions & 0 deletions manifests/modules/aiml/deploy-monitor-genai-model/.workshop/cleanup.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
#!/bin/bash

kubectl delete ingress dogbooth -n dogbooth --ignore-not-found
kubectl delete rayservice dogbooth -n dogbooth --ignore-not-found
kubectl delete ns dogbooth --ignore-not-found

helm uninstall jupyterhub -n jupyterhub
helm uninstall nginx-ingress
helm uninstall kuberay-operator
kubectl delete ns jupyterhub

# Uninstall gpu-operator
GPU_OPERATOR_RELEASE_NAME=$(helm list -n gpu-operator -q)
helm uninstall $GPU_OPERATOR_RELEASE_NAME -n gpu-operator
kubectl delete ns gpu-operator
Loading