Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add PaliGemma 2 examples #133

Open
wants to merge 20 commits into
base: main
Choose a base branch
from
+1,415 −0
Open

Add PaliGemma 2 examples #133

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
69be05a
Add `examples/gke/deploy-paligemma-2-with-tgi` example (WIP)
alvarobartt Dec 13, 2024
8709ae0
Update `examples/gke/deploy-paligemma-2-with-tgi/README.md`
alvarobartt Dec 13, 2024
3902d13
Update `examples/gke/deploy-paligemma-2-with-tgi/README.md`
alvarobartt Dec 13, 2024
7b89298
Comment manifest separator due to `doc-builder` conflicts
alvarobartt Dec 13, 2024
a4168b6
Add notes on PaliGemma prompt formatting and inference
alvarobartt Dec 15, 2024
980a217
Update `examples/gke/deploy-paligemma-2-with-tgi/README.md`
alvarobartt Dec 15, 2024
36f995b
Upload images for `examples/gke/deploy-paligemma2-with-tgi`
alvarobartt Dec 15, 2024
2f6abe2
Temporarily skip `---` due to `doc-builder` formatting issues
alvarobartt Dec 15, 2024
5703b35
Remove `---` as it's not rendering nicely
alvarobartt Dec 15, 2024
713588a
Add missing image reference
alvarobartt Dec 15, 2024
4663c4e
Update notes on prompt formatting
alvarobartt Dec 16, 2024
6330d3f
Apply suggestions from code review
alvarobartt Dec 18, 2024
94f89cb
Upload missing `model-gating.png` and update `README.md`
alvarobartt Dec 18, 2024
2012fd9
Add `examples/vertex-ai/pipelines/fine-tune-paligemma-2-with-pytorch`
alvarobartt Jan 14, 2025
7804264
Remove `imgs` and upload those to `documentation-images`
alvarobartt Jan 14, 2025
3b1a7f5
Update `examples/vertex-ai/pipelines/fine-tune-paligemma-2-with-pytorch`
alvarobartt Jan 14, 2025
78123cb
Fix `pipeline-notebook.ipynb` formatting
alvarobartt Jan 14, 2025
63b6158
Rename `pipeline-notebook.ipynb` to `vertex-notebook.ipynb`
alvarobartt Jan 14, 2025
859527f
Run `scripts/internal/update_example_tables.py`
alvarobartt Jan 14, 2025
6c99feb
Merge branch 'main' into pali-gemma-2-examples
alvarobartt Jan 14, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -45,6 +45,7 @@ The [`examples`](./examples) directory contains examples for using the container
| --------- | ------------------------------------------------------------------------------------------------------------------------------------------ | --------------------------------------------------------------------------- |
| Vertex AI | [examples/vertex-ai/notebooks/trl-lora-sft-fine-tuning-on-vertex-ai](./examples/vertex-ai/notebooks/trl-lora-sft-fine-tuning-on-vertex-ai) | Fine-tune Gemma 2B with PyTorch Training DLC using SFT + LoRA on Vertex AI |
| Vertex AI | [examples/vertex-ai/notebooks/trl-full-sft-fine-tuning-on-vertex-ai](./examples/vertex-ai/notebooks/trl-full-sft-fine-tuning-on-vertex-ai) | Fine-tune Mistral 7B v0.3 with PyTorch Training DLC using SFT on Vertex AI |
| Vertex AI | [examples/vertex-ai/pipelines/fine-tune-paligemma-2-with-pytorch](./examples/vertex-ai/pipelines/fine-tune-paligemma-2-with-pytorch) | Fine-tune PaliGemma 2 with PyTorch Training DLC on Vertex AI |
| GKE | [examples/gke/trl-full-fine-tuning](./examples/gke/trl-full-fine-tuning) | Fine-tune Gemma 2B with PyTorch Training DLC using SFT on GKE |
| GKE | [examples/gke/trl-lora-fine-tuning](./examples/gke/trl-lora-fine-tuning) | Fine-tune Mistral 7B v0.3 with PyTorch Training DLC using SFT + LoRA on GKE |

Expand All @@ -64,6 +65,7 @@ The [`examples`](./examples) directory contains examples for using the container
| GKE | [examples/gke/tgi-llama-405b-deployment](./examples/gke/tgi-llama-405b-deployment) | Deploy Llama 3.1 405B with TGI DLC on GKE |
| GKE | [examples/gke/tgi-llama-vision-deployment](./examples/gke/tgi-llama-vision-deployment) | Deploy Llama 3.2 11B Vision with TGI DLC on GKE |
| GKE | [examples/gke/tgi-deployment](./examples/gke/tgi-deployment) | Deploy Meta Llama 3 8B with TGI DLC on GKE |
| GKE | [examples/gke/deploy-paligemma-2-with-tgi](./examples/gke/deploy-paligemma-2-with-tgi) | Deploy PaliGemma 2 with TGI DLC on GKE |
| GKE | [examples/gke/tgi-from-gcs-deployment](./examples/gke/tgi-from-gcs-deployment) | Deploy Qwen2 7B with TGI DLC from GCS on GKE |
| GKE | [examples/gke/tei-deployment](./examples/gke/tei-deployment) | Deploy Snowflake's Arctic Embed with TEI DLC on GKE |
| Cloud Run | [examples/cloud-run/deploy-gemma-2-on-cloud-run](./examples/cloud-run/deploy-gemma-2-on-cloud-run) | Deploy Gemma2 9B with TGI DLC on Cloud Run |
Expand Down
2 changes: 2 additions & 0 deletions docs/source/resources.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -40,6 +40,7 @@ Learn how to use Hugging Face in Google Cloud by reading our blog posts, present

- [Fine-tune Gemma 2B with PyTorch Training DLC using SFT + LoRA on Vertex AI](https://github.com/huggingface/Google-Cloud-Containers/tree/main/examples/vertex-ai/notebooks/trl-lora-sft-fine-tuning-on-vertex-ai)
- [Fine-tune Mistral 7B v0.3 with PyTorch Training DLC using SFT on Vertex AI](https://github.com/huggingface/Google-Cloud-Containers/tree/main/examples/vertex-ai/notebooks/trl-full-sft-fine-tuning-on-vertex-ai)
- [Fine-tune PaliGemma 2 with PyTorch Training DLC on Vertex AI](https://github.com/huggingface/Google-Cloud-Containers/tree/main/examples/vertex-ai/pipelines/fine-tune-paligemma-2-with-pytorch)

- Evaluation

Expand All @@ -54,6 +55,7 @@ Learn how to use Hugging Face in Google Cloud by reading our blog posts, present
- [Deploy Llama 3.1 405B with TGI DLC on GKE](https://github.com/huggingface/Google-Cloud-Containers/tree/main/examples/gke/tgi-llama-405b-deployment)
- [Deploy Llama 3.2 11B Vision with TGI DLC on GKE](https://github.com/huggingface/Google-Cloud-Containers/tree/main/examples/gke/tgi-llama-vision-deployment)
- [Deploy Meta Llama 3 8B with TGI DLC on GKE](https://github.com/huggingface/Google-Cloud-Containers/tree/main/examples/gke/tgi-deployment)
- [Deploy PaliGemma 2 with TGI DLC on GKE](https://github.com/huggingface/Google-Cloud-Containers/tree/main/examples/gke/deploy-paligemma-2-with-tgi)
- [Deploy Qwen2 7B with TGI DLC from GCS on GKE](https://github.com/huggingface/Google-Cloud-Containers/tree/main/examples/gke/tgi-from-gcs-deployment)
- [Deploy Snowflake's Arctic Embed with TEI DLC on GKE](https://github.com/huggingface/Google-Cloud-Containers/tree/main/examples/gke/tei-deployment)

Expand Down
1 change: 1 addition & 0 deletions examples/gke/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,7 @@ This directory contains usage examples of the Hugging Face Deep Learning Contain

| Example | Title |
| ------------------------------------------------------------ | ------------------------------------------------------------- |
| [deploy-paligemma-2-with-tgi](./deploy-paligemma-2-with-tgi) | Deploy PaliGemma 2 with TGI DLC on GKE |
| [tei-deployment](./tei-deployment) | Deploy Snowflake's Arctic Embed with TEI DLC on GKE |
| [tei-from-gcs-deployment](./tei-from-gcs-deployment) | Deploy BGE Base v1.5 with TEI DLC from GCS on GKE |
| [tgi-deployment](./tgi-deployment) | Deploy Meta Llama 3 8B with TGI DLC on GKE |
Expand Down
Loading
Loading