KFP v2 tracker

[Bobgy]

Design: bit.ly/kfp-v2.
Project: https://github.com/kubeflow/pipelines/projects/9

Tracking by major release milestones:

• KFP 2.0 Alpha
• KFP 2.0 Beta.0 #8697
  • feat(backend): KFP v2 API (v2beta1) #8698
  • [backend] Can't create a run from pipeline with empty PipelineSpec (stored as a file in OS) #8802
  • chore(backend): Manually update v2 image references post v2 API update #8815
  • chore(backend): Update release script due to proto generation changes in V2 #8818
• KFP 2.0 Beta.1 #8858
  • v2 API integration
    • feat(frontend): KFP v2 API integration #8703
    • feat(SDK): KFP v2 API integration #8706
• KFP 2.0 GA #8705
  • Feature: Volume
    • feat(SDK): Support platform-specific features via SDK #8707
    • feat(backend): Accept pipeline YAML that contains platform-specific sections #8758
    • feat(backend): Support volume mount #8708
    • feat(frontend): Run details panel: Volume tab #8715
  • Feature: Secret
    • feat(SDK): Support platform-specific features via SDK #8707
    • feat(backend): Accept pipeline YAML that contains platform-specific sections #8758
    • feat(backend): Support secrets #8709
  • Feature: User log
    • feat(frontend): Show user container log #8714
  • Feature: Optional inputs & default value
    • feat(backend): Support optional input parameters #8716
  • Feature: Environment variable
    • feat(backend): Support environment variables #8704
  • Feature: Accelerator config
    • feat(backend): support accelerator resources #7043
  • Feature: resource requests
    • feat(backend): support resource requests #7047
  • Feature: nodeSelector
    • feature(backend) nodeSelector support in platform-specific spec #8959
  • Non-feature: Documentation
    • docs: v2 documentation update #8713
  • Non-feature: Testing & Release
    • test: v2 backend API based e2e testing #6168
  • Non-feature: Backend data model
    • feat(backend): migrate v1 data to v2 storage format #8736
  • Bugs:
    • fix(backend): fix importer launcher #8724
    • fix(backend/frontend): Run status inconsistency between pipeline and its component #8725
  • Security
    • [CVE] Resolve critical CVEs in KFP v2 #9136
• KFP 2.0 Post-GA #10402
  • Non-feature: Telemetry
    • feat(backend): Separate API tracking counter for v1 and v2 #8712
  • Non-feature: Testing and Release
    • release: improve release process #6184
    • test: v2 upgrade test #10403
  • Feature: Status-IR and MLMD calls
    • feature(backend) Status-IR: provide API message to store status information of a pipeline run #8960
    • feature(backend) Status-IR: support status information for run messages in api-server #8961
    • feature(backend) Status-IR: add MLMD client to persistence agent and support for Status-IR #8964
    • feature(backend) Provide interface for calling MLMD via api-server #8965
    • feature(frontend) Support Status-IR and remove MLMD client in KFP Frontend #8966
    • feat(backend): Support IfPresent..Then..Else placeholder #8710
    • feat(backend): Support Concat placeholder #8711
    • feat(backend): Support PipelineTaskFinalStatus parameter type #8721
    • feat(backend): v2 placeholders - unique placeholders #6155
    • feat(backend): Support task level retry #8717
    • feat(backend): Support loop parallelism #8718
    • feat(backend): Support artifact inputs #8719
    • feat(SDK): Support passing artifact inputs at client #8720
    • feature(backend): Update healthz service in KFP v2 #8833

---

Tracking by feature/area:

• v2 orchestration engine
  • v2 backend compiler and basic orchestration #6149
  • v2 placeholders #6150
  • v2 caching #6156
  • v2 control flow #6157
  • special components #6163
  • v2 e2e testing
    • v2 e2e testing - v2 CLI compiler based #6167
    • test: v2 backend API based e2e testing #6168
  • misc
    • v2 - support resource requests and limits #6354
    • v2 - document how to develop #6183
    • release: improve release process #6184
    • distinguish v2 and v2 compatible labels #6185
    • v2 - input parameter type auto conversion #7058
• v2 UI tracker #6198
• v2 backend API #6199
• v2 backend - full API support #7104
• chore(backend): Migrate backend API reference docs from kuberflow.org #8832

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[chensun]

KFP v2 went GA in June 2023. Track the remaining in #10402.