🚀 Pre-release master -> staging_EventHorizon2

[YuryHrytsuk]

What kind of pre-release?

master branch

Sprint Name

EventHorizon

Pre-release version

2

Commit SHA

afd66d4df2d16763b1899a76408670773fa09939

Planned date

Thursday, Nov. 21, 2024

Did the commit CI suceeded?

• The commit CI succeeded.

Motivation

• Weekly staging release

What Changed

• ♻️ Migrates folders and workspaces repositories to asyncpg #6688 by @pcrespov
• 🔨 Fix: e2e Performance Tests in CI #6707 by @pcrespov
• ✅ Extends test_EC2_INSTANCES_ALLOWED_TYPES_empty_not_allowed #6705 by @pcrespov
• ✨ introduce folder full search #6703 by @matusdrobuliak66
• 🎨Maintenance: make redis client use the client name to ease debugging #6700 by @sanderegg
• 🎨 [Frontend] Make the Light Theme less white #6681 by @odeimaiz
• 🐛 folder full search adding text query parameter #6716 by @matusdrobuliak66
• ✨ [Frontend] Enh: :search also /folders #6713 by @odeimaiz
• 🎨🐛 Enh/fix: frontend knows about trashedAt #6717 by @odeimaiz
• 🐛 [Frontend] TIP: New plan after creating its template #6710 by @odeimaiz
• 🐛 Fix listing folders in workspace #6718 by @matusdrobuliak66
• ✨ instrument (opentelemetry) httpx clients #6715 by @bisgaard-itis
• 🎨 [Frontend] UX: Create Study from Template #6706 by @odeimaiz
• 🎨Computation backend: refactor director-v2 internal computational scheduler to be less resource heavy #6696 by @sanderegg
• 🎨 Adding tracing to agent and dynamic-sidecar (🏗️ DEVOPS) #6691 by @GitHK
• 🎨 [Frontend] Enh: Tag management #6720 by @odeimaiz
• 🐛 Fix healthcheck in api-server #6662 by @bisgaard-itis
• ✨ add project tags to RUT listing/export #6722 by @matusdrobuliak66
• ✨ [Frontend] Feature: Announcement generator #6723 by @odeimaiz
• 🐛 [e2e-playwright] Fix tests #6731 by @odeimaiz
• 🐛 [e2e-playwright] Fix tests, 2nd attempt #6735 by @odeimaiz
• ✨Computational backend: refactoring of dv-2 computational scheduler (Part 2) #6711 by @sanderegg
• 🎨 Improving E2E tests: expected_service_running #6739 by @matusdrobuliak66
• 🐛 adding missing db insert field #6742 by @matusdrobuliak66
• 🎨 adding asyncpg to director-v2 #6746 by @matusdrobuliak66
• Bump codecov/codecov-action from 4.6.0 to 5.0.2 #6749 by @dependabot
• 🎨 web-server api: ordering parameters and simplified openapi specs for complex query parameters #6737 by @pcrespov
• 🐛 [e2e] Fix tests, 3rd attempt #6740 by @odeimaiz
• ♻️⬆️ Migrating director service to fastapi ⚠️ 🚨 #6657 by @pcrespov
• Fixed broken cMIS export when service description was missing #6748 by @GitHK
• ✨ [Frontend] Tester Center #6745 by @odeimaiz
• 🎨 [Frontend] Enh: Support multiple announcements #6729 by @odeimaiz
• ♻️ improving e2e tests (socketio reconnect) #6759 by @matusdrobuliak66
• 🎨 [Frontend] Check all linked nodes exist before loading Study #6762 by @odeimaiz
• 🎨 [e2e][Frontend] Folders and Workspaces related test-ids #6766 by @odeimaiz
• ♻️Director-v0: add setting to control concurrency in client to docker registry #6768 by @sanderegg
• ♻️ OpenTelemetry Enhancements: Filter out healthchecks, add catalog internals instrumentation #6752 by @mrnicegyu11
• ⚗️ ♻️ improving e2e tests (adding structure for additional CI tests) #6765 by @matusdrobuliak66
• 🐛 [e2e] Study Options: Open button #6775 by @odeimaiz
• Bump cross-spawn from 7.0.3 to 7.0.5 in /tests/e2e in the npm_and_yarn group across 1 directory #6743 by @dependabot
• ⬆️ Pydantic v2 migration #6578 by @sanderegg
• 📝 services.md: autodocs openapi specs and images for each service  #6779 by @pcrespov
• 🐛 Fix Redis DSN scheme generation #6790 by @giancarloromeo
• 🐛 Fixed flaky tests in services/dynamic-sidecar/tests/unit/test_modules_outputs_event_filter.py #6795 by @GitHK
• 🐛 Use list instead of set when building the expected result #6796 by @giancarloromeo
• 🎨 [Frontend] Sort folders alphabetically #6794 by @odeimaiz
• 🐛🎨♻️Director-v0: improve registry caching #6799 by @sanderegg
• 🐛 Fix OpenTelemetry endpoint URL creation #6802 by @giancarloromeo
• 🐛Director-V0: Legacy services expect Postgres Endpoint as host:port #6811 by @sanderegg
• 🐛 Fix CLUSTERS_KEEPER_TASK_INTERVAL env var #6812 by @giancarloromeo
• ⬆️♻️ Fixes openapi specs generators and drops openapi-core dependencies #6787 by @pcrespov
• 🐛 [e2e] _open_with_resources #6809 by @odeimaiz
• ✨ Trash workspaces #6690 by @pcrespov
• ✨ [Frontend] Keep console errors #6816 by @odeimaiz
• 🐛Pydantic V2: interpretation of "None" changed #6820 by @sanderegg
• ✨Director-v0: added background task that pre-builds the registry cache #6814 by @sanderegg
• 🎨🔨 Improve workflow for performance tests #6815 by @bisgaard-itis
• 🐛 Fixed issue with serialisation of docker specs #6819 by @GitHK
• 🐛 Fix URL serialization in /invitations:extract endpoint #6808 by @giancarloromeo
• 🐛 Fix Color serialization in Pydantic v2 #6821 by @giancarloromeo
• 🐛 [Frontend] Studies: list more than 5 studies in folder #6813 by @odeimaiz
• Bump codecov/codecov-action from 4.5.0 to 5.0.7 #6826 by @dependabot
• ♻️✨ [Frontend] Enh: model Groups and Users. And their Store #6769 by @odeimaiz
• 🐛 Fixes OrderBy serialization error in pydanticv2 #6828 by @pcrespov

Devops check ⚠️ devops

• Bump python version
  • Update Python3.11 is not installed on machines osparc-ops-environments#883
• NIH STAG: perform docker login (https://git.speag.com/oSparc/osparc-infra/-/merge_requests/263)
  • Update Perform docker hub login on nodes osparc-ops-environments#882

e2e testing check 🧪

No response

Summary 📝

• make release-staging name=<sprint_name> version=<version> git_sha=<commit_sha>
  • https://github.com/ITISFoundation/osparc-simcore/releases/new?prerelease=1&target=<commit_sha>&tag=staging_<sprint_name><version>&title=Staging%20<sprint_name><version>
• Draft pre-release
• Announce (add redis key maintenance in every concerned deployment)

  {"start": "2023-02-01T12:30:00.000Z", "end": "2023-02-01T13:00:00.000Z", "reason": "Release ResistanceIsFutile9 "}

• Announce release in Mattermost

  :loud_sound:  Maintenance scheduled for **NAMED_DAY DD. MM from START_TIME - END_TIME**.
  =========================================================================
  
  @all Be aware that you will automatically be logged out and your projects stopped and saved during the maintenance time. Affected:
  *   [https://staging.osparc.io](https://staging.osparc.io/)
  *   [https://https://staging.s4l-lite.io/](https://https://staging.s4l-lite.io//)
  
  and on premises:
  *   [https://osparc-staging.speag.com](https://osparc-staging.speag.com/)
  *   [https://tip-staging.speag.com](https://tip-staging.speag.com/)
  *   [https://s4l-staging.speag.com](https://s4l-staging.speag.com/)
  *   [https://s4l-lite-staging.speag.com](https://s4l-lite-staging.speag.com/)
  
  
  Reason: Scheduled staging-release of STAGING_NAME_AND_VERSION.
  
  Thanks for your understanding and sorry for the inconveniences,
  
  Your friendly oSparc Team
  
  

Releasing

• Release (release draft)
• Check Release CI
• Check hanging sidecars. Helper command to run in director-v2 CLI simcore-service-director-v2 close-and-save-service <uuid>
• Check deployed
  • aws deploy
  • dalco deploy
• Delete announcement
• Check e2e runs
• Announce

https://github.com/ITISFoundation/osparc-simcore/releases/tag/staging_<sprint_name><version>

[YuryHrytsuk]

done a week ago