Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update the load_sample_data scripts to remove ingestion server usage #4153

Closed
Tracked by #3925
stacimc opened this issue Apr 17, 2024 · 0 comments · Fixed by #4962
Closed
Tracked by #3925

Update the load_sample_data scripts to remove ingestion server usage #4153

stacimc opened this issue Apr 17, 2024 · 0 comments · Fixed by #4962
Assignees
@stacimc
Labels
💻 aspect: code Concerns the software code in the repository ✨ goal: improvement Improvement to an existing user-facing feature 🟨 priority: medium Not blocking but should be addressed soon 🧱 stack: catalog Related to the catalog and Airflow DAGs ⛔ status: blocked Blocked & therefore, not ready for work
Milestone
Removal of the da...

Comments

@stacimc
Copy link
Collaborator

stacimc commented Apr 17, 2024

Current Situation

Blocked by #4150

Our load_sample_data.sh scripts currently use just commands to run parts of the data refresh on the local ingestion server, as part of setting up the local development environment.

Suggested Improvement

We should update the scripts to instead use the Airflow CLI to unpause the two new data refresh DAGs and await their completion.

Additional context

See this section of the IP.
@stacimc stacimc added 🟨 priority: medium Not blocking but should be addressed soon ✨ goal: improvement Improvement to an existing user-facing feature 💻 aspect: code Concerns the software code in the repository ⛔ status: blocked Blocked & therefore, not ready for work 🧱 stack: catalog Related to the catalog and Airflow DAGs labels Apr 17, 2024
@openverse-bot openverse-bot moved this to ⛔ Blocked in Openverse Backlog Apr 17, 2024
This was referenced Apr 17, 2024
Open
Open
@stacimc stacimc mentioned this issue Sep 20, 2024
Merged
8 tasks
@openverse-bot openverse-bot moved this from ⛔ Blocked to 🏗 In Progress in Openverse Backlog Sep 20, 2024
@openverse-bot openverse-bot moved this from 🏗 In Progress to ✅ Done in Openverse Backlog Oct 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@stacimc stacimc

Labels
💻 aspect: code Concerns the software code in the repository ✨ goal: improvement Improvement to an existing user-facing feature 🟨 priority: medium Not blocking but should be addressed soon 🧱 stack: catalog Related to the catalog and Airflow DAGs ⛔ status: blocked Blocked & therefore, not ready for work
Projects
Openverse Backlog
Archived in project
Milestone
Removal of the data refresh server
Development

Successfully merging a pull request may close this issue.

Update init scripts to use new data refresh WordPress/openverse
1 participant
@stacimc