Add Functionality to Stop a Running Job on the Harvest Job Page

[Jin-Sun-tts]

User Story

Implement a feature on the Harvest Job Page that allows users to stop a running job. Upon cancelling, the backend should handle job cancellation by updating the job's status in the HarvestDB job table and associated error table, marking the job as 'error'.

Acceptance Criteria

Frontend:

• Add a "Stop Job" button to the Harvest Job Page.
• The button should be disabled for completed or already stopped jobs.
• A confirmation modal should appear when the "Stop Job" button is clicked, asking the user to confirm the cancellation.

Backend:

• On job cancellation, update the job's status in the harvest_job table to "error".
• Update any relevant entries in the job_error table.
• Ensure that any running processes tied to the job are properly terminated.
• Return appropriate success or error responses to the frontend.

Testing:

• Write unit and integration tests to verify that stopping a job updates both the job and error tables.
• Ensure edge cases are tested (e.g., stopping already completed jobs, handling database errors).

[btylerburton]

We rewrite this to account for the gap created by marking jobs complete when they are in mid-run.

My thinking is instead of doing complicated calculations to update current job progress, we:

• mark the job COMPLETE
• whenever a new job runs it will cleanse the DB of any records that do not have a CKAN_ID, which means they didn't sync.
• This should account for any cases where the job doesn't terminate on its own

We should discuss this as a team