Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Alerts for Fetch METS failures and method to retry. #21

Open
peterVG opened this issue Jun 30, 2020 · 1 comment
Open

Alerts for Fetch METS failures and method to retry. #21

peterVG opened this issue Jun 30, 2020 · 1 comment
Labels
enhancement New feature or request

Comments

@peterVG
Copy link
Member

peterVG commented Jun 30, 2020

AIPScan is intended to be able to scan large volumes of AIPs. We need to expect that some AIPs will not be retrieved or parsed correctly. We need to define requirements for catching & managing these types of errors (could include manual error handling workflows)

@mcantelon
Copy link
Member

mcantelon commented Nov 11, 2023

We could do this to add error reporting:

  • Add "FetchJobError" ORM object/"fetch_job_error" table, to record each fetch job error, with fetch job ID, error type, error details, and error date/time
  • Add "Errors" column to storage service page's fetch job list in which the number of errors is shown
  • If there were any errors make the number of errors link to a web page showing the details of each error

Subsequent to that we could see whether adding recovery handling is worth it.

@mcantelon mcantelon added the enhancement New feature or request label Nov 18, 2023
mcantelon added a commit that referenced this issue Jan 4, 2024
mcantelon added a commit that referenced this issue Jan 4, 2024
mcantelon added a commit that referenced this issue Jan 10, 2024
mcantelon added a commit that referenced this issue Mar 21, 2024
mcantelon added a commit that referenced this issue Mar 21, 2024
mcantelon added a commit that referenced this issue Mar 21, 2024
mcantelon added a commit that referenced this issue Mar 21, 2024
mcantelon added a commit that referenced this issue Mar 22, 2024
mcantelon added a commit that referenced this issue Mar 23, 2024
mcantelon added a commit that referenced this issue Mar 23, 2024
Added fetch error model, a helper function to add error information to
it, and reporting of errors to the storage service page.
mcantelon added a commit that referenced this issue Mar 24, 2024
Added fetch error model, a helper function to add error information to
it, and reporting of errors to the storage service page.
mcantelon added a commit that referenced this issue Mar 24, 2024
Added fetch error model, a helper function to add error information to
it, and reporting of errors to the storage service page.
mcantelon added a commit that referenced this issue Mar 24, 2024
Added fetch error model, a helper function to add error information to
it, and reporting of errors to the storage service page.
mcantelon added a commit that referenced this issue Mar 24, 2024
Added fetch error model, a helper function to add error information to
it, and reporting of errors to the storage service page.
mcantelon added a commit that referenced this issue Mar 24, 2024
Added fetch error model, a helper function to add error information to
it, and reporting of errors to the storage service page.
mcantelon added a commit that referenced this issue Mar 25, 2024
Added fetch error model, a helper function to add error information to
it, and reporting of errors to the storage service page.
mcantelon added a commit that referenced this issue Mar 25, 2024
Added fetch error model, a helper function to add error information to
it, and reporting of errors to the storage service page.
mcantelon added a commit that referenced this issue Mar 25, 2024
Added fetch error model, a helper function to add error information to
it, and reporting of errors to the storage service page.
mcantelon added a commit that referenced this issue Mar 25, 2024
Added fetch error model, a helper function to add error information to
it, and reporting of errors to the storage service page.
mcantelon added a commit that referenced this issue Mar 25, 2024
Added fetch error model, a helper function to add error information to
it, and reporting of errors to the storage service page.
mcantelon added a commit that referenced this issue Mar 25, 2024
Added fetch error model, a helper function to add error information to
it, and reporting of errors to the storage service page.
mcantelon added a commit that referenced this issue Mar 26, 2024
Added fetch error model, a helper function to add error information to
it, and reporting of errors to the storage service page.
mcantelon added a commit that referenced this issue Mar 26, 2024
Added fetch error model, a helper function to add error information to
it, and reporting of errors to the storage service page.
mcantelon added a commit that referenced this issue Mar 26, 2024
Added fetch error model, a helper function to add error information to
it, and reporting of errors to the storage service page.
mcantelon added a commit that referenced this issue Mar 26, 2024
Added fetch error model, a helper function to add error information to
it, and reporting of errors to the storage service page.
mcantelon added a commit that referenced this issue Mar 26, 2024
Added fetch error model, a helper function to add error information to
it, and reporting of errors to the storage service page.
mcantelon added a commit that referenced this issue Mar 26, 2024
Added fetch error model, a helper function to add error information to
it, and reporting of errors to the storage service page.
mcantelon added a commit that referenced this issue May 1, 2024
Added fetch error model, a helper function to add error information to
it, and reporting of errors to the storage service page.
mcantelon added a commit that referenced this issue May 1, 2024
Added fetch error model, a helper function to add error information to
it, and reporting of errors to the storage service page.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants