Metadata 4.5 - Database/ElasticSearch/Lupo - migration phase

[svogt0511]

RESOURCES

• Metadata Schema Release 4.5 Product Spec
• Metadata 4.5 - Technical Spec
• UPDATED LUPO 4.5 PLAN

This development task includes making DB/ElasticSearch/Lupo mods to allow initial processing of the new publisher_v4 field while maintaining the old field, migrating all DOIs to the new field, then cleaning up code and unused resources.

MIGRATION TASKS:

• Add rails DB migrate script for new column for publisher obj, using the departure gem. (Issue Metadata 4.5 - Add field to dataset DB for new publisher_obj #1037)
• Background scripts to populate publisher_obj field for old DOIS. (Issue Schema 4.5 - background script for publisher field migration #1035)
• Elastic Search mapping - for the publisher_obj field. (Issue Elastic Search mapping - for the publisher_obj field #1020)
• Lupo create/update/get endpoints including (Issues: Metadata 4.5 - Create DOI in lupo #1009, Metadata 4.5 - Update DOI in lupo #1010, Metadata 4.5 - Get DOI in lupo #1011)
  • Lupo logic to write to both fields on create/update.
  • Lupo logic to handle publisher=true/false and get the correct data on get request - to maintain backward compatibility.
  • Lupo logic to handle serializer.
• Lupo activities endpoints - handle new publisher field, maintain backward compatibility. (Issue Schema 4.5 - Activities endpoints in Lupo #1038)
• openapi.yml updates (Cody - Schema 4.5 - OpenAPI yaml updates #1048) - waiting on review.
• Database migration - run the migration scripts for adding and populating the new column - staging/test/production. (Issue Schema 4.5 - Run Rails migration scripts #1039) Will finish this after the first Lupo schema 4.5 release (v5.6)
• ElasticSearch migration - add new template for the new field, run the ES re-index in staging/test/production (Schema 4.5 - Run elastic search re-index #1040)

TESTING

• Appropriate tests for each endpoint - create/read/update/get/activities
• Test that the new values are treated appropriately (graphql testing Metadata 4.5 - GraphQL/Lupo testing #1013)