DASB-600 - Report sink fixes and updates #158
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
added 11 commits
August 7, 2024 11:56
|
mkrystof
added a commit
that referenced
this pull request
Aug 20, 2024
* add the sh command * add the sh command * add the sh command * gradle jib step added * gradle jib step added * ci build workflow files modified for graphql * updated version * Fixed name of dex_ingest_datetime (#144) Co-authored-by: Matt B Krystof <[email protected]> * Added submission projection for reports * Added logic for submission projections * Added submission projection for reports * Added fileName to Provenance * Added fileName to Provenance * BOTFREY token changed * Added SECURITY_ENABLED env var * BOTFREY token changed * Added function and property headers * Added enum for StageInfo.Status and made TagsMap<String,String> * Removed unused Tags class * Removed unused Tags class Modified Tags property to be Map<String,String> Changed StageInfo.status to Enum * Made changes based on PR review * Made changes based on PR review * Made changes based on Readme and the PR reviews * Modified stage to action and updated the unit tests * Made changes based on PR review * Changed kotlin version to 1.9.24 (#151) Co-authored-by: Matt B Krystof <[email protected]> * Added dockerhub auth to gradle for jib * Updated kotlin version in gradle properties and added dockerhub auth to jib * DexIngestTimestamp to DexIngestDateTime * Repalced dex_ingest_timestamp with dex_ingest_datetime * new ci files * new ci files * github workflow files updating for 3 microservices * github workflow files updating for 3 microservices * github workflow files updating for 3 microservices * github workflow files updating for 3 microservices * Feature sort filter (#148) * Filter and Sort * Filter and Sort * Set CosmosQueryRequestOptions * Consolidate queries * Use batch processing for query performance * Use batch processing for query performance * Use batch processing for query performance * Update Query * Update Query * Update Query * Update Query * Sync with develop * Remove submissionDate from the query. * Renamed uploadDetails with getReports * Added query to get raw reports (#156) Co-authored-by: Matt B Krystof <[email protected]> * Removed thanks.md file (#157) Co-authored-by: Matt B Krystof <[email protected]> * DASB-600 - Report sink fixes and updates (#158) * Updated logging, reformatting * First round of schema validation fixes * Corrected upload-status schema * Report schema validation updates * Updated load testing Python script to latest version of report schemas * Moving test files out of function app subfolder * Fixed unit test broken by recent change * Added missing dex_ingest_datetime field from reports * Added dex ingest date/time to graphql service * Fixed issues with Python test script for sending hl7 validation msg * Fixed timestamps used in Python test script --------- Co-authored-by: Matt B Krystof <[email protected]> * Added new upload report schemas (#159) Co-authored-by: Matt B Krystof <[email protected]> * Fixed issue with the stage info start and end processing time format (#160) Co-authored-by: Matt B Krystof <[email protected]> * DASB-625 - Fixed issue with disposition type replace no longer working (#162) * Updated Python load testing script to use disposition type * Fixed issue with disposition type not searching report records correctly --------- Co-authored-by: Matt B Krystof <[email protected]> * Made stage info fields required and updated load testing script (#164) Co-authored-by: Matt B Krystof <[email protected]> * Dev feature upload status query updates (#163) * Update Page Summary with the list of senderIds and jurisdictions * Update the queries to use dexIngestDateTime. Add the list of senderIds, Jurisdiction to the getUploadStatus api response. * Update description * Allow the content-types, "application/json" and "json" Add new sort fields, "service" and action Update detailed descriptions for Page Summary * Reverted the changes to the default SchemaDefinition values in the files Metadata files. Updated the default SchemaDefinition values for UploadStage * Updated descriptions for UploadStatus * Improved descriptions Removed duplicate lines * DASB-650 - Safe parse messages as reports, code cleanup (#165) * Safe parse messages as reports, code cleanup * Code cleanup * Fixed load testing script fields for message metadata, tags and data * Fixed the node names for safe message parsing of stage info, tags and data * Fixed python load test script to use integer for message index rather than string * Fixed stage info and message metadata serialization issues --------- Co-authored-by: Matt B Krystof <[email protected]> * Added missing report fields to queries (#166) Co-authored-by: Matt B Krystof <[email protected]> * Addresses the depreciation warning for datetime.utcnow() (#161) * Addresses the depreciation warning for datetime.utcnow() * updated output for dex_ingest_datetime --------- Co-authored-by: Subbu Vemula <[email protected]> Co-authored-by: Manu Kesava <[email protected]> Co-authored-by: Matt B Krystof <[email protected]> Co-authored-by: uek3-cdc <[email protected]> Co-authored-by: Manu Govind Kesava Pillai <[email protected]> Co-authored-by: Madhavi Tammineni <[email protected]> Co-authored-by: Tea Smith <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.