Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feed Source Summary #529

Merged
merged 15 commits into from
Aug 24, 2023
Merged

Conversation

br648
Copy link
Contributor

@br648 br648 commented Apr 18, 2023

Checklist

  • Appropriate branch selected (all PRs must first be merged to dev before they can be merged to master)
  • Any modified or new methods or classes have helpful JavaDoc and code is thoroughly commented
  • The description lists all applicable issues this PR seeks to resolve
  • The description lists any configuration setting(s) that differ from the default settings
  • All tests and CI builds passing

Description

Update to provide a new end point which will return all feed source summaries as required by the UI.

Companion PR: ibi-group/datatools-ui#981

See: https://ibisolutions.atlassian.net/browse/DT-315?focusedCommentId=251321

@binh-dam-ibigroup
Copy link
Contributor

@br648 I think the main bottleneck is that the same query is still repeated for each project, and as a result, the number of times we hit Mongo doesn't change overall. Could you see what happens if getFeedVersionFromPinnedDeployment and getFeedVersionFromLatestDeployment grabbed all projects at once?

@br648 br648 changed the title Check for pinned deployment in MongoDB Feed Source Summary May 3, 2023
@philip-cline
Copy link
Contributor

Couple properties we need in the FeedSourceSummary for the front end:

  • labelIds
  • latestValidation to show this portion of the FeedSource table:
image For this section, we need to query the latest feedVersion - is that something that should be wrapped up in the project query for efficiency?

@philip-cline philip-cline assigned br648 and unassigned philip-cline Jun 16, 2023
@br648
Copy link
Contributor Author

br648 commented Jun 20, 2023

@philip-cline I've made an update to include feed source label ids.

The latest feed version should already be available as part of the information returned by feedsourceSummaries. To keep the payload to a minimum, only the required values from the latest feed version are returned. See FeedSourceControllerTest.canRetrieveDeployedFeedVersionFromLatestDeployment() and FeedSourceControllerTest.canRetrieveDeployedFeedVersionFromPinnedDeployment(). Let me know if additional values are required.

@br648 br648 assigned philip-cline and unassigned br648 Jun 20, 2023
@philip-cline
Copy link
Contributor

@br648 Would it be easy to include projectId in the summary data? Any feedsource update after getting the feedsource summaries requires the project ID to make an update to the feedsource. I could update all the front end methods to include this, but it seems easier to just include it in the data in the first place

@philip-cline philip-cline assigned br648 and unassigned philip-cline Aug 10, 2023
@br648
Copy link
Contributor Author

br648 commented Aug 14, 2023

@br648 Would it be easy to include projectId in the summary data? Any feedsource update after getting the feedsource summaries requires the project ID to make an update to the feedsource. I could update all the front end methods to include this, but it seems easier to just include it in the data in the first place

@philip-cline I have added the project id to the feed source summary.

@br648 br648 assigned philip-cline and unassigned br648 Aug 14, 2023
@philip-cline
Copy link
Contributor

It seems like it will be easier on the front end to integrate these changes if we maintain some of the same structure as previous. Could we use the following structure:

{
  "projectId": "...",
  "id": "...",
  "name": "...",
  "deployable": true,
  "isPublic": false,
  "lastUpdated": "...",
  "labelIds": [],
  "deployedFeedVersionId": "...",
  "deployedFeedVersionStartDate": "...",
  "deployedFeedVersionEndDate": "...",
  "deployedFeedVersionIssues": X,
  latestValidation: {
  		"feedVersionId": "...",
  		"feedVersionStartDate": "...",
  		"feedVersionStartDate": "...",
  		"feedVersionIssues": "..."
  		
  }
}

@br648
Copy link
Contributor Author

br648 commented Aug 18, 2023

@philip-cline Structure updated as requested.

@philip-cline
Copy link
Contributor

Thanks for the update @br648! I just made another small commit changing the field names so that they require less work on the front end

Copy link
Contributor

@philip-cline philip-cline left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is looking good to me! I have been able to create a front end PR to test it out and works well!

@philip-cline philip-cline assigned br648 and unassigned philip-cline Aug 18, 2023
@br648 br648 assigned binh-dam-ibigroup and unassigned br648 Aug 21, 2023
Copy link
Contributor

@binh-dam-ibigroup binh-dam-ibigroup left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Inclined to approve, as the loading is much faster with the UI PR, but I would make sure labelIds is non-null.

@br648 br648 merged commit e604173 into dev Aug 24, 2023
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants