Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reverted #124 and Added Logging #146

Merged
merged 1 commit into from
Oct 21, 2024
Merged

Conversation

TeachMeTW
Copy link
Contributor

@TeachMeTW TeachMeTW commented Oct 21, 2024

Revert Batching Changes and Implement Baseline Logging

Description

Changes Implemented

  • Reverted to Baseline

    • Rolled back previous batching changes to establish a stable performance baseline.
  • Implemented Baseline Logging

    • Logging to add_user_stats and render_content

Testing Performed

  • Reversion Verification
    • Confirmed that all batching changes have been successfully reverted.
    • Ensured no new issues or regressions were introduced by the reversion* (TBD).

Related Issues

Notes

  • This PR establishes the baseline necessary for assessing the impact of future batching and performance improvements.

@TeachMeTW
Copy link
Contributor Author

@shankari @JGreenlee please review

Copy link
Contributor

@shankari shankari left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since this change is going to be reverted anyway, I don't care as much about its code quality, just as long as it works.

@TeachMeTW can you please indicate how you tested this? I am deploying it to staging regardless.

Comment on lines +192 to +205
def render_content(
tab,
store_uuids,
store_excluded_uuids,
store_trips,
store_demographics,
store_trajectories,
start_date,
end_date,
timezone,
key_list,
loaded_uuids_store,
all_data_loaded
):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There are some extraneous whitespace changes here, but I am not going to complain about them since we will revert this commit.

)

elif tab == 'tab-trips-datatable':
# **Handle Trips Tab with Batch Loading (New Implementation)**
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Presumably this comment is no longer accurate

return None, loaded_uuids_store, True

elif tab == 'tab-trajectories-datatable':
# **Handle Trajectories Tab with Batch Loading (New Implementation)**
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ditto

@shankari shankari merged commit 5bb7b8e into e-mission:master Oct 21, 2024
@TeachMeTW
Copy link
Contributor Author

Since this change is going to be reverted anyway, I don't care as much about its code quality, just as long as it works.

@TeachMeTW can you please indicate how you tested this? I am deploying it to staging regardless.

It was a simple test, just loaded up a dataset and watched the UUIDs tab load like previously. I tested with open access and load times came to be about 280 seconds.

@shankari
Copy link
Contributor

As I indicated on Teams, after deploying on to staging, the Trips tab is broken. It doesn't display anything.
Did you test all the tabs?

Screenshot 2024-10-21 at 9 58 14 AM

@TeachMeTW TeachMeTW mentioned this pull request Oct 21, 2024
@TeachMeTW
Copy link
Contributor Author

TeachMeTW commented Oct 21, 2024

@shankari I missed that; Trips and every tab should work now. See #147

@shankari
Copy link
Contributor

I hope this is a learning experience on the importance of testing everything while making changes.
OpenPATH is complex, and even the admin dashboard is complex.
Changes can cause regressions, and it is important to verify that all existing functionality works.

After we have verified this on staging, we need to revisit the proposed timeline in #145

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Tasks completed
Development

Successfully merging this pull request may close these issues.

2 participants