Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Histograms precache #509

Merged
merged 9 commits into from
Sep 11, 2023
Merged

Histograms precache #509

merged 9 commits into from
Sep 11, 2023

Conversation

bruyeret
Copy link
Contributor

@bruyeret bruyeret commented Sep 4, 2023

To be merged after the overview PR #507
Close #502

@bruyeret bruyeret requested a review from luciemac September 4, 2023 12:25
@arjunrajlab
Copy link
Collaborator

This is great, definitely shows very nice performance once loaded!

I am getting a lot of CPU usage and girder seems slow even after progress bar says "Optimized and fully loaded". I'm assuming the histogram caching is running then. Is it possible to show a progress bar for that as well? Whatever it is, there is some process running on Girder that seems to take up CPU for a LONG time after and makes Girder a bit sluggish.

Also, the overview panel seems to load from the full image, so only shows once that is loaded. I've noticed now that the tile_cache can load much faster, but doesn't show up in the overview panel. One could consider using the tile_cache for the overview panel, but I don't think it's super important, just a note.

This is on my laptop because I'm at home today (holiday, technically), but I'll also test this on my server at work tomorrow morning.

Enable listening to the same job several times in the job store
@bruyeret bruyeret requested a review from arjunrajlab September 6, 2023 09:32
Copy link
Collaborator

@arjunrajlab arjunrajlab left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@bruyeret Generally looks good, but I have a question. Right now, the progress bar shows from the very beginning. Is it actually running at the same time as the tile caching? Or is it scheduled to wait until after the tile_cache to begin computation? If it is scheduled to compute after the tile_cache, is it hard to make the progress bar only start once is actually starts computing? If it is a pain to do, then this is fine as it is!

@bruyeret
Copy link
Contributor Author

bruyeret commented Sep 6, 2023

Histogram caching runs after tile caching but it the progress bar is displayed even if the job is inactive
I think it should be a quick fix

@bruyeret
Copy link
Contributor Author

bruyeret commented Sep 6, 2023

It's done! But there is a small time between tile caching and histogram caching when the frontend thinks that everything is cached because histogram caching has not started yet

@arjunrajlab
Copy link
Collaborator

Looks great to me, thank you!

@luciemac
Copy link
Contributor

LGTM

@luciemac luciemac merged commit 573ac70 into master Sep 11, 2023
@luciemac luciemac deleted the histograms-precache branch September 11, 2023 11:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Precache histograms for improved responsiveness of UI
3 participants