New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Speed up data writing #29

Closed

noemifrisina opened this issue Nov 29, 2021 · 1 comment · Fixed by #36

Collaborator

noemifrisina commented Nov 29, 2021

Both for blank image and events datasets the writing is still pretty slow.

noemifrisina linked a pull request

that will close this issue

General tidy up of data writing #36

Merged

7 tasks

Collaborator Author

noemifrisina commented Feb 18, 2022 •

edited

Loading

Blank image writing speed much improved.
eg. (Just for data, without nexus file)

Eiger 9M, 3600 images in 4 files:
CPU times: user 337 ms, sys: 410 ms, total: 747 ms
Wall time: 504 ms
Tristan 10M, 500 images in 1 file:
CPU times: user 78.8 ms, sys: 71.3 ms, total: 150 ms
Wall time: 88.2 ms

In the previous version, the speed was in the order of minutes.

Event writing still to do.

noemifrisina closed this as completed in #36

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment