Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can't seem to load this file #714

Open
arjunrajlab opened this issue Jun 17, 2024 · 6 comments
Open

Can't seem to load this file #714

arjunrajlab opened this issue Jun 17, 2024 · 6 comments
Assignees
Labels
bug Something isn't working
Milestone

Comments

@arjunrajlab
Copy link
Collaborator

Here's a large TIFF we made that doesn't seem to load properly. We tried both with and without transcoding, no dice.

https://www.dropbox.com/scl/fo/795aptgac63h8l8rkpazj/ACQ-0oEb8rDUunMjK3Q6f14?rlkey=xfi3oj5tb7repcaf6p7k4633w&dl=0

@arjunrajlab arjunrajlab added the bug Something isn't working label Jun 17, 2024
@arjunrajlab arjunrajlab added this to the Alpha-Version milestone Jun 17, 2024
@manthey
Copy link
Member

manthey commented Jun 17, 2024

If I manually run large_image_converter on this file, it works. The conversion took ~12 minutes on my faster machine. When uploading it, the conversion is VERY slow. I'll look into why.

@manthey
Copy link
Member

manthey commented Jun 17, 2024

The file is uncompressed and untiled, which makes for inefficient handling.

@arjunrajlab
Copy link
Collaborator Author

Is there a reason it should run slower after upload? It should be running the same command behind the scenes, no?

@manthey
Copy link
Member

manthey commented Jun 18, 2024

It probably is because other actions are occurring at the time of upload even before conversion. I think, for instance, that we may kick off some of the caching as soon as the files arrive but before they are composited or transcoded; when we composite or transcode them, some of this action is wasted (but it would have sped things up in instances of single files that aren't transcoded).

@arjunrajlab
Copy link
Collaborator Author

Hmm, possibly… although the person who uploaded it in the lab left it running for over 24 hours, and still nothing. I checked the jobs, and Girder didn't seem to be running anything else concurrently (there was some other job that fired up around the same time, but that then seemed to finish relatively quickly). I'll have them try again. Meanwhile, could you send me the command to optimize the file offline using large_image?

@manthey
Copy link
Member

manthey commented Jun 18, 2024

The conversion is just large_image_converter <source file> <destination.tiff>

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Status: Backlog
Development

No branches or pull requests

2 participants