-
Notifications
You must be signed in to change notification settings - Fork 57
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Error: Source file could not be loaded #440
Comments
Looks like this also occurs on
|
Looking at the verbose output of either command shows a more interesting tail:
So, while attempting to process .msg files, which are plain text emails, the preview generator takes about 2-5 minutes before returning an error that the source file could not be loaded. At 2-5 minutes a file, when there thousands of them, the scan will essentially never finish running. |
It would appear that, if left to it's own designs, this bug will cause enough preview generation processes to pile up that it will eventually crash the server.
All of these separate running cron jobs cause PHP to time out meaning that the server cannot field requests to users. |
It turns out that part of the errors here are that I had an outdated cron job running |
The problem might be that the failed previews are tried to be generated again and again. I have no experience with the preview provider for msg files and can't promise anything. You could disable it for now if you are not depending on it. I imagine having previews for email files is not critical. |
Indeed, part of the issue is that previews are attempted again and again and turning off previews for . Msg files would solve that. How does one disable specific previews? |
Previews are managed through a combination of We don't do any What apps do you have installed ( Anything like the following? https://github.com/nextcloud/files_emailviewer (Though I don't see a preview provider in it). |
Hi
|
@mellow2012 , how are you executing the script? What command is in your cronjob? |
i am executing it from the comandline on the ubuntu server like occ preview:generate-all —path=the path but i found today in the dtabase in oc_mimetypes the |
Do you get the same hang using "preview:pre-generate" multiple times? preview:pre-generate will not allow multiple runs to happen at the same time and I suspect that they now mark failed files so that they aren't re-attempted, but I can't remember. can you run pre-generate twice, in stead of generate-all and report back your finding? Generate all will force the regeneration of files that already have a preview generated. Using pre-generate doesn't regenerate previews if one already exists. So, you might get the error/timeout the first time around, but you shouldn't get it the next time around because the file should already be marked as attempted. The first run took me longer than a week to finish because I had so many files, but the second run took a minute. This means you still won't have a preview for the msg files, but at least everything else will be generated. |
at the moment i need it for all |
preview:pre-generate will generate it for all, it just won't regenerate or re-attempt on previous failure. |
yes i know |
We have the same issue I guess, but in addition to the preview-generation, the normal cronjob throws those Using the
Any news about getting rid of those errors? Also, as mentioned above, the error is also thrown, when the "normal" cronjob (sudo -u apache php /var/www/html/nextcloud/cron.php) runs; anyway, not always and also with different amounts of appearance of the error - so I am not exactly sure, if those error errors have the same source (those *msg-files)? |
I'm wondering if this is related to nextcloud/server#41803, nextcloud/server#41867, and nextcloud/server#41868. These were added for |
While running
nohup /root/occ preview:generate-all &
The text was updated successfully, but these errors were encountered: