Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Memory issue while importing #1564

Open
arentsen opened this issue Dec 13, 2024 · 0 comments
Open

Memory issue while importing #1564

arentsen opened this issue Dec 13, 2024 · 0 comments
Labels

Comments

@arentsen
Copy link

The error log file displays an error document which says:

PHP Fatal Error – [yii\base\ErrorException](https://www.yiiframework.com/doc-2.0/yii-base-errorexception.html)
Allowed memory size of 536870912 bytes exhausted (tried to allocate 418791424 bytes)
1. in /srv/app/xxx/htdocs/vendor/ether/logs/src/Controller.php

When I look in earlier logs, I see the following line repeated many times:
[queue.WARNING] [application] Attempting to load relations for a non-relational field: sectionBgColors {"memory":24209832}

This is a global field and has nothing to do with the import. What is happening here?

Another line is:

[queue.ERROR] [Exception] Node #5 - {"slug":["*Slug* darf nicht leer sein."]} {"trace":["#0 /srv/app/xxx/htdocs/vendor/craftcms/feed-me/src/queue/jobs/FeedImport.php(99): craft\\feedme\\services\\Process->processFeed(4, Array, Array)","#1 /srv/app/xxx/htdocs/vendor/yiisoft/yii2-queue/src/Queue.php(243): craft\\feedme\\queue\\jobs\\FeedImport->execute(Object(craft\\queue\\Queue))","#2 /srv/app/xxx/htdocs/vendor/yiisoft/yii2-queue/src/cli/Queue.php(147): yii\\queue\\Queue->handleMessage(4430208, 'O:34:\"craft\\\\fee...', 1200, 1)","#3 /srv/app/xxx/htdocs/vendor/craftcms/cms/src/queue/Queue.php(191): yii\\queue\\cli\\Queue->handleMessage(4430208, 'O:34:\"craft\\\\fee...', 1200, 1)","#4 /srv/app/xxx/htdocs/vendor/craftcms/cms/src/queue/Queue.php(166): craft\\queue\\Queue->executeJob()","#5 [internal function]: craft\\queue\\Queue->craft\\queue\\{closure}(Object(Closure))","#6 /srv/app/xxx/htdocs/vendor/yiisoft/yii2-queue/src/cli/Queue.php(114): call_user_func(Object(Closure), Object(Closure))","#7 /srv/app/xxx/htdocs/vendor/craftcms/cms/src/queue/Queue.php(164): yii\\queue\\cli\\Queue->runWorker(Object(Closure))","#8 /srv/app/xxx/htdocs/vendor/craftcms/cms/src/controllers/QueueController.php(98): craft\\queue\\Queue->run()","#9 [internal function]: craft\\controllers\\QueueController->actionRun()","#10 /srv/app/xxx/htdocs/vendor/yiisoft/yii2/base/InlineAction.php(57): call_user_func_array(Array, Array)","#11 /srv/app/xxx/htdocs/vendor/yiisoft/yii2/base/Controller.php(178): yii\\base\\InlineAction->runWithParams(Array)","#12 /srv/app/xxx/htdocs/vendor/yiisoft/yii2/base/Module.php(552): yii\\base\\Controller->runAction('run', Array)","#13 /srv/app/xxx/htdocs/vendor/craftcms/cms/src/web/Application.php(341): yii\\base\\Module->runAction('queue/run', Array)","#14 /srv/app/xxx/htdocs/vendor/craftcms/cms/src/web/Application.php(640): craft\\web\\Application->runAction('queue/run', Array)","#15 /srv/app/xxx/htdocs/vendor/craftcms/cms/src/web/Application.php(303): craft\\web\\Application->_processActionRequest(Object(craft\\web\\Request))","#16 /srv/app/xxx/htdocs/vendor/yiisoft/yii2/base/Application.php(384): craft\\web\\Application->handleRequest(Object(craft\\web\\Request))","#17 /srv/app/xxx/htdocs/web/index.php(23): yii\\base\\Application->run()","#18 {main}"],"memory":34530440,"exception":"[object] (Exception(code: 0): Node #5 - {\"slug\":[\"*Slug* darf nicht leer sein.\"]} at /srv/app/xxx/htdocs/vendor/craftcms/feed-me/src/services/Process.php:533)"}

This line also happens quite a lot:

2024-12-13 22:25:30 [queue.ERROR] [craft\errors\ImageTransformException] Transformation mit ID 41 konnte nicht erzeugt werden. {"trace":["#0 /srv/app/xxx/htdocs/vendor/craftcms/cms/src/elements/Asset.php(2011): craft\\imagetransforms\\ImageTransformer->getTransformUrl(Object(craft\\elements\\Asset), Object(craft\\models\\ImageTransform), true)","#1 /srv/app/xxx/htdocs/vendor/craftcms/cms/src/elements/Asset.php(1937): craft\\elements\\Asset->_url(Object(craft\\models\\ImageTransform), true)","#2 /srv/app/xxx/htdocs/vendor/nystudio107/craft-seomatic/src/helpers/ImageTransform.php(151): craft\\elements\\Asset->getUrl(Object(craft\\models\\ImageTransform), true)","#3 /srv/app/xxx/htdocs/vendor/nystudio107/craft-seomatic/src/services/Helper.php(459): nystudio107\\seomatic\\helpers\\ImageTransform::socialTransform(Object(craft\\elements\\Asset), 'base', 1, 'crop')","#4 /srv/app/xxx/htdocs/vendor/twig/twig/src/Extension/CoreExtension.php(1802): nystudio107\\seomatic\\services\\Helper->socialTransform(200151, 'base', 1, 'crop')","#5 /srv/app/xxx/htdocs/vendor/craftcms/cms/src/helpers/Template.php(148): Twig\\Extension\\CoreExtension::getAttribute(Object(craft\\web\\twig\\Environment), Object(Twig\\Source), Object(nystudio107\\seomatic\\services\\Helper), 'socialTransform', Array, 'method', false, false, false, 1)","#6 /srv/app/xxx/htdocs/storage/runtime/compiled_templates/a1/a152cae62c64191c95c363d1a3a3159e.php(43): craft\\helpers\\Template::attribute(Object(craft\\web\\twig\\Environment), Object(Twig\\Source), Object(nystudio107\\seomatic\\services\\Helper), 'socialTransform', Array, 'method', false, false, false, 1)","#7 /srv/app/xxx/htdocs/vendor/twig/twig/src/Template.php(393): __TwigTemplate_d19f755c7db1cabdc21d808b40c28bab->doDisplay(Array, Array)","#8 /srv/app/xxx/htdocs/vendor/twig/twig/src/Template.php(349): Twig\\Template->yield(Array, Array)","#9 /srv/app/xxx/htdocs/vendor/twig/twig/src/Template.php(364): Twig\\Template->display(Array)","#10 /srv/app/xxx/htdocs/vendor/twig/twig/src/TemplateWrapper.php(35): Twig\\Template->render(Array)","#11 /srv/app/xxx/htdocs/vendor/craftcms/cms/src/web/View.php(722): Twig\\TemplateWrapper->render(Array)","#12 /srv/app/xxx/htdocs/vendor/nystudio107/craft-seomatic/src/helpers/MetaValue.php(276): craft\\web\\View->renderObjectTemplate('{{ seomatic.hel...', Array, Array)","#13 /srv/app/xxx/htdocs/vendor/nystudio107/craft-seomatic/src/helpers/MetaValue.php(102): nystudio107\\seomatic\\helpers\\MetaValue::parseMetaString('{{ seomatic.hel...', true, true)","#14 /srv/app/xxx/htdocs/vendor/nystudio107/craft-seomatic/src/helpers/MetaValue.php(149): nystudio107\\seomatic\\helpers\\MetaValue::parseString('{{ seomatic.hel...', true, true, 4)","#15 /srv/app/xxx/htdocs/vendor/nystudio107/craft-seomatic/src/debug/panels/SeomaticPanel.php(92): nystudio107\\seomatic\\helpers\\MetaValue::parseArray(Array, true, true, true)","#16 /srv/app/xxx/htdocs/vendor/yiisoft/yii2-debug/src/LogTarget.php(61): nystudio107\\seomatic\\debug\\panels\\SeomaticPanel->save()","#17 /srv/app/xxx/htdocs/vendor/craftcms/cms/src/debug/LogTarget.php(30): yii\\debug\\LogTarget->export()","#18 /srv/app/xxx/htdocs/vendor/yiisoft/yii2-debug/src/LogTarget.php(183): craft\\debug\\LogTarget->export()","#19 /srv/app/xxx/htdocs/vendor/yiisoft/yii2/log/Dispatcher.php(194): yii\\debug\\LogTarget->collect(Array, true)","#20 /srv/app/xxx/htdocs/vendor/yiisoft/yii2/log/Logger.php(225): yii\\log\\Dispatcher->dispatch(Array, true)","#21 [internal function]: yii\\log\\Logger->flush(true)","#22 {main}"],"memory":87735288,"exception":"[object] (craft\\errors\\ImageTransformException(code: 0): Transformation mit ID 41 konnte nicht erzeugt werden. at /srv/app/xxx/htdocs/vendor/craftcms/cms/src/imagetransforms/ImageTransformer.php:153)\n[previous exception] [object] (craft\\errors\\ImageException(code: 450): SVG-Zeichenkette konnte nicht geladen werden. at /srv/app/xxx/htdocs/vendor/craftcms/cms/src/image/Raster.php:607)\n[previous exception] [object] (Imagine\\Exception\\RuntimeException(code: 450): Could not load image from string at /srv/app/xxx/htdocs/vendor/pixelandtonic/imagine/src/Imagick/Imagine.php:144)\n[previous exception] [object] (ImagickException(code: 450): XML declaration allowed only at the start of the document\n `No such file or directory` @ error/svg.c/SVGError/3374 at /srv/app/xxx/htdocs/vendor/pixelandtonic/imagine/src/Imagick/Imagine.php:139)"} ```


Can it be that all these together create the memory issue? It is happening since a few weeks now. The import json file is 8kb in size.
@arentsen arentsen added the bug label Dec 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant