You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I had a code which ran a delayed function as a task. I would run this task with different inputs various times. For this reason i included gc.collects inside the function. When running, i could see in the dask dashboard that every task was taking progressively longer for no apparent reason. When i returned to the old version 23.8, everything worked normally. Even without the cg.collects inside the code, the running tasks showed some tasks (probably i assume when gc.collect ran by itself automatically) tasks would take a lot longer. Even thkugh most were taking the expected time, every 20 tasks there was one much longer, and also progressively longer
The text was updated successfully, but these errors were encountered:
Could you please share more details on the problem and your environment? Ideally a minimal reproducer, combined with the output of nvidia-smi and conda list (if using conda) or pip list (if using pip)?
Working on colab with a GPU A100. The problem i have already described above, unfortunately i cant show any code because its a proprietary algorithm. Its been solved by downgrading back to old version.
Unfortunately that description is insufficient to provide any help. We don't need any proprietary pieces of your code, but if you would like us to be able to look at your problem we're going to need more than that, a minimal reproducer without any of your proprietary pieces would suffice.
I had a code which ran a delayed function as a task. I would run this task with different inputs various times. For this reason i included gc.collects inside the function. When running, i could see in the dask dashboard that every task was taking progressively longer for no apparent reason. When i returned to the old version 23.8, everything worked normally. Even without the cg.collects inside the code, the running tasks showed some tasks (probably i assume when gc.collect ran by itself automatically) tasks would take a lot longer. Even thkugh most were taking the expected time, every 20 tasks there was one much longer, and also progressively longer
The text was updated successfully, but these errors were encountered: