training issue

[wangweifan77777]

/home//anaconda3/envs/densefusion/lib/python3.6/site-packages/MinkowskiEngine-0.5.4-py3.6-linux-x86_64.egg/MinkowskiEngine/init.py:42: UserWarning: The environment variable OMP_NUM_THREADS not set. MinkowskiEngine will automatically set OMP_NUM_THREADS=16. If you want to set OMP_NUM_THREADS manually, please export it on the command line before running a python script. e.g. export OMP_NUM_THREADS=12; python your_program.py. It is recommended to set it below 24.
"It is recommended to set it below 24.",
Loading grasping labels...: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 88/88 [00:08<00:00, 10.36it/s]
Loading data path and collision labels...: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 100/100 [00:15<00:00, 6.43it/s]
train dataset length: 25600
train dataloader length: 6400
**** EPOCH 000 ****
Current learning rate: 0.001000
2024-05-15 20:33:17.772664
Killed

[rhett-chen]

Sorry, your question is not clear. It seems fine from the beginning, but I don't know why it was killed.

[bujiebuhuo]

/home//anaconda3/envs/densefusion/lib/python3.6/site-packages/MinkowskiEngine-0.5.4-py3.6-linux-x86_64.egg/MinkowskiEngine/init.py:42: UserWarning: The environment variable OMP_NUM_THREADS not set. MinkowskiEngine will automatically set OMP_NUM_THREADS=16. If you want to set OMP_NUM_THREADS manually, please export it on the command line before running a python script. e.g. export OMP_NUM_THREADS=12; python your_program.py. It is recommended to set it below 24. "It is recommended to set it below 24.", Loading grasping labels...: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 88/88 [00:08<00:00, 10.36it/s] Loading data path and collision labels...: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 100/100 [00:15<00:00, 6.43it/s] train dataset length: 25600 train dataloader length: 6400 **** EPOCH 000 **** Current learning rate: 0.001000 2024-05-15 20:33:17.772664 Killed

I encountered a similar situation. I am running out of memory on my computer (Ubuntu 20.04). I have added swap memory. Then we can start training.