Downloading more Images per class than required and that too randomly

[deshwalmahesh]

I tried downloading the data with the following command:

python ./downloader.py \
    -data_root /imagenet \
    -number_of_classes 19000 \
    -images_per_class 2 \
    -multiprocessing_workers 24

It downloaded arbitrary number of images per class. I mean I am unable to see why this is happening. Some of the images in a class were 21 other were 3 and so on and so forth.

[raghada]

Same here, did you mange to solve it?

[ILYSHI]

The same

[NeonWizard]

Also the same. Set to download 100 classes with 10 images each, downloads around 15 images each instead.

[ogkalu2]

@raghada @NeonWizard @ILYSHI @deshwalmahesh

It's the multiprocessing workers. It's fucking with the code. Set it to 1 and it'll download only as many as you specify