New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

demo.py: running on cuda:0 and cuda:1 gives different results #134

Open

ghost opened this issue Aug 24, 2022 · 2 comments · May be fixed by #175

ghost commented Aug 24, 2022

If I add
DEVICE: 'cuda:1'
https://github.com/facebookresearch/Mask2Former/blob/main/configs/coco/panoptic-segmentation/maskformer2_R50_bs16_50ep.yaml#L3

I get very different (worse) results than cuda:0 or simply comment it.
What's the possible place that caused this issue?

The text was updated successfully, but these errors were encountered:

Author

ghost commented Aug 24, 2022

This is the function block that creates different results:

https://github.com/facebookresearch/Mask2Former/blob/main/mask2former/modeling/pixel_decoder/msdeformattn.py#L324

Author

ghost commented Aug 24, 2022

https://github.com/facebookresearch/Mask2Former/blob/main/mask2former/modeling/pixel_decoder/ops/modules/ms_deform_attn.py#L117

always returns to all 0 values to output if set cuda to none-zero ids (e.g. cuda:1)

ncianeo linked a pull request

that will close this issue

add optional cuda guard for different device usage #175

Open

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment