Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

mask generation for training and inference with MAR #57

Open
YOU-k opened this issue Oct 9, 2024 · 1 comment
Open

mask generation for training and inference with MAR #57

YOU-k opened this issue Oct 9, 2024 · 1 comment

Comments

@YOU-k
Copy link

YOU-k commented Oct 9, 2024

Hi author, thanks for the great work and the general concept about 'masked autoregressive'. When I try to use the model provided, I find that during training, the mask is generated randomly without any auto-regression (the forward function in MAR class), but during inference, the auto-regression is applied.
Am I correct about this or do I understand the code wrongly?

@LTH14
Copy link
Owner

LTH14 commented Oct 9, 2024

Thanks for your interest! Yes, during training, we perform masked image modeling training, which simulates one step in the auto-regression.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants