Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The training mode does not include 'masked-diffuse-lm' #12

Open
Orange1999 opened this issue Apr 27, 2023 · 5 comments
Open

The training mode does not include 'masked-diffuse-lm' #12

Orange1999 opened this issue Apr 27, 2023 · 5 comments

Comments

@Orange1999
Copy link

Orange1999 commented Apr 27, 2023

Thanks for this creative work.

But I have encountered some problems in use, and I hope to get your help.

When I use the following training command as you provided :

python scripts/run_train.py --diff_steps 500 --model_arch bert --lr 0.0003 --lr_anneal_steps 400000 --seed 0 --noise_schedule sqrt --in_channel 128 --modality roc --submit no --padding_mode pad --app "--predict_xstart True --training_mode masked-diffuse-lm --roc_train ../datasets/ROCstory " --bsz 64

the losses is None

And I found that the parameter training_mode="masked-diffuse-lm" is not allowed in ./improved-diffusion/improved_diffusion/gaussian_diffusion.py.
Snipaste_2023-04-27_11-37-00

This project code seems to be the same as Diffusion-LM, can you check the latest commit?

@Ma-Weijian
Copy link

met the same issue. anyone can tell me how to fix that?

@vikyou
Copy link

vikyou commented Jun 14, 2023

met the same issue. anyone can tell me how to fix that?Thank you very much!

@daniellaye
Copy link

Same question. Could I please ask where the masked-diffuse-lm loss is? Thanks a lot!

@vikyou
Copy link

vikyou commented Aug 26, 2023

Has anyone solved this problem?

@vikyou
Copy link

vikyou commented Sep 14, 2023

Does anyone email the author about the code?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants