Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about experimental result #15

Open
HanQingLi1228 opened this issue Apr 21, 2023 · 1 comment
Open

Question about experimental result #15

HanQingLi1228 opened this issue Apr 21, 2023 · 1 comment

Comments

@HanQingLi1228
Copy link

Hi, thanks for the cool paper.

I try to reproduce your result through finetuning ldm of StageB by myself. I directly use your code and fmri_encoder checkpoint without any modifications.
When I compare the performance between the model you provide (finetune.pth) and the model finetuned by myself, there is a gap in both the generated image results and the numerical metrics. For example, the "summary/top-1-class(max)" of your checkpoint is 0.226 while my checkpoint is only 0.1916.
I wonder if you could kindly provide any insights on what may have caused this discrepancy.

Thanks for your time!

@bottle0228
Copy link

Hello, may I ask where you saw the "summary/top 1 class (max)" of your checkpoint is 0.226? Also, have you resolved your problem?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants