Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

一些问题 #79

Open
zhou431496 opened this issue Apr 22, 2024 · 5 comments
Open

一些问题 #79

zhou431496 opened this issue Apr 22, 2024 · 5 comments
Labels
about score About the score of ImageReward

Comments

@zhou431496
Copy link

您好,非常好的工作,我是做文生3D的。如果我将其用于3D生成,有一些疑惑。1 产生的reward可以理解为损失的梯度嘛用来优化3D的表示例如NERF, DMTet这些。2 我只提供一个prompt和image是否可行 3 imagereward可以对法线图,深度图这些产生一个reward嘛
这是我的三个疑惑,期待您的回复

@xujz18
Copy link
Member

xujz18 commented Apr 26, 2024

你好,多谢关注!

  1. 可以的,有一些3D的Reward使用了ImageReward,例如https://github.com/THU-LYJ-Lab/T3Benchhttps://github.com/liuff19/DreamReward
  2. 只提供一个prompt和image完全可行,就是这么用的
  3. 这些图片类型没有验证过,应该需要专门微调一下

Hi, thanks for your attention! 1. it's possible, there are some 3D Rewards that use ImageReward, for example https://github.com/THU-LYJ-Lab/T3Bench https://github.com/liuff19/DreamReward 2. it's perfectly possible to provide only a prompt and an image, that's how it works! 3. these image types are not verified, they should need some special fine-tuning

@xujz18 xujz18 added the about score About the score of ImageReward label Apr 26, 2024
@zhou431496
Copy link
Author

你好,多谢关注!

  1. 可以的,有一些3D的Reward使用了ImageReward,例如https://github.com/THU-LYJ-Lab/T3Benchhttps://github.com/liuff19/DreamReward
  2. 只提供一个prompt和image完全可行,就是这么用的
  3. 这些图片类型没有验证过,应该需要专门微调一下

Hi, thanks for your attention! 1. it's possible, there are some 3D Rewards that use ImageReward, for example https://github.com/THU-LYJ-Lab/T3Bench https://github.com/liuff19/DreamReward 2. it's perfectly possible to provide only a prompt and an image, that's how it works! 3. these image types are not verified, they should need some special fine-tuning

十分感谢你的回复,这对我们十分重要。
当我们要训练ImageReward时,bash scripts/train_one_node.sh 没有被发现,请问是否可以提供

@xujz18
Copy link
Member

xujz18 commented Apr 26, 2024

@zhou431496
Copy link
Author

@zhou431496
Copy link
Author

您好,如果我在prompt中引入带有视角的描述,reward是否可以准确的评判。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
about score About the score of ImageReward
Projects
None yet
Development

No branches or pull requests

2 participants