New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

关于reconstructor和interactor的输入 #7

Open

tengguolong opened this issue Aug 3, 2024 · 0 comments

tengguolong commented Aug 3, 2024 •

edited

Loading

拜读了大佬的paper，很不错的想法！我有两个疑问想请教一下：
1、我理解query reconstructor的输入应该是passage的embedding sequence？但是看代码似乎是只用了passage第一个token的embedding作为表征：https://github.com/Deriq-Qian-Dong/III-Retriever/blob/main/src/modeling.py#L200
2、另外，interactor的输入应该是passage序列+重建的query序列？代码写的仍然是passage表征（即第一个token）+query embedding取平均，这样是否就不是token级别的交互了呢？
https://github.com/Deriq-Qian-Dong/III-Retriever/blob/main/src/modeling.py#L204

tengguolong changed the title 关于关于reconstructor和interactor的输入

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment