Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

代码复现ROUGE得分异常高 #26

Open
wyyNLP opened this issue Sep 30, 2019 · 1 comment
Open

代码复现ROUGE得分异常高 #26

wyyNLP opened this issue Sep 30, 2019 · 1 comment

Comments

@wyyNLP
Copy link

wyyNLP commented Sep 30, 2019

基于字级别的数据,从数据集里把摘要和原文本提取出来以后分别保存,再对他们进行分字处理。在这里标点没有去掉。然后用preprogress.py.在使用rouge评价是把reference和candidate根据字典dict转成index数字进行评分的,rouge结果异常高。
epoch: 3, loss: 23146.946, time: 3100.882, updates: 110000, accuracy: 57.57
F_measure: [57.11, 30.26, 43.7] Recall: [56.44, 29.56, 43.05] Precision: [62.93, 33.76, 48.4]
请问我是数据处理的有问题吗?或者您方便透漏一下您的实验的bleu值吗?

@JustinLin610
Copy link
Collaborator

可能是数据有误,我没有遇到过这种情况,你确认下测试集和LCSTS的是否一致

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants