Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

在SemEval2010Task8数据上没有达到你的效果? #1

Open
cjwen15 opened this issue Nov 24, 2020 · 5 comments
Open

在SemEval2010Task8数据上没有达到你的效果? #1

cjwen15 opened this issue Nov 24, 2020 · 5 comments

Comments

@cjwen15
Copy link

cjwen15 commented Nov 24, 2020

Micro-averaged result (excluding Other):
P = 71/1953 = 3.64% R = 71/2263 = 3.14% F1 = 3.37%

MACRO-averaged result (excluding Other):
P = 6.65% R = 3.25% F1 = 3.49%

<<< The official score is (9+1)-way evaluation with directionality taken into account: macro-averaged F1 = 3.49% >>>

不知是否模型的问题?

@wenyu332
Copy link

Micro-averaged result (excluding Other):
P = 71/1953 = 3.64% R = 71/2263 = 3.14% F1 = 3.37%

MACRO-averaged result (excluding Other):
P = 6.65% R = 3.25% F1 = 3.49%

<<< The official score is (9+1)-way evaluation with directionality taken into account: macro-averaged F1 = 3.49% >>>

不知是否模型的问题?

你好,不知道你后面有没有继续进行尝试,是否达到89%,你是自己重新训练还是直接使用作者提供的模型进行测试呢

@cjwen15
Copy link
Author

cjwen15 commented Dec 22, 2020

Micro-averaged result (excluding Other):
P = 71/1953 = 3.64% R = 71/2263 = 3.14% F1 = 3.37%
MACRO-averaged result (excluding Other):
P = 6.65% R = 3.25% F1 = 3.49%
<<< The official score is (9+1)-way evaluation with directionality taken into account: macro-averaged F1 = 3.49% >>>
不知是否模型的问题?

你好,不知道你后面有没有继续进行尝试,是否达到89%,你是自己重新训练还是直接使用作者提供的模型进行测试呢

我是直接使用作者的模型进行测试的,无其他修改

@wenyu332
Copy link

Micro-averaged result (excluding Other):
P = 71/1953 = 3.64% R = 71/2263 = 3.14% F1 = 3.37%
MACRO-averaged result (excluding Other):
P = 6.65% R = 3.25% F1 = 3.49%
<<< The official score is (9+1)-way evaluation with directionality taken into account: macro-averaged F1 = 3.49% >>>
不知是否模型的问题?

你好,不知道你后面有没有继续进行尝试,是否达到89%,你是自己重新训练还是直接使用作者提供的模型进行测试呢

我是直接使用作者的模型进行测试的,无其他修改

好的,谢谢你 那你最后结果有多少呢

@DongPoLI
Copy link
Owner

DongPoLI commented Jan 14, 2021

Micro-averaged result (excluding Other):
P = 71/1953 = 3.64% R = 71/2263 = 3.14% F1 = 3.37%

MACRO-averaged result (excluding Other):
P = 6.65% R = 3.25% F1 = 3.49%

<<< The official score is (9+1)-way evaluation with directionality taken into account: macro-averaged F1 = 3.49% >>>

不知是否模型的问题?

模型没有问题,另一个我最近的工作:Mul-BERT,你可以看看,在SemEval 2010 Task 8 上最高达到90.72%(Macro-F1), 模型很简单

@LemonQC
Copy link

LemonQC commented Mar 26, 2021

您好,请问哪里可以看到论文呢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants