-
Notifications
You must be signed in to change notification settings - Fork 2
/
Copy pathlog.txt
104 lines (96 loc) · 3.17 KB
/
log.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
# Task A (detecting phrases)
# input file: input/input_example.txt
# gold file: gold/output_A_example.txt
# dev file: dev/output_A_example.txt
* Correct (15):
- "asma" from 3 to 7.
- "afecta" from 8 to 14.
- "vías" from 19 to 23.
- "pulmones" from 43 to 51.
- "hinchan" from 55 to 62.
- "asma" from 67 to 71.
- "enfermedad" from 79 to 89.
- "ataque de asma" from 94 to 108.
- "produce" from 112 to 119.
- "síntomas" from 131 to 139.
- "síntomas" from 154 to 162.
- "tratamiento" from 168 to 179.
- "dependen" from 180 to 188.
- "avanzada" from 216 to 224.
- "enfermedad" from 237 to 247.
* Partial (1):
- "cáncer" from 201 to 207 vs "tipo de cáncer" from 193 to 207.
* Missing (4):
- "vías respiratorias" from 19 to 37.
- "asma" from 104 to 108.
- "empeoran" from 140 to 148.
- "tipo" from 193 to 197.
* Spurious (2):
- "respiratorias" from 24 to 37.
- "es" from 72 to 74.
Precision = 0.89
Recall = 0.79
F1 Score = 0.84
# Taks B (labeling phrases)
# gold file: gold/output_B_example.txt
# dev file: dev/output_B_example.txt
* Correct (16):
- Concept "asma" from 3 to 7.
- Action "afecta" from 8 to 14.
- Concept "vías" from 19 to 23.
- Concept "pulmones" from 43 to 51.
- Action "hinchan" from 55 to 62.
- Concept "asma" from 67 to 71.
- Concept "enfermedad" from 79 to 89.
- Concept "ataque de asma" from 94 to 108.
- Action "produce" from 112 to 119.
- Concept "síntomas" from 131 to 139.
- Concept "síntomas" from 154 to 162.
- Concept "tratamiento" from 168 to 179.
- Action "dependen" from 180 to 188.
- Concept "tipo de cáncer" from 193 to 207.
- Concept "avanzada" from 216 to 224.
- Concept "enfermedad" from 237 to 247.
* Incorrect (0):
* Missing (4):
- Concept "vías respiratorias" from 19 to 37.
- Concept "asma" from 104 to 108.
- Action "empeoran" from 140 to 148.
- Concept "tipo" from 193 to 197.
* Spurious (2):
- Action "es" from 72 to 74.
- Concept "respiratorias" from 24 to 37.
Micro-accuracy: 1.00
Macro-accuracy: 0.73
Precision: 0.89
Recall: 0.80
F1: 0.84
# Taks C (linking)
# gold file: gold/output_C_example.txt
# dev file: dev/output_C_example.txt
* Correct (4):
- subject involving "afecta" and "asma".
- target involving "hinchan" and "pulmones".
- target involving "produce" and "ataque de asma".
- subject involving "dependen" and "tratamiento".
* Missing (9):
- property-of involving "tipo" and "cáncer".
- property-of involving "avanzada" and "enfermedad".
- is-a involving "vías respiratorias" and "vías".
- is-a involving "asma" and "enfermedad".
- target involving "afecta" and "vías respiratorias".
- subject involving "hinchan" and "pulmones".
- subject involving "produce" and "empeoran".
- target involving "empeoran" and "síntomas".
- target involving "dependen" and "tipo".
* Spurious (7):
- is-a involving "avanzada" and "enfermedad".
- property-of involving "respiratorias" and "vías".
- target involving "afecta" and "vías".
- subject involving "es" and "asma".
- target involving "es" and "enfermedad".
- subject involving "produce" and "síntomas".
- target involving "dependen" and "tipo de cáncer".
Precision: 0.36
Recall: 0.31
F1: 0.33