-
Notifications
You must be signed in to change notification settings - Fork 86
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add MAXO annotation evaluation #259
Conversation
Not quite there yet - need to account for partial matches since these all test relations are stored as one-to-one triples but extracted are still one-to-many. |
This still has some strangeness going on with parsing of ungrounded results but otherwise works. |
One remaining bit of weirdness: the extracted predicate is sometimes |
Trying this out on all available test sets before merging. It will likely need some more work after that, but some of that work will concern improving the extraction template. |
One last bit of weirdness: the parsed triples can sometimes get populated with invalid values, despite starting as fully valid objects. - subject: MAXO:0001175
predicate: IS USED TO TREAT
object:
- end-stage liver disease
qualifier:
subject_qualifier:
object_qualifier: becomes this mostly-empty triple: - subject: end-stage liver disease
predicate:
object:
qualifier:
subject_qualifier:
object_qualifier: It shouldn't even be in the triples in the first place as the symptom isn't grounded to HP, so perhaps a boolean is flipped somewhere. |
No description provided.