This repository holds the data and calculation for inter-annotator agreement for is_methods_keystone/not_methods_keystone annotation based on two annotators.
The inter annotator agreement (Cohen's Kappa) is 0.67 based on 235 annotations, which was computed using the irr package (version 0.84.1) in R.
For poster presentations:
Haque, T., Lam, T., Rahman, M., González-Cruz, K., Fu, Y., Schneider, J., Annotating data to train machine learning models to classify citations in biomedical papers. Poster presented at the 2022 American Physician Scientists Association Northeast Regional Conference, January 15-16, 2022. In Abstracts of the 2022 American Physician Scientist Association (APSA) Northeast Regional Conference (NERC), In Int J Med Students Vol 10 (Suppl 1). http://doi.org/10.5195/ijms/2022.1359
Haque, T., Lam, T., Rahman, M., González-Cruz, K., Fu, Y., Schneider, J., Annotating data to train machine learning models to classify citations in biomedical papers. Poster presented at the 2022 American Physician Scientists Association West Regional Conference, January 22, 2022.