EXTRACTING BIO-MOLECULAR EVENTS FROM LITERATURE—THE BIONLP’09 SHARED TASK
Article first published online: 27 NOV 2011
© 2011 Wiley Periodicals, Inc.
Volume 27, Issue 4, pages 513–540, November 2011
How to Cite
Kim, J.-D., Ohta, T., Pyysalo, S., Kano, Y. and Tsujii, J. (2011), EXTRACTING BIO-MOLECULAR EVENTS FROM LITERATURE—THE BIONLP’09 SHARED TASK. Computational Intelligence, 27: 513–540. doi: 10.1111/j.1467-8640.2011.00398.x
- Issue published online: 27 NOV 2011
- Article first published online: 27 NOV 2011
- event extraction;
- molecular biology;
- natural language processing;
- shared task;
- text mining
This paper presents the preparation, results and analysis of the BioNLP’09 shared task on event extraction, organized to address the automatic extraction of fine-grained information from the scientific literature on molecular biology. A representation of this information was defined taking into account both the biological and computational requirements of the task, and corpus resources manually annotated by domain experts provided to task participants. To create a basis for further progress, emphasis was placed on providing fine-grained evaluation that isolates different subtasks and allows the analysis of different aspects of the results through various evaluation criteria. In introducing this new task to the community, we made an effort to reduce the cost of participation by making common natural language processing tools, data, and evaluation methods easily accessible. The task received community-wide participation, establishing the state-of-the-art performance at fine-grained event extraction as well as allowing the identification of remaining challenges and suggesting directions for future improvements. All the resources and results of the shared task are publicly available and an online evaluation on blind test data accessible at http://www-tsujii.is.s.u-tokyo.ac.jp/GENIA/SharedTask/.