DeTEXT: A Database for Evaluating Text Extraction from Biomedical Literature Figures

DeTEXT: A Database for Evaluating Text Extraction from Biomedical Literature Figures. Yin, X., Yang, C., Pei, W., Man, H., Zhang, J., Learned-Miller, E., & Yu, H. PLoS ONE, May, 2015.

Paper doi abstract bibtex

Hundreds of millions of figures are available in biomedical literature, representing important biomedical experimental evidence. Since text is a rich source of information in figures, automatically extracting such text may assist in the task of mining figure information. A high-quality ground truth standard can greatly facilitate the development of an automated system. This article describes DeTEXT: A database for evaluating text extraction from biomedical literature figures. It is the first publicly available, human-annotated, high quality, and large-scale figure-text dataset with 288 full-text articles, 500 biomedical figures, and 9308 text regions. This article describes how figures were selected from open-access full-text biomedical articles and how annotation guidelines and annotation tools were developed. We also discuss the inter-annotator agreement and the reliability of the annotations. We summarize the statistics of the DeTEXT data and make available evaluation protocols for DeTEXT. Finally we lay out challenges we observed in the automated detection and recognition of figure text and discuss research directions in this area. DeTEXT is publicly available for downloading at http://prir.ustb.edu.cn/DeTEXT/.

@article{yin_detext:_2015,
	title = {{DeTEXT}: {A} {Database} for {Evaluating} {Text} {Extraction} from {Biomedical} {Literature} {Figures}},
	volume = {10},
	issn = {1932-6203},
	shorttitle = {{DeTEXT}},
	url = {http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4423993/},
	doi = {10.1371/journal.pone.0126200},
	abstract = {Hundreds of millions of figures are available in biomedical literature, representing important biomedical experimental evidence. Since text is a rich source of information in figures, automatically extracting such text may assist in the task of mining figure information. A high-quality ground truth standard can greatly facilitate the development of an automated system. This article describes DeTEXT: A database for evaluating text extraction from biomedical literature figures. It is the first publicly available, human-annotated, high quality, and large-scale figure-text dataset with 288 full-text articles, 500 biomedical figures, and 9308 text regions. This article describes how figures were selected from open-access full-text biomedical articles and how annotation guidelines and annotation tools were developed. We also discuss the inter-annotator agreement and the reliability of the annotations. We summarize the statistics of the DeTEXT data and make available evaluation protocols for DeTEXT. Finally we lay out challenges we observed in the automated detection and recognition of figure text and discuss research directions in this area. DeTEXT is publicly available for downloading at http://prir.ustb.edu.cn/DeTEXT/.},
	number = {5},
	urldate = {2015-06-03},
	journal = {PLoS ONE},
	author = {Yin, Xu-Cheng and Yang, Chun and Pei, Wei-Yi and Man, Haixia and Zhang, Jun and Learned-Miller, Erik and Yu, Hong},
	month = may,
	year = {2015},
	pmid = {25951377 PMCID: PMC4423993},
}

Downloads: 0

{"_id":"uxMRKQcW8Ci3ehAEi","bibbaseid":"yin-yang-pei-man-zhang-learnedmiller-yu-detextadatabaseforevaluatingtextextractionfrombiomedicalliteraturefigures-2015","author_short":["Yin, X.","Yang, C.","Pei, W.","Man, H.","Zhang, J.","Learned-Miller, E.","Yu, H."],"bibdata":{"bibtype":"article","type":"article","title":"DeTEXT: A Database for Evaluating Text Extraction from Biomedical Literature Figures","volume":"10","issn":"1932-6203","shorttitle":"DeTEXT","url":"http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4423993/","doi":"10.1371/journal.pone.0126200","abstract":"Hundreds of millions of figures are available in biomedical literature, representing important biomedical experimental evidence. Since text is a rich source of information in figures, automatically extracting such text may assist in the task of mining figure information. A high-quality ground truth standard can greatly facilitate the development of an automated system. This article describes DeTEXT: A database for evaluating text extraction from biomedical literature figures. It is the first publicly available, human-annotated, high quality, and large-scale figure-text dataset with 288 full-text articles, 500 biomedical figures, and 9308 text regions. This article describes how figures were selected from open-access full-text biomedical articles and how annotation guidelines and annotation tools were developed. We also discuss the inter-annotator agreement and the reliability of the annotations. We summarize the statistics of the DeTEXT data and make available evaluation protocols for DeTEXT. Finally we lay out challenges we observed in the automated detection and recognition of figure text and discuss research directions in this area. DeTEXT is publicly available for downloading at http://prir.ustb.edu.cn/DeTEXT/.","number":"5","urldate":"2015-06-03","journal":"PLoS ONE","author":[{"propositions":[],"lastnames":["Yin"],"firstnames":["Xu-Cheng"],"suffixes":[]},{"propositions":[],"lastnames":["Yang"],"firstnames":["Chun"],"suffixes":[]},{"propositions":[],"lastnames":["Pei"],"firstnames":["Wei-Yi"],"suffixes":[]},{"propositions":[],"lastnames":["Man"],"firstnames":["Haixia"],"suffixes":[]},{"propositions":[],"lastnames":["Zhang"],"firstnames":["Jun"],"suffixes":[]},{"propositions":[],"lastnames":["Learned-Miller"],"firstnames":["Erik"],"suffixes":[]},{"propositions":[],"lastnames":["Yu"],"firstnames":["Hong"],"suffixes":[]}],"month":"May","year":"2015","pmid":"25951377 PMCID: PMC4423993","bibtex":"@article{yin_detext:_2015,\n\ttitle = {{DeTEXT}: {A} {Database} for {Evaluating} {Text} {Extraction} from {Biomedical} {Literature} {Figures}},\n\tvolume = {10},\n\tissn = {1932-6203},\n\tshorttitle = {{DeTEXT}},\n\turl = {http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4423993/},\n\tdoi = {10.1371/journal.pone.0126200},\n\tabstract = {Hundreds of millions of figures are available in biomedical literature, representing important biomedical experimental evidence. Since text is a rich source of information in figures, automatically extracting such text may assist in the task of mining figure information. A high-quality ground truth standard can greatly facilitate the development of an automated system. This article describes DeTEXT: A database for evaluating text extraction from biomedical literature figures. It is the first publicly available, human-annotated, high quality, and large-scale figure-text dataset with 288 full-text articles, 500 biomedical figures, and 9308 text regions. This article describes how figures were selected from open-access full-text biomedical articles and how annotation guidelines and annotation tools were developed. We also discuss the inter-annotator agreement and the reliability of the annotations. We summarize the statistics of the DeTEXT data and make available evaluation protocols for DeTEXT. Finally we lay out challenges we observed in the automated detection and recognition of figure text and discuss research directions in this area. DeTEXT is publicly available for downloading at http://prir.ustb.edu.cn/DeTEXT/.},\n\tnumber = {5},\n\turldate = {2015-06-03},\n\tjournal = {PLoS ONE},\n\tauthor = {Yin, Xu-Cheng and Yang, Chun and Pei, Wei-Yi and Man, Haixia and Zhang, Jun and Learned-Miller, Erik and Yu, Hong},\n\tmonth = may,\n\tyear = {2015},\n\tpmid = {25951377 PMCID: PMC4423993},\n}\n\n","author_short":["Yin, X.","Yang, C.","Pei, W.","Man, H.","Zhang, J.","Learned-Miller, E.","Yu, H."],"key":"yin_detext:_2015","id":"yin_detext:_2015","bibbaseid":"yin-yang-pei-man-zhang-learnedmiller-yu-detextadatabaseforevaluatingtextextractionfrombiomedicalliteraturefigures-2015","role":"author","urls":{"Paper":"http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4423993/"},"metadata":{"authorlinks":{}}},"bibtype":"article","biburl":"http://fenway.cs.uml.edu/papers/pubs-all.bib","dataSources":["TqaA9miSB65nRfS5H"],"keywords":[],"search_terms":["detext","database","evaluating","text","extraction","biomedical","literature","figures","yin","yang","pei","man","zhang","learned-miller","yu"],"title":"DeTEXT: A Database for Evaluating Text Extraction from Biomedical Literature Figures","year":2015}