Learning from crowds in digital pathology using scalable variational Gaussian processes. López-Pérez, M., Amgad, M., Morales-Álvarez, P., Ruiz, P., Cooper, L. A. D., Molina, R., & Katsaggelos, A. K. Scientific Reports, 11(1):11612, jun, 2021.
Learning from crowds in digital pathology using scalable variational Gaussian processes [link]Paper  doi  abstract   bibtex   
The volume of labeled data is often the primary determinant of success in developing machine learning algorithms. This has increased interest in methods for leveraging crowds to scale data labeling efforts, and methods to learn from noisy crowd-sourced labels. The need to scale labeling is acute but particularly challenging in medical applications like pathology, due to the expertise required to generate quality labels and the limited availability of qualified experts. In this paper we investigate the application of Scalable Variational Gaussian Processes for Crowdsourcing (SVGPCR) in digital pathology. We compare SVGPCR with other crowdsourcing methods using a large multi-rater dataset where pathologists, pathology residents, and medical students annotated tissue regions breast cancer. Our study shows that SVGPCR is competitive with equivalent methods trained using gold-standard pathologist generated labels, and that SVGPCR meets or exceeds the performance of other crowdsourcing methods based on deep learning. We also show how SVGPCR can effectively learn the class-conditional reliabilities of individual annotators and demonstrate that Gaussian-process classifiers have comparable performance to similar deep learning methods. These results suggest that SVGPCR can meaningfully engage non-experts in pathology labeling tasks, and that the class-conditional reliabilities estimated by SVGPCR may assist in matching annotators to tasks where they perform well.
@article{Miguel2021,
abstract = {The volume of labeled data is often the primary determinant of success in developing machine learning algorithms. This has increased interest in methods for leveraging crowds to scale data labeling efforts, and methods to learn from noisy crowd-sourced labels. The need to scale labeling is acute but particularly challenging in medical applications like pathology, due to the expertise required to generate quality labels and the limited availability of qualified experts. In this paper we investigate the application of Scalable Variational Gaussian Processes for Crowdsourcing (SVGPCR) in digital pathology. We compare SVGPCR with other crowdsourcing methods using a large multi-rater dataset where pathologists, pathology residents, and medical students annotated tissue regions breast cancer. Our study shows that SVGPCR is competitive with equivalent methods trained using gold-standard pathologist generated labels, and that SVGPCR meets or exceeds the performance of other crowdsourcing methods based on deep learning. We also show how SVGPCR can effectively learn the class-conditional reliabilities of individual annotators and demonstrate that Gaussian-process classifiers have comparable performance to similar deep learning methods. These results suggest that SVGPCR can meaningfully engage non-experts in pathology labeling tasks, and that the class-conditional reliabilities estimated by SVGPCR may assist in matching annotators to tasks where they perform well.},
author = {L{\'{o}}pez-P{\'{e}}rez, Miguel and Amgad, Mohamed and Morales-{\'{A}}lvarez, Pablo and Ruiz, Pablo and Cooper, Lee A. D. and Molina, Rafael and Katsaggelos, Aggelos K.},
doi = {10.1038/s41598-021-90821-3},
issn = {2045-2322},
journal = {Scientific Reports},
month = {jun},
number = {1},
pages = {11612},
pmid = {34078955},
title = {{Learning from crowds in digital pathology using scalable variational Gaussian processes}},
url = {https://www.nature.com/articles/s41598-021-90821-3},
volume = {11},
year = {2021}
}
Downloads: 0
About
Documentation
Keywords
Search
Users
Terms and Conditions of Use
Privacy Policy
Sitemap
© BibBase.org 2021