SILA: a system for scientific image analysis

SILA: a system for scientific image analysis. Moreira, D., Cardenuto, J. P., Shao, R., Baireddy, S., Cozzolino, D., Gragnaniello, D., Abd-Almageed, W., Bestagini, P., Tubaro, S., Rocha, A., Scheirer, W., Verdoliva, L., & Delp, E. Scientific Reports, 12(1):18306, Oct, 2022.

Paper doi abstract bibtex

A great deal of the images found in scientific publications are retouched, reused, or composed to enhance the quality of the presentation. In most instances, these edits are benign and help the reader better understand the material in a paper. However, some edits are instances of scientific misconduct and undermine the integrity of the presented research. Determining the legitimacy of edits made to scientific images is an open problem that no current technology can perform satisfactorily in a fully automated fashion. It thus remains up to human experts to inspect images as part of the peer-review process. Nonetheless, image analysis technologies promise to become helpful to experts to perform such an essential yet arduous task. Therefore, we introduce SILA, a system that makes image analysis tools available to reviewers and editors in a principled way. Further, SILA is the first human-in-the-loop end-to-end system that starts by processing article PDF files, performs image manipulation detection on the automatically extracted figures, and ends with image provenance graphs expressing the relationships between the images in question, to explain potential problems. To assess its efficacy, we introduce a dataset of scientific papers from around the globe containing annotated image manipulations and inadvertent reuse, which can serve as a benchmark for the problem at hand. Qualitative and quantitative results of the system are described using this dataset.

@Article{Moreira2022,
author={Moreira, Daniel
and Cardenuto, Jo{\~a}o Phillipe
and Shao, Ruiting
and Baireddy, Sriram
and Cozzolino, Davide
and Gragnaniello, Diego
and Abd-Almageed, Wael
and Bestagini, Paolo
and Tubaro, Stefano
and Rocha, Anderson
and Scheirer, Walter
and Verdoliva, Luisa
and Delp, Edward},
title={SILA: a system for scientific image analysis},
journal={Scientific Reports},
year={2022},
month={Oct},
day={31},
volume={12},
number={1},
pages={18306},
 	keywords="journal", 

abstract={A great deal of the images found in scientific publications are retouched, reused, or composed to enhance the quality of the presentation. In most instances, these edits are benign and help the reader better understand the material in a paper. However, some edits are instances of scientific misconduct and undermine the integrity of the presented research. Determining the legitimacy of edits made to scientific images is an open problem that no current technology can perform satisfactorily in a fully automated fashion. It thus remains up to human experts to inspect images as part of the peer-review process. Nonetheless, image analysis technologies promise to become helpful to experts to perform such an essential yet arduous task. Therefore, we introduce SILA, a system that makes image analysis tools available to reviewers and editors in a principled way. Further, SILA is the first human-in-the-loop end-to-end system that starts by processing article PDF files, performs image manipulation detection on the automatically extracted figures, and ends with image provenance graphs expressing the relationships between the images in question, to explain potential problems. To assess its efficacy, we introduce a dataset of scientific papers from around the globe containing annotated image manipulations and inadvertent reuse, which can serve as a benchmark for the problem at hand. Qualitative and quantitative results of the system are described using this dataset.},
issn={2045-2322},
doi={10.1038/s41598-022-21535-3},
url={https://doi.org/10.1038/s41598-022-21535-3}
}

Downloads: 0

{"_id":"wrbpsYejpQXMfSKju","bibbaseid":"moreira-cardenuto-shao-baireddy-cozzolino-gragnaniello-abdalmageed-bestagini-etal-silaasystemforscientificimageanalysis-2022","author_short":["Moreira, D.","Cardenuto, J. P.","Shao, R.","Baireddy, S.","Cozzolino, D.","Gragnaniello, D.","Abd-Almageed, W.","Bestagini, P.","Tubaro, S.","Rocha, A.","Scheirer, W.","Verdoliva, L.","Delp, E."],"bibdata":{"bibtype":"article","type":"article","author":[{"propositions":[],"lastnames":["Moreira"],"firstnames":["Daniel"],"suffixes":[]},{"propositions":[],"lastnames":["Cardenuto"],"firstnames":["João","Phillipe"],"suffixes":[]},{"propositions":[],"lastnames":["Shao"],"firstnames":["Ruiting"],"suffixes":[]},{"propositions":[],"lastnames":["Baireddy"],"firstnames":["Sriram"],"suffixes":[]},{"propositions":[],"lastnames":["Cozzolino"],"firstnames":["Davide"],"suffixes":[]},{"propositions":[],"lastnames":["Gragnaniello"],"firstnames":["Diego"],"suffixes":[]},{"propositions":[],"lastnames":["Abd-Almageed"],"firstnames":["Wael"],"suffixes":[]},{"propositions":[],"lastnames":["Bestagini"],"firstnames":["Paolo"],"suffixes":[]},{"propositions":[],"lastnames":["Tubaro"],"firstnames":["Stefano"],"suffixes":[]},{"propositions":[],"lastnames":["Rocha"],"firstnames":["Anderson"],"suffixes":[]},{"propositions":[],"lastnames":["Scheirer"],"firstnames":["Walter"],"suffixes":[]},{"propositions":[],"lastnames":["Verdoliva"],"firstnames":["Luisa"],"suffixes":[]},{"propositions":[],"lastnames":["Delp"],"firstnames":["Edward"],"suffixes":[]}],"title":"SILA: a system for scientific image analysis","journal":"Scientific Reports","year":"2022","month":"Oct","day":"31","volume":"12","number":"1","pages":"18306","keywords":"journal","abstract":"A great deal of the images found in scientific publications are retouched, reused, or composed to enhance the quality of the presentation. In most instances, these edits are benign and help the reader better understand the material in a paper. However, some edits are instances of scientific misconduct and undermine the integrity of the presented research. Determining the legitimacy of edits made to scientific images is an open problem that no current technology can perform satisfactorily in a fully automated fashion. It thus remains up to human experts to inspect images as part of the peer-review process. Nonetheless, image analysis technologies promise to become helpful to experts to perform such an essential yet arduous task. Therefore, we introduce SILA, a system that makes image analysis tools available to reviewers and editors in a principled way. Further, SILA is the first human-in-the-loop end-to-end system that starts by processing article PDF files, performs image manipulation detection on the automatically extracted figures, and ends with image provenance graphs expressing the relationships between the images in question, to explain potential problems. To assess its efficacy, we introduce a dataset of scientific papers from around the globe containing annotated image manipulations and inadvertent reuse, which can serve as a benchmark for the problem at hand. Qualitative and quantitative results of the system are described using this dataset.","issn":"2045-2322","doi":"10.1038/s41598-022-21535-3","url":"https://doi.org/10.1038/s41598-022-21535-3","bibtex":"@Article{Moreira2022,\nauthor={Moreira, Daniel\nand Cardenuto, Jo{\\~a}o Phillipe\nand Shao, Ruiting\nand Baireddy, Sriram\nand Cozzolino, Davide\nand Gragnaniello, Diego\nand Abd-Almageed, Wael\nand Bestagini, Paolo\nand Tubaro, Stefano\nand Rocha, Anderson\nand Scheirer, Walter\nand Verdoliva, Luisa\nand Delp, Edward},\ntitle={SILA: a system for scientific image analysis},\njournal={Scientific Reports},\nyear={2022},\nmonth={Oct},\nday={31},\nvolume={12},\nnumber={1},\npages={18306},\n \tkeywords=\"journal\", \n\nabstract={A great deal of the images found in scientific publications are retouched, reused, or composed to enhance the quality of the presentation. In most instances, these edits are benign and help the reader better understand the material in a paper. However, some edits are instances of scientific misconduct and undermine the integrity of the presented research. Determining the legitimacy of edits made to scientific images is an open problem that no current technology can perform satisfactorily in a fully automated fashion. It thus remains up to human experts to inspect images as part of the peer-review process. Nonetheless, image analysis technologies promise to become helpful to experts to perform such an essential yet arduous task. Therefore, we introduce SILA, a system that makes image analysis tools available to reviewers and editors in a principled way. Further, SILA is the first human-in-the-loop end-to-end system that starts by processing article PDF files, performs image manipulation detection on the automatically extracted figures, and ends with image provenance graphs expressing the relationships between the images in question, to explain potential problems. To assess its efficacy, we introduce a dataset of scientific papers from around the globe containing annotated image manipulations and inadvertent reuse, which can serve as a benchmark for the problem at hand. Qualitative and quantitative results of the system are described using this dataset.},\nissn={2045-2322},\ndoi={10.1038/s41598-022-21535-3},\nurl={https://doi.org/10.1038/s41598-022-21535-3}\n}\n\n\n\n","author_short":["Moreira, D.","Cardenuto, J. P.","Shao, R.","Baireddy, S.","Cozzolino, D.","Gragnaniello, D.","Abd-Almageed, W.","Bestagini, P.","Tubaro, S.","Rocha, A.","Scheirer, W.","Verdoliva, L.","Delp, E."],"key":"Moreira2022","id":"Moreira2022","bibbaseid":"moreira-cardenuto-shao-baireddy-cozzolino-gragnaniello-abdalmageed-bestagini-etal-silaasystemforscientificimageanalysis-2022","role":"author","urls":{"Paper":"https://doi.org/10.1038/s41598-022-21535-3"},"keyword":["journal"],"metadata":{"authorlinks":{}}},"bibtype":"article","biburl":"https://bibbase.org/network/files/TSLgqgnuxtcMC9Fue","dataSources":["RaZEzzMyXzgjMhMJN","v5pC6iKH87X8YPwsQ"],"keywords":["journal"],"search_terms":["sila","system","scientific","image","analysis","moreira","cardenuto","shao","baireddy","cozzolino","gragnaniello","abd-almageed","bestagini","tubaro","rocha","scheirer","verdoliva","delp"],"title":"SILA: a system for scientific image analysis","year":2022}