Generative Adversarial Networks to Synthetically Augment Data for Deep Learning based Image Segmentation. Neff, T., Payer, C., Štern, D., & Urschler, M. In Proceedings of the OAGM Workshop 2018: Medical Image Analysis, Hall/Tyrol, Austria, pages 22-29, 2018. doi abstract bibtex In recent years, deep learning based methods achieved state-of-the-art performance in many computer vision tasks. However, these methods are typically supervised, and require large amounts of annotated data to train. Acquisition of annotated data can be a costly endeavor, especially for methods requiring pixel-wise annotations such as image segmentation. To circumvent these costs and train on smaller datasets, data augmentation is commonly used to synthetically generate additional training data. A major downside of standard data augmentation methods is that they require knowledge of the underlying task in order to perform well, and introduce additional hyperparameters into the deep learning setup. With the goal to alleviate these issues, we evaluate a data augmentation strategy utilizing Generative Adversarial Networks (GANs). While GANs have shown potential for image synthesis when trained on large datasets, their potential given small, annotated datasets (as is common in e.g. medical image analysis) has not been analyzed in much detail yet. We want to evaluate if GAN-based data augmentation using state-of-the-art methods, such as the Wasserstein GAN with gradient penalty, is a viable strategy for small datasets. We extensively evaluate our method on two image segmentation tasks: medical image segmentation of the left lung of the SCR Lung Database and semantic segmentation of the Cityscapes dataset. For the medical segmentation task, we show that our GAN-based augmentation performs as well as standard data augmentation, and training on purely synthetic data outperforms previously reported results. For the more challenging Cityscapes evaluation, we report that our GAN-based augmentation scheme is competitive with standard data augmentation methods.
@inproceedings{
title = {Generative Adversarial Networks to Synthetically Augment Data for Deep Learning based Image Segmentation},
type = {inproceedings},
year = {2018},
pages = {22-29},
id = {e0d3f062-b87e-3f45-9924-f20342bfe804},
created = {2018-09-04T04:52:29.681Z},
file_attached = {false},
profile_id = {53d1e3c7-2f16-3c81-9a84-dccd45be4841},
last_modified = {2019-11-08T01:39:29.964Z},
read = {false},
starred = {false},
authored = {true},
confirmed = {true},
hidden = {false},
citation_key = {Neff2018},
folder_uuids = {0ec41d70-75f1-4a99-820b-0a83ccc37f54},
private_publication = {false},
abstract = {In recent years, deep learning based methods achieved state-of-the-art performance in many computer vision tasks. However, these methods are typically supervised, and require large amounts of annotated data to train. Acquisition of annotated data can be a costly endeavor, especially for methods requiring pixel-wise annotations such as image segmentation. To circumvent these costs and train on smaller datasets, data augmentation is commonly used to synthetically generate additional training data. A major downside of standard data augmentation methods is that they require knowledge of the underlying task in order to perform well, and introduce additional hyperparameters into the deep learning setup. With the goal to alleviate these issues, we evaluate a data augmentation strategy utilizing Generative Adversarial Networks (GANs). While GANs have shown potential for image synthesis when trained on large datasets, their potential given small, annotated datasets (as is common in e.g. medical image analysis) has not been analyzed in much detail yet. We want to evaluate if GAN-based data augmentation using state-of-the-art methods, such as the Wasserstein GAN with gradient penalty, is a viable strategy for small datasets. We extensively evaluate our method on two image segmentation tasks: medical image segmentation of the left lung of the SCR Lung Database and semantic segmentation of the Cityscapes dataset. For the medical segmentation task, we show that our GAN-based augmentation performs as well as standard data augmentation, and training on purely synthetic data outperforms previously reported results. For the more challenging Cityscapes evaluation, we report that our GAN-based augmentation scheme is competitive with standard data augmentation methods.},
bibtype = {inproceedings},
author = {Neff, Thomas and Payer, Christian and Štern, Darko and Urschler, Martin},
doi = {10.3217/978-3-85125-603-1-07},
booktitle = {Proceedings of the OAGM Workshop 2018: Medical Image Analysis, Hall/Tyrol, Austria}
}
Downloads: 0
{"_id":"8a9FXuY9w83qSd37H","bibbaseid":"neff-payer-tern-urschler-generativeadversarialnetworkstosyntheticallyaugmentdatafordeeplearningbasedimagesegmentation-2018","authorIDs":["5dc49ed5d87d2edf0100002b","5deeebf3dca291de01000036","5e11339e495520de0100002e","5e2f20334557f3de01000117","5e3228cd7b9658f20100003b","7Kn6pNXYAbwfP2qf9","GNRNX8XY6YsvfwLoT","QLJrXtcicsqgMiwYa","R2nAkk8csQ8oKb5gj","Ww5ofBLQKYbrF3J2m","dPNz6LJCS62XHAwue","uhYMbdfHmE55Dkgw2","vQb2TpF7F83goeATt"],"author_short":["Neff, T.","Payer, C.","Štern, D.","Urschler, M."],"bibdata":{"title":"Generative Adversarial Networks to Synthetically Augment Data for Deep Learning based Image Segmentation","type":"inproceedings","year":"2018","pages":"22-29","id":"e0d3f062-b87e-3f45-9924-f20342bfe804","created":"2018-09-04T04:52:29.681Z","file_attached":false,"profile_id":"53d1e3c7-2f16-3c81-9a84-dccd45be4841","last_modified":"2019-11-08T01:39:29.964Z","read":false,"starred":false,"authored":"true","confirmed":"true","hidden":false,"citation_key":"Neff2018","folder_uuids":"0ec41d70-75f1-4a99-820b-0a83ccc37f54","private_publication":false,"abstract":"In recent years, deep learning based methods achieved state-of-the-art performance in many computer vision tasks. However, these methods are typically supervised, and require large amounts of annotated data to train. Acquisition of annotated data can be a costly endeavor, especially for methods requiring pixel-wise annotations such as image segmentation. To circumvent these costs and train on smaller datasets, data augmentation is commonly used to synthetically generate additional training data. A major downside of standard data augmentation methods is that they require knowledge of the underlying task in order to perform well, and introduce additional hyperparameters into the deep learning setup. With the goal to alleviate these issues, we evaluate a data augmentation strategy utilizing Generative Adversarial Networks (GANs). While GANs have shown potential for image synthesis when trained on large datasets, their potential given small, annotated datasets (as is common in e.g. medical image analysis) has not been analyzed in much detail yet. We want to evaluate if GAN-based data augmentation using state-of-the-art methods, such as the Wasserstein GAN with gradient penalty, is a viable strategy for small datasets. We extensively evaluate our method on two image segmentation tasks: medical image segmentation of the left lung of the SCR Lung Database and semantic segmentation of the Cityscapes dataset. For the medical segmentation task, we show that our GAN-based augmentation performs as well as standard data augmentation, and training on purely synthetic data outperforms previously reported results. For the more challenging Cityscapes evaluation, we report that our GAN-based augmentation scheme is competitive with standard data augmentation methods.","bibtype":"inproceedings","author":"Neff, Thomas and Payer, Christian and Štern, Darko and Urschler, Martin","doi":"10.3217/978-3-85125-603-1-07","booktitle":"Proceedings of the OAGM Workshop 2018: Medical Image Analysis, Hall/Tyrol, Austria","bibtex":"@inproceedings{\n title = {Generative Adversarial Networks to Synthetically Augment Data for Deep Learning based Image Segmentation},\n type = {inproceedings},\n year = {2018},\n pages = {22-29},\n id = {e0d3f062-b87e-3f45-9924-f20342bfe804},\n created = {2018-09-04T04:52:29.681Z},\n file_attached = {false},\n profile_id = {53d1e3c7-2f16-3c81-9a84-dccd45be4841},\n last_modified = {2019-11-08T01:39:29.964Z},\n read = {false},\n starred = {false},\n authored = {true},\n confirmed = {true},\n hidden = {false},\n citation_key = {Neff2018},\n folder_uuids = {0ec41d70-75f1-4a99-820b-0a83ccc37f54},\n private_publication = {false},\n abstract = {In recent years, deep learning based methods achieved state-of-the-art performance in many computer vision tasks. However, these methods are typically supervised, and require large amounts of annotated data to train. Acquisition of annotated data can be a costly endeavor, especially for methods requiring pixel-wise annotations such as image segmentation. To circumvent these costs and train on smaller datasets, data augmentation is commonly used to synthetically generate additional training data. A major downside of standard data augmentation methods is that they require knowledge of the underlying task in order to perform well, and introduce additional hyperparameters into the deep learning setup. With the goal to alleviate these issues, we evaluate a data augmentation strategy utilizing Generative Adversarial Networks (GANs). While GANs have shown potential for image synthesis when trained on large datasets, their potential given small, annotated datasets (as is common in e.g. medical image analysis) has not been analyzed in much detail yet. We want to evaluate if GAN-based data augmentation using state-of-the-art methods, such as the Wasserstein GAN with gradient penalty, is a viable strategy for small datasets. We extensively evaluate our method on two image segmentation tasks: medical image segmentation of the left lung of the SCR Lung Database and semantic segmentation of the Cityscapes dataset. For the medical segmentation task, we show that our GAN-based augmentation performs as well as standard data augmentation, and training on purely synthetic data outperforms previously reported results. For the more challenging Cityscapes evaluation, we report that our GAN-based augmentation scheme is competitive with standard data augmentation methods.},\n bibtype = {inproceedings},\n author = {Neff, Thomas and Payer, Christian and Štern, Darko and Urschler, Martin},\n doi = {10.3217/978-3-85125-603-1-07},\n booktitle = {Proceedings of the OAGM Workshop 2018: Medical Image Analysis, Hall/Tyrol, Austria}\n}","author_short":["Neff, T.","Payer, C.","Štern, D.","Urschler, M."],"biburl":"https://bibbase.org/service/mendeley/53d1e3c7-2f16-3c81-9a84-dccd45be4841","bibbaseid":"neff-payer-tern-urschler-generativeadversarialnetworkstosyntheticallyaugmentdatafordeeplearningbasedimagesegmentation-2018","role":"author","urls":{},"metadata":{"authorlinks":{"urschler, m":"https://martinurschler.blogs.auckland.ac.nz/publications/"}},"downloads":0},"bibtype":"inproceedings","creationDate":"2019-11-07T22:46:45.740Z","downloads":0,"keywords":[],"search_terms":["generative","adversarial","networks","synthetically","augment","data","deep","learning","based","image","segmentation","neff","payer","štern","urschler"],"title":"Generative Adversarial Networks to Synthetically Augment Data for Deep Learning based Image Segmentation","year":2018,"biburl":"https://bibbase.org/service/mendeley/53d1e3c7-2f16-3c81-9a84-dccd45be4841","dataSources":["6jn29mijTw27iZTdN","ya2CyA73rpZseyrZ8","2252seNhipfTmjEBQ"]}