Inpainting hydrodynamical maps with deep learning. Mohammad, F. G., Villaescusa-Navarro, F., Genel, S., Angles-Alcazar, D., & Vogelsberger, M. *arXiv:2109.07070 [astro-ph]*, September, 2021. arXiv: 2109.07070

Paper abstract bibtex

Paper abstract bibtex

From 1,000 hydrodynamic simulations of the CAMELS project, each with a different value of the cosmological and astrophysical parameters, we generate 15,000 gas temperature maps. We use a state-of-the-art deep convolutional neural network to recover missing data from those maps. We mimic the missing data by applying regular and irregular binary masks that cover either \$15{\textbackslash}%\$ or \$30{\textbackslash}%\$ of the area of each map. We quantify the reliability of our results using two summary statistics: 1) the distance between the probability density functions (pdf), estimated using the Kolmogorov-Smirnov (KS) test, and 2) the 2D power spectrum. We find an excellent agreement between the model prediction and the unmasked maps when using the power spectrum: better than \$1{\textbackslash}%\$ for \$k{\textless}20 h/\$Mpc for any irregular mask. For regular masks, we observe a systematic offset of \${\textbackslash}sim5{\textbackslash}%\$ when covering \$15{\textbackslash}%\$ of the maps while the results become unreliable when \$30{\textbackslash}%\$ of the data is missing. The observed KS-test p-values favor the null hypothesis that the reconstructed and the ground-truth maps are drawn from the same underlying distribution when irregular masks are used. For regular-shaped masks on the other hand, we find a strong evidence that the two distributions do not match each other. Finally, we use the model, trained on gas temperature maps, to perform inpainting on maps from completely different fields such as gas mass, gas pressure, and electron density and also for gas temperature maps from simulations run with other codes. We find that visually, our model is able to reconstruct the missing pixels from the maps of those fields with great accuracy, although its performance using summary statistics depends strongly on the considered field.

@article{mohammad_inpainting_2021, title = {Inpainting hydrodynamical maps with deep learning}, url = {http://arxiv.org/abs/2109.07070}, abstract = {From 1,000 hydrodynamic simulations of the CAMELS project, each with a different value of the cosmological and astrophysical parameters, we generate 15,000 gas temperature maps. We use a state-of-the-art deep convolutional neural network to recover missing data from those maps. We mimic the missing data by applying regular and irregular binary masks that cover either \$15{\textbackslash}\%\$ or \$30{\textbackslash}\%\$ of the area of each map. We quantify the reliability of our results using two summary statistics: 1) the distance between the probability density functions (pdf), estimated using the Kolmogorov-Smirnov (KS) test, and 2) the 2D power spectrum. We find an excellent agreement between the model prediction and the unmasked maps when using the power spectrum: better than \$1{\textbackslash}\%\$ for \$k{\textless}20 h/\$Mpc for any irregular mask. For regular masks, we observe a systematic offset of \${\textbackslash}sim5{\textbackslash}\%\$ when covering \$15{\textbackslash}\%\$ of the maps while the results become unreliable when \$30{\textbackslash}\%\$ of the data is missing. The observed KS-test p-values favor the null hypothesis that the reconstructed and the ground-truth maps are drawn from the same underlying distribution when irregular masks are used. For regular-shaped masks on the other hand, we find a strong evidence that the two distributions do not match each other. Finally, we use the model, trained on gas temperature maps, to perform inpainting on maps from completely different fields such as gas mass, gas pressure, and electron density and also for gas temperature maps from simulations run with other codes. We find that visually, our model is able to reconstruct the missing pixels from the maps of those fields with great accuracy, although its performance using summary statistics depends strongly on the considered field.}, urldate = {2021-10-25}, journal = {arXiv:2109.07070 [astro-ph]}, author = {Mohammad, Faizan G. and Villaescusa-Navarro, Francisco and Genel, Shy and Angles-Alcazar, Daniel and Vogelsberger, Mark}, month = sep, year = {2021}, note = {arXiv: 2109.07070}, keywords = {Astrophysics - Cosmology and Nongalactic Astrophysics}, }

Downloads: 0

{"_id":"wzbZuYsDKnH5DvG3n","bibbaseid":"mohammad-villaescusanavarro-genel-anglesalcazar-vogelsberger-inpaintinghydrodynamicalmapswithdeeplearning-2021","author_short":["Mohammad, F. G.","Villaescusa-Navarro, F.","Genel, S.","Angles-Alcazar, D.","Vogelsberger, M."],"bibdata":{"bibtype":"article","type":"article","title":"Inpainting hydrodynamical maps with deep learning","url":"http://arxiv.org/abs/2109.07070","abstract":"From 1,000 hydrodynamic simulations of the CAMELS project, each with a different value of the cosmological and astrophysical parameters, we generate 15,000 gas temperature maps. We use a state-of-the-art deep convolutional neural network to recover missing data from those maps. We mimic the missing data by applying regular and irregular binary masks that cover either \\$15{\\textbackslash}%\\$ or \\$30{\\textbackslash}%\\$ of the area of each map. We quantify the reliability of our results using two summary statistics: 1) the distance between the probability density functions (pdf), estimated using the Kolmogorov-Smirnov (KS) test, and 2) the 2D power spectrum. We find an excellent agreement between the model prediction and the unmasked maps when using the power spectrum: better than \\$1{\\textbackslash}%\\$ for \\$k{\\textless}20 h/\\$Mpc for any irregular mask. For regular masks, we observe a systematic offset of \\${\\textbackslash}sim5{\\textbackslash}%\\$ when covering \\$15{\\textbackslash}%\\$ of the maps while the results become unreliable when \\$30{\\textbackslash}%\\$ of the data is missing. The observed KS-test p-values favor the null hypothesis that the reconstructed and the ground-truth maps are drawn from the same underlying distribution when irregular masks are used. For regular-shaped masks on the other hand, we find a strong evidence that the two distributions do not match each other. Finally, we use the model, trained on gas temperature maps, to perform inpainting on maps from completely different fields such as gas mass, gas pressure, and electron density and also for gas temperature maps from simulations run with other codes. We find that visually, our model is able to reconstruct the missing pixels from the maps of those fields with great accuracy, although its performance using summary statistics depends strongly on the considered field.","urldate":"2021-10-25","journal":"arXiv:2109.07070 [astro-ph]","author":[{"propositions":[],"lastnames":["Mohammad"],"firstnames":["Faizan","G."],"suffixes":[]},{"propositions":[],"lastnames":["Villaescusa-Navarro"],"firstnames":["Francisco"],"suffixes":[]},{"propositions":[],"lastnames":["Genel"],"firstnames":["Shy"],"suffixes":[]},{"propositions":[],"lastnames":["Angles-Alcazar"],"firstnames":["Daniel"],"suffixes":[]},{"propositions":[],"lastnames":["Vogelsberger"],"firstnames":["Mark"],"suffixes":[]}],"month":"September","year":"2021","note":"arXiv: 2109.07070","keywords":"Astrophysics - Cosmology and Nongalactic Astrophysics","bibtex":"@article{mohammad_inpainting_2021,\n\ttitle = {Inpainting hydrodynamical maps with deep learning},\n\turl = {http://arxiv.org/abs/2109.07070},\n\tabstract = {From 1,000 hydrodynamic simulations of the CAMELS project, each with a different value of the cosmological and astrophysical parameters, we generate 15,000 gas temperature maps. We use a state-of-the-art deep convolutional neural network to recover missing data from those maps. We mimic the missing data by applying regular and irregular binary masks that cover either \\$15{\\textbackslash}\\%\\$ or \\$30{\\textbackslash}\\%\\$ of the area of each map. We quantify the reliability of our results using two summary statistics: 1) the distance between the probability density functions (pdf), estimated using the Kolmogorov-Smirnov (KS) test, and 2) the 2D power spectrum. We find an excellent agreement between the model prediction and the unmasked maps when using the power spectrum: better than \\$1{\\textbackslash}\\%\\$ for \\$k{\\textless}20 h/\\$Mpc for any irregular mask. For regular masks, we observe a systematic offset of \\${\\textbackslash}sim5{\\textbackslash}\\%\\$ when covering \\$15{\\textbackslash}\\%\\$ of the maps while the results become unreliable when \\$30{\\textbackslash}\\%\\$ of the data is missing. The observed KS-test p-values favor the null hypothesis that the reconstructed and the ground-truth maps are drawn from the same underlying distribution when irregular masks are used. For regular-shaped masks on the other hand, we find a strong evidence that the two distributions do not match each other. Finally, we use the model, trained on gas temperature maps, to perform inpainting on maps from completely different fields such as gas mass, gas pressure, and electron density and also for gas temperature maps from simulations run with other codes. We find that visually, our model is able to reconstruct the missing pixels from the maps of those fields with great accuracy, although its performance using summary statistics depends strongly on the considered field.},\n\turldate = {2021-10-25},\n\tjournal = {arXiv:2109.07070 [astro-ph]},\n\tauthor = {Mohammad, Faizan G. and Villaescusa-Navarro, Francisco and Genel, Shy and Angles-Alcazar, Daniel and Vogelsberger, Mark},\n\tmonth = sep,\n\tyear = {2021},\n\tnote = {arXiv: 2109.07070},\n\tkeywords = {Astrophysics - Cosmology and Nongalactic Astrophysics},\n}\n\n","author_short":["Mohammad, F. G.","Villaescusa-Navarro, F.","Genel, S.","Angles-Alcazar, D.","Vogelsberger, M."],"key":"mohammad_inpainting_2021","id":"mohammad_inpainting_2021","bibbaseid":"mohammad-villaescusanavarro-genel-anglesalcazar-vogelsberger-inpaintinghydrodynamicalmapswithdeeplearning-2021","role":"author","urls":{"Paper":"http://arxiv.org/abs/2109.07070"},"keyword":["Astrophysics - Cosmology and Nongalactic Astrophysics"],"metadata":{"authorlinks":{}}},"bibtype":"article","biburl":"https://bibbase.org/zotero/polyphant","dataSources":["7gvjSdWrEu7z5vjjj"],"keywords":["astrophysics - cosmology and nongalactic astrophysics"],"search_terms":["inpainting","hydrodynamical","maps","deep","learning","mohammad","villaescusa-navarro","genel","angles-alcazar","vogelsberger"],"title":"Inpainting hydrodynamical maps with deep learning","year":2021}