Analyzing Inverse Problems with Invertible Neural Networks

Analyzing Inverse Problems with Invertible Neural Networks. Ardizzone, L., Kruse, J., Wirkert, S., Rahner, D., Pellegrini, E. W., Klessen, R. S., Maier-Hein, L., Rother, C., & Köthe, U. August, 2018.

Paper abstract bibtex

In many tasks, in particular in natural science, the goal is to determine hidden system parameters from a set of measurements. Often, the forward process from parameter- to measurement-space is a well-defined function, whereas the inverse problem is ambiguous: one measurement may map to multiple different sets of parameters. In this setting, the posterior parameter distribution, conditioned on an input measurement, has to be determined. We argue that a particular class of neural networks is well suited for this task – so-called Invertible Neural Networks (INNs). Although INNs are not new, they have, so far, received little attention in literature. While classical neural networks attempt to solve the ambiguous inverse problem directly, INNs are able to learn it jointly with the well-defined forward process, using additional latent output variables to capture the information otherwise lost. Given a specific measurement and sampled latent variables, the inverse pass of the INN provides a full distribution over parameter space. We verify experimentally, on artificial data and real-world problems from astrophysics and medicine, that INNs are a powerful analysis tool to find multi-modalities in parameter space, to uncover parameter correlations, and to identify unrecoverable parameters.

@article{ardizzone_analyzing_2018,
	title = {Analyzing {Inverse} {Problems} with {Invertible} {Neural} {Networks}},
	url = {https://arxiv.org/abs/1808.04730v3},
	abstract = {In many tasks, in particular in natural science, the goal is to determine
hidden system parameters from a set of measurements. Often, the forward process
from parameter- to measurement-space is a well-defined function, whereas the
inverse problem is ambiguous: one measurement may map to multiple different
sets of parameters. In this setting, the posterior parameter distribution,
conditioned on an input measurement, has to be determined. We argue that a
particular class of neural networks is well suited for this task -- so-called
Invertible Neural Networks (INNs). Although INNs are not new, they have, so
far, received little attention in literature. While classical neural networks
attempt to solve the ambiguous inverse problem directly, INNs are able to learn
it jointly with the well-defined forward process, using additional latent
output variables to capture the information otherwise lost. Given a specific
measurement and sampled latent variables, the inverse pass of the INN provides
a full distribution over parameter space. We verify experimentally, on
artificial data and real-world problems from astrophysics and medicine, that
INNs are a powerful analysis tool to find multi-modalities in parameter space,
to uncover parameter correlations, and to identify unrecoverable parameters.},
	language = {en},
	urldate = {2019-11-07},
	author = {Ardizzone, Lynton and Kruse, Jakob and Wirkert, Sebastian and Rahner, Daniel and Pellegrini, Eric W. and Klessen, Ralf S. and Maier-Hein, Lena and Rother, Carsten and Köthe, Ullrich},
	month = aug,
	year = {2018}
}

Downloads: 0

{"_id":"mHzHKBJwXYrHH7ZKW","bibbaseid":"ardizzone-kruse-wirkert-rahner-pellegrini-klessen-maierhein-rother-etal-analyzinginverseproblemswithinvertibleneuralnetworks-2018","authorIDs":[],"author_short":["Ardizzone, L.","Kruse, J.","Wirkert, S.","Rahner, D.","Pellegrini, E. W.","Klessen, R. S.","Maier-Hein, L.","Rother, C.","Köthe, U."],"bibdata":{"bibtype":"article","type":"article","title":"Analyzing Inverse Problems with Invertible Neural Networks","url":"https://arxiv.org/abs/1808.04730v3","abstract":"In many tasks, in particular in natural science, the goal is to determine hidden system parameters from a set of measurements. Often, the forward process from parameter- to measurement-space is a well-defined function, whereas the inverse problem is ambiguous: one measurement may map to multiple different sets of parameters. In this setting, the posterior parameter distribution, conditioned on an input measurement, has to be determined. We argue that a particular class of neural networks is well suited for this task – so-called Invertible Neural Networks (INNs). Although INNs are not new, they have, so far, received little attention in literature. While classical neural networks attempt to solve the ambiguous inverse problem directly, INNs are able to learn it jointly with the well-defined forward process, using additional latent output variables to capture the information otherwise lost. Given a specific measurement and sampled latent variables, the inverse pass of the INN provides a full distribution over parameter space. We verify experimentally, on artificial data and real-world problems from astrophysics and medicine, that INNs are a powerful analysis tool to find multi-modalities in parameter space, to uncover parameter correlations, and to identify unrecoverable parameters.","language":"en","urldate":"2019-11-07","author":[{"propositions":[],"lastnames":["Ardizzone"],"firstnames":["Lynton"],"suffixes":[]},{"propositions":[],"lastnames":["Kruse"],"firstnames":["Jakob"],"suffixes":[]},{"propositions":[],"lastnames":["Wirkert"],"firstnames":["Sebastian"],"suffixes":[]},{"propositions":[],"lastnames":["Rahner"],"firstnames":["Daniel"],"suffixes":[]},{"propositions":[],"lastnames":["Pellegrini"],"firstnames":["Eric","W."],"suffixes":[]},{"propositions":[],"lastnames":["Klessen"],"firstnames":["Ralf","S."],"suffixes":[]},{"propositions":[],"lastnames":["Maier-Hein"],"firstnames":["Lena"],"suffixes":[]},{"propositions":[],"lastnames":["Rother"],"firstnames":["Carsten"],"suffixes":[]},{"propositions":[],"lastnames":["Köthe"],"firstnames":["Ullrich"],"suffixes":[]}],"month":"August","year":"2018","bibtex":"@article{ardizzone_analyzing_2018,\n\ttitle = {Analyzing {Inverse} {Problems} with {Invertible} {Neural} {Networks}},\n\turl = {https://arxiv.org/abs/1808.04730v3},\n\tabstract = {In many tasks, in particular in natural science, the goal is to determine\nhidden system parameters from a set of measurements. Often, the forward process\nfrom parameter- to measurement-space is a well-defined function, whereas the\ninverse problem is ambiguous: one measurement may map to multiple different\nsets of parameters. In this setting, the posterior parameter distribution,\nconditioned on an input measurement, has to be determined. We argue that a\nparticular class of neural networks is well suited for this task -- so-called\nInvertible Neural Networks (INNs). Although INNs are not new, they have, so\nfar, received little attention in literature. While classical neural networks\nattempt to solve the ambiguous inverse problem directly, INNs are able to learn\nit jointly with the well-defined forward process, using additional latent\noutput variables to capture the information otherwise lost. Given a specific\nmeasurement and sampled latent variables, the inverse pass of the INN provides\na full distribution over parameter space. We verify experimentally, on\nartificial data and real-world problems from astrophysics and medicine, that\nINNs are a powerful analysis tool to find multi-modalities in parameter space,\nto uncover parameter correlations, and to identify unrecoverable parameters.},\n\tlanguage = {en},\n\turldate = {2019-11-07},\n\tauthor = {Ardizzone, Lynton and Kruse, Jakob and Wirkert, Sebastian and Rahner, Daniel and Pellegrini, Eric W. and Klessen, Ralf S. and Maier-Hein, Lena and Rother, Carsten and Köthe, Ullrich},\n\tmonth = aug,\n\tyear = {2018}\n}\n\n","author_short":["Ardizzone, L.","Kruse, J.","Wirkert, S.","Rahner, D.","Pellegrini, E. W.","Klessen, R. S.","Maier-Hein, L.","Rother, C.","Köthe, U."],"key":"ardizzone_analyzing_2018","id":"ardizzone_analyzing_2018","bibbaseid":"ardizzone-kruse-wirkert-rahner-pellegrini-klessen-maierhein-rother-etal-analyzinginverseproblemswithinvertibleneuralnetworks-2018","role":"author","urls":{"Paper":"https://arxiv.org/abs/1808.04730v3"},"downloads":0},"bibtype":"article","biburl":"https://bibbase.org/zotero/carlosgogo","creationDate":"2019-12-13T10:16:40.655Z","downloads":0,"keywords":[],"search_terms":["analyzing","inverse","problems","invertible","neural","networks","ardizzone","kruse","wirkert","rahner","pellegrini","klessen","maier-hein","rother","köthe"],"title":"Analyzing Inverse Problems with Invertible Neural Networks","year":2018,"dataSources":["8KsDsKJXTPZFnaHDn"]}