Information Decomposition and Synergy. Olbrich, E, Bertschinger, N, & Rauh, J Entropy, 17(5):3501--3517, 2015.
Information Decomposition and Synergy [link]Paper  doi  abstract   bibtex   
Recently, a series of papers addressed the problem of decomposing the information of two random variables into shared information, unique information and synergistic information. Several measures were proposed, although still no consensus has been reached. Here, we compare these proposals with an older approach to define synergistic information based on the projections on exponential families containing only up to k-th order interactions. We show that these measures are not compatible with a decomposition into unique, shared and synergistic information if one requires that all terms are always non-negative (local positivity). We illustrate the difference between the two measures for multivariate Gaussians.
@article{Olbrich2015,
abstract = {Recently, a series of papers addressed the problem of decomposing the information of two random variables into shared information, unique information and synergistic information. Several measures were proposed, although still no consensus has been reached. Here, we compare these proposals with an older approach to define synergistic information based on the projections on exponential families containing only up to k-th order interactions. We show that these measures are not compatible with a decomposition into unique, shared and synergistic information if one requires that all terms are always non-negative (local positivity). We illustrate the difference between the two measures for multivariate Gaussians.},
author = {Olbrich, E and Bertschinger, N and Rauh, J},
doi = {10.3390/e17053501},
file = {:Users/brekels/Documents/Mendeley Desktop/Information Decomposition and Synergy - Olbrich, Bertschinger, Rauh.pdf:pdf},
issn = {1099-4300},
journal = {Entropy},
keywords = {"Shannon information,-k,70,75,89,94a15,94a17,cf,information,information decomposition,msc classifications,mutual information,pacs classifications,shannon information,shared,shared information,synergy,synergy"},
number = {5},
pages = {3501--3517},
title = {{Information Decomposition and Synergy}},
url = {http://www.mdpi.com/1099-4300/17/5/3501},
volume = {17},
year = {2015}
}

Downloads: 0