Talk:Conditional mutual information

I think the section "Multivariate mutual information" should be renamed. "Multivariate mutual information" is a term that simply does not exist in the literature and is defined and used solely within Wikipedia. I think it is inappropriate for wikipedia to be a primary source for the definition of terms. Other terms for the same (or oppositely signed quantity) include co-information (Bell 2003), multiple mutual information (Han 1980), interaction information (opposite sign) (McGill 1954) or separately as redundancy or synergy (Gawne and Richmond 1993; Schneidman et al. 2003). Without a reference to a published source which defines and uses the term "multivariate mutual information" I think it is confusing and misleading to have it on wikipedia. It is anyway a very ambiguous term as mutual information between two multidimensional variables might very well be (and frequency is) referred to as multivariate mutual information. 130.209.89.69 (talk) 14:06, 7 April 2016 (UTC)

References for formulas

I am looking for a reference for the formula:

$I(X;Y|Z)=H(Z|X)+H(X)+H(Z|Y)+H(Y)-H(Z|X,Y)-H(X,Y)-H(Z)=I(X;Y)+H(Z|X)+H(Z|Y)-H(Z|X,Y)-H(Z)$

I checked but couldn't find it in it. Magomahot (talk) 06:07, 19 July 2016 (UTC)

• _{There is now a link to StackExchange answering this question. I also replaced the ref which seemed mis-cited there by a ref to which is more appropriate. Magomahot (talk) 00:43, 20 July 2016 (UTC)}

References

Slight Notation Confusion

Maybe this is just my unfamiliarity with the topic, but what is meant by the notation in this section: $I(X;Y,Z)$? Is this the same thing as Interaction Information, which is notated $I(X;Y;Z)$? Zjwilliams20 (talk) 15:26, 23 February 2024 (UTC)