Talk:Cross-entropy
 | This article is rated Start-class on Wikipedia's content assessment scale. It is of interest to the following WikiProjects: | ||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||
.jpg){kind=small}
Wiki Education Foundation-supported course assignment edit
This article is or was the subject of a Wiki Education Foundation-supported course assignment. Further details are available on the course page. Student editor(s): Chrishaack.
Above undated message substituted from Template:Dashboard.wikiedu.org assignment by PrimeBOT (talk) 18:42, 16 January 2022 (UTC)
Untitled edit
This article uses the notation KL(p, q) and also DKL(p || m) when talking about Kullback-Leibler divergence. Are these notations two ways of expressing the same idea? If so, the article may want to indicate this equivalence.
The log-likelihood of the training data for a multinomial model is the same as the cross-entropy of the data. (Elements of Statistical Learning, page 32)
L(theta) = sum (all classes k) I(G=k) log Pr(G=k | X = x)
I guess "I(G=k)" is p and Pr(G=k | X=x) is q here.
Could somebody in the know please add this? Thanks!
WikiProject class rating edit
This article was automatically assessed because at least one WikiProject had rated the article as stub, and the rating on other projects was brought up to Stub class. BetacommandBot 09:46, 10 November 2007 (UTC)
To improve clarity, this stub should be merged into the "Kullback–Leibler divergence" article. "Cross entropy" and "relative entropy" refer to the same quantity in the literature, at least up to a sign convention. DRB (talk) 00:39, 15 January 2010 (UTC)
- Hmmm... fair idea but not a cut-and-dry case. maybe put a merge tag on it, at least. Kevin Baastalk 14:07, 15 January 2010 (UTC)
What's missing edit
At least one analogy or example would be most helpful. I get no sense at all as to what this article is attempting to describe. Marc W. Abel (talk) 02:24, 7 May 2012 (UTC)
Why is "cross-entropy" not hyphenated in the title of the page? edit
In the text, "cross-entropy" is written with a hyphen every time (as I believe to be correct). In the title of the page, however, it is not hyphenated. Why is this? — Preceding unsigned comment added by Thomas Tvileren (talk • contribs) 12:48, 27 May 2022 (UTC)