Chi distribution

See also: Chi-squared distribution

In probability theory and statistics, the chi distribution is a continuous probability distribution. It is the distribution of the positive square root of the sum of squares of a set of independent random variables each following a standard normal distribution, or equivalently, the distribution of the Euclidean distance of the random variables from the origin. It is thus related to the chi-squared distribution by describing the distribution of the positive square roots of a variable obeying a chi-squared distribution.

chi

Probability density function
Cumulative distribution function
Parameters	$k>0\,$ (degrees of freedom)
Support	$x\in [0,\infty )$
PDF	${\frac {1}{2^{(k/2)-1}\Gamma (k/2)}}\;x^{k-1}e^{-x^{2}/2}$
CDF	$P(k/2,x^{2}/2)\,$
Mean	$\mu ={\sqrt {2}}\,{\frac {\Gamma ((k+1)/2)}{\Gamma (k/2)}}$
Median	$\approx {\sqrt {k{\bigg (}1-{\frac {2}{9k}}{\bigg )}^{3}}}$
Mode	${\sqrt {k-1}}\,$ for $k\geq 1$
Variance	$\sigma ^{2}=k-\mu ^{2}\,$
Skewness	$\gamma _{1}={\frac {\mu }{\sigma ^{3}}}\,(1-2\sigma ^{2})$
Ex. kurtosis	${\frac {2}{\sigma ^{2}}}(1-\mu \sigma \gamma _{1}-\sigma ^{2})$
Entropy	$\ln(\Gamma (k/2))+\,$ ${\frac {1}{2}}(k\!-\!\ln(2)\!-\!(k\!-\!1)\psi _{0}(k/2))$
MGF	Complicated (see text)
CF	Complicated (see text)

If $Z_{1},\ldots ,Z_{k}$ are $k$ independent, normally distributed random variables with mean 0 and standard deviation 1, then the statistic

$Y={\sqrt {\sum _{i=1}^{k}Z_{i}^{2}}}$

is distributed according to the chi distribution. The chi distribution has one parameter, $k$, which specifies the number of degrees of freedom (i.e. the number of $Z_{i}$).

The most familiar examples are the Rayleigh distribution (chi distribution with two degrees of freedom) and the Maxwell–Boltzmann distribution of the molecular speeds in an ideal gas (chi distribution with three degrees of freedom).

Definitions

Probability density function

The probability density function (pdf) of the chi-distribution is

$f(x;k)={\begin{cases}{\dfrac {x^{k-1}e^{-x^{2}/2}}{2^{k/2-1}\Gamma \left({\frac {k}{2}}\right)}},&x\geq 0;\\0,&{\text{otherwise}}.\end{cases}}$

where $\Gamma (z)$ is the gamma function.

Cumulative distribution function

The cumulative distribution function is given by:

$F(x;k)=P(k/2,x^{2}/2)\,$

where $P(k,x)$ is the regularized gamma function.

Generating functions

The moment-generating function is given by:

$M(t)=M\left({\frac {k}{2}},{\frac {1}{2}},{\frac {t^{2}}{2}}\right)+t{\sqrt {2}}\,{\frac {\Gamma ((k+1)/2)}{\Gamma (k/2)}}M\left({\frac {k+1}{2}},{\frac {3}{2}},{\frac {t^{2}}{2}}\right),$

where $M(a,b,z)$ is Kummer's confluent hypergeometric function. The characteristic function is given by:

$\varphi (t;k)=M\left({\frac {k}{2}},{\frac {1}{2}},{\frac {-t^{2}}{2}}\right)+it{\sqrt {2}}\,{\frac {\Gamma ((k+1)/2)}{\Gamma (k/2)}}M\left({\frac {k+1}{2}},{\frac {3}{2}},{\frac {-t^{2}}{2}}\right).$

Properties

Moments

The raw moments are then given by:

$\mu _{j}=\int _{0}^{\infty }f(x;k)x^{j}dx=2^{j/2}{\frac {\Gamma ((k+j)/2)}{\Gamma (k/2)}}$

where $\Gamma (z)$ is the gamma function. Thus the first few raw moments are:

$\mu _{1}={\sqrt {2}}\,\,{\frac {\Gamma ((k\!+\!1)/2)}{\Gamma (k/2)}}$

$\mu _{2}=k\,$

$\mu _{3}=2{\sqrt {2}}\,\,{\frac {\Gamma ((k\!+\!3)/2)}{\Gamma (k/2)}}=(k+1)\mu _{1}$

$\mu _{4}=(k)(k+2)\,$

$\mu _{5}=4{\sqrt {2}}\,\,{\frac {\Gamma ((k\!+\!5)/2)}{\Gamma (k/2)}}=(k+1)(k+3)\mu _{1}$

$\mu _{6}=(k)(k+2)(k+4)\,$

where the rightmost expressions are derived using the recurrence relationship for the gamma function:

$\Gamma (x+1)=x\Gamma (x)\,$

From these expressions we may derive the following relationships:

Mean: $\mu ={\sqrt {2}}\,\,{\frac {\Gamma ((k+1)/2)}{\Gamma (k/2)}}$, which is close to ${\sqrt {k-{\tfrac {1}{2}}}}$ for large k

Variance: $V=k-\mu ^{2}\,$, which approaches ${\tfrac {1}{2}}$ as k increases

Skewness: $\gamma _{1}={\frac {\mu }{\sigma ^{3}}}\,(1-2\sigma ^{2})$

Kurtosis excess: $\gamma _{2}={\frac {2}{\sigma ^{2}}}(1-\mu \sigma \gamma _{1}-\sigma ^{2})$

Entropy

The entropy is given by:

$S=\ln(\Gamma (k/2))+{\frac {1}{2}}(k\!-\!\ln(2)\!-\!(k\!-\!1)\psi ^{0}(k/2))$

where $\psi ^{0}(z)$ is the polygamma function.

Large n approximation

We find the large n=k+1 approximation of the mean and variance of chi distribution. This has application e.g. in finding the distribution of standard deviation of a sample of normally distributed population, where n is the sample size.

The mean is then:

$\mu ={\sqrt {2}}\,\,{\frac {\Gamma (n/2)}{\Gamma ((n-1)/2)}}$

We use the Legendre duplication formula to write:

$2^{n-2}\,\Gamma ((n-1)/2)\cdot \Gamma (n/2)={\sqrt {\pi }}\Gamma (n-1)$,

so that:

$\mu ={\sqrt {2/\pi }}\,2^{n-2}\,{\frac {(\Gamma (n/2))^{2}}{\Gamma (n-1)}}$

Using Stirling's approximation for Gamma function, we get the following expression for the mean:

$\mu ={\sqrt {2/\pi }}\,2^{n-2}\,{\frac {\left({\sqrt {2\pi }}(n/2-1)^{n/2-1+1/2}e^{-(n/2-1)}\cdot [1+{\frac {1}{12(n/2-1)}}+O({\frac {1}{n^{2}}})]\right)^{2}}{{\sqrt {2\pi }}(n-2)^{n-2+1/2}e^{-(n-2)}\cdot [1+{\frac {1}{12(n-2)}}+O({\frac {1}{n^{2}}})]}}$

$=(n-2)^{1/2}\,\cdot \left[1+{\frac {1}{4n}}+O({\frac {1}{n^{2}}})\right]={\sqrt {n-1}}\,(1-{\frac {1}{n-1}})^{1/2}\cdot \left[1+{\frac {1}{4n}}+O({\frac {1}{n^{2}}})\right]$

$={\sqrt {n-1}}\,\cdot \left[1-{\frac {1}{2n}}+O({\frac {1}{n^{2}}})\right]\,\cdot \left[1+{\frac {1}{4n}}+O({\frac {1}{n^{2}}})\right]$

$={\sqrt {n-1}}\,\cdot \left[1-{\frac {1}{4n}}+O({\frac {1}{n^{2}}})\right]$

And thus the variance is:

$V=(n-1)-\mu ^{2}\,=(n-1)\cdot {\frac {1}{2n}}\,\cdot \left[1+O({\frac {1}{n}})\right]$

Related distributions

• If $X\sim \chi _{k}$ then $X^{2}\sim \chi _{k}^{2}$ (chi-squared distribution)
• $\lim _{k\to \infty }{\tfrac {\chi _{k}-\mu _{k}}{\sigma _{k}}}{\xrightarrow {d}}\ N(0,1)\,$ (Normal distribution)
• If $X\sim N(0,1)\,$ then $|X|\sim \chi _{1}\,$
• If $X\sim \chi _{1}\,$ then $\sigma X\sim HN(\sigma )\,$ (half-normal distribution) for any $\sigma >0\,$
• $\chi _{2}\sim \mathrm {Rayleigh} (1)\,$ (Rayleigh distribution)
• $\chi _{3}\sim \mathrm {Maxwell} (1)\,$ (Maxwell distribution)
• $\|{\boldsymbol {N}}_{i=1,\ldots ,k}{(0,1)}\|_{2}\sim \chi _{k}$ (The 2-norm of $k$ standard normally distributed variables is a chi distribution with $k$ degrees of freedom)
• chi distribution is a special case of the generalized gamma distribution or the Nakagami distribution or the noncentral chi distribution
• The mean of the chi distribution (scaled by the square root of $n-1$) yields the correction factor in the unbiased estimation of the standard deviation of the normal distribution.

Various chi and chi-squared distributions

Name	Statistic
chi-squared distribution	$\sum _{i=1}^{k}\left({\frac {X_{i}-\mu _{i}}{\sigma _{i}}}\right)^{2}$
noncentral chi-squared distribution	$\sum _{i=1}^{k}\left({\frac {X_{i}}{\sigma _{i}}}\right)^{2}$
chi distribution	${\sqrt {\sum _{i=1}^{k}\left({\frac {X_{i}-\mu _{i}}{\sigma _{i}}}\right)^{2}}}$
noncentral chi distribution	${\sqrt {\sum _{i=1}^{k}\left({\frac {X_{i}}{\sigma _{i}}}\right)^{2}}}$

See also

• Nakagami distribution

References

• Martha L. Abell, James P. Braselton, John Arthur Rafter, John A. Rafter, Statistics with Mathematica (1999), 237f.
• Jan W. Gooch, Encyclopedic Dictionary of Polymers vol. 1 (2010), Appendix E, p. 972.

External links

• http://mathworld.wolfram.com/ChiDistribution.html