# Prokhorov's theorem

In measure theory Prokhorov’s theorem relates tightness of measures to relative compactness (and hence weak convergence) in the space of probability measures. It is credited to the Soviet mathematician Yuri Vasilevich Prokhorov, who considered probability measures on complete separable metric spaces. The term "Prokhorov’s theorem" is also applied to later generalizations to either the direct or the inverse statements.

## Statement of the theorem

Let $(S, \rho)$ be a separable metric space. Let $\mathcal{P}(S)$ denote the collection of all probability measures defined on $S$ (with its Borel σ-algebra).

Theorem.

1. A collection $K\subset \mathcal{P}(S)$ of probability measures is tight if and only if the closure of $K$ is sequentially compact in the space $\mathcal{P}(S)$ equipped with the topology of weak convergence.
2. The space $\mathcal{P}(S)$ with the topology of weak convergence is metrizable.
3. Suppose that in addition, $(S,\rho)$ is a complete metric (so that $(S,\rho)$ is a Polish space). There is a complete metric $d_0$ on $\mathcal{P}(S)$ equivalent to the topology of weak convergence; moreover, $K\subset \mathcal{P}(S)$ is tight if and only if the closure of $K$ in $(\mathcal{P}(S),d_0)$ is compact.
↑Jump back a section

## Corollaries

For Euclidean spaces we have that:

• If $(\mu_n)$ is a tight sequence in $\mathcal{P}(\mathbb{R}^k)$ (the collection of probability measures on $k$-dimensional Euclidean space), then there exist a subsequence $(\mu_{n_k})$ and a probability measure $\mu\in\mathcal{P}(\mathbb{R}^k)$ such that $\mu_{n_k}$ converges weakly to $\mu$.
• If $(\mu_n)$ is a tight sequence in $\mathcal{P}(\mathbb{R}^k)$ such that every weakly convergent subsequence $(\mu_{n_k})$ has the same limit $\mu\in\mathcal{P}(\mathbb{R}^k)$, then the sequence $(\mu_n)$ converges weakly to $\mu$.
↑Jump back a section

## Extension

Prokhorov's theorem can be extended to consider complex measures or finite signed measures.

Theorem: Suppose that $(S,\rho)$ is a complete separable metric space and $\Pi$ is a family of Borel complex measures on $S$.The following statements are equivalent:

• $\Pi$ is sequentially compact; that is, every sequence $\{\mu_n\}\subset\Pi$ has a weakly convergent subsequence.
• $\Pi$ is tight and uniformly bounded in total variation norm.
↑Jump back a section

Since Prokhorov's theorem expresses tightness in terms of compactness, the Arzelà-Ascoli theorem is often used to substitute for compactness: in function spaces, this leads to a characterization of tightness in terms of the modulus of continuity or an appropriate analogue — see tightness in classical Wiener space and tightness in Skorokhod space.

There are several deep and non-trivial extension's to Prokhorov's theorem. However, those results do not overshadow the importance and the relevance to applications of the original result.

↑Jump back a section

## References

• Billingsley, Patrick (1999). Convergence of Probability Measures. New York, NY: John Wiley & Sons, Inc. ISBN 0-471-19745-9.
• Bogachev, Vladimir (2006). Measure Theory Vol 1 and 2. Springer. ISBN 978-3-540-34513-8.
• Prokhorov, Yuri V. (1956). "Convergence of random processes and limit theorems in probability theory". Theory of Prob. And Appl. I (in English translation) 2 (2): 157–214. doi:10.1137/1101016.
• Dudley, Richard. M. (1989). Real analysis and Probability. Chapman & Hall. ISBN 0-412-05161-3.
↑Jump back a section