# Bernstein polynomial

(Redirected from Bernstein form)

In the mathematical field of numerical analysis, a Bernstein polynomial is a polynomial that is a linear combination of Bernstein basis polynomials. The idea is named after Sergei Natanovich Bernstein.

Bernstein polynomials approximating a curve

A numerically stable way to evaluate polynomials in Bernstein form is de Casteljau's algorithm.

Polynomials in Bernstein form were first used by Bernstein in a constructive proof for the Weierstrass approximation theorem. With the advent of computer graphics, Bernstein polynomials, restricted to the interval [0, 1], became important in the form of Bézier curves.

Bernstein basis polynomials for 4th degree curve blending

## Definition

The n +1 Bernstein basis polynomials of degree n are defined as

${\displaystyle b_{\nu ,n}(x)={\binom {n}{\nu }}x^{\nu }\left(1-x\right)^{n-\nu },\quad \nu =0,\ldots ,n,}$

where ${\displaystyle {\tbinom {n}{\nu }}}$  is a binomial coefficient.

So, for example, ${\displaystyle b_{2,5}(x)={\tbinom {5}{2}}x^{2}(1-x)^{3}=10x^{2}(1-x)^{3}.}$

The first few Bernstein basis polynomials for blending 1, 2, 3 or 4 values together are:

{\displaystyle {\begin{aligned}b_{0,0}(x)&=1,\\b_{0,1}(x)&=1-x,&b_{1,1}(x)&=x\\b_{0,2}(x)&=(1-x)^{2},&b_{1,2}(x)&=2x(1-x),&b_{2,2}(x)&=x^{2}\\b_{0,3}(x)&=(1-x)^{3},&b_{1,3}(x)&=3x(1-x)^{2},&b_{2,3}(x)&=3x^{2}(1-x),&b_{3,3}(x)&=x^{3}\end{aligned}}}

The Bernstein basis polynomials of degree n form a basis for the vector space ${\displaystyle \Pi _{n}}$  of polynomials of degree at most n with real coefficients. A linear combination of Bernstein basis polynomials

${\displaystyle B_{n}(x)=\sum _{\nu =0}^{n}\beta _{\nu }b_{\nu ,n}(x)}$

is called a Bernstein polynomial or polynomial in Bernstein form of degree n.[1] The coefficients ${\displaystyle \beta _{\nu }}$  are called Bernstein coefficients or Bézier coefficients.

The first few Bernstein basis polynomials from above in monomial form are:

{\displaystyle {\begin{aligned}b_{0,0}(x)&=1,\\b_{0,1}(x)&=1-1x,&b_{1,1}(x)&=0+1x\\b_{0,2}(x)&=1-2x+1x^{2},&b_{1,2}(x)&=0+2x-2x^{2},&b_{2,2}(x)&=0+0x+1x^{2}\\b_{0,3}(x)&=1-3x+3x^{2}-x^{3},&b_{1,3}(x)&=0+3x-6x^{2}+3x^{3},&b_{2,3}(x)&=0+0x+3x^{2}-3x^{3},&b_{3,3}(x)&=0+0x+0x^{2}+1x^{3}\end{aligned}}}

## Properties

The Bernstein basis polynomials have the following properties:

• ${\displaystyle b_{\nu ,n}(x)=0}$ , if ${\displaystyle \nu <0}$  or ${\displaystyle \nu >n.}$
• ${\displaystyle b_{\nu ,n}(x)\geq 0}$  for ${\displaystyle x\in [0,\ 1].}$
• ${\displaystyle b_{\nu ,n}\left(1-x\right)=b_{n-\nu ,n}(x).}$
• ${\displaystyle b_{\nu ,n}(0)=\delta _{\nu ,0}}$  and ${\displaystyle b_{\nu ,n}(1)=\delta _{\nu ,n}}$  where ${\displaystyle \delta }$  is the Kronecker delta function: ${\displaystyle \delta _{ij}={\begin{cases}0&{\text{if }}i\neq j,\\1&{\text{if }}i=j.\end{cases}}}$
• ${\displaystyle b_{\nu ,n}(x)}$  has a root with multiplicity ${\displaystyle \nu }$  at point ${\displaystyle x=0}$  (note: if ${\displaystyle \nu =0}$ , there is no root at 0).
• ${\displaystyle b_{\nu ,n}(x)}$  has a root with multiplicity ${\displaystyle \left(n-\nu \right)}$  at point ${\displaystyle x=1}$  (note: if ${\displaystyle \nu =n}$ , there is no root at 1).
• The derivative can be written as a combination of two polynomials of lower degree:
${\displaystyle b'_{\nu ,n}(x)=n\left(b_{\nu -1,n-1}(x)-b_{\nu ,n-1}(x)\right).}$
• The k:th derivative at 0:

${\displaystyle b_{\nu ,n}^{(k)}(0)=\sum _{\nu =0}^{n}{\frac {n!}{(n-k)!}}{\binom {k}{\nu }}(-1)^{\nu +k}.}$

• The k:th derivative at 1:

${\displaystyle b_{\nu ,n}^{(k)}(1)=(-1)^{k}b_{n-\nu ,n}^{(k)}(0).}$

• The transformation of the Bernstein polynomial to monomials is
${\displaystyle b_{\nu ,n}(x)={\binom {n}{\nu }}\sum _{k=0}^{n-\nu }{\binom {n-\nu }{k}}(-1)^{n-\nu -k}x^{\nu +k}=\sum _{\ell =\nu }^{n}{\binom {n}{\ell }}{\binom {\ell }{\nu }}(-1)^{\ell -\nu }x^{\ell },}$
and by the inverse binomial transformation, the reverse transformation is[2]
${\displaystyle x^{k}=\sum _{i=0}^{n-k}{\binom {n-k}{i}}{\frac {1}{\binom {n}{i}}}b_{n-i,n}(x)={\frac {1}{\binom {n}{k}}}\sum _{j=k}^{n}{\binom {j}{k}}b_{j,n}(x).}$
• The indefinite integral is given by
${\displaystyle \int b_{\nu ,n}(x)dx={\frac {1}{n+1}}\sum _{j=\nu +1}^{n+1}b_{j,n+1}(x).}$
• The definite integral is constant for a given n:
${\displaystyle \int _{0}^{1}b_{\nu ,n}(x)dx={\frac {1}{n+1}}\quad \ \,{\text{for all }}\nu =0,1,\dots ,n.}$
• If ${\displaystyle n\neq 0}$ , then ${\displaystyle b_{\nu ,n}(x)}$  has a unique local maximum on the interval ${\displaystyle [0,\ 1]}$  at ${\displaystyle x={\frac {\nu }{n}}}$ . This maximum takes the value
${\displaystyle \nu ^{\nu }n^{-n}\left(n-\nu \right)^{n-\nu }{n \choose \nu }.}$
• The Bernstein basis polynomials of degree ${\displaystyle n}$  form a partition of unity:
${\displaystyle \sum _{\nu =0}^{n}b_{\nu ,n}(x)=\sum _{\nu =0}^{n}{n \choose \nu }x^{\nu }\left(1-x\right)^{n-\nu }=\left(x+\left(1-x\right)\right)^{n}=1.}$
• By taking the first ${\displaystyle x}$ -derivative of ${\displaystyle (x+y)^{n}}$ , treating ${\displaystyle y}$  as constant, then substituting the value ${\displaystyle y=1-x}$ , it can be shown that
${\displaystyle \sum _{\nu =0}^{n}\nu b_{\nu ,n}(x)=nx.}$
• Similarly the second ${\displaystyle x}$ -derivative of ${\displaystyle (x+y)^{n}}$ , with ${\displaystyle y}$  again then substituted ${\displaystyle y=1-x}$ , shows that
${\displaystyle \sum _{\nu =1}^{n}\nu (\nu -1)b_{\nu ,n}(x)=n(n-1)x^{2}.}$
• A Bernstein polynomial can always be written as a linear combination of polynomials of higher degree:
${\displaystyle b_{\nu ,n-1}(x)={\frac {n-\nu }{n}}b_{\nu ,n}(x)+{\frac {\nu +1}{n}}b_{\nu +1,n}(x).}$
• The expansion of the Chebyshev Polynomials of the First Kind into the Bernstein basis is[3]
${\displaystyle T_{n}(u)=(2n-1)!!\sum _{k=0}^{n}{\frac {(-1)^{n-k}}{(2k-1)!!(2n-2k-1)!!}}b_{k,n}(u).}$

## Approximating continuous functions

Let ƒ be a continuous function on the interval [0, 1]. Consider the Bernstein polynomial

${\displaystyle B_{n}(f)(x)=\sum _{\nu =0}^{n}f\left({\frac {\nu }{n}}\right)b_{\nu ,n}(x).}$

It can be shown that

${\displaystyle \lim _{n\to \infty }{B_{n}(f)}=f}$

uniformly on the interval [0, 1].[4][1][5][6]

Bernstein polynomials thus provide one way to prove the Weierstrass approximation theorem that every real-valued continuous function on a real interval [ab] can be uniformly approximated by polynomial functions over ${\displaystyle \mathbb {R} }$ .[7]

A more general statement for a function with continuous kth derivative is

${\displaystyle {\left\|B_{n}(f)^{(k)}\right\|}_{\infty }\leq {\frac {(n)_{k}}{n^{k}}}\left\|f^{(k)}\right\|_{\infty }\quad \ {\text{and}}\quad \ \left\|f^{(k)}-B_{n}(f)^{(k)}\right\|_{\infty }\to 0,}$

${\displaystyle {\frac {(n)_{k}}{n^{k}}}=\left(1-{\frac {0}{n}}\right)\left(1-{\frac {1}{n}}\right)\cdots \left(1-{\frac {k-1}{n}}\right)}$

is an eigenvalue of Bn; the corresponding eigenfunction is a polynomial of degree k.

### Probabilistic proof

This proof follows Bernstein's original proof of 1912.[8] See also Feller (1966) or Koralov & Sinai (2007).[9][10]

Suppose K is a random variable distributed as the number of successes in n independent Bernoulli trials with probability x of success on each trial; in other words, K has a binomial distribution with parameters n and x. Then we have the expected value ${\displaystyle \operatorname {\mathcal {E}} \left[{\frac {K}{n}}\right]=x\ }$  and

${\displaystyle p(K)={n \choose K}x^{K}\left(1-x\right)^{n-K}=b_{K,n}(x)}$
${\displaystyle \lim _{n\to \infty }{P\left(\left|{\frac {K}{n}}-x\right|>\delta \right)}=0}$

for every δ > 0. Moreover, this relation holds uniformly in x, which can be seen from its proof via Chebyshev's inequality, taking into account that the variance of 1n K, equal to 1n x(1−x), is bounded from above by 1(4n) irrespective of x.

Because ƒ, being continuous on a closed bounded interval, must be uniformly continuous on that interval, one infers a statement of the form

${\displaystyle \lim _{n\to \infty }{P\left(\left|f\left({\frac {K}{n}}\right)-f\left(x\right)\right|>\varepsilon \right)}=0}$

uniformly in x. Taking into account that ƒ is bounded (on the given interval) one gets for the expectation

${\displaystyle \lim _{n\to \infty }{\operatorname {\mathcal {E}} \left(\left|f\left({\frac {K}{n}}\right)-f\left(x\right)\right|\right)}=0}$

uniformly in x. To this end one splits the sum for the expectation in two parts. On one part the difference does not exceed ε; this part cannot contribute more than ε. On the other part the difference exceeds ε, but does not exceed 2M, where M is an upper bound for |ƒ(x)|; this part cannot contribute more than 2M times the small probability that the difference exceeds ε.

Finally, one observes that the absolute value of the difference between expectations never exceeds the expectation of the absolute value of the difference, and

${\displaystyle \operatorname {\mathcal {E}} \left[f\left({\frac {K}{n}}\right)\right]=\sum _{K=0}^{n}f\left({\frac {K}{n}}\right)p(K)=\sum _{K=0}^{n}f\left({\frac {K}{n}}\right)b_{K,n}(x)=B_{n}(f)(x)}$

### Elementary proof

The probabilistic proof can also be rephrased in an elementary way, using the underlying probabilistic ideas but proceeding by direct verification:[11][12][13][14][15]

The following identities can be verified:

(1) ${\displaystyle \sum _{k}{n \choose k}x^{k}(1-x)^{n-k}=1}$

("probability")

(2) ${\displaystyle \sum _{k}{k \over n}{n \choose k}x^{k}(1-x)^{n-k}=x}$

("mean")

(3) ${\displaystyle \sum _{k}\left(x-{k \over n}\right)^{2}{n \choose k}x^{k}(1-x)^{n-k}={x(1-x) \over n}.}$

("variance")

In fact, by the binomial theorem

${\displaystyle (1+t)^{n}=\sum _{k}{n \choose k}t^{k},}$

and this equation can be applied twice to ${\displaystyle t{\frac {d}{dt}}}$ . The identities (1), (2), and (3) follow easily using the substitution ${\displaystyle t=x/(1-x)}$ .

Within these three identities, use the above basis polynomial notation

${\displaystyle b_{k,n}(x)={n \choose k}x^{k}(1-x)^{n-k},}$

and let

${\displaystyle f_{n}(x)=\sum _{k}f(k/n)\,b_{k,n}(x).}$

Thus, by identity (1)

${\displaystyle f_{n}(x)-f(x)=\sum _{k}[f(k/n)-f(x)]\,b_{k,n}(x),}$

so that

${\displaystyle |f_{n}(x)-f(x)|\leq \sum _{k}|f(k/n)-f(x)|\,b_{k,n}(x).}$

Since f is uniformly continuous, given ${\displaystyle \varepsilon >0}$ , there is a ${\displaystyle \delta >0}$  such that ${\displaystyle |f(a)-f(b)|<\varepsilon }$  whenever ${\displaystyle |a-b|<\delta }$ . Moreover, by continuity, ${\displaystyle M=\sup |f|<\infty }$ . But then

${\displaystyle |f_{n}(x)-f(x)|\leq \sum _{|x-{k \over n}|<\delta }|f(k/n)-f(x)|\,b_{k,n}(x)+\sum _{|x-{k \over n}|\geq \delta }|f(k/n)-f(x)|\,b_{k,n}(x).}$

The first sum is less than ε. On the other hand, by identity (3) above, and since ${\displaystyle |x-k/n|\geq \delta }$ , the second sum is bounded by 2M times

${\displaystyle \sum _{|x-k/n|\geq \delta }b_{k,n}(x)\leq \sum _{k}\delta ^{-2}\left(x-{k \over n}\right)^{2}b_{k,n}(x)=\delta ^{-2}{x(1-x) \over n}<\delta ^{-2}n^{-1}.}$
(Chebyshev's inequality)

It follows that the polynomials fn tend to f uniformly.

## Generalizations to higher dimension

Bernstein polynomials can be generalized to k dimensions – the resulting polynomials have the form Bi1(x1) Bi2(x2) ... Bik(xk).[16] In the simplest case only products of the unit interval [0,1] are considered; but, using affine transformations of the line, Bernstein polynomials can also be defined for products [a1, b1] × [a2, b2] × ... × [ak, bk]. For a continuous function f on the k-fold product of the unit interval, the proof that f(x1, x2, ... , xk) can be uniformly approximated by

${\displaystyle \sum _{i_{1}}\sum _{i_{2}}\cdots \sum _{i_{k}}{n_{1} \choose i_{1}}{n_{2} \choose i_{2}}\cdots {n_{k} \choose i_{k}}f\left({i_{1} \over n_{1}},{i_{2} \over n_{2}},\dots ,{i_{k} \over n_{k}}\right)x_{1}^{i_{1}}(1-x_{1})^{n_{1}-i_{1}}x_{2}^{i_{2}}(1-x_{2})^{n_{2}-i_{2}}\cdots x_{k}^{i_{k}}(1-x_{k})^{n_{k}-i_{k}}}$

is a straightforward extension of Bernstein's proof in one dimension. [17]

## Notes

1. ^ a b Lorentz 1953
2. ^ Mathar, R. J. (2018). "Orthogonal basis function over the unit circle with the minimax property". Appendix B. arXiv:1802.09518.
3. ^ Rababah, Abedallah (2003). "Transformation of Chebyshev-Bernstein Polynomial Basis". Comp. Meth. Appl. Math. 3 (4): 608–622. doi:10.2478/cmam-2003-0038.
4. ^ Natanson (1964) p. 6
5. ^ Feller 1966
6. ^ Beals 2004
7. ^ Natanson (1964) p. 3
8. ^ Bernstein 1912
9. ^ Koralov, L.; Sinai, Y. (2007). ""Probabilistic proof of the Weierstrass theorem"". Theory of probability and random processes (2nd ed.). Springer. p. 29.
10. ^ Feller 1966
11. ^ Lorentz 1953, pp. 5–6
12. ^ Beals 2004
13. ^ Goldberg 1964
14. ^ Akhiezer 1956
15. ^ Burkill 1959
16. ^ Lorentz 1953
17. ^