Draft:Progressive-iterative approximation

• Comment: Please remove the numbers before the (sub)headings. Like "1. Iteration Methods" is supposed to be "Iteration Methods" as Wikipedia is not a textbook. Do that throughout the article and add some more sources as there are quite a handful of statements without sources. Vanderwaalforces (talk) 16:31, 3 November 2023 (UTC)

---

Progressive-iterative approximation method is an iterative method of data fitting with geometric meanings. Given the data points to be fitted, the method obtains a series of fitting curves (surfaces) by iteratively updating the control points, and the limit curve (surface) can interpolate or approximate the given data points. It avoids solving a linear system of equations directly and allows flexibility in adding constraints during the iterative process. Therefore, it has been widely used in geometric design and related fields.

The study of the iterative method with geometric meaning can be traced back to the work of scholars such as Prof. Dongxu Qi and Prof. Carl de Boor in the 1970s. In 1975, Qi et al. developed and proved the "profit and loss" algorithm for uniform cubic B-spline curves，and in 1979, de Boor independently proposed this algorithm. In 2004, Hongwei Lin and coauthors proved that non-uniform cubic B-spline curves and surfaces have the "profit and loss" property. Later, in 2005, Lin et al. proved that the curves and surfaces with normalized and totally positive basis all have this property and named it progressive iterative approximation (PIA). In 2007, Maekawa et al. changed the algebraic distance in PIA to geometric distance and named it geometric interpolation (GI). In 2008, Cheng et al. extended it to subdivision surfaces and named the method progressive interpolation (PI). Since the iteration steps of the PIA, GI, and PI algorithms are similar and all have geometric meanings, we collectively referred to them as geometric iterative methods (GIM).

PIA is now extended to several common curves and surfaces in the geometric design field, including NURBS curves and surfaces, T-spline surfaces, implicit curves and surfaces, etc.

1. Iteration Methods

Generally, progressive-iterative approximation can be divided into interpolation and approximation schemes. In interpolation algorithms, the number of control points is equal to that of the data points; in approximation algorithms, the number of control points can be less than that of the data points. Specifically, there are some representative iteration methods, such as local-PIA, implicit-PIA, fairing-PIA, and isogeometric least-squares progressive-iterative approximation (IG-LSPIA), which is specialized for solving the isogeometric analysis problem.

1.1 Interpolation scheme: PIA

To facilitate the description of the PIA iteration format for different forms of curves and surfaces, we write B-spline curves and surfaces, NURBS curves and surfaces, B-spline solids, T-spline surfaces, and triangular Bernstein–Bézier (B–B) surfaces uniformly in the following form:

$\mathbf {P} (\mathbf {t} )=\sum _{i=1}^{n}\mathbf {P} _{i}B_{i}(\mathbf {t} ).$

For example:

• If $\mathbf {P} (\mathbf {t} )$ is a B-spline curve，then $\mathbf {t}$ is a scalar, $B_{i}(t)$ is a B-spline basis function，and $\mathbf {P} _{i}$ denotes the control point；
• If $\mathbf {P} (\mathbf {t} )$ is a B-spline patch with $n_{u}\times n_{v}$ control points，then $\mathbf {t} =(u,v)$，$B_{i}(\mathbf {t} )=N_{i}(u)N_{i}(v)$，where $N_{i}(u)$ and $N_{i}(v)$ are B-spline basis functions；
• If $\mathbf {P} (\mathbf {t} )$ is a trivariate B-spline solid with $n_{u}\times n_{v}\times n_{w}$ control points, then $\mathbf {t} =(u,v,w)$，$B_{i}(\mathbf {t} )=N_{i}(u)N_{i}(v)N_{i}(w)$，where $N_{i}(u)$、$N_{i}(v)$ and $N_{i}(w)$ are B-spline basis functions.

Given an ordered data set ${\mathbf {Q} _{i},i=1,2,\cdots ,n}$，with parameters $t_{i},i=1,2,\cdots ,n$ satisfying $t_{1}<t_{2}<\cdots$, the initial fitting curve (surface) is

$\mathbf {P} ^{(0)}(t)=\sum _{i=1}^{n}\mathbf {P} _{i}^{(0)}B_{i}(t)$,

where the initial control points of the initial fitting curve (surface) $\mathbf {P} _{i}^{(0)}$ can be randomly selected. Suppose that after the $k$th iteration, the $k$th fitting curve (surface）$\mathbf {P} ^{(k)}(t)$ is generated by

$\mathbf {P} ^{(k)}(t)=\sum _{i=1}^{n}\mathbf {P} _{i}^{(k)}B_{i}(t).$

To construct the $(k+1)$st curve (surface)，we first calculate the difference vectors，

$\mathbf {\Delta } _{i}^{(k)}=\mathbf {Q} _{i}-\mathbf {P} ^{(k)}(t_{i}),i=1,2,\cdots ,n,$

and then update the control points by

$\mathbf {P} _{i}^{(k+1)}=\mathbf {P} _{i}^{(k)}+\mathbf {\Delta } _{i}^{(k)},$

leading to the $(k+1)$st fitting curve (surface)：

$\mathbf {P} ^{(k+1)}(t)=\sum _{i=1}^{n}\mathbf {P} _{i}^{(k+1)}B_{i}(t).$

In this way, we obtain a sequence of curves (surfaces)

$\mathbf {P} ^{(\alpha )}(t),\alpha =0,1,2,\cdots .$

It has been proved that this sequence of curves (surfaces) converges to a limit curve (surface) that interpolates the give data points, i.e.,

$\lim \limits _{\alpha \rightarrow \infty }\mathbf {P} ^{(\alpha )}(t_{i})=\mathbf {Q} _{i},i=1,2,\cdots ,n.$

1.2 Approximation scheme: LSPIA

For the B-spline curve and surface fitting problem, Deng and Lin proposed a least-squares progressive–iterative approximation（LSPIA)., which allows the number of control points to be less than that of the data points and is more suitable for large-scale data fitting problems

Assume that the number of data points is $m$，and the number of control points is $n(n\leq m)$. Following the notations in the Section above, the $k$th fitting curve (surface) generated after the $k$th iteration is $\mathbf {P} ^{(k)}(t)$, i.e.,

$\mathbf {P} ^{(k)}(t)=\sum _{j=1}^{n}\mathbf {P} _{j}^{(k)}B_{j}(t).$

To generate the $(k+1)$st fitting curve (surface)，we compute the following difference vectors in turn:

Difference vectors for data points：

$\mathbf {\Delta } _{i}^{(k)}=\mathbf {Q} _{i}-\mathbf {P} ^{(k)}(t_{i}),i=1,2,\cdots ,m,$

and,

Difference vectors for control points

$\mathbf {D} _{j}^{(k)}={\frac {\sum _{i\in I_{j}}{c_{i}B_{j}(t_{i})\mathbf {\Delta } _{i}^{(k)}}}{\sum _{i\in I_{j}}c_{i}B_{j}(t_{i})}},j=1,2,\cdots ,n,$

where $I_{j}$ is the index set of the data points in the $j$th group，whose parameters fall in the local support of the $j$th basis function, i.e., $B_{j}(t_{i})\neq 0$. $c_{i},i\in I_{j}$ are weights that guarantee the convergence of the algorithm, usually taken as $c_{i}=1,i\in I_{j}$.

Finally, the control points of the $(k+1)$st curve (surface) are updated by $\mathbf {P} _{j}^{(k+1)}=\mathbf {P} _{j}^{(k)}+\mathbf {D} _{j}^{(k)},$ leading to the $(k+1)$st fitting curve (surface) $\mathbf {P} ^{(k+1)}(t)$. In this way，we obtain a sequence of curve (surface)，and the limit curve (surface) converges to the least-squares fitting result to the given data points.

1.3 Local-PIA

In the local-PIA, the control points are divided into active and fixed control points, whose subscripts are denoted as ${\textstyle I=\left\{i_{1},i_{2},\cdots ,i_{I}\right\}}$ and ${\textstyle J=\left\{j_{1},j_{2},\cdots ,j_{J}\right\}}$, respectively. Assume that, the ${\textstyle k}$th fitting curve (surface) is ${\textstyle \mathbf {P} ^{(k)}(t)=\sum _{j=1}^{n}\mathbf {P} _{j}^{(k)}B_{j}(t)}$，where the fixed control point satisfy

$\mathbf {P} _{j}^{(k)}=\mathbf {P} _{j}^{(0)},\quad j\in J,\quad k=0,1,2,\cdots .$

Then，on the one hand, the iterative formula of the difference vector ${\textstyle \mathbf {D} _{h}^{(k+1)}}$ corresponding to the fixed control points is

${\begin{aligned}\mathbf {D} _{h}^{(k+1)}&=\mathbf {Q} _{h}-\sum _{j=1}^{n}\mathbf {P} _{j}^{(k+1)}B_{j}(t_{h})\\&=\mathbf {Q} _{h}-\sum _{j\in J}\mathbf {P} _{j}^{(k+1)}B_{j}(t_{h})-\sum _{i\in I}\left(\mathbf {P} _{i}^{(k)}+\mathbf {D} _{i}^{(k)}\right)B_{i}(t_{h})\\&=\mathbf {Q} _{h}-\sum _{j=1}^{n}\mathbf {P} _{j}^{(k)}B_{j}(t_{h})-\sum _{i\in I}\mathbf {D} _{i}^{(k)}B_{i}(t_{h})\\&=\mathbf {D} _{h}^{(k)}-\sum _{i\in I}\mathbf {D} _{i}^{(k)}B_{i}(t_{h}),\quad h\in J.\end{aligned}}$

On the other hand, the iterative formula of the difference vector ${\textstyle \mathbf {D} _{l}^{(k+1)}}$ corresponding to the active control points is

${\begin{aligned}\mathbf {D} _{l}^{(k+1)}&=\mathbf {Q} _{l}-\sum _{j=1}^{n}\mathbf {P} _{j}^{(k+1)}B_{j}(t_{l})\\&=\mathbf {Q} _{l}-\sum _{j=1}^{n}\mathbf {P} _{j}^{(k)}B_{j}(t_{l})-\sum _{i\in I}\mathbf {D} _{i}^{(k)}B_{i}(t_{l})\\&=\mathbf {D} _{l}^{(k)}-\sum _{i\in I}\mathbf {D} _{i}^{(k)}B_{i}(t_{l})\\&=-\mathbf {D} _{i_{1}}^{(k)}B_{i_{1}}(t_{l})-\mathbf {D} _{i_{2}}^{(k)}B_{i_{2}}(t_{l})-\cdots +\left(1-B_{l}(t_{l})\right)\mathbf {D} _{l}^{(k)}-\cdots -\mathbf {D} _{i_{I}}^{(k)}B_{i_{I}}(t_{l}),\quad l\in I.\end{aligned}}$

Arranging the above difference vectors into a one-dimensional sequence,

$\mathbf {D} ^{(k+1)}=\left[\mathbf {D} _{j_{1}}^{(k+1)},\mathbf {D} _{j_{2}}^{(k+1)},\cdots ,\mathbf {D} _{j_{J}}^{(k+1)},\mathbf {D} _{i_{1}}^{(k+1)},\mathbf {D} _{i_{2}}^{(k+1)},\cdots ,\mathbf {D} _{i_{I}}^{(k+1)}\right]^{T},\quad k=0,1,2,\cdots ,$

the local iteration format in matrix form is,

$\mathbf {D} ^{(k+1)}=\mathbf {T} \mathbf {D} ^{(k)},\quad k=0,1,2,\cdots ,$

where, ${\textstyle \mathbf {T} }$ is the iteration matrix,

$\mathbf {T} ={\begin{bmatrix}\mathbf {E} _{J}&-\mathbf {B} _{1}\\0&\mathbf {E} _{I}-\mathbf {B} _{2}\end{bmatrix}},$

${\textstyle \mathbf {E} _{J}}$ and ${\textstyle \mathbf {E} _{I}}$ are the identity matrices and

$\mathbf {B} _{1}={\begin{bmatrix}B_{i_{1}}\left(t_{j_{1}}\right)&B_{i_{2}}\left(t_{j_{1}}\right)&\cdots &B_{i_{I}}\left(t_{j_{1}}\right)\\B_{i_{1}}\left(t_{j_{2}}\right)&B_{i_{2}}\left(t_{j_{2}}\right)&\cdots &B_{i_{I}}\left(t_{j_{2}}\right)\\\vdots &\vdots &\vdots &\vdots \\B_{i_{1}}\left(t_{j_{J}}\right)&B_{i_{2}}\left(t_{j_{J}}\right)&\cdots &B_{i_{I}}\left(t_{j_{J}}\right)\\\end{bmatrix}},\mathbf {B} _{2}={\begin{bmatrix}B_{i_{1}}\left(t_{i_{1}}\right)&B_{i_{2}}\left(t_{i_{1}}\right)&\cdots &B_{i_{I}}\left(t_{i_{1}}\right)\\B_{i_{1}}\left(t_{i_{2}}\right)&B_{i_{2}}\left(t_{i_{2}}\right)&\cdots &B_{i_{I}}\left(t_{i_{2}}\right)\\\vdots &\vdots &\vdots &\vdots \\B_{i_{1}}\left(t_{i_{I}}\right)&B_{i_{2}}\left(t_{i_{I}}\right)&\cdots &B_{i_{I}}\left(t_{i_{I}}\right)\\\end{bmatrix}}.$

The above local iteration format converges and can be extended to blending surfaces and subdivision surfaces.

1.4 Implicit-PIA

The progressive iterative approximation format for implicit curve and surface reconstruction is presented in the following. Given an ordered point cloud ${\textstyle \left\{\mathbf {Q} _{i}\right\}_{i=1}^{n}}$ and a unit normal vector ${\textstyle \left\{\mathbf {n} _{i}\right\}_{i=1}^{n}}$ on the data points, we want to reconstruct an implicit curve (surface) from the given point cloud. To avoid trivial solution, some offset points ${\textstyle \left\{\mathbf {Q} _{l}\right\}_{l=n+1}^{2n}}$ are added to the point cloud. They are offset by a distance ${\textstyle \sigma }$ along the unit normal vector of each point

$\mathbf {Q} _{l}=\mathbf {Q} _{i}+\sigma \mathbf {n} _{i},\quad l=n+i,\quad i=1,2,\cdots ,n.$

Assume that ${\textstyle \epsilon }$ is the value of the implicit function at the offset point

$f\left(\mathbf {Q} _{l}\right)=\epsilon ,\quad l=n+1,n+2,\cdots ,2n.$

Let the implicit curve after the ${\textstyle \alpha }$th iteration be

$f^{(\alpha )}(x,y)=\sum _{i=1}^{N_{u}}\sum _{j=1}^{N_{v}}C_{ij}^{(\alpha )}B_{i}(x)B_{j}(y),$

where ${\textstyle C_{ij}^{(\alpha )}}$ is the control point.

Define the difference vector of data points as

${\begin{aligned}\Delta _{k}^{(\alpha )}&=0-f^{(\alpha )}(x_{k},y_{k}),\quad k=1,2,\cdots ,n,\\\Delta _{l}^{(\alpha )}&=\epsilon -f^{(\alpha )}(x_{l},y_{l}),\quad l=n+1,n+2,\cdots ,2n.\end{aligned}}$

Next, calculate the difference vector of control coefficients

$D_{ij}^{(\alpha )}=\mu \sum _{k=1}^{2n}B_{i}(x_{k})B_{j}(y_{k})\Delta _{k}^{(\alpha )},\quad i=1,2,\cdots ,N_{u},\quad j=1,2,\cdots ,N_{v},$

where ${\textstyle \mu }$ is the convergence coefficient. As a result, the new control coefficients are

$C_{ij}^{(\alpha +1)}=C_{ij}^{(\alpha )}+D_{ij}^{(\alpha )},$

leading to the new algebraic B-spline curve

$f^{(\alpha +1)}(x,y)=\sum _{i=1}^{N_{u}}\sum _{j=1}^{N_{v}}C_{ij}^{(\alpha +1)}B_{i}(x)B_{j}(y).$

The above procedure is carried out iteratively to generate a sequence of algebraic B-spline functions ${\textstyle \left\{f^{(\alpha )}(x,y),\alpha =0,1,2,\cdots \right\}}$. The sequence converges to a minimization problem with constraints when the initial control coefficients ${\textstyle C_{ij}^{(0)}=0}$.

Assume that the implicit surface generated after the ${\textstyle \alpha }$th iteration is

$f^{(\alpha )}(x,y,z)=\sum _{i=1}^{N_{u}}\sum _{j=1}^{N_{v}}\sum _{k=1}^{N_{w}}C_{ijk}^{(\alpha )}B_{i}(x)B_{j}(y)B_{k}(z),$

the iteration format is similar to that of the curve case.

1.5 Fairing-PIA

To develop fairing-PIA, we first define the functionals as follows:

${\mathcal {F}}_{r,j}(f)=\int _{t_{1}}^{t_{m}}B_{r,j}(t)fdt,\quad j=1,2,\cdots ,n,\quad r=1,2,3,$

where ${\textstyle B_{r,j}(t)}$ represents the ${\textstyle r}$th derivative of the basis function ${\textstyle B_{j}(t)}$.

Let the curve after the ${\textstyle k}$th iteration be

$\mathbf {P} ^{[k]}(t)=\sum _{j=1}^{n}B_{j}(t)\mathbf {P} _{j}^{[k]},\quad t\in [t_{1},t_{m}].$

To construct the new curve ${\textstyle \mathbf {P} ^{[k+1]}(t)}$，we first calculate the ${\textstyle (k+1)}$st difference vectors for data points,

$\mathbf {d} _{i}^{[k]}=\mathbf {Q} _{i}-\mathbf {P} ^{[k]}(t_{i}),\quad i=1,2,\cdots ,m.$

Then, the fitting difference vectors and the fairing vectors for control points are calculated by

$\mathbf {\delta } _{j}^{[k]}=\sum _{h\in I_{j}}B_{j}(t_{h})\mathbf {d} _{h}^{[k]},\quad j=1,2,\cdots ,n,$ $\mathbf {\eta } _{j}^{[k]}=\sum _{l=1}^{n}{\mathcal {F}}_{r,l}\left(B_{r,j}(t)\right)\mathbf {P} _{l}^{[k]},\quad j=1,2,\cdots ,n.$

Finally, the control points of the $(k+1)$st curve are produced by

$\mathbf {P} _{j}^{[k+1]}=\mathbf {P} _{j}^{[k]}+\mu _{j}\left[\left(1-\omega _{j}\right)\mathbf {\delta } _{j}^{[k]}-\omega _{j}\mathbf {\eta } _{j}^{[k]}\right],\quad j=1,2,\cdots ,n,$

where $\mu _{j}$ is a normalization weight, and $\omega _{j}$ is a smoothing weight corresponding to the $j$th control point. The smoothing weights can be employed to adjust the smoothness individually, thus bringing great flexibility for smoothness. The larger the smoothing weight is, the smoother the generated curve is. The new curve is obtained as follows

$\mathbf {P} ^{[k+1]}(t)=\sum _{j=1}^{n}B_{j}(t)\mathbf {P} _{j}^{[k+1]},\quad t\in [t_{1},t_{m}].$

In this way, we obtain a sequence of curves ${\textstyle \left\{\mathbf {P} ^{[k]}(t),\;k=1,2,3,\cdots \right\}}$. The sequence converges to the solution of the conventional fairing method based on energy minimization when all smoothing weights are equal ( ${\textstyle \omega _{j}=\omega }$). Similarly, the fairing-PIA can be extended to the surface case.

1.6 IG-LSPIA

Given a boundary value problem

$\left\{{\begin{aligned}{\mathcal {L}}u=f,&\quad {\text{in}}\;\Omega ,\\{\mathcal {G}}u=g,&\quad {\text{on}}\;\partial \Omega ,\end{aligned}}\right.$

where ${\textstyle u:\Omega \to \mathbb {R} }$ is the unknown solution，${\textstyle {\mathcal {L}}}$ and ${\textstyle {\mathcal {G}}}$ are the differential operator and boundary operator, respectively. ${\textstyle f}$ and ${\textstyle g}$ are the continuous functions. In the isogeometric analysis method, NURBS basis functions are used as form functions to solve the numerical solution of this boundary value problem. The same basis functions are applied to represent the numerical solution ${\textstyle u_{h}}$ and the geometric mapping ${\textstyle G}$:

${\begin{aligned}u_{h}\left({\hat {\tau }}\right)&=\sum _{j=1}^{n}R_{j}({\hat {\tau }})u_{j},\\G({\hat {\tau }})&=\sum _{j=1}^{n}R_{j}({\hat {\tau }})P_{j},\end{aligned}}$

where ${\textstyle R_{j}({\hat {\tau }})}$ denotes the NURBS basis function，${\textstyle u_{j}}$ is the control coefficient. After substituting the collocation points ${\textstyle {\hat {\tau }}_{i},i=1,2,...,{m}}$ into the strong form of PDE，we obtain a discretized problem

$\left\{{\begin{aligned}{\mathcal {L}}u_{h}({\hat {\tau }}_{i})=f(G({\hat {\tau }}_{i})),&\quad i\in {\mathcal {I_{L}}},\\{\mathcal {G}}u_{h}({\hat {\tau }}_{j})=g(G({\hat {\tau }}_{j})),&\quad j\in {\mathcal {I_{G}}},\end{aligned}}\right.$

where ${\textstyle {\mathcal {I_{L}}}}$ and ${\textstyle {\mathcal {I_{G}}}}$ denote the subscripts of internal and boundary collocation points, respectively.

Arranging the control coefficients ${\textstyle u_{j}}$ of the numerical solution ${\textstyle u_{h}({\hat {\tau }})}$ into an ${\textstyle 1}$-dimensional column vector, i.e., ${\textstyle \mathbf {U} =[u_{1},u_{2},...,u_{n}]^{T}}$, the discretized problem can be reformulated in matrix form

$\mathbf {AU} =\mathbf {b} ,$

where ${\textstyle \mathbf {A} }$ is the collocation matrix，and ${\textstyle \mathbf {b} }$ is the load vector.

Assume that the discretized load values are data points ${\textstyle \left\{b_{i}\right\}_{i=1}^{m}}$ to be fitted. Given the initial guess of the control coefficients${\textstyle \left\{u_{j}^{(0)}\right\}_{j=1}^{n}}$（${\textstyle n<m}$），we obtain an initial blending function

$U^{(0)}({\hat {\tau }})=\sum _{j=1}^{n}A_{j}({\hat {\tau }})u_{j}^{(0)},\quad {\hat {\tau }}\in [{\hat {\tau }}_{1},{\hat {\tau }}_{m}],$

where ${\textstyle A_{j}({\hat {\tau }})}$， ${\textstyle j=1,2,\cdots ,n}$，represents the combination of different order derivatives of the NURBS basis functions determined using the operators ${\textstyle {\mathcal {L}}}$ and ${\textstyle {\mathcal {G}}}$

$A_{j}({\hat {\tau }})=\left\{{\begin{aligned}{\mathcal {L}}R_{j}({\hat {\tau }}),&\quad {\hat {\tau }}\ {\text{in}}\ \Omega _{p}^{in},\\{\mathcal {G}}R_{j}({\hat {\tau }}),&\quad {\hat {\tau }}\ {\text{in}}\ \Omega _{p}^{bd},\quad j=1,2,\cdots ,n,\end{aligned}}\right.$

where ${\textstyle \Omega _{p}^{in}}$ and ${\textstyle \Omega _{p}^{bd}}$ indicate the interior and boundary of the parameter domain, respectively. Each ${\textstyle A_{j}({\hat {\tau }})}$ corresponds to the ${\textstyle j}$th control coefficient. Assume that ${\textstyle J_{in}}$ and ${\textstyle J_{bd}}$ are the index sets of the internal and boundary control coefficients, respectively. Without loss of generality, we further assume that the boundary control coefficients have been obtained using strong or weak imposition and are fixed, i.e.,

$u_{j}^{(k)}=u_{j}^{*},\quad j\in J_{bd},\quad k=0,1,2,\cdots .$

The ${\textstyle k}$th blending function, generated after the ${\textstyle k}$th iteration of IG-LSPIA, is assumed to be as follows:

$U^{(k)}({\hat {\tau }})=\sum _{j=1}^{n}A_{j}({\hat {\tau }})u_{j}^{(k)},\quad {\hat {\tau }}\in [{\hat {\tau }}_{1},{\hat {\tau }}_{m}].$

Then, the difference vectors for collocation points (DCP) in the ${\textstyle (k+1)}$st iteration are obtained using

${\begin{aligned}\delta _{i}^{(k)}&=b_{i}-\sum _{j=1}^{n}A_{j}({\hat {\tau }}_{i})u_{j}^{(k)}\\&=b_{i}-\sum _{j\in J_{bd}}A_{j}({\hat {\tau }}_{i})u_{j}^{(k)}-\sum _{j\in J_{in}}A_{j}({\hat {\tau }}_{i})u_{j}^{(k)},\quad i=1,2,...,m.\end{aligned}}$

Moreover, group all load values whose parameters fall in the local support of the ${\textstyle j}$th derivatives function, i.e., ${\textstyle A_{j}({\hat {\tau }}_{i})\neq 0}$, into the ${\textstyle j}$th group corresponding to the ${\textstyle j}$th control coefficient, and denote the index set of the ${\textstyle j}$th group of load values as ${\textstyle I_{j}}$. Lastly, the differences for control coefficients (DCC) can be constructed as follows:

$d_{j}^{(k)}=\mu \sum _{h\in I_{j}}A_{j}({\hat {\tau }}_{h})\delta _{h}^{(k)},\quad j=1,2,...,n,$

where ${\textstyle \mu }$ is a normalization weight to guarantee the convergence of the algorithm.

Thus, the new control coefficients are updated via the following formula,

$u_{j}^{(k+1)}=u_{j}^{(k)}+d_{j}^{(k)},\quad j=1,2,...,n,$

Consequently, the ${\textstyle (k+1)}$st blending function is generated as follows:

$U^{(k+1)}({\hat {\tau }})=\sum _{j=1}^{n}A_{j}({\hat {\tau }})u_{j}^{(k+1)}.$

The above iteration process is performed until the desired fitting precision is reached and a sequence of blending functions is obtained

$\left\{U^{(k)}({\hat {\tau }}),k=0,1,\dots \right\}.$

The IG-LSPIA converges to the solution of a constrained least-squares collocation problem.

2. Proof of convergence

Non-singular case

• If ${\textstyle m=n}$, the PIA iterative format in matrix form is

${\begin{aligned}\mathbf {P^{(\alpha +1)}} &=\mathbf {P^{(\alpha )}} +\mathbf {\Delta } ^{(\alpha )},\\&=\mathbf {P} ^{(\alpha )}+\mathbf {Q} -\mathbf {B} \mathbf {P} ^{(\alpha )},\\&=\left(\mathbf {I} -\mathbf {B} \right)\mathbf {P} ^{(\alpha )}+\mathbf {Q} ,\end{aligned}}$

where，

${\begin{aligned}&\mathbf {Q} =\left[\mathbf {Q} _{1},\mathbf {Q} _{2},\cdots ,\mathbf {Q} _{m}\right]^{T},\\&\mathbf {P^{(\alpha )}} =\left[\mathbf {P} _{1}^{(\alpha )},\mathbf {P} _{2}^{(\alpha )},\cdots ,\mathbf {P} _{n}^{(\alpha )}\right]^{T},\\&\mathbf {\Delta } ^{(\alpha )}=\left[\mathbf {\Delta } _{1}^{(\alpha )},\mathbf {\Delta } _{2}^{(\alpha )},\cdots ,\mathbf {\Delta } _{n}^{(\alpha )}\right]^{T},\\&\mathbf {B} ={\begin{bmatrix}B_{1}(t_{1})&B_{2}(t_{1})&\cdots &B_{n}(t_{1})\\B_{1}(t_{2})&B_{2}(t_{2})&\cdots &B_{n}(t_{2})\\\vdots &\vdots &\ddots &\vdots \\B_{1}(t_{m})&B_{2}(t_{m})&\cdots &B_{n}(t_{m})\\\end{bmatrix}}.\end{aligned}}$

The convergence of the PIA is related to the properties of the collocation matrix. If the spectral radius of iteration matrix $\mathbf {I} -\mathbf {B}$ is less than $1$，then the PIA is convergent. It has been shown that the PIA methods for Bézier curves and surface, B-spline curves and surfaces, NURBS curves and surfaces, Triangular Bernstein-Bézier surface, and subdivision surfaces (Loop, Catmull-Clark, Doo-Sabin) are convergent.

• If ${\textstyle n<m}$，the LSPIA in matrix form is

${\begin{aligned}\mathbf {P^{(\alpha +1)}} &=\mathbf {P^{(\alpha )}} +\mu \mathbf {B} ^{T}\mathbf {\Delta } ^{(\alpha )},\\&=\mathbf {P} ^{(\alpha )}+\mu \mathbf {B} ^{T}\left(\mathbf {Q} -\mathbf {B} \mathbf {P} ^{(\alpha )}\right),\\&=\left(\mathbf {I} -\mu \mathbf {B} ^{T}\mathbf {B} \right)\mathbf {P} ^{(\alpha )}+\mu \mathbf {B} ^{T}\mathbf {Q} .\end{aligned}}$

When the matrix ${\textstyle \mathbf {B} ^{T}\mathbf {B} }$ is nonsingular，the following results can be obtained.

Lemma If ${\textstyle 0<\mu <{\frac {2}{\lambda _{0}}}}$ ，where ${\textstyle \lambda _{0}}$ is the largest eigenvalue of the matrix ${\textstyle \mathbf {B} ^{T}\mathbf {B} }$，then the eigenvalues of ${\textstyle \mu \mathbf {B} ^{T}\mathbf {B} }$ are real numbers and satisfy ${\textstyle 0<\lambda (\mu \mathbf {B} ^{T}\mathbf {B} )<2}$.

Proof Since ${\textstyle \mathbf {B} ^{T}\mathbf {B} }$ is nonsingular，and ${\textstyle \mu >0}$，then ${\textstyle \lambda (\mu \mathbf {B} ^{T}\mathbf {B} )>0}$. Moreover，

$\lambda (\mu \mathbf {B} ^{T}\mathbf {B} )=\mu \lambda (\mathbf {B} ^{T}\mathbf {B} )<2{\frac {\lambda (\mathbf {B} ^{T}\mathbf {B} )}{\lambda _{0}}}<2.$

In summary，${\textstyle 0<\lambda (\mu \mathbf {B} ^{T}\mathbf {B} )<2}$.

Theorem If ${\textstyle 0<\mu <{\frac {2}{\lambda _{0}}}}$ ，LSPIA is convergent, and converges to the least-squares fitting result to the given data points.

Proof From the matrix form of iterative format, we obtain the following :

${\begin{aligned}\mathbf {P^{(\alpha +1)}} &=\left(\mathbf {I} -\mu \mathbf {B} ^{T}\mathbf {B} \right)\mathbf {P} ^{(\alpha )}+\mu \mathbf {B} ^{T}\mathbf {Q} ,\\&=\left(\mathbf {I} -\mu \mathbf {B} ^{T}\mathbf {B} \right)\left[\left(\mathbf {I} -\mu \mathbf {B} ^{T}\mathbf {B} \right)\mathbf {P} ^{(\alpha -1)}+\mu \mathbf {B} ^{T}\mathbf {Q} \right]+\mu \mathbf {B} ^{T}\mathbf {Q} ,\\&=\left(\mathbf {I} -\mu \mathbf {B} ^{T}\mathbf {B} \right)^{2}\mathbf {P} ^{(\alpha -1)}+\sum _{i=0}^{1}\left(\mathbf {I} -\mu \mathbf {B} ^{T}\mathbf {B} \right)\mu \mathbf {B} ^{T}\mathbf {Q} ,\\&=\cdots \\&=\left(\mathbf {I} -\mu \mathbf {B} ^{T}\mathbf {B} \right)^{\alpha +1}\mathbf {P} ^{(0)}+\sum _{i=0}^{\alpha }\left(\mathbf {I} -\mu \mathbf {B} ^{T}\mathbf {B} \right)^{\alpha }\mu \mathbf {B} ^{T}\mathbf {Q} .\\\end{aligned}}$

According to above Lemma, the spectral radius of the matrix ${\textstyle \mu \mathbf {B} ^{T}\mathbf {B} }$ satisfies

$0<\rho \left({\mu \mathbf {B} ^{T}\mathbf {B} }\right)<2,$

Thus，the spectral radius of the iteration matrix satisfies

$0<\rho \left({\mathbf {I} -\mu \mathbf {B} ^{T}\mathbf {B} }\right)<1.$

When ${\textstyle \alpha \rightarrow \infty }$

$\left(\mathbf {I} -\mu \mathbf {B} ^{T}\mathbf {B} \right)^{\infty }=0,\ \sum _{i=0}^{\infty }\left(\mathbf {I} -\mu \mathbf {B} ^{T}\mathbf {B} \right)^{\alpha }={\frac {1}{\mu }}\left(\mathbf {B} ^{T}\mathbf {B} \right)^{-1}.$

As a result,

$\mathbf {P} ^{(\infty )}=\left(\mathbf {B} ^{T}\mathbf {B} \right)^{-1}\mathbf {B} ^{T}\mathbf {Q} ,$

i.e., ${\textstyle \mathbf {B} ^{T}\mathbf {B} \mathbf {P} ^{(\infty )}=\mathbf {B} ^{T}\mathbf {Q} }$，which is equivalent to the normal equation of the fitting problem. Hence, the LSPIA algorithm converges to the least squares result for a given sequence of points.

Singular case

Lin et al. showed that LSPIA converges even when the iteration matrix is singular..

3. Acceleration algorithms and others

• Precondition：Liu et al. proposed a preconditioned PIA for Bézier surfaces via the diagonally compensated reduction method, effectively improving the accuracy and efficiency of the classical algorithm.
• Iteration matrix inverse approximation: Sajavičius improves the LSPIA based on the matrix approximate inverse method. In each iteration step, the approximate inverse of the coefficient matrix of the least-squares fitting problem is first computed and then used as the weight to adjust the control points.
• Optimal weight: Lu initially presented a weighted progressive-iterative approximation (WPIA) that introduces the optimal weight of difference vectors for control points to accelerate the convergence. Moreover, Zhang et al. proposed a weighted local PIA format for tensor Bézier surfaces. Li et al. assigned initial weights to each data point, and the weights of the interpolated points are determined adaptively during the iterative process
• Acceleration with memory: In 2020, Huang et al. proposed a progressive-iterative approximation method with memory for least square fitting (MLSPIA), which has a similar format to the momentum method. MLSPIA generates a series of fitting curves (surfaces) with three weights by iteratively adjusting the control points. With appropriate parameter selection, these curves (surfaces) converge to the least squares fit results for a given data point and are more efficient than LSPIA.
• Stochastic descent strategy：Rios and Jüttle explored the relationship between LSPIA and gradient descent method and proposed a stochastic LSPIA algorithm with parameter correction.

4. Applications

Since PIA has obvious geometric meaning, constraints can be easily integrated in the iterations. Currently, PIA has been widely applied in many fields, such as data fitting, reverse engineering, geometric design, mesh generation, data compression, fairing curve and surface generation, and isogeometric analysis.

Data fitting

• Adaptive data fitting：The control points are divided into active control points and fixed control points. In each round of iteration, if the fitting error of a data point reaches a given precision, its corresponding control point is fixed and not updated. The above iterative process is repeated until all control points are fixed . The algorithm performs well on large-scale data fitting by adaptively reducing the number of active control points.
• Large-scale data fitting：By combining T-spline with PIA, an incremental fitting algorithm suitable for fitting large-scale data sets is proposed. During the incremental iteration, each new round of iterations reuses information from the last round of iterations to save computation. While the convergence speed of the traditional point-by-point iterative algorithm decreases as the number of control points increases, in PIA the computation of each iteration step is unrelated to the number of control points, thus exhibiting a powerful data fitting capability.
• Local fitting：Based on the local property of PIA，a series of local PIA formats have been proposed.

Implicit reconstruction

For implicit curve and surface reconstruction, the PIA avoids the additional zero level set and regularization term, which greatly improves the speed of the reconstruction algorithm.

Offset curve approximation

Firstly, the data points are sampled on the original curve. Then, the initial polynomial approximation curve or rational approximation curve of the offset curve is generated from these sampled points. Finally, the offset curve is approximated iteratively using the PIA method.

Mesh generation

Input a triangular mesh model, the algorithm first constructs the initial hexahedral mesh, and extracts the quadrilateral mesh of the surface as the initial boundary mesh. During the iterations, the movement of each mesh vertex is constrained to ensure the validity of the mesh. Finally, the hexahedral model is fitted to the given input model. The algorithm can guarantee the validity of the generated hexahedral mesh, i.e., the Jacobi value at each mesh vertex is greater than zero.

Data compression

First, the image data are converted into a one-dimensional sequence by Hilbert scan; then, these data points are fitted by LSPIA to generate a Hilbert curve; finally, the Hilbert curve is sampled, and the compressed image can be reconstructed. This method can well preserve the neighborhood information of pixels.

Fairing curve and surface generation

Given a data point set, we first define the fairing functional, and calculate the fitting difference vector and the fairing vector of the control point; then, adjust the control points with fairing weights. According to the above steps, the fairing curve and surface can be generated iteratively. Due to the sufficient fairing parameters, the method can achieve global or local fairing. It is also flexible to adjust knot vectors, fairing weights, or data parameterization after each round of iteration. The traditional energy-minimization method is a special case of this method, i.e., when the smooth weights are all the same.

Isogeometric analysis

The discretized load values are regarded as the set of data points, and the combination of the basis functions and their derivative functions is used as the blending function for fitting. The method automatically adjusts the degrees of freedom of the numerical solution of the partial differential equation according to the fitting result of the blending function to the load values. In addition, the average iteration time per step is only related to the number of data points (i.e., collocation points) and unrelated to the number of control coefficients.

References

•  This article incorporates text by Jian, Yini; Lin, Hongwei available under the CC BY 4.0 license.