Open main menu

Wikipedia β

Statistical signal processing

Statistical signal processing is an approach to signal processing which treats signals as stochastic processes, utilizing their statistical properties to perform signal processing tasks. Statistical techniques are widely used in signal processing applications. For example, one can model the probability distribution of noise incurred when photographing an image, and construct techniques based on this model to reduce the noise in the resulting image.

Contents

Examples of statistical signal modelsEdit

A classic problem in signal processing is estimating a signal, or its underlying parameters, from noisy observations. This is typically accomplished using either as a Bayesian or a frequentist model. We provide a classic example for each of these models.

Noise reductionEdit

Let   be an unknown, random, zero-mean, normally-distributed, wide-sense stationary process. We would like to estimate   from noisy measurements  , where   is a noise process, uncorrelated with  , which is likewise zero-mean, normally-distributed, and wide-sense stationary. Then, the optimal estimator is obtained by passing   through a linear filter whose frequency response is given by

 

where   and   are the spectral densities of   and  , respectively.

Parameter estimationEdit

Many types of signals can be modeled using a small number of unknown parameters. This can be useful, for example, in signal compression (only the parameters need be stored, rather than the entire signal), as well as signal analysis (the parameters may hint at underlying characteristics of the model generating the signals).

As an example, suppose a discrete-time signal   is modeled as an autoregressive process,

 

where   is additive white Gaussian noise and   are unknown deterministic parameters (the autoregression parameters). Then, from observations of  , it is of interest to estimate the autoregression parameters. This may be done using the method of least squares, or using the more computationally efficient Yule-Walker equations.

Further readingEdit