Noise modeling and Probability Theory

From BioenWiki

Jump to: navigation, search

Noise modeling refers to modeling and describing noises using a mathematical way. In physics, telecommunication, imaging processing and other fields, noise is fluctuations in and the addition of external factors to the stream of target information (signal) being received at a detector. In imaging process, the sources of noise arise from the disturbance during image acquisition, digitization, transimission and storage.

From physics point of view, the term noise has the following meanings:

1. An undesired disturbance within the frequency band of interest; the summation of unwanted or disturbing energy introduced into a communications system from man-made and natural sources.

2. A disturbance that affects a signal and that may distort the information carried by the signal.

3. Random variations of one or more characteristics of any entity such as voltage, current, or data.

4. A random signal of known statistical properties of amplitude, distribution, and spectral density.

Noise has long been studied. People analyze its property, type, influence and what can be done about it. Most of the research is done in mathematics and close related to Probability Theory.

Contents

Some noise models

Although in many cases noise is dependent upon physical properties of device,media,etc, people often consider noise as random variables, characterized by a probability density function (PDF). The following are some noise models and their PDFs which are commonly used in signal/imaging processing.


Uniform noise

The Uniform PDF is given by:

Uniform.gif

The plot of uniform PDF

Uniform noise.jpeg

The mean of this density function is given by

Uniform2.gif

and its variance by

Uniform3.gif


Uniform noise is not often encountered in real-world imaging systems, but provides a useful comparison with Gaussian noise. The linear average is a comparatively poor estimator for the mean of a uniform distribution. This implies that nonlinear filters should be better at removing uniform noise than Gaussian noise.


Gaussian noise

The PDF of a Gaussian random variable x, is given by

Equation1.gif

x is the gray level, µ is the mean, σ is the standard deviation and σ2 is the variance.

The plot of Gaussian PDF is like:

Gaussian plot.gif

Gaussian noise is defined as noise with a Gaussian amplitude distribution[1].

The Gaussian distribution has an important property: to estimate the mean of a stationary Gaussian random variable, one can't do any better than the linear average. This makes Gaussian noise a worst-case scenario for nonlinear image restoration filters, in the sense that the improvement over linear filters is least for Gaussian noise. To improve on linear filtering results, nonlinear filters can exploit only the non-Gaussianity of the signal distribution.


Rayleigh noise

The PDF of Rayleigh noise is given by

Rayleigh.gif

The plot of Rayleigh PDF is like:

Rayleigh noise.jpg

The mean of this density function is given by

Rayleigh2.gif

and variance is given by

Rayleigh3.gif


Exponential noise

The PDF of exponential noise is given by

Exp.gif

The plot of exponential PDF is like:

Exp plot.jpg

The mean of this density function is given by

Exp2.gif

and variance is given by

Exp3.gif


Impulse noise

The PDF of impulse noise (also known as salt-and-pepper noise) is given by

Impulse.gif

The plot of its PDF is like:

Impulse noise.jpg

Impulse noise consists of random occurrences of energy spikes having random amplitude and and spectral content.


Erlang(Gamma) noise

The PDF of Erlang noise is given by

Erlang.gif

The plot of its PDF is like:

Erlang noise.jpg

The mean of this density function is given by

Erlang2.gif

and variance is given by

Erlang3.gif

Noise sources in image processing

A large portion of images are formed from light using modern electro-optics. In particular the use of modern, charge-coupled device (CCD) cameras where photons produce electrons that are commonly referred to as photoelectrons. Nevertheless, most of the observations about noise and its various sources hold equally well for other imaging modalities. The major sources of noise during image acquisition from electro-optics devices are photon noise, thermal noise, on-chip electronic noise, amplifier noise, and quantization noise.

Noise evaluation

Please refer to

Colors of noise

Signal-to-noise ratio

Noise level

Noise power

Noise-equivalent power

Phase noise

See also

This page contains material from Gonzalez, R. and Woods, R. Digital Image Processing, Second Edition, Addison Wesley, 2002.

Personal tools