<< Chapter < Page | Chapter >> Page > |
The sufficient statistic computed for each signal can be given two signal processing interpretations in the colored noise case.Both of these rest on considering the quantity as a simple dot product, but with different ideas on grouping terms. The simplest is to group the kernel with thesignal so that the sufficient statistic is the dot product between the observations and a modified version of the signal . This modified signal thus becomes the equivalent to the unit-sample response of the matched filter. In this form,the observed data are unaltered and passed through a matched filter whose unit-sample response depends on both the signal andthe noise characteristics. The size of the noise covariance matrix, equal to the number of observations used by thedetector, is usually large: hundreds if not thousands of samples are possible. Thus, computation of the inverse of the noisecovariance matrix becomes an issue. This problem needs to be solved only once if the noise characteristics are static; theinverse can be precomputed on a general purpose computer using well-established numerical algorithms. The signal-to-noiseratio term of the sufficient statistic is the dot product of the signal with the modified signal . This view of the receiver structure is shown in .
A second and more theoretically powerful view of the computations involved in the colored noise detector emerges whenwe factor covariance matrix. The Cholesky factorization of a positive-definite,symmetric matrix (such as a covariance matrix or its inverse) has the form . With this factorization, the sufficient statistic can be written as The components of the dot product are multiplied by the same matrix ( ), which is lower-triangular. If this matrix were also Toeplitz, the product of this kind between a Toeplitz matrix and a vector would be equivalent to theconvolution of the components of the vector with the first column of the matrix. If the matrix is not Toeplitz (which,inconveniently, is the typical case), a convolution also results, but with a unit-sample response that varies with theindex of the output--a time-varying, linear filtering operation. The variation of the unit-sample response corresponds to thedifferent rows of the matrix running backwards from the main-diagonal entry. What is the physical interpretation of theaction of this filter? The covariance of the random vector is given by . Applying this result to the current situation, we set and with the result that the covariance matrix is the identity matrix! Thus, the matrix corresponds to a (possibly time-varying) whitening filter : we have converted the colored-noise component of the observed data to white noise! Asthe filter is always linear, the Gaussian observation noise remains Gaussian at the output. Thus, the colored noise problemis converted into a simpler one with the whitening filter: the whitened observations are first match-filtered with the"whitened" signal (whitened with respect to noise characteristics only) then half the energy of the whitened signal is subtracted( ).
To demonstrate the interpretation of the Cholesky factorization of the covariance unit matrix as a time-varyingwhitening filter, consider the covariance matrix This covariance matrix indicates that the nosie was produced by passing white Gaussian noise through a first-order filterhaving coefficient : , where is unit-variance white noise. Thus, we would expect that if a whitening filter emerged from the matrixmanipulations (derived just below), it would be a first-order FIR filter having a unit-sample response proportional to Simple arithmetic calculations of the Cholesky decomposition suffice to show that the matrices and are given by and that their inverses are Because is diagonal, the matrix equals the term-by-term square root of the inverse of . The product of interest here is therefore given by Let express the product . This vector's elements are given by Thus, the expected FIR whitening filter emerges after the first term. The expression could not be of this form as no observations were assumed to precede . This edge effect is the source of the time-varying aspect of the whitening filter. If thesystem modeling the noise generation process has only poles, this whitening filter will always stabilize - not vary withtime - once sufficient data are present within the memory of the FIR inverse filter. In contrast, the presence of zeros inthe generation system would imply an IIR whitening filter. With finite data, the unit-sample response would then changeon each output sample.
Notification Switch
Would you like to follow the 'Statistical signal processing' conversation and receive update notifications?