Discrete time convolution

Introduction

Convolution, one of the most important concepts in electrical engineering, can be used to determine the output a system produces for a given input signal. It can be shown that a linear time invariant system is completely characterized by its impulse response. The sifting property of the discrete time impulse function tells us that the input signal to a system can be represented as a sum of scaled and shifted unit impulses. Thus, by linearity, it would seem reasonable to compute of the output signal as the sum of scaled and shifted unit impulse responses. That is exactly what the operation of convolution accomplishes. Hence, convolution can be used to determine a linear time invariant system's output from knowledge of the input and the impulse response.

Convolution and circular convolution

Convolution

Operation definition

Discrete time convolution is an operation on two discrete time signals defined by the integral

for all signals $f,g$ defined on $\mathbb{Z}$ . It is important to note that the operation of convolution is commutative, meaning that

for all signals $f,g$ defined on $\mathbb{Z}$ . Thus, the convolution operation could have been just as easily stated using the equivalent definition

for all signals $f,g$ defined on $\mathbb{Z}$ . Convolution has several other important properties not listed here but explained and derived in a later module.

Definition motivation

The above operation definition has been chosen to be particularly useful in the study of linear time invariant systems. In order to see this, consider a linear time invariant system $H$ with unit impulse response $h$ . Given a system input signal $x$ we would like to compute the system output signal $H\left(x\right)$ . First, we note that the input can be expressed as the convolution

by the sifting property of the unit impulse function. By linearity

Since $H\left(\delta \right[n-k\left]\right)$ is the shifted unit impulse response $h[n-k]$ , this gives the result

Hence, convolution has been defined such that the output of a linear time invariant system is given by the convolution of the system input with the system unit impulse response.

Graphical intuition

It is often helpful to be able to visualize the computation of a convolution in terms of graphical processes. Consider the convolution of two functions $f,g$ given by

The first step in graphically understanding the operation of convolution is to plot each of the functions. Next, one of the functions must be selected, and its plot reflected across the $k=0$ axis. For each real $n$ , that same function must be shifted left by $n$ . The point-wise product of the two resulting plots is then computed, and then all of the values are summed.