Fast Algorithms for Multidimensional Signals

Similar to 1-D Digital signal processing in case of the Multidimensional signal processing[1] we have Efficient algorithms. The efficiency of an Algorithm can be evaluated by the amount of computational resources it takes to compute output or the quantity of interest. In this page, two of the very efficient algorithms for multidimensional signals are explained. For the sake of simplicity and description it is explained for 2-D Signals. However, same theory holds good for M-D signals. The exact computational savings for each algorithm is also mentioned.

Motivation and applications

edit

In the case of digital systems, a mathematical expressions can be used to describe the input-output relationship and an algorithm can be used to implement this relationship. Similarly, algorithms can be developed to implement different transforms such as Digital filter, Fourier transform, Histogram, Image Enhancements, etc. Direct implementation [2] of these input-output relationships and transforms is not necessarily the most efficient way to implement those.

When people began to compute such outputs from input through direct implementation, they began to look for more efficient ways. This wiki page aims at showcasing such efficient and fast algorithms for multidimensional signals and systems. A multidimensional (M-D) signal can be modeled as a function of M independent variables, where M is greater than or equal to 2. These signals may be categorized as continuous, discrete, or mixed. A continuous signal can be modeled as a function of independent variables which range over a continuum of values, example – an audio wave travelling in space, 3-D space waves measured at different times. A discrete signal, on the other hand, can be modeled as a function defined only on a set of points, such as the set of integers. An image is the simplest example of a 2-D discrete domain signal that is spatial in nature.

In the context of Fast Algorithms, consider the example below:

We need to compute A which is given by

A = αγ + αδ + βγ + βδ where α,β,γ and δ are complex variables.

To compute A, we need 4 complex multiplications and 3 complex additions. The above equation can be written in its simplified form as

A = (α + β)(γ + δ)

This form requires only 1 complex multiplication and 2 complex additions.

Thus the second way of computing A is much more efficient and fast compared to the first method of computing A. This is the motivation for the evolution of the fast algorithms in the digital signal processing Field. Consequently, many of the real-world applications make use of these efficient Algorithms for fast computations.

Problem Statement and Basics

edit

The simplest form of representing a Linear Shift Invariant system(LSI) is through its Impulse response. The output of such LSI discrete domain system is given by the convolution of its input signal and system's impulse response. This is mathematically represented as follows:

 

where   is the impulse response of the system.

 

According to the equation above to obtain the Output value at a particular point ( say  ) we need to multiply several values of the input   and Impulse Response  . Of course this is dependent on the Region of Support of the input as well as the impulse response. The key point here to be noted is that we need to perform so many complex multiplications and additions to obtain 1 output value.

Assuming a 2-D input signal is of length   and the system's impulse response is of length   we need to perform   number of multiplications to obtain all output values. The output can be computed efficiently if one can exploit some characteristics of the system.

We encounter a similar scenario when we have to compute the discrete Fourier Transforms of a signal of interest.

The Direct Calculation of the 2-D DFT is simply the evaluation of the double Sum [3]

   

 

The total number of complex multiplications and complex additions needed to evaluate this 2-D DFT by direct calculation is  . This is a naive approach, however, we already know that an N-point 1-D DFT can be computed with far fewer than   multiplications by using the Fast Fourier Transform (FFT) algorithm. As described in the next section we can develop Fast Fourier transforms for calculating 2-D or higher dimensional DFTs as well [3]

Fast Algorithms for Multidimensional signals

edit

Row Column Decomposition approach for the evaluation of DFT

edit

Source:[3]

The DFT sum   in the previous equation can also be written in the following form

 

Let   denote the quantity inside the brackets and is given by:

 

 

Employing this method the DFT   can be computed as multiple 1-D DFTs. That is, each column of   can be considered as a 1-D DFT of the corresponding column of  (  = constant). And each row of   is the 1-DFT of the corresponding row of the  (  = constant). Hence we are computing the 2-D DFT by decomposing it into Row and Column DFTs.

The same principle is employed for evaluating the M-D DFT of a M - dimensional signal.

Now let's talk about the computational savings we get using this approach. It is observed that we require   complex additions and multiplications. Further, if each of these 1-D DFT is computed using a 1-D FFT, the number of complex multiplications can be further reduced to  

Vector Radix Fast Fourier Transform

edit

Source:[3]

Just like the 1-D FFT, decimation in time can be achieved in the case of 2-D Signals. The 1-D DFT of a signal whose length is a power of 2, can be expressed in terms of two half-length DFTs, each of these can again be expressed as a combination of quarter length DFTs and so on.

In the case of 2-D signals we can express the   DFT in terms of four   DFTs (assuming   and   are powers of 2). For the sake of simplicity let us assume that  . The DFT double sum can be decomposed into four separate summations, one over those samples of   for which both   and   are even, one for which   is even and   is odd, one for which   is odd and   is even and the last one for which   and   are odd.

This is written as :

 

where

 

 

 

 

All the arrays   and   are each periodic in   with horizontal and vertical periods  . Using this fact and also the fact that   we can obtain the following identities :

 

 

 

 

The above equation tell us how to compute the four DFT points   for a particular value of   from the four points  .   can be obtained by evaluating a   -point DFT (similarly other   can be obtained).

Thus we see that the   DFT can be expressed in terms of four   DFTs.

By analogy from the 1-D case, the computation depicted in the below figure is called a   or more precisely   .

 

Each butterfly requires three complex multiplications and eight complex additions for the calculation of outputs from the inputs. And to compute all the samples of   from   it requires calculations of   butterflies.

This decimation procedure is performed   times when   is a power of 2. Each stage of decimation consists of   butterflies, and each butterfly involves three complex multiplications and eight complex additions and hence the number of complex multiplications that needs to be performed during the computation of an   -point radix   FFT is given by

 

See also

edit

References

edit
  1. ^ Bose, N.K., ed. (1985). Multidimensional Systems Theory, Progress, Directions and Open Problems in Multidimensional Systems. Dordrecht, Holland: D. Reidel Publishing Company.
  2. ^ Fast Algorithms for Signal Processing by Richard E. Blahut, Cambridge University Press 2010
  3. ^ a b c d Dan E. Dudgeon, Russell M. Mersereau, “Multidimensional Digital Signal Processing”, Prentice-Hall Signal Processing Series, ISBN 0136049591, 1983.