7.2 Audio fingerprint generation

In order to provide a more compact representation of our audio signals, we researched methods of audiofingerprinting. The method we used, which appeared to be very effective, was one that compared the amount of energy in differentfrequency bands. This method takes advantage of the fact that the human ear can only distinguish audio frequencies that are verydifferent from one another. There are 25 audible frequency bands, also known as critical bands, that vary in width and range from 0to 20kHz. The human ear can be modeled as a series of 25 band pass filters. As long as two frequencies fall within the same criticalband, they are generally indistinguishable. Therefore rather than keep the entire spectrum for each one of our audio signals we canexamine the patterns of energy variations from one critical band to the next, which only requires retaining one value, (the totalenergy), for each critical band.

To implement this system in Matlab, we first divided the signal into time frames using Hanning windows of about37 ms. The purpose of using Hanning windows is to prevent extraneous oscillations from occurring in the spectrum. We alsooverlapped the Hanning windows in order to prevent the amplitude modulating effect of consecutive Hanning window.

Figure 1: Audio Fingerprint Generation scheme.

Each time window goes through this process.

The Fast Fourier Transform (FFT) is taken for each windowed timeframe and the generated spectrum is divided intothe 25 critical bands. The energy is calculated for each critical band and energy difference between two consecutive bands is storedinto an array of length 24. This process is done for each timeframe which results in a matrix of 24 rows and one column for eachtimeframe. Within each row of the matrix, consecutive values are compared. If the value increases from one column index to the next,the value in the prior column is replaced with a 1. Otherwise it becomes a -1. This column to column, or timeframe to timeframe,comparison examines energy fluctuations similar to the way we compared energy differences between consecutive critical bands.This overall scheme results in a matrix of dimensions 24 x (#timeframes -1). This set of 1s and -1s is the audio signal’sfingerprint. The only thing left to do once is compare audio fingerprints to find a match and return song information.