0.3 Experimental results

Trial 1 results

The first run through of our program showed promising results for the numbers, but less than stellar results for some of the letters. After several rounds of experimentation, we identified several ways to improve our algorithm. One major change was standard cropping for the template characters and the test license plate. While our original template dictionary images were cropped from the original images downloaded from the camera phone, our test images were obtained from a 256 by 400 pixel crop, thus there were slight differences in the images which lead to results that were not passing the matched filter test. Because matched filter is a very sensitive test, it responds to even the slightest changes that may not be detectable by a quick glance from a human eye.

Another adjustment that improved our results was flipping the image right to left and upside down before applying the 'conv2' function. This set up our image so that applying the function was equivalent to calculating a correlation, yielding significantly more sensitive and accurate results.

Trial 2 results

After changing our template dictionary samples so our dictionary and test images were cropped from a 256 by 400 pixel image and making adjustments to the image before applying ‘conv2’, we saw much better results. Our program accurately identifies characters on this type of Texas plate, returning the correct characters in order. Thus far it has produced accurate results on the five plates we have tested on, with an average processing time of 0.78252 seconds.

For one of our test images, license plate 'BP2F146' (Figure 1) we tested the template dictionary character '4' with the entire license plate. The results showed that the program found the location and match of '4' on the right place in the license plate, as shown in a heat map in Figure 2. This visual also shows the low correlation, represented by cooler colors, of the other pixels of the license plate with the template '4' character. Figure 3 shows the results of correlating position six (sixth character) on the license plate with the entire template dictionary. In this case, the sixth character is '4' and the stem plot shows that indeed the template '4' was chosen as the highest match and most probable choice. However, our experiments did reveal that other characters do not produce as distinct correlation results and may not offer an obvious match choice. When correlation values are close, our program will always choose the highest one which could possibly lead to an incorrect detection.

Test license plate

Template character '4' identified and located on license plate

'4' identified as most likely match at position six

To further illustrate the degree of accuracy of our program, we have constructed a Confusion Matrix of the correlation results (Figure 4) between license plate characters and the template dictionary characters. After running our program on several test license plates, we obtain the average correlation value between each character and the template dictionary to create this data visualization that shows the highest matches in warm colors. Through this diagram, it can be seen that the close matches lie along the diagonal of the matrix, which is ideal as the diagonal represents the matching characters between the template dictionary and license plate. However, on this figure it is also easy to visualize the "trouble characters", such as the '8', 'B', and the 'D', which are slightly off the diagonal and may show similar high correlation values even when they are not the correct match.

Visualization of high correlation values between matches