QR Code
QR Code
QR Code
Research Article
Development of Smart Plate Number Recognition
System for Fast Cars with Web Application
Received 20 September 2019; Revised 16 November 2019; Accepted 6 January 2020; Published 7 February 2020
Copyright © 2020 Olamilekan Shobayo et al. This is an open access article distributed under the Creative Commons Attribution
License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is
properly cited.
Traffic law violation has been recognized as a major cause for road accidents in most parts of the world with majority occurring in
developing countries. Even with the presence of rules and regulations stipulated against this, violators are still on the increase. This
is due to the fact that the rules are not properly enforced by appropriate authorities in those parts of the world. Therefore, a system
needs to be designed to assist law enforcement agencies to impose these rules to improve road safety and reduce road accidents.
This work uses a Vehicle Plate Number Recognition (VNPR) system which is a real-time embedded system to automatically
recognize license plate numbers. It provides an alternative means to VPNR using an open-source library known as openCV. The
main aim of the system is to use image processing to identify vehicles violating traffic by their plate numbers. It consists of an IR
sensor for detecting the vehicle. During testing, a minimum time was set for the sensor to detect the object which was recorded by
the microprocessor. Once it was less than the set time, the camera was triggered to capture the plate number and store the image
on the Raspberry Pi. The image captured is processed by the Raspberry Pi to extract the numbers on the image. The numbers on
the capture imaged were viewed on a web page via an IP address. The system if implemented can be used to improve road safety
and control traffic of emerging smart cities. It will also be used to apply appropriate sanctions for traffic law violators.
1. Introduction The earliest systems were deployed on the A1 road and at the
Dartford Tunnel. However, it gained more recognition in the
With the increase in the number of automobiles, it has last decade due to the advancement of the digital camera and
become increasingly challenging to track them and almost the increase in computational speed [3]. The first written
impossible to identify the owners of these vehicles in case of down case of VNPR being used to solve a crime case oc-
violation of any traffic law [1]. This has led to increase in curred in November 2005, in Bradford, UK. In the early
traffic congestion, and with it comes traffic problems. Several 1990s, significant advancement in technology led to the
cases of kidnapping, hit and run, robbery, smuggling, and redesign of vehicle plate number recognition system from
on-road fatalities are continuously reported, and this is limited, highly expensive, fixed base applications to simple
because these vehicles cannot be easily recognized especially easy to install mobile ones [4]. Vehicle plate number rec-
moving at high speed [2]. This has led to the need to develop ognition system has broad applications and is not limited to
a system that can tackle these issues. Vehicle plate number traffic control. It can be used in parking; it recognizes a
recognition system was invented by the British in 1976 at the vehicle when it enters a gate and stores the information on a
police scientific development branch in the UK. Prototype database and when the vehicle is leaving it matches it up with
systems were already in full flow by 1979, and initial con- what has already been stored. It is also used in access control
tracts were awarded for mass productions and industrial use. to grant access to only vehicles of authorized personnel.
2 Applied Computational Intelligence and Soft Computing
Although vehicle plate number recognition system has been implementation of an automated plate number recognition
regularly addressed on paper, it has not been completely system using Optical Character Recognition (OCR) to in-
actualized in real-life scenarios due to certain constraints [5]. terpret information on the images of a vehicle plate number
We live in a digital age with new technologies springing forth using Raspberry Pi processor. The image captured is pro-
everyday, and as a result, only minimal human effort is cessed and verified by the Raspberry Pi processor for au-
required to get things done and life is generally simplified. thentication purposes. The proposed system then segmented
Due to the digitization of our everyday life images taken the license plate and identified each particle of the fragment.
from a camera become very useful as these images can be To get final result, the system extracts the number plate using
processed to extract important information from them [6]. open ALPR design. This result was then manually compared
Integrating vehicle plate number recognition system into with the input image. The system used was unable to detect
intelligent transport systems makes it possible to automate moving object and could not improve quality of image in the
motorway toll collection, analyze traffic, and improve law system. The system was however able to easily identify the
enforcement. The need to integrate information and tech- plate number and process the image of the number plate.
nology into all aspects of human life has led to the demand The authors in [11] implemented a system to detect over-
for processing of vehicles as a valuable resource information speeding vehicles & inform authorities in case of any vio-
communication. This is because an information system lations. The system makes use of LIDAR (Light Detection
without any form of data on it is unrealistic. There has always and Ranging) technology to check the speed of the moving
been a need to identify vehicles by their plate number in a vehicle. LIDAR is a remote sensing method that makes use of
real environment and use the information in real-life ap- light in form of pulsed laser to measure the distance to a
plications. Due to this, various techniques and vehicle target by illuminating the target with pulsed laser light and
recognition systems have been developed for various ap- using a sensor to measure the reflected pulses [12]. The
plications such as traffic control, automation, and security major drawback of the system is its high cost and the amount
[7]. of time taken to achieve it. The system was however an
effective system. The authors in [13] implemented an ALPR
2. Related Works for detecting traffic violators for promoting sustainability in
modern transport systems. This system made use of a camera
The increasing affluence of modern life has led to an increase to capture the plate number of vehicles. The image was then
in the number of user-road vehicles. This has led to an refined using different techniques such as thinning and
unprecedented level in civil problems—the problems being convolution; next OCR (Optical Character Recognition) was
vehicle identification and traffic control [8]. Due to the used to recognize the text on the number plate. The image
increasing challenge of traffic control, there arises a need to was then extracted in the form of text; the characters are then
manage traffic better. The recognition of fast-moving ve- matched with a prestored database containing details of the
hicles is an important aspect of Intelligent Transportation college or campus road users with their cell-phone number
System (ITS). ITS was developed to implement information and vehicle plate number. When a match is detected, the
and communication technologies in the field of road offender is sent a warning message on his phone number.
transport, some of which include vehicle management, The major limitation of the system was the difficulty in
traffic management as well as interfacing with other systems implementing system in larger areas like cities. The system
of transportation. A lot of researchers have tried to develop was highly accurate and cost effective as not many com-
ITS systems with different levels of success stories. The ponents were required. The authors in [14] designed a
authors in [9] designed a system to recognize plate numbers system to automatically detect number plates of vehicles in
using Python and OpenCV. The design was implemented the cases of variations in the number plate. These variations
using a real-time embedded system designed to automati- could be the location of the plate, font size on the plate, and
cally identify number plates of vehicles. The system made use various designs and text used on the number plate. The
of the python software and image processing algorithms in system made use of a preprocessing module to improve the
the OpenCV library to capture the image. It was also used in quality of the captured image. Removal of blur and noise was
preprocessing to resize the image, perform error checking, also carried out in this stage. Next, the system used plate
and convert image to grayscale. Threshold algorithms were localization to create a bounding area around the region of
used to binarize the image in order to retain the quality of the image. Then the numbers on the number plate were
image, and character segmentation was done using image extracted after which they were segmented to identify the
scissoring to scan the image and crop out the white portion region of each character on the number plate. Finally, the
by partitioning the image lines into individual characters. numbers were sent to a database with appropriate infor-
The system however was unable to sense moving vehicles mation on the owner of the vehicle. The downside of the
and had no presence of database to record information system was the several stages involved which were cum-
collected. The system is easy to use as it makes use of free- bersome and the several components required which made it
open source software applications that are easy to use and expensive. The upside of the system was the high accuracy of
also makes use of computer vision for conversion of still 98.75% recorded in number plate detection and the pro-
images to information usable by computers. The authors in vision of a database to record information collected which
[10] designed a system that automatically recognizes plate was useful for referral purposes. The author in [15] designed
number using Raspberry Pi. The system proposes the a system to identify the plate number of fast-moving vehicles
Applied Computational Intelligence and Soft Computing 3
using snapshots of precaptured images of surveillance of the camera. The plus of the system was that it was
cameras. The design made use of an estimation algorithm automated and made use of a database to compare existing
parameter known as the novel kernel parameter for plate numbers.
deblurring the plate number of the fast-moving vehicles.
Various algorithms were used to carry out sparse repre-
2.1. The Problem. Traffic laws and devices are put in place to
sentation, the angle was calculated using the genuine
monitor and control traffic, including pedestrians, motor
motion angle of the vehicle and the length of the motion
vehicle drivers, and cyclists. As is well known, there are
kernel was calculated using random transform in the
several traffic law offenders in our country today and this has
frequency domain. Finally, the image was deblurred using
led to several accident incidents without any repercussion
NBID (nonblind image deblurring) algorithm. The
being meted out. These traffic law breakers go about their
downgrade of the system was the extreme difficulty in
business freely and confidently knowing that they may never
implementing the system and the lack of a database to
be caught because the appropriate systems have not been put
record information collected. The positive side of the
in place. The resultant consequence of breaking traffic laws
system was its ability to handle motion blurred number
has led to traffic gird locks, road accidents, and even death
plate which is unrecognizable by the naked eye. The authors
when involved in a fatal accident. There is no questioning the
in [16] designed a system to recognize dirty and unclear
need for appropriate systems to check mate traffic law
vehicle number plates for real-time applications. The
breakers so as to ensure our roads are safer. The current
system was implemented to meet real-time conditions,
problem involves identifying fast-moving vehicles by their
some of which include variations in weather conditions,
plate number. It can be extremely hard to capture the image
poor lighting, different traffic situations, and high-speed
of moving vehicles in real time in such a way that the vehicle
vehicles all of which affect vehicle detection. The system
plate number is detected. The existing systems reviewed
implemented made use of several hardware platforms along
above have deployed several means to capture plate number
with robust algorithms to detect vehicle plate number.
systems. Most of them successfully captured the plate
Datasets were used from images captured from crossroads
numbers of fast-moving vehicles. The closest to this work,
in different conditions, in the day and night and other
which uses OpenCV with python, was able to detect the plate
various conditions. The system made use of plate detection
number but did not incorporate a database system to
to identify the vehicle plate number which was then seg-
identify the culprit.
mented into individual characters before character rec-
ognition was carried out. The limitation of the system was
its inability to detect moving vehicles. The benefits of the 2.2. Proposed Solution. Our proposed solution will be a
system were the high accuracy results of 98.7%, 99.2%, and novel system that uses the existing OpenCV code, written in
97.6% recorded and its numerous real-life applications. The Python but will incorporate a web page that will display the
authors in [17] implemented a system to recognize vehicle result of the saved plate number, which can be used to query
number plate using IOT (Internet of Things). The system a database for the identification of a defaulter. The database
was designed to meet changing urban requirements in the will have the plate numbers of all vehicles that will be tested
modern-day transportation system. The system proposed and queried to reveal the defaulter. The system developed
four major stages: preprocessing of the obtained image to will take a very effective and methodological approach in the
enhance the quality of the number plate, extraction of the detection of fast-moving vehicles, using cost-effective
plate number region, character segmentation to segment techniques and achieving great results. The process flow of
each character in the number plate, and character recog- the system is shown in Figures 1–5.
nition. The system also proposed the use of a novel algo-
rithm to extract the plate number region through a unique
2.2.1. Vehicle Detection. The proposed system identifies the
edge detection algorithm. The system also created a da-
moving vehicle using passive infrared sensors (PIR). Upon
tabase which contains information about the owner of
sensing the vehicle, the PIR sends an input signal to the
different vehicles which was done using IOT. However, the
Raspberry Pi which in turn triggers the USB camera.
system was unable to detect moving vehicles and could not
be used in real-life application. The system however had
provision of a database to record collected information and 2.2.2. Image Acquisition. The next step is the image ac-
was implemented using modern technology—IOT. The quisition. The Raspberry Pi which is interfaced with on
authors in [18] developed a system to identify vehicles that receiving the input signal triggers the camera to capture the
go in and out of a barrier gate parking system. The system image of the vehicle. This is quite a difficult task as it entails
made use of a real-time embedded system consisting of a capturing the image of a moving vehicle to extract infor-
Pinoir camera for image capture and a Raspberry Pi for mation in real time. The image should be captured in such a
image processing. Once the system detects a vehicle way that it contains either the front or rear view of the
approaching the barrier, it automatically reads the license vehicle with its plate number [19]. The image to be captured
plate number and compares it with an existing list and is usually in the RGB (Red, Green, and Blue) colour model.
opens the barrier if there is a match. The major short- The level of success in this stage can be affected by a number
coming of the system was the inability to capture the license of factors, some of which include system noise, blur, dis-
plate number at far distances because of the fixed position tortion, and excessive relative motion of vehicle.
4 Applied Computational Intelligence and Soft Computing
Start
2.2.5. Character Segmentation. This process involves crop-
ping out the required portion of the plate number. It par-
Object dectection titions line images into individual characters; it divides an
image comprised of characters into subimages of individual
symbols. It involves isolating the image from the back-
Image capture ground in order to properly identify each text.