<p>Ever wondered how those cameras catch license plates so quickly? Well, this project does just that! Using YOLOv8 for real-time license plate detection and OCR models, it recognizes the text in the plates. You'll get to dive into the world of computer vision, where detecting and reading license plates becomes a breeze. Whether you're into AI projects or just curious, this one's going to be a great work!</p>

Learn how to build a real-time license plate detection system using YOLOv8 and OCR. Detect license plates efficiently in images and video streams for various applications.

YOLOv8 and OCR models are used for accurate and quick results in automated license plate identification and recognition.

Real-Time License Plate Detection Using YOLOv8 and OCR Model

<h2>Project Overview</h2><p>This project takes license plate detection to the next level with <a href="https://www.aionlinecourse.com/ai-basics/yolo-you-only-look-once" target="_blank">YOLOv8</a>. Yolov8 is a super-fast object detection model. The goal is to <strong>detect license plates</strong> in images and then extract the text from them using <strong>OCR models</strong>. It&rsquo;s perfect for <strong>building smart systems</strong>, like parking lots or toll booths, that need to recognize vehicles automatically.  Whether you're working with images or video streams, it handles both with ease. The project is designed to be fast, accurate, and easy to use. Plus, it&rsquo;s scalable. </p><h2>Key Features:</h2><ul><li>YOLOv8 is fast and precise. It detects plates instantly in real-world conditions.  </li><li>The project doesn&rsquo;t just detect plates, it reads them! OCR helps extract the plate number quickly.  </li><li>With high accuracy, this system minimizes mistakes in license plate recognition, making it dependable.  </li><li>Built with simplicity in mind, you can easily integrate it into any system or application.</li></ul><h2>Prerequisites</h2><p>Before you dive into this fun project, here are a few things you'll need to have ready:</p><ul><li>Ensure that <a href="https://www.python.org/" target="_blank">Python</a> is installed (recommended to use at least the third version).  </li><li>For license plate detection, you will need to install YOLOv8 from Ultralytics.  </li><li>Don&rsquo;t forget to integrate an OCR library that will help to read the text of the license plate, for example, Tesseract or EasyOCR.  </li><li>The OpenCV library will be associated with image processing, and it will be helpful to display the results in real-time.  </li><li>Ensure that you have <a href="https://pypi.org/project/pip/" target="_blank">pip</a> or conda to install the necessary Python packages as the installation process will be easy.  </li><li>You don&rsquo;t have to be a programming expert, although any background in Python programming will assist with reading and tweaking the code.  </li><li>Join <a href="https://roboflow.com/" target="_blank">RoboFlow</a> and sign up for a free account and organize, label, and annotate your data set. RoboFlow helps in simplifying the preparation of the data for YOLOv8.</li></ul><h2>Approach</h2><p>Here in this project, we apply YOLOv8 to detect license plates in the images and video stream. The Yolov8 model is trained for license plate detection. This model guarantees a high level of detection and accuracy. Once the license plates are detected, the <a href="https://www.aionlinecourse.com/ai-basics/optical-character-recognition-ocr" target="_blank">Optical Character Recognition</a> tools such as Tesseract or EasyOCR extract the text out of those plates. For real-time image processing and visualization, OpenCV is employed to handle the input and display the results. The dataset for training and testing is managed and labeled using RoboFlow. This approach effectively combines YOLOv8 for object detection with OCR for text recognition. This enables fast and accurate detection and reading of license plates, even in challenging conditions.</p><h2>Flow of Actions</h2><h3>The overall workflow of this project includes:</h3><ul><li><strong>Data Collection</strong>: We start by collecting a dataset from Roboflow.    </li><li><strong>Data Labeling and Preprocessing</strong>: Before the detection of the license plate images, they were labeled using the RoboFlow.  </li><li>Model Setup: Images went through a pre-trained YOLOv8 model for detecting license plates.  </li><li><strong>Detection Phase</strong>: This project used the YOLOv8 model to detect and localize license plates on the input images.  </li><li><strong>OCR Integration</strong>: Tesseract or EasyOCR was used to extract the numbers from the license plate.  </li><li><strong>Image Processing</strong>: For managing input images and displaying the detection results OpenCV was used.  </li><li><strong>Text Output:</strong> Text was extracted from the license plate and further preprocessed and exclaimed in visual form.</li></ul><h2>Data Collection</h2><p>For this project, the dataset used was obtained from publicly available license plate image datasets from Roboflow. These images were then analyzed using RoboFlow for labeling and making the images fit for training YOLOv8 models. No custom data collection was performed. The project collected the dataset that was primarily developed for license plate detection and recognition challenges.</p><h2>Data Preparation</h2><p>The dataset involved in this project comprises vehicles with clear number plates. To label these images, the RoboFlow was used to draw the exact location of the plate. To make the dataset accurate, the images were taken under different lighting conditions, at different angles, and perspectives. After labeling, the data was split again into train and test so as to train the YOLOv8 model for license plate detection and testing the performance of the model. Such a preparation phase contributed to a model capable of identifying license plates in different scenarios in a real-world setting.</p><h2>Data preparation workflow:</h2><ul><li><strong>Dataset Upload:</strong> Users uploaded vehicle images showing their number plates to RoboFlow for further processing.  </li><li><strong>Annotation</strong>: All the images were annotated in RoboFlow by indicating various positions of the number plates for proper training of the intended model.   </li><li><strong>Data Augmentation</strong>: Increase the dataset with image variations (rotate, crop, brighten, etc.) to improve the reliability of the model.  </li><li><strong>Data Splitting</strong>: The labeled data was divided into two parts: training data to train the model and test data to evaluate the trained model.  </li><li><strong>Exporting Dataset</strong>: At last, the dataset was exported into a format that can be used with the YOLOv8 model in preparation for the training of the model.</li></ul>


<h2>Step-by-step guide:</h2><h3>Connect Google Drive</h3><p>You can mount your Google Drive in a <a href="https://colab.research.google.com/" target="_blank">Google Colab notebook</a> with this piece of code. This makes it easy to view files saved in Google Drive. Additionally, in Colab, you can change and analyze data. You can also train models.</p>


<p>The os.chdir() function sets the current working directory to the specified path. This means that the code will now operate in this folder for any file-related tasks. The os.getcwd() function is used to print the current working directory. This confirms that the script has successfully moved to the specified directory.</p>


<h2><span style="color: inherit; font-family: inherit; font-size: 1.75rem; font-weight: 500;">Install Necessary Packages.</span></h2><p>This code installs the Ultralytics library. It provides access to the YOLOv8 model for object detection. After installation, it imports the library and runs a system check using ultralytics.checks() to ensure the environment is properly set up and all dependencies are ready for running YOLOv8.</p>


<h2><span style="color: inherit; font-family: inherit; font-size: 1.75rem; font-weight: 500;">Load dataset</span></h2><p>This code trains the <strong>YOLOv8 model</strong> on a license plate dataset for 100 epochs using images sized at 640x640 pixels.<br></p>


<h2><span style="color: inherit; font-family: inherit; font-size: 1.75rem; font-weight: 500;">Install the necessary packages.</span></h2><p>This code imports libraries required for image processing and object detection, including torch for deep learning, OpenCV for handling images, Ultralytics for using the YOLOv8 model, PIL for image manipulation, torchvision transforms for image transformations, and matplotlib for visualizing results.<br></p>


<h2><span style="color: inherit; font-family: inherit; font-size: 1.75rem; font-weight: 500;">Choosing an AI Model for Real-Time License Plate Detection</span></h2><p>For this project, YOLOv8 was chosen due to its exceptional ability. To perform real-time object detection with this model. YOLO models are known for their speed and accuracy in identifying objects within images. YOLOv8 processes number plate images in a single deep layer. It detects and identifies number plates. After that, OCR extracts the main text from number plates for license plate recognition. </p><p>By using YOLOv8, we ensured that the model aligns with the project&rsquo;s goal. It provides fast, accurate, and detection. Also, it enhances the detection capabilities in self-driving applications.</p><h3>Load a pretrained YOLOv8n model</h3><p>This code loads a pre-trained YOLOv8n model from the specified path using Ultralytics.</p>


<p class="">Moreover, this code uses the previously loaded YOLOv8n model to do inference on an image file ('car.png'). The results are stored in the 'results' variable.</p>


<h3>Custom YOLOv8 Model Inference and Result Visualization</h3><p>This code first loads a custom YOLOv8 model from the specified path. It then performs inference on the image 'car.png,' saving the output as specified by save=True. After inference, the results are iterated over, converting each prediction to an RGB image format for display and visualization. Using the plot() method, the predictions are plotted, then displayed, and the final image is saved as 'results.jpg'.</p>


<p class="">Thirdly, the predicted image from the YOLOv8 model is loaded and shown using this code. The image is read using OpenCV's read function, and it is shown using Matplotlib. More so, the YOLOv8 model is run, and the anticipated image is stored in the supplied directory.</p>


<h2><span style="color: inherit; font-family: inherit; font-size: 1.75rem; font-weight: 500;">Identifying Real-Time License Plate Detection from Video</span></h2><p>This code loads a pre-trained YOLOv8 model from the file best.pt. It was previously trained for license plate detection. It then uses this model to run detection on a video file. Then The save=True parameter ensures that the results are saved to the specified location.<br></p>


<h3>Installing Dependencies for Image Processing and OCR</h3><p>This code installs various libraries needed for the project. This includes easyocr for text recognition, scikit-image and opencv-python for image processing, lap and filterpy for tracking and filtering tasks, pandas for data manipulation, and numpy and scipy for numerical computations.<br></p>


<h2><span style="color: inherit; font-family: inherit; font-size: 1.75rem; font-weight: 500;">OCR implementation</span></h2><p>Starts an OCR (optical character recognition) reader utilizing the 'easyocr' library. The reader is set to recognize English characters, and the GPU is disabled. It means the OCR processing will run on the CPU instead of the GPU.<br></p>


This code creates two dictionaries to handle character-to-number and number-to-character conversions. It is for common visual mistakes in license plate recognition. For example, 'O' is often misread as '0', and 'I' as '1'.<br>


The 'write_csv' Python function saves the output of a process detecting license plates and cars into a CSV file. It requires two parameters: output_path and results. It first creates a header with columns for frame number, car ID, bounding boxes for cars and license plates, detection scores, and recognized license plate text. It then loops through the results dictionary, extracting and formatting relevant details like bounding boxes and text for each detected car and license plate.<br>


The license_complies_format function checks if a given text string matches with a specific license plate format. It first checks if the text is exactly 7 characters long. Then, it validates that the first two and the last three characters are uppercase letters. The third and fourth positions must be digits. If all these conditions are fulfilled the function returns True otherwise it returns False.<br>


The function 'format_license' converts a license plate text into a predefined dictionary by mapping. It uses dictionaries 'dict_int_to_char' and 'dict_char_to_int' to format the license plate. If a conversion is possible, it replaces the character; otherwise, it leaves the character unchanged. The function then returns the reformatted license plate string.<br>


The function 'read_license_plate' uses an OCR reader to extract text from a cropped license plate image.  It uses the easyOCR reader to detect text in the cropped image. The function removes spaces, converts the text to uppercase, and verifies if the text follows the required format. It then checks if the text is in the required format. if it is then return the formatted plate and its detection score. If the text is not valid then return None<br>


The get_car function determines which car a license plate detected belongs to by matching the coordinates of the license plate with the vehicles. It iterates through the vehicle_track_ids, to see if this license plate bounding box fits within this vehicle bounding box entirely. If there is a match it will result in an applicable vehicle bounding box as well as that vehicle&rsquo;s id. If no match is made then it returns -. It means that the corresponding vehicle was not found.<br>


<p class="">This piece of code imports the SORT algorithm ('Sort'), OpenCV ('cv2'), and the YOLO from Ultralytics ('YOLO'). An empty dictionary ('results') and a SORT tracker object are initialized.</p>


<h2><span style="color: inherit; font-family: inherit; font-size: 1.75rem; font-weight: 500;">Store result</span></h2><p>This code processes video frames to detect vehicles and license plates. It reads frames from the video and uses the COCO model to detect vehicles and store their bounding boxes. These detections are tracked using a <a href="https://www.aionlinecourse.com/ai-basics/multi-object-tracking" target="_blank">multi-object tracker</a>. The license plate detector identifies license plates, and the function get_car assigns each license plate to its corresponding vehicle. The detected license plates are cropped, processed, and converted to grayscale for easier text recognition. The easyOCR model then reads the license plate text. If valid text is found, the result is stored, including vehicle and license plate details. Finally, all results are saved into a CSV file.<br></p>


<p class="">The interpolate_bounding_boxes function fills in any missing data for vehicles and license plates between video frames. If some frames don&rsquo;t have bounding box information, it estimates the missing data by smoothly interpolating between the known frames. This way, the tracking of vehicles and license plates remains continuous across the video, even when detections are missing. For the frames where data was filled in, it assigns default scores, while the original frames keep their actual detection values.</p>


<h2><span style="color: inherit; font-family: inherit; font-size: 1.75rem; font-weight: 500;">Bounding Box Interpolation and CSV Update</span></h2><p>This code reads bounding box data from a CSV file, interpolates it, and saves the updated information into a new CSV file. First, it opens test.csv in read mode, using csv.DictReader to load the data as dictionaries in a list called data. Next, it processes this data with the interpolate_bounding_boxes(data) function to enhance or fill in bounding box details across frames. Finally, it writes the interpolated data to a new CSV file named test_interpolated.csv, using csv.DictWriter with a defined header that includes frame numbers, car and license plate IDs, bounding boxes, license numbers, and their respective scores. This process enables refined bounding box data for further analysis or use.<br></p>


<h2><span style="color: inherit; font-family: inherit; font-size: 1.75rem; font-weight: 500;">Create a bounding box to detect number plates to check Real-Time License Plate Detection</span></h2><p>The draw_border function adds a border around a rectangle in an image. It uses the top-left and bottom-right coordinates to define the rectangle. Instead of a full box, it draws partial lines at each corner. You can change the color, thickness, and line length for both the x and y axes. The function uses OpenCV&rsquo;s cv2.line() to create these lines. Once done, it returns the image with the border added.<br></p>


<p class="">The code starts by reading a CSV file into a variable called results. It loads the file test_interpolated.csv using pandas. Next, it opens a video file located at v.mp4. The video is loaded using OpenCV's cv2.VideoCapture. It sets up the video writer with the codec mp4v. The frames per second (FPS) and video dimensions are taken from the video. Finally, it prepares to write the output video as out1.mp4 using the original video&rsquo;s width, height, and FPS.</p>


<p>The code creates a dictionary called license_plate. It loops through each unique car_id in the results. For each car, it finds the highest license plate score. It stores the license plate number with the highest score in the dictionary. The video frame number for that car is set using cv2.CAP_PROP_POS_FRAMES. The code reads the frame from the video. Next, it extracts the license plate coordinates from the results. The license plate is cropped from the frame using these coordinates. The cropped image is resized for better visibility. The resized license plate crop is then saved in the license_plate dictionary. After the loop, the frame number is reset to 0 for future processing.</p>


<h2><span style="color: inherit; font-family: inherit; font-size: 1.75rem; font-weight: 500;">Frame Processing with Bounding Boxes and License Plate Overlay</span></h2><p>The code adds license plate numbers to video frames, overlays bounding boxes, and creates a new video file. It's compact, reuses border drawing, and adds text to the frame for improved readability.<br></p>


<p class="">The code defines a 'show_video' function to compress and view videos in a colab Notebook, generating a data URL for display and returning the compressed video.</p>


<p>The code compresses and displays a video using the'show_video' method. More so, it enables interactive viewing through an HTML \&lt;'video'&gt; element with playing controls.</p><p>
</p>


<h2>Project Conclusion</h2><p>In this project, we developed a tool that can automatically find cars and read license plates from video clips and images. We used a method called YOLOv8 to detect the cars and another technique, OCR, to read the numbers on the plates. If any frames were missing data, we filled in the blanks using interpolation to ensure accuracy. The system then linked each plate to the right car and showed the results on the video with clear borders around the vehicles and the plate numbers displayed. This tool can be helpful for things like managing traffic or automating parking systems, offering a simple and practical solution.<br />Whether you're a tech enthusiast or just curious, diving into this project could open a world of opportunities in <strong>AI-powered automation!</strong></p><h2>Challenges and Troubleshooting</h2><ul><li><p><strong>Data Accuracy and Image Quality:</strong><br /><strong>Solution</strong>: The dataset should consist of better images or image enhancement processes like sharpening, contrast, and brightness adjustments can be applied. Image noise reduction can also be utilized or the images may be cleaned up in advance.  </p></li><li><p><strong>Dealing with Missing Data for Frames:</strong><br /><strong>Solution</strong>: Interpolation techniques may be used to fill in the empty data set in between frames in such a manner that the motion is smooth and unbroken. Furthermore, frame rates can also be improved or motion deblurring techniques can be used to restrain losses in detection due to blind spots.  </p></li><li><p><strong>Real-Time Processing Speed:</strong><br /><strong>Solution</strong>: Make use of hardware acceleration for instance a GPU to enhance the speed during processing. As an alternative, one may optimize the model by reducing the video quality or simplifying the model.  </p></li><li><p><strong>License Plate Recognition in Various Conditions</strong>:<br /><strong>Solution</strong>: Train the OCR model on diverse datasets that include plates with different formats and from various angles or lighting conditions. Data augmentation techniques could also be practiced to create more diverse training samples, thus improving performance</p></li></ul><h2>FAQs</h2><p><strong>Question 1: What is the main purpose of the Real-Time License Plate Detection and OCR Recognition project?</strong><br /><strong>Answer:</strong> The first goal is to perform real-time license plate recognition using YOLOv8 for the detection of plates. OCR models for the recognition of text. This is useful in areas such as; traffic control, toll gates, and tracking of vehicles.</p><p><strong>Question 2: What does YOLOv8 bring to the table regarding the involvement of license plate detection and the growth of its efficiency?</strong><br /><strong>Answer:</strong> YOLOv8 is an advanced object detection model that can effectively detect license plates. More so, in single or multiple scenarios, and can accurately detect low-quality or overcrowded images.</p><p><strong>Question 3: What role does the OCR model play in detecting license plates?</strong><br /><strong>Answer:</strong> The OCR model serves to recognize and decode license plates having been detected. Moreover, it converts them into formats that can be analyzed by the computational system.</p><p><strong>Question 4: What are the challenges one might face executing license plate detection using Yolov8?</strong><br /><strong>Answer:</strong> Major difficulties of running OCR on low-quality pictures to character recognition, detecting the speed of the algorithm. Moreover, Changes to the light or weather according to which the text was taken.</p><p><strong>Question 5: Is it possible to use this system together with other traffic or vehicle observation systems?</strong><br /><strong>Answer:</strong> Yes, this can indeed be easily implemented with real-time applications. Examples: traffic monitoring, parking space, automated tolling systems. Because of the scalability of the proposed system.</p><h2>Ready to try by yourself!</h2><p>Ready to take your AI projects to the next level? </p><p>Start exploring today, implement your own solutions, and watch how <strong>AI-driven automation</strong> can transform the way you work. Don’t wait—explore the future of license plate recognition now! To explore more you can visit our <a href="https://www.aionlinecourse.com/ai-basics" target="_blank">website</a>.<br /></p>

Real-Time License Plate Detection Using YOLOv8 and OCR Model

Code Explanation

Step-by-step guide:

Connect Google Drive

Buy Now