Real-Time Anomaly and Incident Detection Based on YOLO and Lucas–Kanade Optical Flow Tracking

Project Code :TCMAPY2396

Objective

The objective of this project is to develop a real-time anomaly and incident detection system based on deep learning techniques, specifically YOLOv26 and RT-DETR. The project aims to enhance safety monitoring by detecting accidents using images captured through surveillance systems. By leveraging the capabilities of YOLOv26 for object detection, RT-DETR for improved multi-object tracking, and Soft-NMS for enhanced localization, the system aims to automatically identify accidents as they occur. The integration of Grad-CAM will provide visual interpretability by highlighting regions in the image that influence the model's decisions. The goal is to create an efficient, automated solution for real-time accident detection, enabling rapid response to incidents and enhancing safety management systems.

Abstract

This paper presents a novel approach to real-time anomaly and incident detection using YOLOv26, RT-DETR, Grad-CAM, and Soft-NMS. The system aims to identify incidents, specifically accidents, by processing image datasets through advanced object detection techniques. The YOLOv26 and RT-DETR models are employed for detecting objects in images, with Soft-NMS applied to enhance the accuracy of object localization by reducing redundant predictions. Grad-CAM is utilized for visual interpretability, providing insights into the decision-making process of the models by generating class activation maps. The detection process focuses on a single class, accidents, and optimizes the performance by fine-tuning hyperparameters and leveraging the strengths of these advanced models. The methodology improves the robustness and precision of incident detection in real-time applications, offering a scalable solution for automated surveillance and safety systems.

Keywords: YOLOv26, RT-DETR, Grad-CAM, Soft-NMS, real-time anomaly detection, accident detection, object detection, hyperparameter optimization, machine learning, deep learning.

NOTE: Without the concern of our team, please don't submit to the college. This Abstract varies based on student requirements.

Block Diagram

Specifications

SOFTWARE REQUIREMENS

Operating System                               :  Windows 7/8/10

Server side Script                               :  html,css,js

Programming Language                     :  Python

Libraries                                             : Flask, Pandas, pytorch                                                                                                           Numpy , Seaborn

IDE/Workbench                                  :  VSCode

Database                                             :  SQLite  

HARDWARE REQUIREMENTS

Processor                                  - I3/Intel Processor

RAM                                       - 8GB (min)

Hard Disk                                - 128 GB

Key Board                               - Standard Windows Keyboard

Mouse                                      - Two or Three Button Mouse

Monitor                                    - Any

Demo Video

mail-banner
call-banner
contact-banner
Request Video