Sign Language Recognition using Yolo Model

Project Code :TCMAPY1606

Objective

The primary objective of this project is to develop a robust and efficient Sign Language Recognition system using the YOLOv8 deep learning model. The goal is to detect and classify American Sign Language (ASL) gestures in real-time and convert them into readable English text.

Abstract

This project presents an innovative approach to real-time Sign Language Recognition using the YOLOv8 (You Only Look Once version 8) object detection algorithm. Aimed at enhancing communication accessibility for individuals with hearing and speech impairments, the system is capable of detecting and recognizing a comprehensive set of American Sign Language (ASL) hand signs, including alphabets (A–Z), numbers (1–9), and commonly used expressions such as "Hello," "Thank You," "Yes," "No," and "I Love You." The dataset used is sourced from Roboflow's sign recognition collection, which provides annotated images of various hand signs. The model is trained in Google Colab for optimized performance and later integrated into a user-friendly Streamlit-based web application. This enables end-users to upload or use real-time camera input for instant sign detection. YOLOv8's advanced architecture ensures high-speed inference and accurate localization, making the system suitable for real-time applications. The framework’s end-to-end design bridges the gap between the deaf community and non-signers by enabling quick interpretation of signs into readable text. This project lays the foundation for future expansion into gesture-based human-computer interaction, education tools, and assistive technologies for differently-abled individuals. 

  Keywords:
YOLOv8, Sign Language Recognition, Streamlit, Real-Time Detection, Assistive Technology.

NOTE: Without the concern of our team, please don't submit to the college. This Abstract varies based on student requirements.

Block Diagram

Specifications

H/W CONFIGURATION:

u  Processor    - I3/Intel Processor

u  Hard Disk    -160 GB

u  RAM            - 8 GB

 

 S/W CONFIGURATION:

 

u  Operating System       :   Windows 7/8/10      .          

u  Server side Script       :   HTML, CSS & JS.

u  IDE                             :   Vscode

u  Libraries Used            :    Numpy, Pandas,Sklearn,Tensorflow

u  Technology                 :    Python 3.6+.

Demo Video