In the context of India, a country with a rich tapestry of regional sign languages, effectively recognizing and interpreting Indian Sign Language (ISL) presents a formidable challenge for individuals with hearing and speaking impairments. This system introduces an innovative method for ISL recognition by leveraging the YOLOv5s (You Only Look Once version 5) object detection framework. Complementing the YOLOv5s, the project integrates Microsoft Azure’s cognitive app service, specifically the computer vision capabilities, and utilizes Mesa, a Python agent development framework. This comprehensive approach aims to enhance the expression and communication of individuals with hearing and speaking impairments in a predominantly spoken language-oriented world.