Sign Language is the main communicating tool for hearing impaired and mute people, and to ensure an independent life for them, the automatic interpretation of sign language is an extensive research area. With the use of image processing and artificial intelligence, many techniques and algorithms have been developed in this area. Every sign language recognition system is trained for recognizing the signs and converting them into required pattern. The proposed system aim to provide speech to speechless, in this paper the double handed Indian Sign Language is captured as a series of images and it’s processed with the help of MATLAB and then it’s converted to speech and text.