Hand Gesture Recognition using Gradient based Key Frame Extraction

Vibhav Joshi, Rushikesh Hiray, Sakshi Kale, Shweta Mantode

Abstract


Sign language is a mainstream method of communication by people suffering from hearing and speech impairment and other disabilities. Around 360 million people globally are suffering from disabled hearing loss. Minimizing the communication gap between differently-abled and normal people becomes a necessity to ensure effective communication among all. In this paper, a method for developing a system which recognizes cue symbols of sign languages to act as a communication medium between healthy and differently-abled people has been proposed. Two standard sign languages are considered for reference, as, cue symbols vary for each region. The system includes a hand gesture recognition system, where gestures are given as input and the corresponding output is in the form of text as well as speech. We have used gradient value for splitting two or more gestures from a continuous video sequence and extracting key frames. Features of pre-processed key frames are extracted using OH (Orientation Histogram) and dimensions of these features are reduced using PCA (Principal Component Analysis). SVM (Support Vector machine) classifier is used for classification of the isolated pre-processed gestures. After the classification process, corresponding connotation of gestures given as input is obtained.

Full Text:

PDF

References


Kumud Tripathi∗, Neha Baranwal and G. C. Nandi, Continuous Indian Sign Language Gesture Recognition and Sentence Formation, Robotics and Artificial Intelligence Lab, Indian Institute of Information Technology, Allahabad, Eleventh International Multi-Conference on Information Processing-2015 (IMCIP-2015).

Vidur S. Bhatnagar, Rachit Magon, Rashi Srivastava, Manish K Thakur “A Cost Effective Sign Language to Voice Emulation System” in Proc. 8th International Conference, 2015.

Jung-Bae Kim, Kwang-Hyun Park, Won-Chul Bang and Z. Z. Bien, Continuous Gesture Recognition System for Korean Sign Language based on Fuzzy Logic and Hidden Markov Model, IEEE International Conference on Fuzzy Systems, 2002, FUZZ-IEEE’02, Proceedings of the 2002, vol. 2, pp. 1574, 1579 doi: 10.1109/FUZZ.2002.1006741, (2002).

Lalit Kane, Pritee Khanna “Towards Establishing a Mute Communication An Indian Sign Language Perspective” in IEEE Proceedings of 4th International Conference on Intelligent Human Computer Interaction, Kharagpur, India, December 27-29, 2012.

Matheesha Fernando, Janaka Wijayanayaka “Low-cost approach for Real-time Sign Language Recognition” in 2013 IEEE 8th International Conference on Industrial and Information Systems, ICIIS 2013, Aug. 18-20, 2013, Sri Lanka.

Robita, IIIT Allahabad.


Refbacks

  • There are currently no refbacks.