Research on building a sign language recognition system using strain sensors based on Ion liquid applied in the subject of Microelectromechanics

Abstract

The primary goal of this paper is to translate sign language gestures into both spoken words and written text. The system utilizes a glove with strain sensors based on ionic liquid technology. These strain sensors are attached to each finger of the glove, enabling the detection of movement in the fingers. When the hand moves to express a letter in sign language, the resistance of the strain sensors on each finger changes. The changes in resistance from the strain sensors are likely translated into a digital signal. This digital signal is then processed to recognize the specific sign language gesture being made. The recognized sign language gestures are converted into spoken words through a voice synthesis system. Simultaneously, the system may display the corresponding written text, providing a visual representation of the sign language gesture.