An Android Based Human Computer Interactive System with Motion Recognition and Voice Command Activation



Human machine interface (HMI), referred to as a correlated system of human activities and operation of a specific device, ratifies control mechanism of a targeted machine by execution of certain physical actions. This paper presents an effective design of an Android-based human computer interactive (HCI) system with voice command activation and gesture recognition to control a computer. With a continuous data acquisition from a 3-D accelerometer sensor embedded into the smart phone, the proposed system substantiates remote computing through processing of the orientation readings of physical movement of the phone and compilation of inputted audio texts. With Wi-Fi connectivity, the smart phone is attached to the wrist of a human body. The motion parameters are utilized to control the cursor movement of the host computer and the voice commands are used for ultimate execution of an instruction. Such a wireless system provides reliable and effective control operations of the computing domains, electronic devices and robotic structures. Physically challenged people get benefitted by such systems through easy and faster computing operations. The developed work has been tested under certain conditions and the performance analysis affirms its sustainability.

Full Text:



Cho H , Kim S , Baek J and Fisher P, “Motion recognition with smart phone embedded 3-axis accelerometer sensor”, in Proc. IEEE Int. Conf. Systems, Man, and Cybernetics (SMC), pp. 919-924, Oct. 2012.

Torunski E , Saddik AE and Petriu E. , “Gesture recognition on a mobile device for remote event generation”, in Proc. IEEE Int. Conf. Multimedia and Expo (ICME), pp. 1 6, Jul. 2011.

Sarkar M , Haider MZ , Chowdhury D and Rabbi G, “An Android Based Human Computer Interactive System with Motion Recognition and Voice Command Activation”,in Proc. 5th Int. Conf. Informatics, Electronics and Vision (ICIEV), pp. 170-175, 2016.

Kannan P , Udayakumar SK and Ahmed KR , “Automation using voice recognition with python sl4a script for android devices”, in Proc. Int. Conf. Industrial Automation, Information and Communications Technology (IAICT), pp. 1-4, Aug. 2014.

Shin KI , Park JS , Lee JY, and Park JH , “Design and implementation of improved authentication system for android smartphone users”, in Proc. 26th Int. Conf. Advanced Information Networking and Applications Workshops, pp. 704-707, Mar. 2012.

Zhang F , Wang X , Yang Y , Fu Y , and Wang S , “A human-machine interface software based on android system for hand rehabilitation robot”, in Proc. Int. Conf. Information and Automation (ICInfA), pp. 625-630, Aug. 2015.

Zhang S , McCullagh P , Nugent C , and Zheng H, “Activity monitoring using a smart phones accelerometer with hierarchical classification”, in Proc. Sixth Int. Conf. Intelligent Environments (IE), pp. 158-163, Jul. 2010.

Obuliraj B , Vijayalakshmi R and Sudha K , “Remote controlling pc with smartphone inputs from remote place with internets”, in Proc. National Conf. Research Advances in Communication Electrical Science and Structure (NCRACCESS), pp. 40-43, 2015.

Khadilkar SU and Wagdarikar N , “Android phone controlled voice, gesture and touch screen operated smart wheelchair”, in Proc. Int. Conf. Pervasive Computing (ICPC), pp. 1-4, Jan. 2015.

Zhong Y , Raman TV, Burkhardt C , Biadsy F and Bigham JP, “Justspeak: Enabling universal voice control on android”, in Proc. 11th Web for All Conf., ser. W4A 14. New York, NY, USA: ACM, pp. 36:1-36:4, 2014 [Online]. Available:

Wang X , Tarrio P , Bernardos A and Metola E , “User-independent accelerometer-based gesture recognition for mobile devices”, The Advances in Distributed Computing and Artificial Intelligence Journal, 2012.

Marasovic T , Papic V and Marasovic J , “Motion-based gesture recognition algorithms for robot manipulation”, Int. Journal of Advanced Robotic Systems, 2014.

Lu Z , Chen X , Li Q , Zhang X and Zhou P , “A Hand Gesture Recognition Framework and Wearable Gesture-Based Interaction Prototype for Mobile Devices”, IEEE Trans. Human-Machine Systems, vol. 44, no. 2, pp. 293-299, Apr. 2014.

Xie R and Cao J, “Accelerometer-Based Hand Gesture Recognition by Neural Network and Similarity Matching”, IEEE Sensors Journal, vol. 16, no. 11, pp. 4537-4545, Jun. 2016.



  • There are currently no refbacks.

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Creative Commons License

This site is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.