Interactive Games Using Hand-Eye Coordination Method for Autistic Children Therapy

Azrulhizam Shapi’i, Noor Atifah Abd Rahman, Mohd Syazwan Baharuddin, Mohd Ridzwan Yaakub


Recent studies have found that imbalanced motor skills (hand-eye coordination) among autism spectrum disorder (ASD) or autistic children cause lower efficiency in daily routines. Autistic children need long-term rehabilitation programs to improve their abilities. However, problems with a lack of motivation to participate in conventional therapy and the high cost of therapy sessions arise over time. Autism children need to do repetitive activities every time therapy sessions been done. Repetitive activities cause children having less interest to participate ongoing therapy sessions. Other than that, the therapy process usually requires a long time to be implemented that cause the relatively high cost had to be paid by the patient's family. The use of technology is seen more effective and less boring for child with autism. However, the use of games technology require gamer to hold game controller. Proposals for motion-based touchless games using NUI technology, such as the Kinect Xbox 360, to be used in rehabilitation are exciting for patients, but the design elements do not meet the requirements of autistic people. Hence, this research proposes a Kinect game based on design elements for autistic rehabilitation. The objective of this research is to identify symptom of eye-hand coordination problem and develop serious game using Kinect technology as the solution for the problem faced by autism children. This technology provides a low-budget solution costs of therapy and games base on 3D sensor without the use of control equipment which must be hold or touch by hand. Moreover, Kinect does not need a controller or additional body-worn attachment during play time. A game prototype was developed and measured, and an evaluation resulted in positive feedback from the user and therapists, thus meeting the objective of this study.


Autism, Hand-eye coordination, Kinect, Rehabilitation game, Natural user interface.

Full Text:




Baranowski, T., Buday, R., Thompson, D.I., & Baranowski, J.(2009). Playing for Real: Video Games and Stories for Health-Related Behavior Change. American Journal of Preventive Medicine34(1), 1–23.

Wilkinson, N., Ang, R.P., & Goh. D.H. (2008). Online Video Game Therapy for Mental Health Concerns: A Review. International Journal of Social Psychiatry, 54(4), 370–382.

Shapi`i, A., Nor Bahari, N., Arshad, H., Mat Zin,N.A., Mahayuddin, Z.R. (2015). Rehabilitation Exercise Game Model for Post-stroke using Microsoft Kinect Camera, International Conference on Biomedical Engineering (ICoBE), Penang, 117-122.

Elaklouk, A. Mat Zin, N.A., Shapii, A.(2013) Game design for acquired brain injury cognitive rehabilitation : a conceptual framework, Advances in Visual Informatics (Lecture Notes in Computer Science), 218-230

Ceranoglu, T.A.(2010). Video Games in Psychotherapy. Review of General Psychology14(2), 141–146.

Bertachinni, F., Rende, A.D., Bilotta, E., Gabriele. L., Elizabeth, D., & Valenti, A.(2013). An Emotional Learning Environment for Subjects with Autism Spectrum Disorder. International Conference on Interactive Collaborative Learning (ICL), 653–659.

Smisek, J., Jancosek, M., & Pajdla, T. (2011). 3D with Kinect. IEEE International Conference on Computer Vision Workshops, 1154–1160.

Bruer, J., & Bente, G. (2010). Why so serious? On the relation of serious games and learning. Journal for Computer Game Culture, 4(1), 7–24.

Shapi`i, A. Mat Zin, N.A., Elaklouk, A. (2015). A game system for cognitive rehabilitation. Biomed Research International , 1-7.

Chien, Y.C., Lange, B., Mi, Z., Koenig, S., Requejo, P., Somboon, N., Sawchuk, A.A., & Rizzo, A.A.(2012). Towards Pervasive Physical Rehabilitation Using Microsoft Kinect. 6th International Conference on Pervasive Computing Technologies for Healthcare (Pervasive Health) and Workshops, 159–162.

Ahmed Mohammed Elaklouk, Nor Azan Mat Zin , Azrulhizam Shapii. (2015) Investigating therapists` intention to use serious games for acquired brain injury cognitive rehabilitation, Journal of King Saud University Computer and Information Sciences . 160-169.

Chung, L.L., Ya, L.H., Tzu, K.L., Chien, M.T., Yung, F.C., & Erdenetsogt, D.(2015). A Microsoft Kinect-based virtual rehabilitation system to train balance ability for stroke patients. International Conference on Cyberworlds, 54–60.

Elaklouk, A, Mat Zin, N. Shapii., (2013). A Conceptual Framework for Designing Brain Injury Cognitive Rehabilitation Gaming System, International, Journal of Digital Content Technology and its Applications, 7(15):31-41

Ave, A.C., Caro, J.D., Pacapac, D.M.C. & Salamanca, K.M.G.(2013). A Kinesthetic Game as a Motivational Aid and Monitor in Upper Extremities Burns Rehabilitation.Information. Intelligence, Systems and Applications (IISA), Fourth InternationalConference,1–3.

Lange, B., Flynn, S., Proffitt, R., Chien, Y.C., Meng, & Rizzo, A.S. (2010). Development of an Interactive Game-Based Rehabilitation Tool for Dynamic Balance Training. Journal of Topic Stroke Rehabilitation 17(5), 345–352.

Novak, J. Game Development Essentials. 3rd ed. USA: DELMAR Cengage Learning.

Bartoli, L., Garzotto, F., Gelsomini, M., Oliveto, L., & Valoriani, M.(2014). Designing and Evaluating Touchless Playful Interaction for ASD Children. IDC '14: Proceedings of the 2014 Conference on Interaction Design and Children, 17–26.



  • There are currently no refbacks.

Published by INSIGHT - Indonesian Society for Knowledge and Human Development