Enhancing Communication for People with Autism Through the Design of a Context-aware Mobile Application for PECS
DOI:
https://doi.org/10.13052/jicts2245-800X.1231Keywords:
Autism, IoT, PECS, context aware system, mobile application, sensing technology, autism spectrum disorderAbstract
Autism is a neurodevelopmental condition characterized by difficulties with social skills and communication. Autistic individuals require different types of assistance to cope with these challenges. The Picture Exchange Communication System (PECS) is a commonly used program for teaching nonverbal and symbolic communication skills, particularly for children with limited or no communication abilities. However, despite the development of various technology-based PECS systems, there is a lack of features that can simplify their use by children with autism. In our work, we are developing a design of a personalized and context-aware PECS system. Our system not only presents pictures as content but also adapts and enhances the content using contextual information.
Downloads
References
American Psychiatric Association (APA) (Ed.) Diagnostic and Statistical Manual of Mental Disorders, 5th ed.; American Psychiatric Association: Arlington, VA, USA, 2013.
Organization for Autism Research, Inc. (OAR) Life Journey through Autism: Navigating the Special Education System. 2012. Available online: http://www.researchautism.org/resources/reading/documents/SPEDGuide.pdf (accessed on 16 November 2018).
E. 1, «Cinq méthodes pour aider les autistes,» [En ligne]. Available: https://www.europe1.fr/sante/Cinq-methodes-pour-aider-les-autistes-496156.
A. S.-L.-H. Association, «Augmentative and Alternative Communication (AAC),» [En ligne]. Available: https://www.asha.org/njc/aac/. [Accès le 12 7 2022].
Otebolaku, A.M., Andrade, M.T. Context-aware media recommendations for smart devices. J Ambient Intell Human Comput 6, 13–36 (2015). https://doi.org/10.1007/s12652-014-0234-y.
Brumback, R.A., Harper, C.R. and Weinberg, W.A. (1996) ‘Non-Verbal Learning Disabilities, Asperger’s Syndrome, Pervasive Developmental Disorder: Should We Care?’, Journal of Child Neurology 11 (6): 427–9.
Bondy, A. S., and Frost, L. A. (1994). The Picture Exchange Communication System. Focus on Autistic Behavior, 9(3), 1–19. https://doi.org/10.1177/108835769400900301.
F. Foluke, «What is Communication?,» ResearchGate, 2018.
H. M. B. S. L. L. C. Richler Jennifer, «Developmental Trajectories of Restricted and Repetitive Behaviors and Interests in Children with Autism Spectrum Disorders,» PMC, vol. 22, pp. 55–69, 2010.
Hodges H, Fealko C, Soares N. Autism spectrum disorder: definition, epidemiology, causes, and clinical evaluation. Transl Pediatr. 2020 Feb;9(Suppl 1):S55-S65. doi: 10.21037/tp.2019.09.09. PMID: 32206584; PMCID: PMC7082249.
N. I. o. M. Health, «Autism Spectrum Disorder,» [En ligne]. Available: https://www.nimh.nih.gov/health/topics/autism-spectrum-disorders-asd.
Rechowicz KJ, Shull JB, Hascall MM, Diallo SY, O’Brien KJ. Internet-of-Things Devices in Support of the Development of Echoic Skills among Children with Autism Spectrum Disorder. Sensors (Basel). 2021 Jul 5;21(13):4621. doi: 10.3390/s21134621. PMID: 34283166; PMCID: PMC8272129.
Xiaofeng Liu et al., “An interactive training system of motor learning by imitation and speech instructions for children with autism,” 2016 9th International Conference on Human System Interactions (HSI), Portsmouth, 2016, pp. 56–61, doi: 10.1109/HSI.2016.7529609.
Yousif, Jabar and Yousif, Mohammed. (2020). Humanoid Robot as Assistant Tutor for Autistic Children. International Journal of Computation and Applied Sciences. 8. 8–13.
Fatimayin, Foluke. (2018). What is Communication?
N. I. Ishak, H. M. Yusof, S. N. Sidek and Z. Jaalan, “Interactive robotic platform for education and language skill rehabilitation,” 2017 IEEE 4th International Conference on Smart Instrumentation, Measurement and Application (ICSIMA), Putrajaya, Malaysia, 2017, pp. 1–5, doi: 10.1109/ICSIMA.2017.8312031.
I S. A. Farhan, M. N. Rahman Khan, M. R. Swaron, R. N. Saha Shukhon, M. M. Islam and M. A. Razzak, “Improvement of Verbal and Non-Verbal Communication Skills of Children with Autism Spectrum Disorder using Human Robot Interaction,” 2021 IEEE World AI IoT Congress (AIIoT), Seattle, WA, USA, 2021, pp. 0356–0359, doi: 10.1109/AIIoT52608.2021.9454193.
X. Liu and W. Zhao, “Buddy: A Virtual Life Coaching System for Children and Adolescents with High Functioning Autism,” 2017 IEEE 15th Intl Conf on Dependable, Autonomic and Secure Computing, 15th Intl Conf on Pervasive Intelligence and Computing, 3rd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress (DASC/PiCom/DataCom/CyberSciTech), Orlando, FL, USA, 2017, pp. 293–298, doi: 10.1109/DASC-PICom-DataCom-CyberSciTec.2017.62.
Herrero, J.F., Lorenzo, G. An immersive virtual reality educational intervention on people with autism spectrum disorders (ASD) for the development of communication skills and problem solving. Educ Inf Technol 25, 1689–1722 (2020). https://doi.org/10.1007/s10639-019-10050-0.
Zhang, Bingchen, Wang, Yanqun, Yang, Yuling and Song, Lishu. (2021). ASD Children’s APP Emotional Interaction Design Based on Smart Toys of Internet of Things. Mobile Information Systems. 2021. 1–7. doi: 10.1155/2021/1342538.
Chien, M.-E., Jheng, C.-M., Lin, N.-M., Tang, H.-H., Taele, P., Tseng, W.-S., Chen, M. Y. (2015). iCAN: A tablet-based pedagogical system for improving communication skills of children with autism. International Journal of Human-computer Studies, 73, 79–90. https://doi.org/10.1016/j.ijhcs.2014.06.001.
De Leo, G., Gonzales, C. H., Battagiri, P., and Leroy, G. (2011). A smart-phone application and a companion website for the improvement of the communication skills of children with autism: Clinical rationale, technical development and preliminary results. Journal of Medical Systems, 35(4), 703–711. https://doi.org/10.1007/s10916-009-9407-1.
Tang, Tiffany and Winoto, Pinata. (2018). An Interactive Picture Exchange Communication System (PECS) Embedded with Augmented Aids Enabled by IoT and Sensing Technologies for Chinese Individuals with Autism. 299–302. doi: 10.1145/3267305.3267629.
Miglino, Orazio and Di Ferdinando, Andrea & Di Fuccio, Raffaele & Rega, Angelo & Ricci, Carlo. (2014). Bridging Digital and Physical Educational Games Using RFID/NFC Technologies. Journal of E-Learning and Knowledge Society. 3. 83–104. doi: 10.20368/1971-8829/959.
L. F. Guerrero-Vásquez, J. F. Bravo-Torres and M. López-Nores, “AVATAR “autism: Virtual agents to augment relationships in children”,” 2017 IEEE XXIV International Conference on Electronics, Electrical Engineering and Computing (INTERCON), Cusco, Peru, 2017, pp. 1–4, doi: 10.1109/INTERCON.2017.8079705.
Adrian Iftene, Diana Trandabăţ, Enhancing the Attractiveness of Learning through Augmented Reality, Procedia Computer Science, Volume 126, 2018, Pages 166–175, ISSN 1877-0509, https://doi.org/10.1016/j.procs.2018.07.220.
Holt, S., and Yuill, N. (2017). Tablets for two: How dual tablets can facilitate other-awareness and communication in learning disabled children with autism. International Journal of Child-computer Interaction, 11, 72–82. https://doi.org/10.1016/j.ijcci.2016.10.005.
Miller, T., Leroy, G., Huang, J., Chuang, S., Charlop-Christy, M. H., 2006. Using a digital library of images for communication: comparison of a card-based system to PDA software. In: Proceedings of the 1st International Conference on Design Science Research in Information Systems and Technology (DESRIST). Claremont Colleges Library, Claremont, CA, USA, pp. 454–460.
M. S. A. El-Seoud, A. Karkar, J. M. Al Ja’am and O. H. Karam, “A pictorial mobile-based communication application for non-verbal people with autism,” 2014 International Conference on Interactive Collaborative Learning (ICL), 2014, pp. 529–534, doi: 10.1109/ICL.2014.7017828.
Voon, N.H., Bazilah, S.N., Maidin, A., Jumaat, H., Ahmad, M.Z. (2015). AutiSay: A Mobile Communication Tool for Autistic Individuals. In: Phon-Amnuaisuk, S., Au, T. (eds) Computational Intelligence in Information Systems. Advances in Intelligent Systems and Computing, vol. 331. Springer, Cham. https://doi.org/10.1007/978-3-319-13153-5_34.
Mohammad, H. and Abu-Amara, F. (2019). A Mobile Social and Communication Tool for Autism. International Journal of Emerging Technologies in Learning (iJET), 14(19), 159–167. Kassel, Germany: International Journal of Emerging Technology in Learning. Retrieved October 10, 2022, from https://www.learntechlib.org/p/217005/.
Mohamed Abdel Hameed, M. Hassaballah, Mosa E. Hosney, Abdullah Alqahtani, “An AI-Enabled Internet of Things Based Autism Care System for Improving Cognitive Ability of Children with Autism Spectrum Disorders”, Computational Intelligence and Neuroscience, vol. 2022, Article ID 2247675, 12 pages, 2022. https://doi.org/10.1155/2022/2247675.
Macias E, Suarez A, Lloret J. Mobile sensing systems. Sensors (Basel). 2013 Dec 16;13(12):17292–321. doi: 10.3390/s131217292. PMID: 24351637; PMCID: PMC3892889.
Tarus, J.K., Niu, Z. and Mustafa, G. Knowledge-based recommendation: a review of ontology-based recommender systems for e-learning. Artif Intell Rev 50, 21–48 (2018).
Grzegorz J. et al., Mobile platform for affective context-aware systems, Future Generation Computer Systems, Volume 92, 2019, Pages 490–503, ISSN 0167-739X, https://doi.org/10.1016/j.future.2018.02.033. (https://www.sciencedirect.com/science/article/pii/S0167739X17312207).
J.-H. Park, W.-I. Park, Young-Kuk Kim and Ji-Hoon Kang, “Personalized recommender system for resource sharing based on context-aware in ubiquitous environments,” 2008 International Symposium on Information Technology, Kuala Lumpur, Malaysia, 2008, pp. 1–5, doi: 10.1109/ITSIM.2008.4631888.
P. Suppa and E. Zimeo, “A Context-Aware Mashup Recommender Based on Social Networks Data Mining and User Activities,” 2016 IEEE International Conference on Smart Computing (SMARTCOMP), St. Louis, MO, USA, 2016, pp. 1–6, doi: 10.1109/SMARTCOMP.2016.7501672.
Y. Salman, A. Abu-Issa, I. Tumar and Y. Hassouneh, “A Proactive Multi-type Context-Aware Recommender System in the Environment of Internet of Things,” 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing, Liverpool, UK, 2015, pp. 351–355, doi: 10.1109/CIT/IUCC/DASC/PICOM.2015.50.
H. F. Abdulkarem, G. Y. Abozaid and M. I. Soliman, “Context-Aware Recommender System Frameworks, Techniques, and Applications: A Survey,” 2019 International Conference on Innovative Trends in Computer Engineering (ITCE), Aswan, Egypt, 2019, pp. 180–185, doi: 10.1109/ITCE.2019.8646564.
El Arbaoui F.E.Z., El Hari K., Saidi R. A Survey on the Application of the Internet of Things in the Diagnosis of Autism Spectrum Disorder. In: Advanced Technologies for Humanity. ICATH 2021. Lecture Notes on Data Engineering and Communications Technologies, vol. 110. Springer, Cham. (2022).
El Arbaoui F.E.Z., El Hari K., Saidi R. A Review on The Application of The Internet of Things in Monitoring Autism and Assisting Parents and Caregivers. In: Computational intelligence for medical internet of things MIoT application systems. Elsevier. (2022).
Faieq, S., Saidi, R., El Ghazi, H., Front, A., and Rahmani, M. D. (2021). Building adaptive context-aware service-based smart systems. Service Oriented Computing and Applications, 15(1), 21–42.
