A3CP: Engineering an AI-based adaptable and customisable communication system for non-verbal people with Cerebral Palsy

Communication is a fundamental human right and a critical determinant of an individual’s overall well-being within a community[1]. Many with complex disabilities remain marginalized due to communication limitations which can have severe impacts on their health and quality of life.

A3CP (Ability Adaptive Augmentation for Communication Personalisation) is an academic research project seeking to meet the communication needs of non-verbal people with complex disabilities like Cerebral Palsy (CP). These individuals could gain profound benefits from a communication system capable of using “off the shelf” components to monitor their unique sounds, motions, and gestures and translating these signals into meaningful communication. This approach would bridge the gap between current “no-tech” approaches and “hi-tech” solutions, offering a more inclusive and efficient means of communication, empowering individuals inadequately served by current approaches to better express their thoughts and needs, especially to non-familiar individuals. The figure below illustrates the different techniques.

No-Tech: Hand signals, sounds, expressions used to indicate needs.

Lo-Tech: Printed books or cards with images which can be pointed at.

Hi-Tech: Matrices of ordered items selected with eye tracking, or other pointing method.

A3CP: The user’s motions, sounds, other contextual factors classified with AI/ ML.

Why is this research important and why should it be conducted now?

Technologies such as tablets offering menus of images or words, and eye-tracking or breath control devices to allow people with movement constraints to select items have made an enormous difference in many peoples’ lives. Yet, these approaches are still challenging for many, for example those who lack the ability to control their head position or lack the cognitive ability to use these systems.

Current approaches are customizable in terms of input devices, but they still require adaptation to the abilities of the system, rather than the system adapting to the abilities of the individuals. Existing approaches are limited to one way of expressiveness instead of supporting personalised inputs from individuals such as physical movements, expressions, and vocalizations. Those who cannot adapt to existing systems or need several modes of communication still lack effective tools. This severely limits independence, individual achievement, and ability to gain support for needs.

This proposal promotes a transformative approach to engineer augmentative and alternative communication (AAC) technologies, with the potential to benefit an underserved and marginalized group. Leveraging recent advancements and cost reductions in technology, the proposal seeks to address critical issues:

  1. Enhancing social Inclusivity: The initiative targets non-verbal people with complex disabilities like Cerebral Palsy, enabling their societal integration, engagement, and quality of life through improved communication support.
  2. Holistic Communication Solutions: By adopting a hybrid method, the project aims to overcome drawbacks of both “no-tech” and “hi-tech” methods, creating a system that adapts to the user’s abilities rather than necessitating that the user adapt to the system.
  3. Advancements in Technology: Progress in sensor and AI technologies offer new opportunities to decode unique expressions.
  4. User-centred: This approach is explicitly user-centred, building on the skills, abilities, and preferences of each individual user.
  5. Early Intervention: Enhancing early communication could positively impact children’s development and communication skills, enhancing their trajectory.

[1] Brady, N.C., Bruce, S., Goldman, A., Erickson, K., Mineo, B., Ogletree, B.T., Paul, D., Romski, M.A., Sevcik, R., Siegel, E. and Schoonover, J., 2016. Communication services and supports for individuals with severe disabilities: Guidance for assessment and intervention. American journal on intellectual and developmental disabilities, 121(2), pp.121-138.

Scroll to Top