SmartPredict App for AAC Conversation

People with Complex communication needs (CCN) and motor impairments not only rely on augmentative and alternative communication (AAC) technologies to express themselves, they also rely on communication partners to augment their message production. We're developing this new app to take advantage of the physical skills, language skills and shared knowledge of communication partners to enhance the user's communication performance while allowing the user to maintain control over the conversation. 

How it works

The Smart Predict app system utilizes two Android apps that communicate wirelessly: an AAC user app (for persons with CCN and motor impairments), and a co-constructor app (for non-disabled conversation partners). The AAC user spells out a message with Smart Predict user app. The Smart Predict co-constructor app, displays a copy of the AAC user's message as it is being created. This enables the co-constructor to suggest words or phrases in real time by either typing out words, or by choosing words from a prediction list. The word and phrase predictions, along with other words stored in the device, are used by a language model within the Smart Predict AAC user's app, and presented in standard word prediction lists to the AAC user. The AAC user maintains independence to choose or ignore the co-construction suggestions during message generation. This written interaction between the tablet devices mimics the co-construction behavior observed in typical speaking conversations.

 

Below, are diagrams of the interface for the user's device and the conversation partner's device.

Interface of User's Device:

photo of interface of Smart Predict user's device

 

 

 

 

 

 

 

 

 

 

 

 

Interface of Conversation Partner's Device:

photo of interface of Smart Predict conversation partner's device

How we are testing it

We will train each participant to use the appropriate Smart Predict app. Users and partners will participate in conversations. We want to learn if the apps help people communicate more effectively.

The video below is a description and simulation of how the Smart Predict system works and how we will be testing it.

How to learn more

View recruitment information for AAC users

View recruitment information for conversation partners

 

If you have any further questions, please contact:

503-418-0987