Spokeit: Building a mobile speech therapy experience

Jared Duval, Zachary Rubin, Elena Márquez Segura, Natalie Friedman, Milla Zlatanov, Louise Yang, Sri Kurniawan

Research output: Chapter in Book/Report/Conference proceedingConference contribution

25 Scopus citations

Abstract

SpokeIt is a mobile serious game for health designed to support speech articulation therapy. Here, we present SpokeIt as well as 2 preceding speech therapy prototypes we built, all of which use a novel offline critical speech recognition system capable of providing feedback in real-time. We detail key design motivations behind each of them and report on their potential to help adults with speech impairment co-occurring with developmental disabilities. We conducted a qualitative within-subject comparative study on 5 adults within this target group, who played all 3 prototypes. This study yielded refined functional requirements based on user feedback, relevant reward systems to implement based on user interest, and insights on the preferred hybrid game structure, which can be useful to others designing mobile games for speech articulation therapy for a similar target group.

Original languageEnglish (US)
Title of host publicationMobileHCI 2018 - Beyond Mobile
Subtitle of host publicationThe Next 20 Years - 20th International Conference on Human-Computer Interaction with Mobile Devices and Services, Conference Proceedings
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)9781450358989
DOIs
StatePublished - Sep 3 2018
Externally publishedYes
Event20th International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI 2018 - Barcelona, Spain
Duration: Sep 3 2018Sep 6 2018

Publication series

NameMobileHCI 2018 - Beyond Mobile: The Next 20 Years - 20th International Conference on Human-Computer Interaction with Mobile Devices and Services, Conference Proceedings

Conference

Conference20th International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI 2018
Country/TerritorySpain
CityBarcelona
Period9/3/189/6/18

Keywords

  • Developmental Disabilities
  • Serious Game for Health
  • Speech Therapy
  • SpokeIt
  • User-centered design

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Information Systems
  • Computer Networks and Communications
  • Software

Fingerprint

Dive into the research topics of 'Spokeit: Building a mobile speech therapy experience'. Together they form a unique fingerprint.

Cite this