Projects
Holoboard
HoloBoard is an augmented reality (AR) communication system designed to support nonspeaking autistic individuals in developing independent typing skills. Inspired by traditional letterboards, HoloBoard digitally adapts and enhances the experience by integrating AR-based scaffolding, motor support, and real-time feedback.
From Letterboards to Holograms: Advancing Assistive Technology for Nonspeaking Autistic Individuals with the HoloBoard.
Lorans Alabood; Travis Dow; Kaylyn B. Feeley; Vikram K. Jaswal; Diwakar Krishnamurthy. ACM Conference on Human Factors in Computing Systems (ACM CHI 2024). 1-15. (2024)
HoloGaze
HoloGaze is an augmented reality (AR) communication system that leverages gaze tracking to assist nonspeaking autistic individuals in expressing themselves more efficiently. Designed to address motor planning challenges, HoloGaze enables users to interact with a virtual keyboard using eye movements, reducing the physical effort required for communication.
Evaluating Gaze Interactions within AR for Nonspeaking Autistic Users. Ahmadreza Nazari; Lorans Alabood; Molly Rathbun; Vikram K. Jaswal; Diwakar Krishnamurthy. The ACM Symposium on Virtual Reality Software and Technology (ACM VRST 2024). 1-9. (2024)
Personalized AR Communication for Non speaking Autistic Individuals
This project explores how augmented reality (AR) communication systems can be personalized to better support nonspeaking autistic individuals. Traditional AAC devices often lack adaptability, making communication inefficient for users with unique sensory, cognitive, and motor profiles. This study investigates customizable AR interfaces that dynamically adjust to individual needs.
Personalizing an AR-based Communication System for Nonspeaking Autistic Users. Ahmadreza Nazari; Lorans Alabood; Kaylyn B. Feeley; Vikram K. Jaswal; Diwakar Krishnamurthy. 29th ACM Conference on Intelligent User Interfaces (ACM IUI 2024). (2024)
HoloType
Many nonspeaking autistic individuals face limited access to academic content due to outdated assumptions about their abilities. HoloType is an Augmented Reality (AR) application designed to provide engaging, customizable, and age-appropriate educational experiences tailored to their unique sensory and motor needs. Unlike traditional tools, HoloType allows users to move freely and interact with lessons in an immersive environment. Built for HoloLens 2, it offers spelling exercises and multiple-choice comprehension tasks, enabling more interactive and accessible learning. By leveraging AR, HoloType creates new opportunities for education, empowering nonspeaking students to engage with meaningful academic content.
AR-Based Educational Software for Nonspeaking Autistic People – A Feasibility Study. Ali Shahidi; Lorans Alabood; Kate M. Kaufman; Vikram K. Jaswal; Diwakar Krishnamurthy; Mea Wang. 22nd IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2023). 1-9. (2023)
ViC- Remote Communication Training
This project explores the first AR telepresence system designed to support nonspeaking autistic individuals in learning to spell using a letterboard—without requiring a physically present Communication and Regulation Partner (CRP). By leveraging holographic avatars and real-time motion tracking, the system enables immersive, remote spelling sessions, reducing geographic barriers to effective communication training.
Autonomous ViC
Many nonspeaking autistic individuals learn typing-based communication with the help of human Communication Regulation Partners (CRPs), who provide hands-on guidance, emotional regulation, and structured support. This project explores how an Augmented Reality (AR) agent powered by Artificial Intelligence (AI) can extend and reinforce CRP-led training by allowing users to practice independently in a responsive, interactive, and adaptive environment.
Towards an Augmented Reality Agent to Support Communication for Nonspeaking Autistic People. Travis Dow; Pratishtha Pratishtha; Lorans Alabood; Vikram K. Jaswal; Diwakar Krishnamurthy. ACM Conference on Human Factors in Computing Systems (ACM CHI 2024 – Late Breaking Work (LBW) Track). (2024)
LetterBox
LetterBox is a cost-effective XR-based spelling tool designed for affordable video-passthrough headsets like the Meta Quest series, supporting Augmented Reality (AR), Mixed Reality (MR), and Virtual Reality (VR). Unlike prior systems that rely on expensive hardware and error-prone tapping interactions, LetterBox introduces a novel grab-and-release selection method, reducing accidental errors and promoting more deliberate engagement. By allowing users to choose their preferred immersion level, LetterBox adapts to individual sensory and motor needs, making spelling practice more accessible, flexible, and personalized. This approach has the potential to expand access to effective communication training, offering a scalable solution for nonspeaking individuals worldwide.