Publications
1. From Letterboards to Holograms: Advancing Assistive Technology for Nonspeaking Autistic Individuals with the HoloBoard
- CHI ’24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems
Summary: Presents HoloBoard, an AR system designed to help nonspeaking autistic individuals transition to more independent communication by using a virtual letterboard. In a study with 23 participants, most were able to spell words and perform complex tasks without the need for a human assistant, demonstrating the system’s potential to enhance autonomy and provide new social and educational opportunities.
2. Towards an Augmented Reality Agent to Support Communication for Nonspeaking Autistic People
- CHI EA ’24: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems
Summary: Describes the development of an AR system for nonspeaking autistic individuals to practice spelling using a virtual educator. By modeling interactions from recorded sessions, the virtual educator can effectively mimic a real educator, offering a more accessible and independent method for communication training.
3. Evaluating Gaze Interactions within AR for Nonspeaking Autisitic Users
- VRST ’24 Proceedings of the 30th ACM Symposium on Virtual Reality Software and Technology
Summary:Evaluates the feasibility of eye gaze interactions within an augmented reality (AR) environment for nonspeaking autistic individuals. The study utilized HoloLens 2 to create an interactive system called HoloGaze, allowing users to select targets by fixating their gaze or using a physical button.
4. Personalizing an AR-based Communication System for Nonspeaking Autistic Users
- IUI ’24: Proceedings of the 29th International Conference on Intelligent User Interfaces
Summary: Investigates the use of Behavioral Cloning (BC) for the purpose of creating a personalized and adaptive placement policy for a virtual letterboard within AR for nonspeaking autistic individuals. This approach aims to reduce reliance on human assistants, thereby enhancing autonomy and privacy in communication, and demonstrates improved accuracy over non-ML methods.
5. AR-Based Educational Software for Nonspeaking Autistic People – A Feasibility Study
- IEEE Explore – AR-Based Educational Software for Nonspeaking Autistic People – A Feasibility Study (2023 IEEE International Symposium)
Summary: Investigates the feasibility of using head-mounted AR applications to provide meaningful academic content for nonspeaking autistic individuals, addressing limitations in traditional education approaches.
6. Can Cross-Reality Help Nonspeaking Autistic People Transition to AR Typing?
- CHI EA ’23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
Summary: Explores the transition phase from traditional communication methods to augmented reality typing, aiming to facilitate motor skills development for independent typing in nonspeaking autistic individuals.
7. Interactive AR Applications for Nonspeaking Autistic People? – A Usability Study
- CHI ’23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Summary: Examines the usability of head-mounted AR devices for nonspeaking autistic individuals through a study involving an interactive application, emphasizing the importance of understanding their tolerance and interaction with virtual objects.
8. HoloType-CR: Cross Reality Communication Training for Minimally Verbal Autistic Persons
- IEEE Explore – HoloType-CR: Cross Reality Communication Training for Minimally Verbal Autistic Persons (2022 IEEE International Symposium)
Summary: Introduces HoloType-CR, an immersive typing training system designed for minimally verbal autistic individuals, aiming to make communication training more accessible and cost-effective through cross-reality approaches.
9. Holotype: Lived Experience-Based Communication Training for Nonspeaking Autistic People
CHI EA ’22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems
Summary: Addresses the gap in technology support for nonspeaking autistic individuals by incorporating insights from lived experiences into an augmented reality communication training prototype, emphasizing personalized learning environments to develop expressive written communication skills.