Research Highlights

My research lies in the intersection of human-AI interaction and accessibility. I aim to enable AI assistants to provide human-level assistance in real-world tasks, so that AI assistants can understand users over time and proactively provide timely, personalized support.

StateScribe UIST 2026StateScribeChange awareness across real-world revisits Sidekick UIST 2026SidekickMultitasking with computer-use agents CHI 2026TouchScribeHand-object interactions with live descriptions Best Paper UIST 2024WorldScribeContext-aware live visual descriptions ChatGPT Live Video ASSETS 2025Live Video AIProbing gaps in ChatGPT's real-world assistance UIST 2022OmniScribeImmersive audio descriptions for 360° videos

News

06/2026My Adobe intern project Sidekick was accepted to UIST 2026!
06/2026StateScribe on accessible change awareness was accepted to UIST 2026!
06/2026Honored to receive the Taiwan Government Scholarship!
04/2026Honored to receive the Rackham Predoctoral Fellowship!
02/2026TouchScribe is accepted to CHI 2026 — see you in 🇪🇸 Barcelona!
10/2025Excited to share that I will be interning at  Apple in Seattle this summer!
08/2025I will attend both UIST DS 2025 and ASSETS DC 2025!
08/2025My Meta intern project Viago was accepted to UIST 2025!
08/2025Findings on ChatGPT's live video chat for real-world assistance were accepted to ASSETS 2025!
03/2025Honored to receive the  Apple Scholars in AIML Ph.D. Fellowship (AI for Accessibility)!
01/2025Excited to share that I will be interning at Adobe Research in Seattle this summer!
10/2024WorldScribe received a Google Academic Research Award (Society-Centered AI)!
10/2024WorldScribe awarded Best Paper Award 🏆 at UIST 2024!
07/2024EditScribe and CustomAD accepted to ASSETS 2024, and WorldScribe to UIST 2024.
05/2024Started my internship at Meta Reality Labs in Toronto!
02/2024Received the Weinberg Cognitive Science Fellowship; passed candidacy exam — now a Ph.D. candidate!
12/2023Received the Rackham International Student Fellowship.

Publications

2026

First page of the StateScribe paper
StateScribe: Towards Accessible Change Awareness Across Real-World Revisits Ruei-Che Chang*, Xirui Jiang*, Rosiana Natalie, Hao Chen, Vlad Roznyatovskiy, Charlie Jianzhong Zhang, Kang G. Shin, Ke Sun, Anhong Guo (* Equal contribution) UIST 2026 — PDF • arXiv • video • 30s preview
First page of the Sidekick paper
Sidekick: Designing Communication for Effective Multitasking with Computer Use Agents Ruei-Che Chang, Wenqian Xu, Ding Li, Bryan Wang, Anhong Guo UIST 2026 — PDF • arXiv • video • 30s preview
First page of the TouchScribe paper
TouchScribe: Augmenting Non-Visual Hand-Object Interactions with Automated Live Visual Descriptions Ruei-Che Chang, Rosiana Natalie, Wenqian Xu, Jovan Zheng Feng Yap, Tiange Luo, Venkatesh Potluri, Anhong Guo CHI 2026 — ACM • PDF • arXiv • video

2025

First page of the Enabling Real-World Assistive Agents paper
Enabling Real-World Assistive Agents: From Live Vision to Proactive Context-Aware Information Delivery Ruei-Che Chang UIST 2025 Doctoral Symposium — ACM • PDF
First page of the Probing the Gaps in ChatGPT's Live Video Chat for Real-World Assistance for People who are Blind or Visually Impaired paper
Probing the Gaps in ChatGPT's Live Video Chat for Real-World Assistance for People who are Blind or Visually Impaired Ruei-Che Chang, Rosiana Natalie, Wenqian Xu, Jovan Zheng Feng Yap, Anhong Guo ASSETS 2025 — ACM • PDF • arXiv
First page of the Viago paper
Viago: Exploring Visual-Audio Modality Transitions for Social Media Consumption on the Go Ruei-Che Chang, Tovi Grossman, Carine Rognon, Michael Glueck, Christopher Collins, Amy Karlson, Hemant Bhaskar Surale UIST 2025 — ACM • PDF
First page of the Strange Familiars paper
Strange Familiars: Exploring the Design of Avatars and Virtual Environments for Reconnecting Dormant Ties in Virtual Reality Yu-Ting Yen, Fang-Ying Liao, Chi-Lan Yang, Ruei-Che Chang, Fu-Yin Cherng, Bing-Yu Chen IEEE TVCG 2025 — paper

2024

First page of the WorldScribe paper
WorldScribe: Towards Context-Aware Live Visual Descriptions Ruei-Che Chang, Yuxuan Liu, Anhong Guo UIST 2024 ( Best Paper Award) — ACM • PDF • arXiv • video • project page * Received a Google Academic Research Award (Society-Centered AI) and featured in Michigan Engineering News.
First page of the EditScribe paper
EditScribe: Non-Visual Image Editing with Natural Language Verification Loops Ruei-Che Chang, Yuxuan Liu, Lotus Zhang, Anhong Guo ASSETS 2024 — ACM • PDF • arXiv • video
First page of the Audio Description Customization paper
Audio Description Customization Rosiana Natalie, Ruei-Che Chang, Smitha Sheshadri, Anhong Guo, Kotaro Hara ASSETS 2024 — ACM • PDF • video
First page of the SoundShift paper
SoundShift: Exploring Sound Manipulations for Accessible Mixed-Reality Awareness Ruei-Che Chang, Chia-Sheng Hung, Bing-Yu Chen, Dhruv Jain, Anhong Guo DIS 2024 — ACM • PDF • video
First page of the ImageExplorer Deployment paper
ImageExplorer Deployment: Understanding Text-Based and Touch-Based Image Exploration in the Wild Andi Xu, Minyu Cai, Dier Hou, Ruei-Che Chang, Anhong Guo W4A 2024 — ACM • PDF • video • project page
First page of the AdvCAPTCHA paper
AdvCAPTCHA: Creating Usable and Secure Audio CAPTCHA with Adversarial Machine Learning Hao-Ping (Hank) Lee, Wei-Lun Kao, Hung-Jui Wang, Ruei-Che Chang, Yi-Hao Peng, Fu-Yin Cherng, Shang-Tse Chen USEC 2024 — paper

2023

First page of the Understanding (Non-)Visual Needs for the Design of Laser-Cut Models paper
Understanding (Non-)Visual Needs for the Design of Laser-Cut Models Ruei-Che Chang*, Seraphina Yong*, Fang-Ying Liao, Chih-An Tsao, Bing-Yu Chen (* Equal contribution) CHI 2023 — ACM • PDF • video

2022

First page of the OmniScribe paper
OmniScribe: Authoring Immersive Audio Descriptions for 360° Videos Ruei-Che Chang, Chao-Hsien Ting, Chia-Sheng Hung, Wan-Chen Lee, Liang-Jin Chen, Yu-Tzu Chao, Bing-Yu Chen, Anhong Guo UIST 2022 — ACM • PDF • video • project page
First page of the Puppeteer paper
Puppeteer: Exploring Intuitive Hand Gestures and Upper-Body Postures for Manipulating Human Avatar Actions Ching-Wen Hung, Ruei-Che Chang, Hong-Sheng Chen, Chung Han Liang, Liwei Chan, Bing-Yu Chen VRST 2022 — ACM • PDF • video

2021

First page of the Daedalus in the Dark paper
Daedalus in the Dark: Designing for Non-Visual Accessible Construction of Laser-Cut Architecture Ruei-Che Chang, Chih-An Tsao, Fang-Ying Liao, Seraphina Yong, Tom Yeh, Bing-Yu Chen UIST 2021 — ACM • PDF • video
First page of the AccessibleCircuits paper
AccessibleCircuits: Adaptive Add-On Circuit Components for People with Blindness or Low Vision Ruei-Che Chang*, Wen-Ping Wang*, Chi-Huan Chiang, Te-Yen Wu, Zheer Xu, Justin Luo, Bing-Yu Chen, Xing-Dong Yang (* Equal contribution) CHI 2021 — ACM • PDF • video

2020

First page of the Glissade paper
Glissade: Generating Balance Shifting Feedback to Facilitate Auxiliary Digital Pen Input Kai-Chieh Huang, Chen-Kuo Sun, Da-Yuan Huang, Yu-Chun Chen, Ruei-Che Chang, Shuo-wen Hsu, Chih-Yun Yang, Bing-Yu Chen CHI 2020 ( Honorable Mention) — ACM • PDF • video
First page of the Exploring the Design Space of User-System Communication for Smart-home Routine Assistants paper
Exploring the Design Space of User-System Communication for Smart-home Routine Assistants Yi-Shyuan Chiang*, Ruei-Che Chang*, Yi-Lin Chuang, Shih-Ya Chou, Hao-Ping Lee, I-Ju Lin, Jian-Hua Jiang Chen, Yung-Ju Chang (* Equal contribution) CHI 2020 — ACM • PDF • video
First page of the TanGo paper
TanGo: Exploring Expressive Tangible Interactions on Head-Mounted Displays Ruei-Che Chang*, Chi-Huan Chiang*, Shuo-wen Hsu, Chih-Yun Yang, Da-Yuan Huang, Bing-Yu Chen (* Equal contribution) SUI 2020 — ACM • PDF • video

2019

First page of the Masque paper
Masque: Exploring Lateral Skin Stretch Feedback on the Face with Head-Mounted Displays Chi Wang, Da-Yuan Huang, Shuo-wen Hsu, Chu-En Hou, Yeu-Luen Chiu, Ruei-Che Chang, Jo-Yu Lo, Bing-Yu Chen UIST 2019 — ACM • PDF • video