News
Lab updates, paper milestones, grants, and community activities.
- 🎓 Ehtesham's dissertation defense was successful. Say hello to Dr. Ehtesham, the first doctoral graduate from the lab! Dissertation title: "Accessible and Multimodal Programming in the Age of AI: Natural Input, Output, and Structured Representations."
- VoiceAlign: A Shimming Layer for Enhancing the Usability of Legacy Voice User Interface Systems has been accepted to the 2026 ACM Conference on Intelligent User Interfaces (IUI 2026). Huge congrats, Ehtesham!
- Giving Meaning to Movements: Challenges and Opportunities in Expanding Communication by Pairing Unaided AAC with Speech Generated Messages has been accepted. Huge congrats, Imran!
- Yaoyu He joined the lab.
- Our seed grant titled "Leveraging artificial intelligence to enhance language learning by non-speaking children with disabilities who use speech generating technologies" was funded by the Center for Socially Responsible AI (CSRAI). Details.
- 🎉 Ehtesham and Touhid received Graduate Teaching Fellowships (GTF)!
- Our seed proposal "From Cognitive Debt to Cognitive Engagement: A Cross-Course Framework for Teaching with Weaker LLMs" was funded by the College of IST.
- Nathan joined the lab.
- Our seed proposal "Teaching Intelligent Interface Design for AI Systems" was accepted by the College of IST.
- Wheeler received the UIST 2024 best paper honorable mention award. Congratulations, Touhid and Imran!
- Several papers are submitted to CHI 2025.
- One paper is submitted to ICRA 2025.
- Two papers are submitted to IEEE VR 2025.
- One paper is submitted to AAAI 2025.
- Zheyu's master's work on VR locomotion is accepted to VRST 2024! Congratulations, Zheyu!
- Our paper, Wheeler, is accepted to UIST 2024! Congratulations, Touhid and Imran!
- One paper is accepted to CogSci 2024. Congratulations Lingyun, Duk Hee, and Ehtesham!
- Two papers are accepted to CHI 2024! Congratulations, Chaeeun and Jingyi!
- Two papers are now in R&R phase in CHI 2024.
- Our proposal to NSF:Future of work has been funded!
- Two papers are accepted in IMWUT 2023. Congratulations, Ehtesham and Touhid!
- Welcome our new lab member, Imran Kabir!
- Three seed proposals are funded by various centers and institutes at Penn State.
- Co-write a book chapter on Robot-Mediated Assistance: Opportunities and Challenges in Computer Vision and Human-Robot Interaction.
- One paper is accepted to DIS 2023. Congratulations, Jingyi!
- Our journal, Understanding the Usages, Life-Cycle, and Opportunities of Screen Readers' Plugins is accepted to TACCESS Journal. Congratulations, Farhani!
- Our paper, A Probabilistic Model and Metrics for Estimating Perceived Accessibility of Desktop Applications in Keystroke-Based Non-Visual Interactions is accepted to CHI 2023. Congratulations, Touhid!
- Our paper, Data Sonification with Natural Sounds is accepted to CHI 2023. Congratulations, Naimul!
- We are on the news: New coding tool could aid computer programmers who are blind or have low vision.
- Our paper, Grid-Coding, received the UIST 2022 Best Paper Award! Congratulations, Ehtesham! Try Grid Coding.
- An NIH R01 proposal is submitted.
- Multiple papers submitted to CHI 2022.
- Serving as a PC member in AAAI 2023 and IUI 2023 conferences.
- Our paper, Grid-Coding: An Accessible, Efficient, and Structured Coding Paradigm for Blind and Low-Vision Programmers is accepted to UIST 2022.
- One journal paper submitted to ACM Transactions on Interactive Intelligent Systems (TiiS).
- One paper submitted to USENIX Security 2023.
- One journal paper submitted to ACM Transactions on Accessible Computing (TACCESS).
- We are on the news: Tech designed to aid visually impaired could benefit from human-AI collaboration.
- Our paper, Helping Helpers: Supporting Volunteers in Remote Sighted Assistance with Augmented Reality Maps is accepted to DIS 2022.
- Received two seed grants ($33K and $40K) on accessible computer vision algorithm and AI-based study companion.
- Our paper, Opportunities for Human-AI Collaboration in Remote Sighted Assistance is accepted to IUI 2022.
- Our journal paper, Iterative Design and Prototyping of Computer Vision Mediated Remote Sighted Assistance is accepted to ACM Transactions on Computer-Human Interaction (TOCHI).
- Our paper, Tilt-Explore: Making Tilt Gestures Usable for Low-Vision Smartphone Users is accepted to UIST 2021.
- Our paper, Understanding Screen Readers' Plugins is accepted to ASSETS 2021.
- We are on the news: New tool could help lessen bias in live television broadcasts.
- Our poster, Towards Multi-Wheel Input Device for Non-Visual Interaction is accepted to UIST 2020.
- Our paper on balancing actors' gender and skin-color in live telecasts is accepted to CSCW 2020.
- Our poster Wayfinding and Navigating in Virtual Environment: Learning from Audio Games is accepted in Thinking Within Symposium 2020 - Exploring Immersive Technologies in Education and Research.
- Our paper DarkReader got the best paper nominee award in ASSETS 2019!
- 1 paper accepted in ASSETS 2019!