Automatic detection of web accessibility issues largely relies on verifying code compliance with standards, which is useful for static problems but cannot detect issues that only emerge during user interaction with dynamic content. Prior work has proposed strategies to automate detection of these interaction-based problems without real users, but such strategies remain limited to specific widget types and depend on the presence of semantic attributes. In this work, we explore the feasibility of detecting accessibility issues for screen reader users by simulating keyboard-based user interaction. Our automated approach analyzes changes in web interfaces that occur in response to certain event patterns that we call Accessibility Events (AEvents). To test how simulated interaction can uncover dynamic AEvents, we generated simulations of user interaction on 5 real websites, while applying AEvent detection mechanisms. We compared our results against an automated checker and manual expert inspection. Our approach identified 97 issues, complementing the 28 found through manual inspection and detecting substantially more issues than the automated checker. Because it evaluates the interface in real time and adapts to its changes during interaction, our approach offers a scalable complement to manual testing. These findings lay the groundwork for new accessibility evaluation frameworks capable of identifying dynamic accessibility issues.
@proceedings{simulating-user-interaction-events-to-discover-dynamic-accessibility-smells,
year = {2026},
title = {Simulating User Interaction Events to Discover Dynamic Accessibility Smells},
author = {Fernando Durgam and Julián Grigera and Alejandra Garrido},
ranking = {B},
abstract = {Automatic detection of web accessibility issues largely relies on verifying code compliance with standards, which is useful for static problems but cannot detect issues that only emerge during user interaction with dynamic content.
Prior work has proposed strategies to automate detection of these interaction-based problems without real users, but such strategies remain limited to specific widget types and depend on the presence of semantic attributes.
In this work, we explore the feasibility of detecting accessibility issues for screen reader users by simulating keyboard-based user interaction.
Our automated approach analyzes changes in web interfaces that occur in response to certain event patterns that we call Accessibility Events (AEvents).
To test how simulated interaction can uncover dynamic AEvents, we generated simulations of user interaction on 5 real websites, while applying AEvent detection mechanisms.
We compared our results against an automated checker and manual expert inspection.
Our approach identified 97 issues, complementing the 28 found through manual inspection and detecting substantially more issues than the automated checker.
Because it evaluates the interface in real time and adapts to its changes during interaction, our approach offers a scalable complement to manual testing.
These findings lay the groundwork for new accessibility evaluation frameworks capable of identifying dynamic accessibility issues.},
}