Our ongoing project ABILITY is making strides in enhancing digital accessibility for the Blind and Visually Impaired (BVI) community. Through AI-based image analysis, we're crafting a multimodal assistant system, offering speech, tactile representations, and braille support. Recent user studies revealed preferences for detailed image descriptions, focusing on spatial positioning and object interaction. Exciting progress toward a dedicated BVI-tablet is underway, marking a significant step in revolutionizing accessibility.
For more details follow our paper in IEEE SMC23: https://ieeesmc2023.org/abstract_files/SMC23_1531_FI.pdf