Software Design for Low-Latency Visuo-Auditory Sensory Substitution on Mobile Devices - Université de Bourgogne Accéder directement au contenu
Article Dans Une Revue Communications in Computer and Information Science Année : 2017

Software Design for Low-Latency Visuo-Auditory Sensory Substitution on Mobile Devices

Résumé

Visuo-auditory sensory substitution devices transform a video stream into an audio stream to help visually impaired people in situations where spatial information is required, such as avoiding moving obstacles. In these particular situations, the latency between an event in the real world and its auditory transduction is of paramount importance. In this article, we describe an optimized software architecture for low-latency video-to-audio transduction using current mobile hardware. We explain step-by-step the required computations and we report the corresponding measured latencies. The whole latency is approximately 65 ms with a capture resolution of 160 × 120 at 30 frames-per-second and 1000 sonified pixels per frame.

Dates et versions

hal-01679635 , version 1 (10-01-2018)

Identifiants

Citer

Maxime Ambard. Software Design for Low-Latency Visuo-Auditory Sensory Substitution on Mobile Devices. Communications in Computer and Information Science, 2017, 10 (2), ⟨10.5539/cis.v10n2p1⟩. ⟨hal-01679635⟩
51 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More