Experimental AI smart glasses enhance hearing aids by reading lips

AI-powered glasses enhance hearing aids through precise lip-reading technology.

: Heriot-Watt, Edinburgh Napier, and Stirling universities developed AI-enabled smart glasses that read lips to support hearing aids. The glasses clean up speech by focusing on lip movements, improving comprehension for the hearing impaired amidst background noise. They offer additional assistance in noisy environments for individuals with normal hearing. The smart glasses require internet connectivity, relying on cloud servers in Sweden for AI processing.

Recent advancements have brought forth experimental smart glasses developed by researchers from Heriot-Watt University, Edinburgh Napier University, and the University of Stirling. These AI-powered glasses utilize a camera trained to read lips, enhancing the functionality of traditional hearing aids. By deciphering lip movements, the glasses improve speech clarity and reduce background noise like traffic and household appliances. This innovation, intended mainly for people experiencing hearing loss, does not aim to replace hearing aids but rather to complement them. It also offers benefits for individuals with normal hearing in environments such as crowded places.

Data transmission remains crucial for this technology, as the glasses lack sufficient processing power for on-device AI computations. Instead, they send and receive information from cloud servers in Sweden. The research team claims that with high-speed broadband and 5G connectivity, the latency is negligible, providing near real-time lip-reading capabilities. However, reliance on internet access can pose challenges in areas with poor connectivity.

Apple’s AirPods Pro 2 had previously incorporated similar features, obtaining FDA approval for their use as over-the-counter hearing aids. With the AI smart glasses, the UK researchers hope to provide a more affordable solution to hearing aid users. They argue that existing devices struggle to isolate multiple speakers, whereas the glasses can focus on one person at a time.

Despite the promising capabilities, this technology is not yet integrated into consumer smart glasses from companies like Meta, though Meta's Oakley AI Glasses have the hardware that could support such features. Meanwhile, Apple is rumored to launch AI-infused smart glasses in the near future. Both companies have promoted live translation features, which could complement visual AI technologies like lip reading.

This innovative development in assistive technology shines a light on the potential of AI to deliver cost-effective solutions. If these AI smart glasses are proven effective and accessible, they could reshape the market for hearing aids and similar assistive devices.

Sources: TechSpot, The Independent, Heriot-Watt University

AICloudinnovation