Microsoft’s smart headsets paint pictures using sound to help the blind 'see' better

Microsoft and British charity Guide Dogs have developed a technology intended to help visually impaired persons better navigate their surroundings by creating a “3D soundscape” or a mental map of the environment around them.

Guide Dogs updated its assistive technology to build smart headsets and an app intended to help the visually impaired find their way around better by using sound. The tech generates a constant clicking sound that guides a user in the correct direction. The first prototype of the technology was released last year.

Microsoft said the technology is in phase two and includes a redesign that’s more “descriptive rather than prescriptive”. The company’s partnership with Guide Dogs is leading both partners to discover the potential of the technology. Ultimately, the technology will facilitate the movement of visually impaired people, helping them become self-determining and confident when outside their homes.

In phase one, the device relied on information from sensors mounted on objects such as buildings or trains to a receiver in the wearer's headband. Microsoft said sound was used as an anchor instead of sight during phase one.

"Guiding by sounds in the same way, a lighthouse guides by light, this technology demonstrator paints you a picture with sound. Placing spatially situated synthetic sounds around you -- both verbal and non-verbal -- it creates a 3D soundscape of the world in a language you can understand”, said Microsoft.

Features like "Orientate" and "Look Ahead" assist wearers to instantly discover what’s immediately around them. Users also receive more information about what’s approaching them.

The software allows users to use either their voice or a physical remote to ask for and hear additional information about landmarks around them. And it works together with the app to lead users to and around a destination using directional audio and sound prompts to help build a mental image.

Additionally, an application called "CityScribe" was developed by Microsoft to allow people to tag obstacles like park benches and corners most mapping services don’t pick up.

"It does paint a picture of the town, It told me all the different shops on each side of the road but it also told me the names of the streets and also the compass direction. I just think it gives you greater freedom really and gives you more independence”, said Gerald James, who tried out the update.

Kate Riddle, who also trialed the technology, said the device boosted her confidence by taking out so much of the stress of being somewhere new.

“That is massively empowering, and it makes the journey pleasurable rather than a chore. Rather than going out because you have to, this is a 'going out because I can'."

Microsoft's “Cities Unlocked” project is part of the British government-backed Future Cities Catapult. The Microsoft initiative is one of seven launched by the UK's Technology Strategy Board with the aim of developing world-leading innovations in specialist areas.

Contact the writer at feedback@ibtimes.com.au or tell us what you think below.