Microsoft app uses machine learning to narrate the world
Seeing AI by Microsoft, Global

Microsoft app uses machine learning to narrate the world

Global – Designed to assist those that are visually impaired, the app can describe everything from text in a document to people’s emotions.

Seeing AI by Microsoft, Global

Global – Designed to assist those that are visually impaired, the app can describe everything from text in a document to people’s emotions.

The research project, Seeing AI, has been in development since 2016. The app, now available free on iOS, initially in six countries, helps people with visual impairments to navigate and experience the world. Users hold up their phone camera to the object they want described and choose the type of description they want to hear. ‘When asking a friend, there will be different things you want to know about,’ says tech lead Saqib Shaikh.

The app is able to read short pieces of text or scan an entire document. It can also recognise people and things by storing and memorising their faces. It can distinguish facial features, estimate people’s ages and read their emotions. In addition, it is also able to recognise images in other apps such as Mail, Twitter and WhatsApp, and relay what is displayed to the user.

The Big Picture

  • As we explored in the Technology section of Implicit Inclusivity, designers are looking at how to incorporate AI into their products to improve the day-to-day experiences of people with physical disabilities
  • Some smaller brands have already innovated in this field, but as brands such as Microsoft develop consumer-facing products the technology is set to advance further
Discover More Signals & Stats
London welcomes the world’s first Museum of Youth Culture

Signals & Stats

London welcomes the world’s first Museum of Youth Culture

The world’s first permanent museum dedicated to youth culture is set to open in Camden, London, in December 2025.
Visuals : Youth : Culture
Swedish insurer hacks social media algorithms with mental health anthem

Signals & Stats

Swedish insurer hacks social media algorithms with mental health anthem

Swedish insurer Länsförsäkringar Göteborg och Bohuslän has launched Detoxify, a subversive campaign that uses music to retrain harmful social media...
Insight : Sweden : Algorithms
Stat: Gen Z shuns the values most desired by hiring managers

Signals & Stats

Stat: Gen Z shuns the values most desired by hiring managers

New research from behavioural-science company Becoming You Labs reveals that only a small fraction of American Gen Z hold the three main values tha...
Youth : Gen Z : Work
Stella McCartney debuts plant-based feathers at Paris Fashion Week

Signals & Stats

Stella McCartney debuts plant-based feathers at Paris Fashion Week

At Paris Fashion Week, Stella McCartney unveiled a striking alternative to bird feathers: plant-based Fevvers.
Stella McCartney : Fevvers : Feathers
Pedestrians are walking faster and lingering less in public spaces

Signals & Stats

Pedestrians are walking faster and lingering less in public spaces

Pedestrians in American cities are moving faster and spending less time lingering in public spaces, according to a new study from MIT’s Senseable C...
MIT : Wellness : Design
Stat: Taylor Swift’s new album movie breaks US box office

Signals & Stats

Stat: Taylor Swift’s new album movie breaks US box office

Taylor Swift’s latest project, The Official Release Party of a Showgirl, turned a listening event into a box office hit, earning £24.6m ($33m, €28....
Pop Culture : Advertising : Media
Chanel’s le19M brings Parisian craftsmanship to Tokyo

Signals & Stats

Chanel’s le19M brings Parisian craftsmanship to Tokyo

Chanel’s le19M has landed in Tokyo with La Galerie du 19M Tokyo, an exhibition that unites Parisian artisans and Japanese craftspeople in a celebra...
Luxury : Fashion : Design
Healf 2025 explores the future of wellness, longevity and human potential

Signals & Stats

Healf 2025 explores the future of wellness, longevity and human potential

Held at London’s 180 Studios from 3–5 October, Healf 2025 brought together the leading voices in health and science to explore the future of w...
Global Events : Health And Fitness : Men's Health
Stat: Cognitive difficulties rising sharply among young American adults

Signals & Stats

Stat: Cognitive difficulties rising sharply among young American adults

A new study published in Neurology reveals a significant increase in self-reported cognitive difficulties among US adults, particularly those under...
Health : Wellness : US Market
Future Château launches mid-strength wines at Selfridges

Signals & Stats

Future Château launches mid-strength wines at Selfridges

Future Château, the new wine brand from author Tom Benn, is launching at Selfridges in October 2025 with a debut range of premium 5% ABV wines desi...
Drinks : Retail : Food
You have 2 free News articles remaining. Sign up to LS:N Global to get unlimited access to all articles.
BECOME A MEMBER
SIGN IN