Microsoft app uses machine learning to narrate the world
Seeing AI by Microsoft, Global

Microsoft app uses machine learning to narrate the world

Global – Designed to assist those that are visually impaired, the app can describe everything from text in a document to people’s emotions.

Seeing AI by Microsoft, Global

Global – Designed to assist those that are visually impaired, the app can describe everything from text in a document to people’s emotions.

The research project, Seeing AI, has been in development since 2016. The app, now available free on iOS, initially in six countries, helps people with visual impairments to navigate and experience the world. Users hold up their phone camera to the object they want described and choose the type of description they want to hear. ‘When asking a friend, there will be different things you want to know about,’ says tech lead Saqib Shaikh.

The app is able to read short pieces of text or scan an entire document. It can also recognise people and things by storing and memorising their faces. It can distinguish facial features, estimate people’s ages and read their emotions. In addition, it is also able to recognise images in other apps such as Mail, Twitter and WhatsApp, and relay what is displayed to the user.

The Big Picture

  • As we explored in the Technology section of Implicit Inclusivity, designers are looking at how to incorporate AI into their products to improve the day-to-day experiences of people with physical disabilities
  • Some smaller brands have already innovated in this field, but as brands such as Microsoft develop consumer-facing products the technology is set to advance further
Discover More Daily Signals
Dutch Design Week 2025: Digital afterlives and making space for grief

Daily Signals

Dutch Design Week 2025: Digital afterlives and making space for grief

Dutch Design Week 2025 has so far prompted visitors to question what it means to be human, and what challenges that notion more than death itself.
Dutch Design Week : Design : Global Events
ASOS Live redefines fashion shopping through creator-led video content

Daily Signals

ASOS Live redefines fashion shopping through creator-led video content

ASOS has launched ASOS Live, a new video shopping experience designed to merge inspiration, content and commerce within its app.
Fashion : Asos : Retail
Stat: Gen Alpha face stricter screen time controls at home and school

Daily Signals

Stat: Gen Alpha face stricter screen time controls at home and school

New survey data from Morning Consult reveals that technology bans are already widespread in schools across the US, with more than half of parents o...
Technology : Gen Alpha : Education
Dutch Design Week 2025: Slowing AI and fostering empathy

Daily Signals

Dutch Design Week 2025: Slowing AI and fostering empathy

The 25th edition of Dutch Design Week has kicked off in Eindhoven with this year’s anniversary theme being Past, Present, Possible. The purpose of ...
Dutch Design Week : DDW : Global Events
Oatly’s Future of Taste report spotlights flavours shaping global beverage culture

Daily Signals

Oatly’s Future of Taste report spotlights flavours shaping global beverage culture

Oatly has unveiled its first Future of Taste report, charting the flavours and formats set to influence global beverage culture.
Food : Drink : Flavour
Stat: Size inclusivity stalls on spring/summer 2026 catwalks

Daily Signals

Stat: Size inclusivity stalls on spring/summer 2026 catwalks

The Vogue Business Spring/Summer 2026 Size Inclusivity Report reveals disappointing progress on fashion’s size representation. Of 9,038 runway look...
Fashion : Identity : Stat
The Ordinary exposes beauty industry buzzwords in dystopian new video

Daily Signals

The Ordinary exposes beauty industry buzzwords in dystopian new video

In a provocative new campaign, skincare brand The Ordinary is calling out the beauty industry’s reliance on pseudo-scientific language.
Beauty : Skincare : Misinformation
Luxury travellers prioritise value, experience and climate-conscious choices for 2026

Daily Signals

Luxury travellers prioritise value, experience and climate-conscious choices for 2026

Luxury travel is set to evolve in 2026, with affluent travellers seeking deeper meaning, personalisation and sustainable choices, according to Virt...
Luxury : Gen Alpha : Luxury Travel
Stat: Public confidence in UK food safety reaches record high

Daily Signals

Stat: Public confidence in UK food safety reaches record high

Public trust in the UK’s food system has hit its highest level since 2020, according to the Food Standards Agency’s Food and You 2 survey.
Food : Health : Stat
Swedish campaign encourages doctors to prescribe visits

Daily Signals

Swedish campaign encourages doctors to prescribe visits

Visit Sweden has launched The Swedish Prescription, making it ‘the first country in the world prescribed by doctors’.
Health : Travel : Tourism
You have 2 free News articles remaining. Sign up to LS:N Global to get unlimited access to all articles.
BECOME A MEMBER
SIGN IN