Microsoft app uses machine learning to narrate the world
Seeing AI by Microsoft, Global

Microsoft app uses machine learning to narrate the world

Global – Designed to assist those that are visually impaired, the app can describe everything from text in a document to people’s emotions.

Article/21610 54c
Seeing AI by Microsoft, Global

Global – Designed to assist those that are visually impaired, the app can describe everything from text in a document to people’s emotions.

The research project, Seeing AI, has been in development since 2016. The app, now available free on iOS, initially in six countries, helps people with visual impairments to navigate and experience the world. Users hold up their phone camera to the object they want described and choose the type of description they want to hear. ‘When asking a friend, there will be different things you want to know about,’ says tech lead Saqib Shaikh.

The app is able to read short pieces of text or scan an entire document. It can also recognise people and things by storing and memorising their faces. It can distinguish facial features, estimate people’s ages and read their emotions. In addition, it is also able to recognise images in other apps such as Mail, Twitter and WhatsApp, and relay what is displayed to the user.

The Big Picture

  • As we explored in the Technology section of Implicit Inclusivity, designers are looking at how to incorporate AI into their products to improve the day-to-day experiences of people with physical disabilities
  • Some smaller brands have already innovated in this field, but as brands such as Microsoft develop consumer-facing products the technology is set to advance further
Discover More News
Iris van Herpen unveils Sympoiesis at Paris Haute Couture Week

News

Iris van Herpen unveils Sympoiesis at Paris Haute Couture Week

At Paris Haute Couture Week, Iris van Herpen unveiled Sympoiesis, a collection steeped in material innovation.
Couture : Fashion : Bioluminescent Algae
Foresight Friday: Dan Hastings, deputy foresight editor

News

Foresight Friday: Dan Hastings, deputy foresight editor

Every Friday, we offer an end-of-week wrap-up of the topics, issues, ideas and virals we’re all talking about.
Fashion : Luxury : Pop Culture & Media
Stat: Global spending on leisure travel will triple by 2040

News

Stat: Global spending on leisure travel will triple by 2040

A new report by Boston Consulting Group reveals that the global leisure travel market is set to triple in value, growing from £3.51 trillion ($4.25...
Travel : Hospitality : Tourism
Tripadvisor rebranding elevates travellers’ voices

News

Tripadvisor rebranding elevates travellers’ voices

Tripadvisor has unveiled a major rebranding led by creative studio Koto, marking its evolution from a pioneering travel guide into a global booking...
Travel : Hospitality : Design
Atlanta’s first women’s sports bar Jolene Jolene redefines the game

News

Atlanta’s first women’s sports bar Jolene Jolene redefines the game

Jolene Jolene, Atlanta’s first-ever women’s sports bar, is proof that interest in women’s sports is reshaping the traditionally male-dominated spor...
Hospitality : Sports : Leisure
Stat: Gen Z aren’t quitting alcohol after all

News

Stat: Gen Z aren’t quitting alcohol after all

New research challenges the narrative that Gen Z are the sober generation.
Statistic : Generation Z : Alcohol
Pattern Beauty brings authenticity and curl culture to tv with first-ever commercial

News

Pattern Beauty brings authenticity and curl culture to tv with first-ever commercial

Tracee Ellis Ross has launched Pattern Beauty’s first ever tv commercial, a 60-second spot that blends humour, nostalgia and a celebration of textu...
Haircare : Pattern Beauty : Beauty
The Messenger bot quietly transforming women’s safety in Jordan

News

The Messenger bot quietly transforming women’s safety in Jordan

A discreet digital tool is offering life-saving support to vulnerable women in Jordan.
Artifical Intelligence : Technology : Women's Safety
Stat: Study finds TikTok is reshaping luxury discovery

News

Stat: Study finds TikTok is reshaping luxury discovery

A new study in the US, the UK, France and Italy, commissioned by TikTok, reveals a structural shift in how consumers discover luxury, inc...
Statistic : TikTok : Luxury
BMW rebrands motorcycling as digital detox

News

BMW rebrands motorcycling as digital detox

BMW Motorrad and its UAE dealership AGMC have launched Throttle Therapy, a series of 10-second videos positioning motorcycling as a form of digital...
Health & Wellness : Advertising : Digital Detox
You have 0 free News articles remaining. Sign up to LS:N Global to get unlimited access to all articles.
BECOME A MEMBER
SIGN IN