Microsoft app uses machine learning to narrate the world
Seeing AI by Microsoft, Global

Microsoft app uses machine learning to narrate the world

Global – Designed to assist those that are visually impaired, the app can describe everything from text in a document to people’s emotions.

Article/21610 54c
Seeing AI by Microsoft, Global

Global – Designed to assist those that are visually impaired, the app can describe everything from text in a document to people’s emotions.

The research project, Seeing AI, has been in development since 2016. The app, now available free on iOS, initially in six countries, helps people with visual impairments to navigate and experience the world. Users hold up their phone camera to the object they want described and choose the type of description they want to hear. ‘When asking a friend, there will be different things you want to know about,’ says tech lead Saqib Shaikh.

The app is able to read short pieces of text or scan an entire document. It can also recognise people and things by storing and memorising their faces. It can distinguish facial features, estimate people’s ages and read their emotions. In addition, it is also able to recognise images in other apps such as Mail, Twitter and WhatsApp, and relay what is displayed to the user.

The Big Picture

  • As we explored in the Technology section of Implicit Inclusivity, designers are looking at how to incorporate AI into their products to improve the day-to-day experiences of people with physical disabilities
  • Some smaller brands have already innovated in this field, but as brands such as Microsoft develop consumer-facing products the technology is set to advance further
Discover More News
Polaroid champions an analogue way of living amid AI hype

News

Polaroid champions an analogue way of living amid AI hype

Polaroid has launched The Camera for an Analog Life, a campaign designed to push back against screen fatigue and AI overload. The initiative celebr...
Technology : Design : Advertising
Zalando shifts from algorithm discovery to beauty expert authority with Insider’s Edit

News

Zalando shifts from algorithm discovery to beauty expert authority with Insider’s Edit

Zalando is rethinking how it sells beauty with the launch of Insider’s Edit, a new shoppable content series that blends expert advice with curated ...
Beauty : Retail : Fashion
Stat: AI’s impact on traditional search is already impacting ad spend

News

Stat: AI’s impact on traditional search is already impacting ad spend

As AI agents begin making purchases on behalf of consumers, retailers must redesign websites and rethink advertising strategies to remain visible a...
Technology : Retail
Iris van Herpen unveils Sympoiesis at Paris Haute Couture Week

News

Iris van Herpen unveils Sympoiesis at Paris Haute Couture Week

At Paris Haute Couture Week, Iris van Herpen unveiled Sympoiesis, a collection steeped in material innovation.
Couture : Fashion : Bioluminescent Algae
Foresight Friday: Dan Hastings, deputy foresight editor

News

Foresight Friday: Dan Hastings, deputy foresight editor

Every Friday, we offer an end-of-week wrap-up of the topics, issues, ideas and virals we’re all talking about.
Fashion : Luxury : Pop Culture & Media
Stat: Global spending on leisure travel will triple by 2040

News

Stat: Global spending on leisure travel will triple by 2040

A new report by Boston Consulting Group reveals that the global leisure travel market is set to triple in value, growing from £3.51 trillion ($4.25...
Travel : Hospitality : Tourism
Tripadvisor rebranding elevates travellers’ voices

News

Tripadvisor rebranding elevates travellers’ voices

Tripadvisor has unveiled a major rebranding led by creative studio Koto, marking its evolution from a pioneering travel guide into a global booking...
Travel : Hospitality : Design
Atlanta’s first women’s sports bar Jolene Jolene redefines the game

News

Atlanta’s first women’s sports bar Jolene Jolene redefines the game

Jolene Jolene, Atlanta’s first-ever women’s sports bar, is proof that interest in women’s sports is reshaping the traditionally male-dominated spor...
Hospitality : Sports : Leisure
Stat: Gen Z aren’t quitting alcohol after all

News

Stat: Gen Z aren’t quitting alcohol after all

New research challenges the narrative that Gen Z are the sober generation.
Statistic : Generation Z : Alcohol
Pattern Beauty brings authenticity and curl culture to tv with first-ever commercial

News

Pattern Beauty brings authenticity and curl culture to tv with first-ever commercial

Tracee Ellis Ross has launched Pattern Beauty’s first ever tv commercial, a 60-second spot that blends humour, nostalgia and a celebration of textu...
Haircare : Pattern Beauty : Beauty
You have 2 free News articles remaining. Sign up to LS:N Global to get unlimited access to all articles.
BECOME A MEMBER
SIGN IN