Microsoft app uses machine learning to narrate the world
Seeing AI by Microsoft, Global

Microsoft app uses machine learning to narrate the world

Global – Designed to assist those that are visually impaired, the app can describe everything from text in a document to people’s emotions.

Seeing AI by Microsoft, Global

Global – Designed to assist those that are visually impaired, the app can describe everything from text in a document to people’s emotions.

The research project, Seeing AI, has been in development since 2016. The app, now available free on iOS, initially in six countries, helps people with visual impairments to navigate and experience the world. Users hold up their phone camera to the object they want described and choose the type of description they want to hear. ‘When asking a friend, there will be different things you want to know about,’ says tech lead Saqib Shaikh.

The app is able to read short pieces of text or scan an entire document. It can also recognise people and things by storing and memorising their faces. It can distinguish facial features, estimate people’s ages and read their emotions. In addition, it is also able to recognise images in other apps such as Mail, Twitter and WhatsApp, and relay what is displayed to the user.

The Big Picture

  • As we explored in the Technology section of Implicit Inclusivity, designers are looking at how to incorporate AI into their products to improve the day-to-day experiences of people with physical disabilities
  • Some smaller brands have already innovated in this field, but as brands such as Microsoft develop consumer-facing products the technology is set to advance further
Discover More Daily Signals
Swedish campaign encourages doctors to prescribe visits

Daily Signals

Swedish campaign encourages doctors to prescribe visits

Visit Sweden has launched The Swedish Prescription, making it ‘the first country in the world prescribed by doctors’.
Health : Travel : Tourism
Airbnb and Strava champion countryside run-cations

Daily Signals

Airbnb and Strava champion countryside run-cations

Airbnb and Strava are tapping into ‘the rural run-cation’, staycations built around scenic runs, fresh air and connection with friends. As explored...
Sports : Travel And Hospitality : Health And Wellness
Stat: Gen Z lead European travel boom with highest spending and trip frequency

Daily Signals

Stat: Gen Z lead European travel boom with highest spending and trip frequency

Gen Z are driving a significant surge in European travel, outspending and out-travelling all other generations, according to MMGY’s 2025 Portrait o...
Travel
Rosewood leans into modern luxury with refreshed brand identity

Daily Signals

Rosewood leans into modern luxury with refreshed brand identity

Luxury hotel group Rosewood is repositioning itself as a lifestyle and cultural leader, with a focus on storytelling and experiential travel.
Luxury : Hospitality : Rosewood
Foresight Friday: Olivia Houghton, insights and engagement director

Daily Signals

Foresight Friday: Olivia Houghton, insights and engagement director

Every Friday, we offer an end-of-week wrap-up of the topics, issues, ideas and virals we’re all talking about. This week, insights and engagement d...
Culture : Beauty : Fashion
Stat: Study shows decline in social media use among younger adults

Daily Signals

Stat: Study shows decline in social media use among younger adults

Adults are spending less time on social media, following a peak three years ago. By the end of 2024, those aged 16 or older were spending an averag...
Media : Technology : Statistic
Ulta Beauty opens UB Marketplace to 100 emerging brands

Daily Signals

Ulta Beauty opens UB Marketplace to 100 emerging brands

Ulta Beauty has launched UB Marketplace, a new online platform introducing more than 100 emerging beauty and wellness brands to its website and app...
Beauty : Retail : Ecommerce
Travel platform Curated Spaces is powered by trusted tastemakers

Daily Signals

Travel platform Curated Spaces is powered by trusted tastemakers

Travel start-up Curated Spaces has launched a booking platform that puts personal style, trusted recommendations and curated experiences at the hea...
Travel : Hospitality : Digital
Stat: Gen Z women are shaping a new liberal majority in the US

Daily Signals

Stat: Gen Z women are shaping a new liberal majority in the US

New polling highlights a sharp political gender gap within Gen Z, positioning young women as the most liberal demographic in the US, according to a...
Youth : Politics : Gen Z
Heineken transforms Seoul’s rooftops into social sanctuaries

Daily Signals

Heineken transforms Seoul’s rooftops into social sanctuaries

Heineken is transforming Seoul’s empty rooftops into vibrant social spaces as part of a new campaign combatting urban loneliness and removing barri...
Culture : Drink : Loneliness
You have 2 free News articles remaining. Sign up to LS:N Global to get unlimited access to all articles.
BECOME A MEMBER
SIGN IN