Microsoft app uses machine learning to narrate the world
Seeing AI by Microsoft, Global

Microsoft app uses machine learning to narrate the world

Global – Designed to assist those that are visually impaired, the app can describe everything from text in a document to people’s emotions.

Seeing AI by Microsoft, Global

Global – Designed to assist those that are visually impaired, the app can describe everything from text in a document to people’s emotions.

The research project, Seeing AI, has been in development since 2016. The app, now available free on iOS, initially in six countries, helps people with visual impairments to navigate and experience the world. Users hold up their phone camera to the object they want described and choose the type of description they want to hear. ‘When asking a friend, there will be different things you want to know about,’ says tech lead Saqib Shaikh.

The app is able to read short pieces of text or scan an entire document. It can also recognise people and things by storing and memorising their faces. It can distinguish facial features, estimate people’s ages and read their emotions. In addition, it is also able to recognise images in other apps such as Mail, Twitter and WhatsApp, and relay what is displayed to the user.

The Big Picture

  • As we explored in the Technology section of Implicit Inclusivity, designers are looking at how to incorporate AI into their products to improve the day-to-day experiences of people with physical disabilities
  • Some smaller brands have already innovated in this field, but as brands such as Microsoft develop consumer-facing products the technology is set to advance further
Discover More Daily Signals
Heineken transforms Seoul’s rooftops into social sanctuaries

Daily Signals

Heineken transforms Seoul’s rooftops into social sanctuaries

Heineken is transforming Seoul’s empty rooftops into vibrant social spaces as part of a new campaign combatting urban loneliness and removing barri...
Culture : Drink : Loneliness
Feeling introduces transdermal energy patch to combat daily fatigue

Daily Signals

Feeling introduces transdermal energy patch to combat daily fatigue

Manchester-based wellness brand Feeling has launched a transdermal energy patch designed to address persistent fatigue in individuals who maintain ...
Health : Wellness : Supplements
Stat: Gift cards become inflation-era solution for festive shoppers

Daily Signals

Stat: Gift cards become inflation-era solution for festive shoppers

As inflation continues to put pressure on spending, gift cards are set to dominate this year’s festive period in the US. According to Blackhaw...
Retail : Consumer Spending : Inflation
Yōjō harnesses vagus nerve technology for everyday wellbeing

Daily Signals

Yōjō harnesses vagus nerve technology for everyday wellbeing

Yōjō is a new wellness eco-system using non-invasive vagus nerve stimulation (nVNS), biofeedback and human coaching to help people calm their bodie...
Health : Wellness : Technology
OpenAI launches agentic AI shopping system

Daily Signals

OpenAI launches agentic AI shopping system

ChatGPT users in America can now shop directly within conversations through OpenAI’s new Instant Checkout feature, available to Pro, Plus and Free ...
Technology : Retail : Agentic AI
Stat: The running boom is powering New York’s economy

Daily Signals

Stat: The running boom is powering New York’s economy

Running is proving to be big business for New York, according to the latest Economic Impact Study from New York Road Runners (NYRR).
Sport : Health : Running
Vacheron Constantin’s La Quête du Temps stars in Louvre exhibition

Daily Signals

Vacheron Constantin’s La Quête du Temps stars in Louvre exhibition

Luxury Swiss watchmaker Vacheron Constantin has unveiled La Quête du Temps at the Louvre, a monumental automaton clock to celebrate the brand’s 270...
Luxury : Watches : Retail
Mandarin Oriental to open first golf and wellness resort in Dubai

Daily Signals

Mandarin Oriental to open first golf and wellness resort in Dubai

Mandarin Oriental is expanding its luxury footprint in Dubai with its first dedicated golf resort and branded residences, set to open in 2030.
Travel : Hospitality : Luxury
Stat: Medical misinformation is a growing concern for US Women

Daily Signals

Stat: Medical misinformation is a growing concern for US Women

A recent survey by Clue reveals that 82% of US women are concerned about encountering medical misinformation online, with over half (55%) reporting...
Stats : Statistic : Statistics
Netflix’s Famous Last Words signals a new era of digital legacy

Daily Signals

Netflix’s Famous Last Words signals a new era of digital legacy

Dr Jane Goodall, the renowned ethologist and conservationist passed away this week. An interview she recorded for Netflix’s new series Famous Last ...
Technology : Legacy : Longevity
You have 2 free News articles remaining. Sign up to LS:N Global to get unlimited access to all articles.
BECOME A MEMBER
SIGN IN