Microsoft app uses machine learning to narrate the world
Seeing AI by Microsoft, Global

Microsoft app uses machine learning to narrate the world

Global – Designed to assist those that are visually impaired, the app can describe everything from text in a document to people’s emotions.

Article/21610 54c
Seeing AI by Microsoft, Global

Global – Designed to assist those that are visually impaired, the app can describe everything from text in a document to people’s emotions.

The research project, Seeing AI, has been in development since 2016. The app, now available free on iOS, initially in six countries, helps people with visual impairments to navigate and experience the world. Users hold up their phone camera to the object they want described and choose the type of description they want to hear. ‘When asking a friend, there will be different things you want to know about,’ says tech lead Saqib Shaikh.

The app is able to read short pieces of text or scan an entire document. It can also recognise people and things by storing and memorising their faces. It can distinguish facial features, estimate people’s ages and read their emotions. In addition, it is also able to recognise images in other apps such as Mail, Twitter and WhatsApp, and relay what is displayed to the user.

The Big Picture

  • As we explored in the Technology section of Implicit Inclusivity, designers are looking at how to incorporate AI into their products to improve the day-to-day experiences of people with physical disabilities
  • Some smaller brands have already innovated in this field, but as brands such as Microsoft develop consumer-facing products the technology is set to advance further
Discover More News
NRF 2025 Retail’s Big Show Europe: Unified commerce and inspirational entertainment

News

NRF 2025 Retail’s Big Show Europe: Unified commerce and inspirational entertainment

On the opening day of NRF 2025: Retail’s Big Show Europe, the spotlight turned to unified commerce and the evolving role of physical stores in omni...
Retail : NRF : Pop Up Store
The Future Laboratory presents The Synthocene Era macrotrend at Première Vision

News

The Future Laboratory presents The Synthocene Era macrotrend at Première Vision

The Future Laboratory’s co-founder and chief creative officer Christopher Sanderson presented The Synthocene Era macrotrend at the fashion industry...
Global Events : Technology : The Synthocene Era
Gen Z in China are using AI to transform themselves into collectable merchandise

News

Gen Z in China are using AI to transform themselves into collectable merchandise

Gen Z in China are using AI art tools and 3D printing to transform themselves into ‘guzi’ – personalised collectable merchandise.
China : Kidults : Kidult Craze
Stat: Gen Z stay indoors for days as screen time replaces nature

News

Stat: Gen Z stay indoors for days as screen time replaces nature

Two-thirds of Gen Z in Britain confess they can go days without stepping outside, according to new research by Super, Natural British Columbia.
Gen Z : Nature : Health And Wellness
Big W embraces the beautiful chaos of parenting in new campaign

News

Big W embraces the beautiful chaos of parenting in new campaign

Department store chain Big W is shaking up family advertising with a bold new campaign celebrating the chaos, meltdowns and small wins of everyday ...
Advertising & Branding : Parenting : Retail
George at Asda unveils new adult adaptive clothing range

News

George at Asda unveils new adult adaptive clothing range

George at Asda has launched a 28-piece adult adaptive clothing collection, designed in collaboration with the late breast cancer campaigner Nicky N...
Retail : Fashion : George At Asda
Stat: Girls’ sport participation could unlock leadership potential at work

News

Stat: Girls’ sport participation could unlock leadership potential at work

Girls who play extracurricular sport in the UK are 50% more likely to go on to achieve senior professional roles at work, according to Game Changin...
Sport : Women's Sports : Teenage Girls
Vattenfall and Samuel L Jackson’s seaweed snack is grown on wind farms

News

Vattenfall and Samuel L Jackson’s seaweed snack is grown on wind farms

Swedish energy company, Vattenfall has teamed up with actor Samuel L Jackson to launch Wind Farmed Seaweed Snacks, a limited-edition delicacy grown...
Visual : Sweden : Energy
Happy Head debuts DNA-based system for personalised hair growth

News

Happy Head debuts DNA-based system for personalised hair growth

Happy Head has launched StrandIQ, the world’s first dermatologist-developed hair growth system powered by genetic analysis, giving patients tailore...
Health : Wellness : Happy Head StrandIQ
Stat: Luxury consumers’ optimism is improving amid global slowdown

News

Stat: Luxury consumers’ optimism is improving amid global slowdown

Saks’ latest Luxury Pulse survey shows rising confidence among luxury shoppers, with more than half planning to maintain or increase their spending...
Stat : Statistics : Statistic
You have 0 free News articles remaining. Sign up to LS:N Global to get unlimited access to all articles.
BECOME A MEMBER
SIGN IN