The colour of music: Interactive site expresses synaesthesia

28.03.2014 Synaesthesia : Senses : Convergence

California – Designer Jono Brandel and Japanese music duo Lullatone wanted to create a digital expression of synaesthesia, the neurological condition where one sense triggers another. The result is Patatap, an interactive musical instrument that combines touch, sound, animation and music to create wondrous sensory overload.

Patatap harnesses a computer's keyboard to create musical notes that are linked to animations. As people type, the screen is filled with colours and lines while different synth beats play in response to each letter keyed in. The experience creates a soundscape, visualising music through type, and lets users switch between colour palettes and sounds simply by pressing the space bar.

‘The motivation behind Patatap is to introduce the medium of visual music to a broad audience,’ Brandel explains on his website. ‘Patatap invites creators of all ages to engage the mind and senses in a different type of creation process.’

You can have a go at Patatap yourself in the interactive video above. For more on designers exploring expressions of synaesthesia, see the Synaesthetics section of The Convergence Economy macrotrend. 

You have 2 free News articles remaining. Sign up to one of our membership packages from just £100 a month.
View Subscription Offers Sign in

What do we use cookies for?

We use cookies to enable the use of our platform’s paid features and to analyse our traffic. No personal data, including your IP address, is stored and we do not sell data to third parties.

Learn more