Air guitar

The AR Music Kit, which is part of the Android Experiments with Google project, enables users to create simple instruments using augmented reality (AR).

Users begin by printing off Post-it sized markers that the app recognises as different musical notes. When the user moves their hand over a marker, the action is detected by the phone’s camera and the app plays the corresponding note.

The app features guitar and piano effects and a Music Box option that enables users to line up the markers in a sequence to create melodies.

‘We actually developed a lot of different instruments with different interactions,’ says Suzuki. ‘I would like to develop more and expand the idea.’