Disney has developed a way to live map colour from a 2D colouring book onto an animated 3D model using augmented reality.

A video released by Disney shows tests where if you view specially-designed images through an app, the character you draw comes to life in an augmented 3D virtual space. The technology can recognise boundaries in a similar way to a QR code reader but can also recognise the drawing itself and the colours applied to it, even if the image moves. An app-enabled device will be able to move 360 degrees around the character, which is created by mapping each pixel on the 2D drawing to each surface pixel on the 3D animation.

ETH Zurich and the Swiss university EPFL, worked with Disney on the development, which could be implemented into future visitor attractions as part of an immersive experience.



“It’s more than just a toy,” said Disney Research Zurich’s Bob Sumner, speaking to the BBC. “It focuses on an area we call ‘augmented creativity’ where we use augmented reality to enhance creative play.

“What this allows us to do is add a magical overlay on top of traditional activities so that children can really enhance the power of their creativity.”

The research team is now taking the technology beyond drawings and looking at how it can apply the revolutionary new technology to musical and educational experiences, something it will reveal at some point in November.