DISEGNO + SMARTPHONE = MUSICA

Musikeyrtual

DESCRIPTION AND OBJECTIVES OF THE PROJECT

The project was born from the idea of ​​two deserving students of the Computer Vision course at the Department of Computer Science at Sapienza University of Rome. The initial development involved using a computer and a few different cameras (one color and one depth) to allow a user to play a musical keyboard drawn on paper. The scientific community positively accepted the prototype at an international conference, opening the doors to more in-depth experimentation. Thanks to the partnership with the Catalano Foundation, the project was presented to the TIM Foundation in the Call for Ideas with a new and more exciting objective: exclusively using a smartphone and its integrated cameras.

The purposes of this project are multiple, from promoting social interaction to reducing costs for musical equipment. Using your smartphone with a simple sheet of paper offers considerable advantages regarding transportability, affordability, and shareability. The target audience this system is aimed at is children and young people in schools, encouraging teamwork, teaching musical subjects, and learning the technological principles underlying the operation of the software.

 

INNOVATIVE USE OF TECHNOLOGIES

Over time, recognition systems based on the use of cameras have become increasingly accurate and precise. The computing power of devices has also grown exponentially, guaranteeing the possibility of carrying out operations considered impossible until the last decade, particularly on mobile or miniaturized systems.

These assumptions today allow us to develop complex systems to track the movement of objects in the surrounding space, such as human bodies or parts of it. Furthermore, artificial intelligence, particularly machine learning, provides crucial support. The topic of “Hand Tracking” is very current in the IT field, as are image processing algorithms for recognizing lines, shapes, and details of specific objects. Aggregating these two realities on ultra-portable systems, such as smartphones, would not only lead to the achievement of the intended objective but also open the way to new scientific experiments.

 

PARTNERS

Fondazione Anna Maria Catalano

 

FOUNDED BY

Fondazione TIM

 

Learn more: VISIT THE WEBSITE