Tangible music composer for children


  • Juan Ignacio Francesconi Departamento de Ciencias e Ingeniería de la Computación, Universidad Nacional del Sur, Bahía Blanca, Argentina
  • Martín Leonardo Larrea Departamento de Ciencias e Ingeniería de la Computación, Universidad Nacional del Sur, Bahía Blanca, Argentina
  • Cristina Manresa-Yee Math and Computer Science Department, University of Balearic Islands, Ed. Anselm Turmeda, Palma de Mallorca, Spain


Tangible interface, Music, Low-cost, Incremental learning, Collaborative work, Intuitive performance, Human computer interaction


Music education should start from an early age. Theories of child development and learning emphasize the importance of manipulating physical objects. Music learning and teaching has traditionally been carried out mainly by visual and auditory activities. With this in mind, we combine music learning with tangible interfaces to stimulate senses toward music in children over six years old. We present a token+constraint tangible interface for children to learn musical skills such as musical notes, rhythm and the sound of different instruments. The work describes a low-cost tangible interface addressed to children that allows learning music in an intuitive, incremental and collaborative manner. The system recognizes in real-time preestablished patterns and associates them with musical notes and instruments to allow composing music. The system was designed to be usable and to benefit from the advantages that tangible interfaces can provide to children. Furthermore, it was implemented with low cost and easy to get tools and resources, such as wooden boards and a standard webcam


Download data is not yet available.


[1] Sharlin E, Watson B. On Tangible User Interfaces, Human and Spatiality. Personal and Ubiquitous Computing, 2004, Volume 8 (Issue 5), 338-346.
[2] O’Malley C, Fraser DS. Literature review in learning with tangible technologies. NESTA, Futurelab, 2004.
[3] Hourcade JP, Bederson BB, Druin A, Guim-bretière F. Differences in pointing task performance between preschool children and adults using mice. ACM Transactions on Computer-Human Interaction, 2004, Volume 11 ( Issue 4), 357-386.
[4] Revelle G, Zuckerman O, Druin A, Bolas M. Tangible User Interfaces for Children Proceeding. CHI EA ’05 CHI ’05 extended abstracts on Human factors in computing systems, 2051-2052.
[5] Ullmer B, Ishii H. Emerging frameworks for tangible user interfaces. IBM Systems Journal, 2000,Volume 39( Issues 3 & 4), 915-931.
[6] Ishi H. The tangible user interface and its evolution. Communications of the ACM - Organic user interfaces, 2008, Volume 51 (Issue 6), 32-36.
[7] Fishkin K. P. A taxonomy for and analysis of tangible interfaces. Personal and Ubiquitous
Computing, 2004, Volume 8 (Issue 5), 347-358.
[8] Montessori M. The Montessori Method. Translated by Anne Everett George. New York: Frederick A. Stokes Company, 1912.
[9] Ullmer B., Ishii H., Jacob RJK. Token+Constraint Systems for Tangible Interaction with Digital nformation. ACM Trans. on Computer-Human Interaction, 2005 Volume 12 (Issue 1), 81-118.
[10] Terrenghi L., Kranz M., Holleis P., Schmidt A. A cube to learn: a TUI for the design of a learning appliance. Personal and Ubiquitous Computing, 2006, Volume 10, (Issue 2), 153-158.
[11] Marco J., Cerezo E., Baldassarri S. Bringing tabletop technology to all: evaluating a tangible farm game with kindergarten and special needs children. Personal and Ubiquitous Computing, 2012, Springer London, 1-15
[12] Antle A. N. The CTI framework: informing the design of tangible systems for children. In Proc. TEI 2007, 2007, ACM Press, 195-202.
[13] Zigelbaum J., Millner A., Desai B., Ishii H. BodyBeats: Whole-body, musical interfaces for children. Extended Abstracts CHI ’06, 2006, ACM Press, 1595-1600.
[14] Xu D. Tangible User Interface for Children - An Overview. in Proc. of the UCLAN, 2005, Department of Computing Conference.
[15] Zuckerman O., Arida S., Resnick M. Extending Tangible Interfaces for Education: Digital Montessori inspired Manipulatives. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2005, ACM Press, New York, NY, 859-868.
[16] Goldin-Meadow S. Hearing Gesture: How Our Hands Help Us Think. Harvard University Press, 2003.
[17] Rieser J. J., Garing A. E., Young M. F. Imagery, action and young children’s spatial orientation - it’s not being there that counts, it’s what one has in mind. Child Development, 1994, Volume 65 (Issue 5), 1262-1278.
[18] Wagner Cook S., Goldin-Meadow S. The Role of Gesture in Learning: Do Children Use Their Hands to Change Their Minds?. Journal of cognition and development, 2006, Volume 7 (Issue 2), Lawrence Erlbaum Associates, 211-232. http://www.codeproject.com/Articles/6228/CMIDI-Toolkit.
[19] Markopoulos P., Read J., MacFarlane S., Höysniemi J. Evaluating Children’s Interactive Products; Principles and Practices for interaction designers. Morgan Kaufmann, 2008.
[20] Bott J., Crowley J., LaViola J. Exploring 3Dgestural interfaces for music creation in video games. In Proceedings of the 4th International Conference on Foundations of Digital Games, 2009, 18-25.
[21] Bean A., Siddiqi S., Chowdhury A., Whited B., Shaer O., Jacob R. J. K. Marble Track Audio Manipulator (MTAM): A Tangible User Interface for Audio Composition. Proceedings of the 2nd International Conference on Tangible and Embedded Interaction (TEI’08), 2008, ACM.
[22] Bakker S., Hoven Evd., Antle A. N. MoSo Tangibles: Evaluating Embodied Learning. TEI ’11 Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction, 2011, 85-92.
[23] Bakker S., Antle A. N., Van Den Hoven E. Embodied metaphors in tangible interaction design. Personal Ubiquitous Computing, 2012, Volume 16 (Issue 4), 433-449.
[24] Schiettecatte B., Vanderdonckt J. AudioCubes: a distributed cube tangible interface based on interaction range for sound design. Proceedings of the 2nd international conference on Tangible and embedded interaction (TEI ’08), 2008, ACM Press, 3-10.
[25] Newton-Dunn H., Nakano H., Gibson J. Block jam: a tangible interface for interactive music. Proceedings of the 2003 conference on New interfaces for musical expression, 2003.
[26] Jordà S., Kaltenbrunner M., Geiger G., Bencina R. The reacTable*. Proceedings of the International Computer Music Conference (ICM05), 2005.
[27] Patten J., Recht B., Ishii H. Interaction Techniques for Musical Performance with Table-top Tangible Interfaces. ACE 2006 Advances in Computer Entertainment, 2006.
[28] Bradski G., Kaehler A. Learning OpenCV. O’Reilly Media, 2008.
[29] Yoo T. S., Ackerman M. J., Lorensen W. E., Schroeder W., Chalana V., Aylward S., Metaxas D., Whitaker R. Engineering and algorithm design for an image processing Api: a technical report on ITK–the Insight Toolkit. National Library of Medicine, National Institutes of Health, 2002, Bethesda USA.




How to Cite

Francesconi, J. I., Larrea, M. L., & Manresa-Yee, C. (2013). Tangible music composer for children. Journal of Computer Science and Technology, 13(02), p. 84–90. Retrieved from https://journal.info.unlp.edu.ar/JCST/article/view/618



Original Articles