Chromaesthetica: A Virtual Reality App for Learning Musical Theory Using Sound-Colour Cross-Modal Associations

Research output: Chapter in Book/Report/Conference proceedingsChapterpeer-review

Abstract

This demo paper presents a Virtual Reality (VR) application designed to explore innovative methods of learning basic music theory through sound-colour cross-modal associations. Leveraging the immersive capabilities of the latest head-mounted displays, the application provides an interactive and engaging platform with significant potential for music education. The demo marks an initial step in investigating how VR's immersive features can enhance the understanding of sound-colour associations and their role in learning musical concepts, specifically intervals and melodies within the C Major scale. Two groups will participate in the study: a control group will learn using a predefined sound-colour mapping, while the experimental group will create their own personalised mappings through a pre-test in VR, which will be applied in subsequent lessons. The forthcoming study aims to provide valuable insights into the effectiveness of VR and cross-modality in facilitating music theory education.

Original languageEnglish
Title of host publicationProceedings of MUM 2024 the 23rd International Conference on Mobile and Ubiquitous Multimedia
EditorsAndrii Matviienko, Jasmin Niess, Thomas Kosch
PublisherAssociation for Computing Machinery
Pages513-515
Number of pages3
ISBN (Electronic)9798400712838
DOIs
Publication statusPublished - 1 Dec 2024
Event23rd International Conference on Mobile and Ubiquitous Multimedia, MUM 2024 - Stockholm, Sweden
Duration: 1 Dec 20244 Dec 2024

Publication series

NameACM International Conference Proceeding Series

Conference

Conference23rd International Conference on Mobile and Ubiquitous Multimedia, MUM 2024
Country/TerritorySweden
CityStockholm
Period1/12/244/12/24

Keywords

  • colour
  • cross-modal associations
  • e-learning
  • music
  • synaesthesia
  • virtual reality
  • visuals

Fingerprint

Dive into the research topics of 'Chromaesthetica: A Virtual Reality App for Learning Musical Theory Using Sound-Colour Cross-Modal Associations'. Together they form a unique fingerprint.

Cite this