Fluid Soundscapes: Touching Kandinsky
ExhibitionHarvard XR 2024 showcase
ExhibitionInnovative Horizons
ExhibitionDawn of the Century
Overview
"Fluid Soundscapes: Touching Kandinsky" is an interactive audiovisual installation that harnesses digital technology to envelop audiences in the synesthetic artistry of Kandinsky. This interactive piece allows spectators to engage directly with Kandinsky's works through gesture interaction technology, creating a bridge between classical art and contemporary digital expression.
Design
The audio experience combines AI-generated background music with real-time sound synthesis, creating a dynamic soundscape that responds to user interaction. TouchDesigner brings Kandinsky’s paintings to life with dynamic animations and real-time visual feedback, creating an immersive visual experience.
Implementation
We utilize Leap Motion to track the hand movements of users and determine if their hands are within any predefined shape areas. When a match is identified, corresponding visual effects are triggered along with sound output, creating a seamless interaction between human gesture and digital response.
Reflection
This is the first time I have seriously engaged with new media art. Using TouchDesigner and Max/MSP has been intriguing, as these tools don’t require extensive coding but still embody programming concepts. I’m pleased to discover that the skills I acquired in college can be used to create artistic works, not just technical projects.
This project is still in its early stages, and there is much room for improvement. For instance, the sound currently utilizes simple chords and matrix music, which could be developed into something more sophisticated. Nevertheless, this has been a great beginning for me to explore the intersection of art and technology.
The installation explores the interplay of technology with the essence of artistic spirit. It serves as a modern interpretation of cross-media expression, enriching sensory experiences and offering new perspectives on how we can interact with classical art through contemporary digital means.