For my final project, I want to explore the relationship between sound, movement, and visual art. My idea is to record my friend while he creates a piece of artwork and then use his movements as inspiration for the sound design and music.
Rather than simply adding background music, I want the audio to respond to what is happening on screen. The movement of a pencil across paper, brush strokes, hand gestures, and changes in pace will all influence the sounds that I create. I am interested in how sound can highlight the creative process and make the audience more aware of the physical actions involved in making art.
Some techniques I want to experiment with:
- Synchronising sounds to specific movements
- Using recorded are-making sounds as percussive or rhythmic elements
- Layering foley and sound effects to emphasise particular actions
- Changing the music based on the speed and energy of the movement
I plan to record both video and audio during the creation process. These recordings can be used as source material for foley, sound effects, and musical rhythms. For example, the scratching of a pencil or the tapping of tools could become part of the soundtrack. I will experiment with synchronising sounds to specific movements to create a stronger connection between the visual and audio elements.
This idea was influenced by my visit to the Games Design students, where I saw how sound is used to respond to actions within games and animations. It made me think about how movement can trigger sound and how audio can enhance storytelling. Through this project, I hope to develop my skills in recording, editing, sound design, and composition while creating an engaging audiovisual piece.
Fantasia (1940)
One influence that relates to my project is Fantasia (1940). It’s an animated film created by Disney. The film combines music and visuals in a way that allows the audience to experience sound and movements together. Rather than using music simply as a background audio, the animation is carefully synchronised to the rhythm and emotion of the sound soundtrack.
This links to my project because I am also interested in the relationship between sound and visual action. While Fantasia uses animation to respond to the movement of an artist. The timing of pencil marks and hand gestures will influence the audio design, helping create a stronger connection.
