A/V - The Interactions Between Live Sound and Visuals - Part 1, VJing

A/V - The Interactions Between Live Sound and Visuals

Part 1 - VJing

A key component of live music performance is not only what we hear, but also what we see. While my studies mainly focus on sound, I find the interactions between the sonic and visual elements of live music events to be interesting and enjoyable. During my time at The Forum Hertfordshire I have had heavy involvement with the visual elements involved in live performance and events - mainly through lighting and LED screens. It certainly took some time to develop a proficiency with both these elements to the point where I could quickly respond to sonic or visual cues so that all systems work together in an organic fashion.

VJing is the process of mixing still images and moving videos together with sound in a live context, utilising effects and techniques to synchronise the video and in interesting ways. I'd been taught at The Forum how to use VJ software Resolume Arena 5, which works well as a VJ tool for me. One of the main things I like about Resolume is the ability to map and use MIDI control surfaces, which I have incorporated through an Akai APC 20 and my own personal control map and button functions.

As a general rule, I consider it important to have awareness of other industry standards and their uses and benefits. I asked my managers of alternative softwares, who pointed me in the direction of VJ softwares MadMapper and VDMX. These work in similar fashion, although they are less common and operate under different interfaces.

After a while, I found my VJ elements to be a little static and bland, and begun looking into ways of making it more involved. While I was taught the basic operation of Resolume, I have developed a habit of reading through manuals to learn about new possibilities, as well as to solve problems that I come across. I decided to downloaded the trial version of Resolume to try out things on my own under my own time and control of not being in front of an audience.

I was aware that The University of Hertfordshire Audio Technician, Richard Newby, has a strong background in live visuals and Resolume Arena. I asked him if he'd had any tips, and he told me about the Audio FFT function to control parameters. I took an auxiliary copy send of the DJ mix from the Yamaha M7CL desk and plugged it into the mic input of the computer. I then set the logo image opacity parameter control to Audio FFT. From here, I filtered the input values to correspond to the bass frequencies of the kick drum, so the logo pulsed in brightness in beat with the music. I used this technique during the live performances of Katy B, DJ EZ and DJ Lord (Public Enemy), which was met with positive response.

Learning how to understand and utilise Resolume's features was really a series of trial and error, which was guided by using manuals, speaking to other VJ's and observing other VJ work at concerts and online videos.