Learn how to connect audio to Live Effects with Vezér.
When you publish projects with the Live Effects labs feature, these effects will run in real-time on the Lightform device during playback. This means that we can adjust the parameters of Live Effects during playback, and the effects will change in real-time.
OSC & Vezér
"Open Sound Control (OSC) is a protocol for communication among computers, sound synthesizers, and other multimedia devices that is optimized for modern networking technology. Bringing the benefits of modern networking technology to the world of electronic musical instruments, OSC's advantages include interoperability, accuracy, flexibility, and enhanced organization and documentation." Read more here
We can leverage the dynamic ability of Live Effects by sending OSC messages to the Lightform device that map to their parameters. One of our favorite ways of using OSC with Live Effects is connecting audio to a Live Effect's parameters using Vezér. Vezér will convert audio data to keyframes, which can be sent as OSC messages.
Essentially, Tron's edges can react to your favorite tunes.
Vezér is a Mac only software. Similar things can be achieved with Ableton and other OSC capable softwares.
Step 1 Download Vezér
Vezér is a timeline based MIDI, OSC and DMX sequencer made for audiovisual artists. We'll be using this to convert audio waveform to keyframes, which we can then send as OSC messages to the LF1.
Download Vezér here: https://imimot.com/vezer/
If you need any help with Vezér, be sure to check out their guide.
Step 2 Enable Labs to create a Live Effect in Lightform Creator
- Select an effect in the Layers Panel, or add an effect to a surface
- Enable Labs by going to Help > Enable Labs
- Go to Effect Options in the Properties Panel
- Press Live
Because of playback settings on Lightform devices, you can only have 1 Live effect per slide.
Step 3 Locate OSC Mappings in Lightform Creator
After you publish a project with a Live Effect to the Lightform device, you'll see Live Effect Parameters on the right side of the Control Page. Click the OSC Mappings button to see the global OSC mappings for the project and the local OSC mappings for each live effect per slide.
Step 4 Create a New Project in Vezér
- Open Vezér and press Create New Project
- Drag an audio file into the composition
- Go to Composition→Composition Preferences...
- Change the duration to the length of your audio file and press Apply
Step 5 Set up OSC Value Tracks
- Select the audio track and drag your mouse around to select the part of the audio waveform you want to convert to keyframes. To select the whole track,
CMD+cto copy the Keyframes to the pasteboard (you can copy-paste from the Edit menu as well)
- Press the + button on the bottom to add a track
- Select OSC Value from the list of options
- Locate the editable text box that says Track #
- Input an OSC Mapping, which can be found in Lightform Creator (e.g., '/next', '/Slide/speed')
- Locate the drop-down that says Vezér OSC Out 1
- *Select your Lightform device by name from the dropdown. If it does not appear in the drop-down list, make sure it is powered on and connected to the same network as your computer
- Select the empty track next to the track information, and press
CMD+Vto paste the previously copied audio track
Color parameters of Live Effects will not work.
Step 6 Hit Play!
Step 7 Selecting the right parameters & settings
The audio-reactivity can seem very sensitive. Here are a few tips to find the right settings for your audio track.
1. Try each parameter on its own
Too many parameters can be too much at first. Try playing with one parameter at a time to see how it reacts to the audio, and to see which ones are better suitable for your audio track. Once you see each individual parameter's behavior, you might get more of a sense of what would look good together. Then, you can start incorporating multiple parameters.
2. Play with the interpolation settings
Change the interpolation settings by right-clicking on an OSC track. Choose between the many interpolation options. By default, this is set to linear interpolation.
We suggest choosing no interpolation to minimize the amount of OSC messages that get sent to the Lightform device.
See additional information about keyframes on Vezér here: https://imimot.com/help/vezer/keyframes/#interpolations
3. Play with the OSC Track settings
Effects parameters fall within the range of 0.0 - 1.0. If you want to sync an Effect's parameter to audio, but still want to have some control over the range of values set, you can define a minimum and maximum range (e.g., limiting the edge width of Tron to be between 0.5-1.0).
See additional information about OSC Tracks on Vezér here: https://imimot.com/help/vezer/tracks/#osc-value-track
Try out all the live effects, and try different audio tracks!