Sync Audio to Live Effects with Vezér

labs-icon.pngLightform Labs Feature

Learn how to connect audio to Live Effects with Vezér (macOS only)

When you publish projects with the Live Effects labs feature, these effects will run in real-time on the Lightform device during playback. This means that we can adjust the parameters of Live Effects during playback, and the effects will change in real-time. 

OSC & Vezér

"Open Sound Control (OSC) is a protocol for communication among computers, sound synthesizers, and other multimedia devices that is optimized for modern networking technology. Bringing the benefits of modern networking technology to the world of electronic musical instruments, OSC's advantages include interoperability, accuracy, flexibility, and enhanced organization and documentation." Read more here

We can leverage the dynamic ability of Live Effects by sending OSC messages to the Lightform device that map to their parameters. One of our favorite ways of using OSC with Live Effects is connecting audio to a Live Effect's parameters using Vezér. Vezér will convert audio data to keyframes, which can be sent as OSC messages.

Essentially, Tron's edges can react to your favorite tunes. 

Note

Vezér is a Mac only software. Similar things can be achieved with Ableton and other OSC capable softwares.

Step 1 Download Vezér

Vezér is a timeline based MIDI, OSC and DMX sequencer made for audiovisual artists. We'll be using this to convert audio waveform to keyframes, which we can then send as OSC messages to the LF1.

Download Vezér here: https://imimot.com/vezer/

Note

If you need any help with Vezér, be sure to check out their guide.

Step 2 Add Live Effects

  1. Select an effect in the Layers Panel, or add an effect to a surface
  2. Enable Labs by going to Help > Enable Labs
  3. Go to Effect Options in the Properties Panel
  4. Press Live

Note

Because of playback settings on Lightform devices, you can only have 1 Live effect per slide.

Step 3 Locate OSC Mappings

After you publish a project with a Live Effect to the Lightform device, you'll see Live Effect Parameters on the right side of the Control Page. Click the OSC Mappings button to see the global OSC mappings for the project and the local OSC mappings for each live effect per slide. 

Step 4 Create a New Project in Vezér

  1. Open Vezér and press Create New Project
  2. Drag an audio file into the composition
  3. Go to Composition→Composition Preferences...
  4. Change the duration to the length of your audio file and press Apply

Step 5 Set up OSC Value Tracks

  1. Select the audio track and drag your mouse around to select the part of the audio waveform you want to convert to keyframes. To select the whole track, double-click or press CMD+a
  2. Press CMD+c to copy the Keyframes to the pasteboard (you can copy-paste from the Edit menu as well)
  3. Press the + button on the bottom to add a track
  4. Select OSC Value from the list of options
  5. Locate the editable text box that says Track #
  6. Input an OSC Mapping, which can be found in Lightform Creator (e.g., '/next', '/Slide/speed')
  7. Locate the drop-down that says Vezér OSC Out 1
  8. *Select your Lightform device by name from the dropdown. If it does not appear in the drop-down list, make sure it is powered on and connected to the same network as your computer.
    • If you still don't see the device, you can manually add it based on the device's IP address. You can find your device's IP address in Lightform Creator on the Control Page, or by looking on the projected Testcard.
    • Once you find the IP, go to Vezer's Preferences (Cmd+,). Add a new "OSC Output" and modify the "OSC Output IP" to be the device IP you found in the previous step. You can also change the name to your device's name, if you prefer. Leave the Port set to 8000.
    • Now go back to the dropdown mentioned at the top of this instruction, and choose the new OSC Output you just created.
  9. Select the empty track next to the track information, and press CMD+V to paste the previously copied audio track

Note

Color parameters of Live Effects will not work.

Step 6 Hit Play!

Step 7 Selecting the right parameters & settings

The audio-reactivity can seem very sensitive. Here are a few tips to find the right settings for your audio track.

1. Try each parameter on its own

Too many parameters can be too much at first. Try playing with one parameter at a time to see how it reacts to the audio, and to see which ones are better suitable for your audio track. Once you see each individual parameter's behavior, you might get more of a sense of what would look good together. Then, you can start incorporating multiple parameters.

2. Play with the interpolation settings

Change the interpolation settings by right-clicking on an OSC track. Choose between the many interpolation options. By default, this is set to linear interpolation.  

Note

We suggest choosing no interpolation to minimize the amount of OSC messages that get sent to the Lightform device.

See additional information about keyframes on Vezér here: https://imimot.com/help/vezer/keyframes/#interpolations

3. Play with the OSC Track settings

Effects parameters fall within the range of 0.0 - 1.0. If you want to sync an Effect's parameter to audio, but still want to have some control over the range of values set, you can define a minimum and maximum range (e.g., limiting the edge width of Tron to be between 0.5-1.0).

See additional information about OSC Tracks on Vezér here: https://imimot.com/help/vezer/tracks/#osc-value-track

Conclusion

Try out all the live effects, and try different audio tracks! 

Was this article helpful?
13 out of 17 found this helpful

Sign in to make a suggestion to improve this article

  • Comment actions Permalink
    Avatar
    said baadj

    hi it ray to do it all what you say but can't get the sound I download a free version of vezer perhaps 

    this is  the problem 

  • Comment actions Permalink
    Avatar
    Ian Dodge

    Can't get this to work.  Followed all steps as instructed.  But the Lightform LFC is not visible in the Vezer dropdown menu.  All devices are connected to the same Wifi.  Tried with both the Vezer demo and Vezer full version software.

  • Comment actions Permalink
    Avatar
    Mike Wood

    https://guide.lightform.com/hc/en-us/articles/360015876173/comments/360004253534

     

    Hi Ian, 

    I had the same problem that it did not show up in the drop down. I then went to the preference of Vezer, click on OSC, and add the IP address manually. Also make sure you publish to your Lightform from Lightform creator. Once you publish, set up IP from Vezer, set up all the OSC Slide mappings, press the play button in Vezer. Enjoy!!!!

  • Comment actions Permalink
    Avatar
    Adam McIntyre

    Has anyone had any luck yet with Ableton?  I'm an avid Ableton Live user and would love to see if anyone has used it to send OSC messages to LFC.