We can use the Microsoft Kinect to send OSC messages to the Lightform device. In this tutorial, we'll be using an open source solution that allows you to control OSC values using Kinect Body Tracking.
KinectV2-OSC sends OSC messages for each body detected by the Kinect. We edited the code to add a feature that detects right-to-left hand movement then sends an OSC message to the Lightform device to trigger the next slide.
This requires a bit of coding!
|Windows 8+ (we tested on Windows 10)|
|V2 Kinect sensor|
|Visual Studio 2013+ (we tested on VS 2015)|
Step 1 Download and Run the KinectV2-OSC app
Clone the KinectV2-OSC repository:
cdinto the directory you want the files to live in
Open KinectV2OSC.sln in Visual Studio. Run the application by pressing the green Start button. Verify that the application runs and you successfully see skeleton data. The screen should look like this:
Step 2 Create Gesture Detection
In this example, we detect a right hand moving from right to left and send an OSC message to trigger the next slide.
Here is the Kinect Body class: https://docs.microsoft.com/en-us/previous-versions/windows/kinect/dn772824(v%3dieb.10)
Step 3 Change IP Address and Port to your Lightform Device's IP Address
We'll need to make sure that the OSC message is sent to your Lightform device, so we'll configure the right IP address and port in the KinectV2-OSC properties file. Locate the IP address of your Lightform device in the Control Page in Lightform Creator:
Go to Properties -> Resources to change the IP and port number in the KinectV2-OSC resources file. The port number is 8000:
Step 4 Send OSC Message
KinectV2-OSC uses Rug.OSC to send OSC messages. You can find this usage in BodySender.cs and MessageBuilder.cs. Here is the OSC message we send to the Lightform device:
OSCMessage message = OscMessage.Parse("/next, 1.0");
This sends the value 1.0f to the OSC address"/next", which triggers the next slide. You can find the full list of OSC mappings for the Lightform device in the Control Page:
This tutorial just scratches the surface of how you can use the Kinect with the Lightform device. We'll be adding more examples of this (e.g., body pose estimates with Live Effect parameters...). Maybe you'll beat us to it ;)