Behavior Control
This control is developed by:
AvatarDJ Sures
Created January 27 2017
Updated January 9
Help Index

Kinect Body Control

How To Download and Use This Control

  1. Make sure you have the latest version of EZ-Builder installed.
  2. Select Download This Control button below to download the file.
  3. Double click the downloaded file to open it.
  4. The installer will automatically add this control to EZ-Builder.
Download This Control

This EZ-Builder plugin enables controlling servos of your robot by moving joints of your body, which are detected by a Microsoft xBox 360 Kinect only. servos can be assigned to each joint using the Settings window. Degrees to move the servos are automatically calculated for joints in relation to the connecting joint. For example, the wrist position in degrees is calculated in relationship to the elbow position. And the elbow position in degrees is calculated in relationship to the shoulder position. Each joint can be assigned to control servo positions between 1-180 degrees of your robot.



User-inserted image

Settings
The configuration window provides you with 3 tabs. The general tab contains settings for filtering and such. The other 2 tabs are to specify servos per joint.

Increase the smoothness value to remove servo jitter. However, there will be a slight delay as the smoothness value increases.
User-inserted image

The Upper and Lower servo tabs will specify what servos will be assigned to different joints of your body.
User-inserted image


Kinect Compatibility
I'm unsure of what kinect's work with the SDK in Windows, due to limited information published by Microsoft (or at least hard to find information). There are multiple Kinect versions, the one I used is xBox 360 Kinect. Join the discussion on compatible versions here: http://www.ez-robot.com/Community/Forum/Thread?threadId=10018

Drivers
Compiled against Kinect 1.8 SDK, because I only have an XBOX 360 Kinect. I'm unsure of the compatibility with later versions. The SDK can be installed from here, as you will need the libraries it includes: https://www.microsoft.com/en-ca/download/details.aspx?id=40278

Work In Progress
- The servos for legs are not implemented yet
- The should rotation servos are not implemented yet

October 8 2017
Nice this works:D
Body control would still be nice:) it just needs to be opdated to take kinect20.dll too with kinect10.dll...
October 8 2017
From your perspective (the user) it seems a simple change swap kinect10.dll with kinect20.dll and voila!

The reality is different: Kinect 2.0 has a different API, you will need:
1) change the code to support two different APIs.
2) Check before loading the DLLs (Lazy load) or create/support different plugins (the user can have both sensors or only one of them).

All the above is only possible if you have the real stuff (Kinect V2).
January 9
I have installed the plugin and installed the right kinect software also.
(kinect 1, Windows 10)

The kinect works when I start the Microsoft Kinect software: I can see camera vision and movements.

When I try to use the EZ-robot with kinect plugin, I can connect the EZ-Robot software to the kinect (it's is found by the ez-robot software), but then it ends. No red wire movements or whatever.

I got some info on the plugin-window once, but didn't got that also anymore.

Any help would be nice !

With kind regards,

;-) Arthur
DJ Sures
Synthiam
January 9 — Updated January 9
Hi Arthur - did you install the driver specified in the description above? I believe it is 1.8, and the link is included above. What do you mean by "then it ends"? Are you meaning the computer shuts down or EZ-Builder crashes? I'll need as much information as you can tell me to help

Also, @ptp made a much better plugin that you can find here: https://synthiam.com/Software/Manual/DepthSensor-15873
January 9 — Updated January 9
Oh that's right I forgot there was a Kinect plugin ,I have one Kinect camera from Xbox 360 but it has the funny USB connector that won't fit standard computer USB ports. I guess I need to buy the special adapter to fit on computers,I saw them cheap on Ebay and Amazon. Not sure if it will work with EZ software but I do see articles online how to get it working on any windows 10 Laptops so will try both ways as the camera only cost me 13 dollars at one of those hock shops ,it looks brand new and hopefully will power up when I get the special USB adapter to Laptop kit.