Thumbnail

Kinect Xbox 360 Depth Mapping

by Microsoft

Use the microsoft xbox 360 connect to send navigation/obstacle information into the ARC NMS (navigation messaging system)

Requires ARC v3 (Updated 2/15/2022)

How to add the Kinect Xbox 360 Depth Mapping robot skill

  1. Load the most recent release of ARC (Get ARC).
  2. Press the Project tab from the top menu bar in ARC.
  3. Press Add Robot Skill from the button ribbon bar in ARC.
  4. Choose the Navigation category tab.
  5. Press the Kinect Xbox 360 Depth Mapping icon to add the robot skill to your project.

Don't have a robot yet?

Follow the Getting Started Guide to build a robot and use the Kinect Xbox 360 Depth Mapping robot skill.


How to use the Kinect Xbox 360 Depth Mapping robot skill

Use the microsoft xbox 360 connect to send navigation/obstacle information into the ARC NMS (navigation messaging system). This skill publishes obstacle scan distance data to ARC's NMS (navigation messaging system) to be used in SLAM or The Navigator skills.

Because the entire image depth is unnecessary to be processed for mapping, only a portion is. This prevents your robot from picking up distances of things irrelevant to its size and distance. Using the options for the detection area, tune the pink box to the area of detection.

Required Drivers

The SDK 1.8 can be installed from here, as you will need the libraries it includes: https://www.microsoft.com/en-ca/download/details.aspx?id=40278

*Note: under development (see To Do)

User-inserted image

To Do - additional testing to verify distance from point cloud is calculated correctly

  • compensate for distance with camera angle
  • add variables (min, max depth & sound direction)
  • move detect rectangle into config menu

ARC Pro

Upgrade to ARC Pro

Join the ARC Pro community and gain access to a wealth of resources and support, ensuring your robot's success.

PRO
Portugal
#1  

Nice! Must get me a Kinect.

PRO
Synthiam
#2  

So far my test results aren’t that great. I think the intel depth camera is the way to go ... or a 360 degree lidar

PRO
Portugal
#3  

Yes, the lidar seems to be the logic choice with the T265. It way less recourse hungry.

PRO
Portugal
#4   — Edited

Still waiting for my T265............

PRO
Synthiam
#5  

That t265 is super great. Wish they were cheaper and more of them lol

PRO
Canada
#6  

I'm very interested in this skill!

I really like the idea of using Kinect sensors on robots because you can find them for pretty cheap these days. They are usually around $10-15 CAD at second-hand stores and sites.

In the future will this skill be able to move the Kinect pan/tilt motors?

Has anyone tried powering the Kinect's 12V line with a lower voltage? like 11.1V?

PRO
Synthiam
#7   — Edited

There’s no advantage to moving the motors, if they exist in the model. It would decrease the accuracy of detected obstacles degrees/distance by the Kinect

PRO
Portugal
#8  

I don't have a kinect, but would love to see this skill in action. A video about it would be great.