Movement Joystick icon Movement Joystick Analog joystick UI to control any ARC movement panel via mouse/touch-configurable dead zone, max speed, center-reset for smooth robot motion Try it →
Tutorial
Canada
Published — Updated

Control Robot With Virtual Reality Headset

Learn how to control your robot with a virtual reality headset in the synthiam software platform


Related Hardware (view all EZB hardware)
JD Humanoid by EZ-Robot
JD humanoid robot kit - WiFi-enabled, 16 DOF with metal-gear servos; easy, fun, educational, available from the EZ-Robot online store.
Wi-Fi / USB
Servos 24
Camera
Audio
UART 3
I2C
ADC 8
Digital 24
Six Hexapod by EZ-Robot
Six hexapod robot kit: Canadian-designed, customizable WiFi 6-legged platform with 12 servos/12 DOF for dynamic motion. Available at EZ-Robot.
Wi-Fi / USB
Servos 24
Camera
Audio
UART 3
I2C
ADC 8
Digital 24
Roli Rover by EZ-Robot
Roli WiFi planetary rover kit, customizable with 13 ez-bit ports for add-ons, built to traverse varied surfaces. Sold by EZ-Robot
Wi-Fi / USB
Servos 24
Camera
Audio
UART 3
I2C
ADC 8
Digital 24
EZ-B V4 by EZ-Robot
EZ-B v4/2 robot controller: dual Cortex ARM, Wi-Fi, audio/video, 24 servo/digital ports, I2C/UART, camera and Synthiam ARC control for custom robots
Wi-Fi / USB
Servos 24
Camera
Audio
UART 3
I2C
ADC 8
Digital 24
EZ-B Iotiny by EZ-Robot
Control IoTiny with Synthiam ARC: 100MHz Cortex‑M4 Wi‑Fi IoT/robot controller-camera, servos, ADC, I2C and digital I/O for easy internet automation
Wi-Fi / USB
Servos 8
Camera
Audio
UART
I2C
ADC
Digital
Roomba by iRobot
Convert iRobot Roomba into a smart, fully featured personal robot with the EZ-Robot Complete Kit-movement control and Roomba manual included.
Controller Dependant
Servos
Camera
Audio
UART
I2C
ADC
Digital
Program Arduino Uno with EZB firmware for Synthiam ARC control; pinouts, PWM pins and frequency details for Arduino boards.
USB
Servos 12
Camera
Audio
UART
I2C
ADC 6
Digital 14
Synthiam ARC enables Arduino Mega 2560 control with 8 ADC, 13 PWM, 21 digital ports and 24 servos; includes firmware, shield and tutorials
USB
Servos 24
Camera
Audio
UART 3
I2C
ADC 8
Digital 21
Opencm 9.04 by Robotis
Control Robotis DYNAMIXEL servos with OpenCM9.04-C using Synthiam ARC - XL-320 TTL support, expansion board for AX/MX, UART0 or UART2 selectable
USB
Servos 200
Camera
Audio
UART
I2C
ADC
Digital
Connect BBC Micro:bit to Synthiam ARC via USB. Access GPIO, LEDs, buttons; upload Arduino firmware for I2C, SPI and analog sensors.
USB
Servos Varies
Camera
Audio
UART
I2C
ADC 3
Digital 16
Connect Synthiam ARC to Arduino Leonardo via USB using EZB firmware to control GPIO, PWM, servos, and ADC; enable DTR in ARC connection.
USB
Servos 12
Camera
Audio
UART Varies
I2C
ADC Varies
Digital Varies
Bioloid by Robotis
Control Robotis Bioloid AX-12 servos with Synthiam ARC using OpenCM, OpenCR or EZ-B; add cameras, Kinect control, walking gaits and Raspberry Pi hacks
USB
Servos 200
Camera
Audio
UART
I2C
ADC
Digital
Esp32 by Espressif
Control ESP32 boards with Synthiam ARC: EZB-like firmware for GPIO, PWM/servos, serial, WiFi modes, safe pins, wiring and power tips.
Wi-Fi
Servos Varies
Camera
Audio
UART Varies
I2C
ADC Varies
Digital Varies
Ohmni telepresence robot with 13MP Supercam and low-latency streaming; run Synthiam ARC on Windows 10, use Ohmnilabs Standalone Skill and Exosphere.
Wi-Fi
Servos 1
Camera
Audio
UART
I2C
ADC
Digital

Step 1

This tutorial video will demonstrate how to use Virtual Reality with your robot to see what the robot sees, and control servos by moving your head. The associated robot skill plugin supports all virtual reality headsets through Steam VR (OpenVR), Google Play and iOS, including Google Cardboard, Oculus, Windows Mixed Reality and HTC Vive. The plugin does two things, it allows you to see what the robot sees and control the servos with the Pitch and Yaw of the headset. This means when you move your head, the robot head can move as well, mimicking your movement.

Choose a robot to start with here: https://synthiam.com/GettingStarted Download EZ-Builder: https://synthiam.com/download Virtual Reality Robot: https://synthiam.com/Products/Controls/Virtual-Reality/Virtual-Reality-Robot-15982 DJ's Full LiveHack: https://youtu.be/lfVwgmZLeKE


ARC Pro

Upgrade to ARC Pro

Subscribe to ARC Pro, and your robot will become a canvas for your imagination, limited only by your creativity.

Author Avatar
PRO
USA
#1  

Do you have an app for a IPHONE?

#2  

Quote:

Do you have an app for a IPHONE?
Since the Android phone just needs WiFi and does not need cellular service, you can probably pick up a cheap used one.  I would get one locally where you can set it up in front of the owner or from someone you know and trust because if the owner doesn't de-register from their account, you will not be able to log onto Google Play services from it even if you factory reset.  Many sellers either don't know this, or if they are selling a stolen device, they will ghost you when you try to get their credentials to remove them from the phone.

Alan

#4  

Would it be possible to use the vr robot camera to automatically generate maps in unity environment for later use with out the vr connected for autonomous locomotion?