Exosphere combines telepresence, artificial intelligence, machine learning and human assistance to give autonomous behaviors to cloud robotics.
+ How To Add This Control To Your Project (Click to Expand)
Manual
Exosphere gives any robot the ability to execute autonomous tasks or telepresence capabilities in the workplace or home with the aid of human intelligence. Exosphere bridges the gap between robotics, machine learning, and artificial intelligence.
Who Is Exosphere For?
It’s for any robot to be remote controlled by a human to achieve tasks or become a telepresence host.
The way we think is being replicated in AI algorithms include moral hesitation, judgment, and responsibility. This is why AI greatly benefits from human interaction. With close to 1 million robot connections on Synthiam’s platform, when the exosphere is publicly released, robots from around the world are added daily with new tasks. These tasks are created for real robots with real problems to solve. This gets AI out of the lab and into the real world.
Exosphere can control as much or little as necessary to help robots achieve their goals. Even if that means using human intelligence to fill in the 10% edge cases that robots can’t do.
How Does It Work?
1. A robot is instructed to execute a task.
2. The task is submitted to Exosphere as a contract request.
3. AI/ML and humans provide a confidence bid to win the contract.
4. If AI/ML can’t control the robot to successfully perform a task, another contract is issued to a human operator to take over or assist the robot. In turn, training the global AI knowledge base for future task requests.
Main Window - Control Tab
1. Control and Log Tabs
This selects between the Control and Log sections of the Exosphere Skill main window.
2. Task Description Field
Enter the description of the task you are generating, with detailed instructions for the user who will be accepting the task.
3. Submit/Cancel Task Button
Once the task is submitted, a remote operator will take control of the robot. It is highly recommended to monitor the robot when remotely operated to avoid hazards to the robot or damage to the environment. Once submitted, your task will be added to the Synthiam servers, and users on the website will be notified of the new task. You can also use this button for an emergency stop to cancel the task when it's running.
4. Task Details Field
Displays the time the task was requested, who picked up the task and when it was picked up.
Main Window - Log Tab
1. Log Selection Drop-Down
This selects the level of information you would like to see in the Log Display window. Verbose, Debug, Error, or None.
2. Clear Log Button
Clears the Log Display Window.
3. Log Display Window
Displays the Log information when errors occur. The amount of information is tailored by the Log Selection Drop-down.
Configuration - General Tab
1. Robot Model and Description
Write in your Robot's Make, Model, and Title. Then add a description of it which describes the Robot's qualities.
2. Session Password and Minimum Rating
Optionally set a password and a minimum rating a user must have to control your robot.
Note: *These features have not been implemented yet*
3. Maximum Joystick Drive Speed
Use the drop-down to set the maximum speed of your robot being controlled by the Joystick. If your robot is connected to ARC you can use the on-screen Joystick to test the speed.
4. Keyboard Drive Speed
Use the drop-down to set the maximum speed of your robot being controlled by the Keyboard. If your robot is connected to ARC you can use the "Test Forward" and "Stop" buttons to test with.
Configuration - Scripts Tab
1. Task Created, Accepted, and Completed Scripts
This section allows you to add scripts that will execute when the following conditions are met: your task is created, accepted, or completed.
2. User Defined Scripts
Add additional scripts to your generated Exosphere task. They will show up as playable scripts on your generated Task in the order you have them added.
Configuration - Advanced Tab

1. Audio
If enable this section allows the user who accepts your task to hear through your robot's microphone with the settings you configure. This allows you to communicate with the user in real-time.
2. Text to Speech Check-box
Once enabled, the user can write text responses that will be converted to audio. The audio will come out of your robot's speaker.
3. Video Settings
You can select an installed video device for the user to use for real-time visual feedback. You can use the check box to send video tracking information to the user as well.
4. Telepresence Mode
Enabling this allows two-way communication between the remote operator and the robot. The remote operator's camera video and audio will be displayed in fullscreen on the robot. This allows the robot to approach someone and have a two-way conversation with the remote operator. At the end of the session, the "rating" window is not displayed to the remote operator. There is a tutorial on configuring a robot for exosphere telepresence by clicking here.
5. Experimental Features
These are internal development features. These features may not work and are not documented.
Configuration - User Access Tab
1. Username Field
This field allows you to write in a username.
2. Access Type
Once the add button is pressed it will add the inputted username into your Access list and assign it to the selected access type (in the drop-down).
3. Access List
This window displays the users you have added and their access type.
How to Use the Exosphere Skill
1) Add the Camera device skill to your ARC project (Project -> Add Skill -> Camera -> Camera Device).
2) Add a Movement Panel skill to your ARC project that matches your robot (Project -> Add Skill -> Movement Panels).
3) Add the Exosphere skill to your ARC project (Project -> Add Skill -> Machine Learning -> Exosphere).
4) Add a brief description of your task to the task description field in the Exosphere skill main window.
5) Click the Submit Task button. The task is now on the Synthiam servers awaiting a user to pick it up.
6) Once the task is completed. Rate the user in three areas on how well the task was completed. 5 stars = the best job. This will help advance the machine learning database with reinforcement learning.
Video
Compatibility
With the onset of pandemics like Covid-19, it is important for Exosphere to have compatibility with existing robots to leverage their ability with human operators - while continuing to train the knowledge base for future autonomous behaviors. Exosphere was designed as a web service & skill to allow connections from existing robots or control software, such as ROS or ARC. However, it only takes minutes to add any robot to Exosphere with Synthiam’s ARC software. As per the Synthiam way, we’ll be adding many tutorials that demonstrate how to add a variety of robots to Exosphere using ARC.
the outermost region of a planet's atmosphere.
Looks like Synthiam is going to space. Can we all come ?
The Matrix...but instead of Neo, its a robot.."I want to learn jiu jitsu"
Just saying maybe we should be worried more about the machines learning then humans. Lol.
We are waiting, we are staying tuned, lol
sounds exciting.
When will hear about this?
Hope all are ok
downloaded your new version 40
Any instructions yet?
EZAng
Try making your robot walk
I see the robot, no moving
do you have a JD robot?
use a walking robot with a camera
in the Movement Panel are 3 speed settings.forwart/backwarts/stop.
witsh one do i need in the config?
i get the adventurebot going straigh forwart only using 180 forwart speed.?
that is diff when using the arrow key's on your board.i cant get the setting good.
when i set the settings for speed so the adventurebot go straigh forwart in my arc,
it changes when using exosphere .
I looked it up,
For Linux - I am windows 10 :-( very happy ARC uses windows...
Robot Operating System (ROS)
The ROS Development Studio
At The Construct, we have believed in this approach since 2015 and developed a platform that integrates all those tools. The ROS Development Studio (ROSDS):
Runs on the cloud
Provides a robotics development environment with simulations that already work
Allows the transfer to real robots in a standardized procedure
And, of course, it is based on ROS!
When you create a ROS program in the ROSDS, you can use any of the already provided simulation, or you can create your own. What is interesting is that, when you make your code work with the selected simulation, that work can be shared and reproduced by anyone under the same exact conditions. If it worked for you, it will work for anybody else that gets your ROSDS project.
and a lot more...
EZang
when i click on the settings page it drives straigh.
I am ready to test your robot now
EzAng
1) Can you send me your robot project that is having trouble going Forward with exosphere?
2) Can you tell me what button you use for forward from this picture?
just add the exosphere control to your robot and start using it.
It’s awesome. I’m gonna start using it at the office to get my drinks haha. I’ll rig something up tomorrow.
gonna use your inmoov one day to! You can add custom buttons to move the arms and such
dj i use the ( click to use arrow keys ) below.
i send my project
i had to get some sleep.
richard, drinks... dinner... sounds like a robot date! That’ll solve half of my isolation challenges lol.
yes arrow key forwart is up.i also notest the adventure turn left and right is way to fast.
cant get it to line up.
thank you
EzAng
i am awake.watshing mike tyson.xD
and waiting for parts.
it is 10:30 pm here Wednesday.
I should be back tomorrow
ready to test your robot if you want
EzAng
EzAng
I have my robot waiting for someone to activate it
EzAng
EzAng
try again please
EzAng
EzAng
get as close as possible where you see the color most
EzAng
charging the robot
EzAng
indeed.i am using roli.moment.
EzAng
EzAng
EzAng
Great
EzAng
adventurebot turns in circles and roli almost dont move.i set bolt at 200 now.
you set that in exosphere
Where is everyone else?
EzAng
thank you for the pics.
EzAng
EzAng
you did set the speed in exosphere, great - you also can test the speed there
EzAng
EzAng
look for the mini robot.xD
100% again
We need better obstacles
EzAng
All sounds
seems like the app goes right into our home, visual and audio :-)
EzAng
EzAng
EzAng
EzAng
way too much.i set him up again so you can see the eyes change hoppefully.lol
EzAng
You did great, do did Dj
need to make a harder one :-)
EzAng
DJ try again please or who ever is out there
EzAng
EzAng
or one that pushes a small ball to a destination
EzAng,
EzAng
EzAng
EzAng
robot doesn move.
EzAng
EzAng
EzAng
EzAng
Did you try the avitar program yet? Works fine
EzAng
sounds like DJ
amazing
EzAng
I am very happy you followed up with your theory - You said, something that was bigger than the cloud. Something that fed the cloud. Something that controlled the cloud.
Exosphere was born and we all can participate in this.
Thanks again for such amazing technology
EzAng
What a time to be alive!!
All the best
EzAng
I did the tasks and drove the EZ robots on the site. It was fun as a telepresence exercise.
Did the advance again 4/24/2020
EzAng
EzAng
still does not work
I wanted to runaway but at that speed I have doubts If I could reach the door
EzAng
EzAng
error:
ezang: You can figure it out
EzAng
The way the rooms looks to go and the bottom left camera on my screen are not in synch it seems
EzAng
my robot froze can't move
I am drunk!!
EzAng
how do you get it to ask a question? like directions, excuse me
EzAng
EzAng
EzAng
Ezang
Thanks,
EzAng
in the meantime for pro users, create scripts and the buttons will show up.