Cognitive Emotion

How to add the Cognitive Emotion robot skill

  1. Load the most recent release of ARC (Get ARC).
  2. Press the Project tab from the top menu bar in ARC.
  3. Press Add Robot Skill from the button ribbon bar in ARC.
  4. Choose the Camera category tab.
  5. Press the Cognitive Emotion icon to add the robot skill to your project.

Don't have a robot yet?

Follow the Getting Started Guide to build a robot and use the Cognitive Emotion robot skill.

How to use the Cognitive Emotion robot skill

Use the Microsoft Cognitive Emotion cloud service to describe images. The images come from the Camera Device added to the project. This plugin requires an internet connection. Please consult the appropriate lessons in the learn section to configure your EZ-B to WiFi client mode or add a second USB WiFi adapter from this tutorial.

Currently Disabled

This robot skill will only return an error because Microsoft has discontinued this service for their AI ethics. Microsoft had concerns that this technology detects the sex, age, and emotions of a person who may feel violated by their personal rights. This robot skill will be maintained here if a replacement is found.

What Can You Do?

An easy example of using this control is adding this simple line of code to the control config. The code will speak what the camera sees for emotion from the PC speaker. You will need a Camera Device robot skill, and this robot skill will be added to the project.

See It In Action

DJ Sures created this project using an EZ-Robot JD to make the robot have a conversation and recognize his emotions. The robot comes out with some funniest things in response to DJ's questions!

You can try DJ's sample project if you have an EZ-Robot JD Humanoid.

Download DJ's testemotion.EZB project

It would look like this...

And add this simple line of code...

say("You are " + $EmotionConfidence + " percent " +  $EmotionDescription)

Limited Daily Quota

This robot skill uses a shared license key with Microsoft, enabling ARC users to experiment and demo this robot skill. The shared license key provides a daily quota for ARC Pro users of 500 requests per day. Because this robot skill uses a 3rd party service that costs Synthiam per transaction, the daily quota does not exceed our spending limit. If your application requires a higher daily quota, we can provide a robot skill that allows specifying your license key to pay Microsoft service directly. Contact Us for more information.


Upgrade to ARC Pro

ARC Pro will give you immediate updates and new features needed to unleash your robot's potential!


I see the same eight emotions listed for both Cognitive Emotion and Cognitive Face. Does this skill duplicate the emotion detection functionality of the Cognitive Face skill? If not, how are they different when it comes to reading someone's emotions?




It is actually the other way around. The Face robot skill uses features from the emotion robot skill. For more information, the author of the robot skills and their documentation at microsoft can be found here:


FYI the testemotion example that you can download on this page no longer works.  Plugins out of date