Cognitive Face

+ How To Add This Control To Your Project (Click to Expand)
  1. Load the most recent release of ARC.
  2. Press the Project tab from the top menu bar in ARC.
  3. Press Add Control from the button ribbon bar in ARC.
  4. Choose the Camera category tab.
  5. Press the Cognitive Face icon to add the control to your project.

Use the Cognitive Face cloud service to detect faces, describe emotions, guess age and get the name of the person from a worldwide database. The images come from the Camera Device added to the project. This plugin requires an internet connection. Please consult the appropriate lessons in the learn section to configure your EZ-B to WiFi client mode or add a second USB WiFi adapter from this tutorial.

What Does It Do?

This control will use the camera to detect and learn your facial features. Once you teach it your name, your face profile is saved in a global worldwide database. Now every ezrobot on the planet can know who everyone is! With this control, you can visit a friend and their ezrobot will know who you are. Detected names, age, and emotion are stored in variables to be used in EZ-Script or Blockly. Use ControlCommand() to trigger Detect or Learn. Consult the Cheat Sheet for available ControlCommands.

What Doesn't This Do?

The Camera Device Control has built-in support for tracking, such as Objects, Faces, Colors, Motion, Glyphs and more. This control does not track a face - meaning, this control will not move servos or have your robot detect when a face is in the camera view. For moving servos and detecting faces, use the Face Tracking option of the Camera Device. This control will populate variables and execute a script with the detected Name, Age and Emotional status of the face in the camera.

What Can I Do With It?

When your face and name have been taught to the control, the information is saved in a cloud database. Any ezrobot that detects your face can know your name. This means you can create very simple scripts that greet people or perform specific actions.

Cognitive Face In Action

In the screenshot below, you can see Dj Sures' face detected. The control displays his name, estimated age, and emotional status. Now that the Cognitive Face Cloud Database has learned DJ's face, if your robot were to see DJ, it would know who he is.


Limited Daily Quota

This robot skill uses a shared license key with Microsoft that enables ARC users to experiment and demo this robot skill. The shared license key provides a daily quota for ARC Pro users of 500 requests per day. Because this robot skill uses a 3rd party service that costs Synthiam per transaction, the daily quota is applied to not exceed our spending limit. If your application requires a higher daily quota, we can provide a robot skill that allows specifying your own license key to pay Microsoft service directly. Contact Us for more information.

It looks like a great thing to have in a robot, but how do I get the name of the person into a variable as well as the values for surprise, sadness, etc.
You’ll find those values in the global variables.