Cognitive Vision

Thumbnail

How To Add This Control To Your Project

  1. Load the most recent release of EZ-Builder
  2. Press the Project tab from the top menu bar of EZ-Builder
  3. Press Add Control from the button ribbon bar of EZ-Builder
  4. Choose the Camera category tab
  5. Press the Cognitive Vision icon to add the control to your project

Use the Microsoft Cognitive Computer Vision cloud service to describe or read text in images. The images come from the Camera Device added to the project. This plugin requires an internet connect. If your are using a WiFi enabled robot controller (such as EZ-Robot EZ-B v4 or IoTiny), lease consult their manualsto configure WiFi client mode or add a second USB WiFi adapter from this tutorial.

Details

The behavior control will detect objects using cognitive machine learning. The image will be analyzed and each detected object will be stored in variable arrays. The width, height, location and description of each object. The image will also be analyzed for adult content. Use the Variable Watcher to view the detected details in real-time.



Educational Tutorial

This educational tutorial for using the Cognitive Vision behavior control was created by The Robot Program by EZ-Robot. This same procedure can be executed on any robot with a camera, or PC with a USB Camera.



What Can You Do?

An easy example on how to use this control is to add this simple line of code to the control config. The code will speak out of the PC speaker what the camera sees. Here's a sample project: testvision.EZB

Demo

DJ Sures from Synthiam created this demo using an EZ-Robot JD by combining this Cognitive Vision behavior control, Pandora Bot and speech recognition. He was able to have conversations with the robot, which is quite entertaining!

You will need a Camera Device and this plugin added to the project. It would look like this...




And add this simple line of code to the plugin configuration...

say("I am " + $VisionConfidence + " percent certain that i see " + $VisionDescription)
#3  
How did I miss that..cross eyed! Thank you ..once again! Must sleep..
#4   — Edited
...odd the new version filters adult content?! How is that a feature? What was Microsoft trying to prevent/use cases? Especially if you think of all the other filters they could have added for whats found in an image.
Synthiam
#5   — Edited
I don’t believe there’s any filtering being done. There is a value of how much adult content there is, but I don’t believe anything is filtered

you can always stand nude in front of your robot to test it out hahaha
#6   — Edited
Yeah your right not a filter more of a tag. Still wondering why that’s a feature . Why not something useful like cats chasing dogs?

I did a little research earlier today and it’s possible to create custom object detection projects. Train and prediction. Makes it more useful for a case by case robot. 

..of course I got naked in front of the vision cognition ...it said '100% sure you should put your clothes back on!' Lol.
Synthiam
#7  
Ya it’s a rating - it’ll help some applications to prevent abuse. I know we’re using it for a new service we’re releasing in beta next week. 

ill take a look at the custom detection part. Although it is quite easy to do local with the object tracking built in the camera control
#8  
Looking forward to that beta!