Behavior Control
Index

Cognitive Vision

Thumbnail

How To Add This Control To Your Project

  1. Load the most recent release of EZ-Builder
  2. Press the Project tab from the top menu bar of EZ-Builder
  3. Press Add Control from the button ribbon bar of EZ-Builder
  4. Choose the Camera category tab
  5. Press the Cognitive Vision icon to add the control to your project

Use the Microsoft Cognitive Computer Vision cloud service to describe or read text in images. The images come from the Camera Device added to the project. This plugin requires an internet connect. Please consult the appropriate lessons in the learn section to configure your EZ-B to WiFi client mode or add a second USB WiFi adapter from this tutorial.



What Can You Do?

An easy example on how to use this control is to add this simple line of code to the control config. The code will speak out of the PC speaker what the camera sees. Here's a sample project: testvision.EZB

You will need a Camera Device and this plugin added to the project. It would look like this...




And add this simple line of code to the plugin configuration...

say("I am " + $VisionConfidence + " percent certain that i see " + $VisionDescription)
#1   — Edited
I just watched the videos on these services and tried to set up a text read and he just says he is 87 percent he sees the words..but not the actual words. Any one with pointers to get this to work? I tried both hand written and typed words. Do they need to be a certain size? Or this service from microsoft needs work? 

The code:say("I am " + $VisionConfidence + " percent certain that i see the words" + $VisionReadText)

Synthiam
#2  
1) please use code tags when pasting code

2) The code doesn't have space when appending $visionReadText to the string, which means it will would be a real weird word (i.e. wordsometextthatwasdetected). Your code should be...

Code:


say("I am " + $VisionConfidence + " percent certain that i see the words " + $VisionReadText)


*Notice the space after "words"

3) i tested and it works fine reading text.

User-inserted image
#3  
How did I miss that..cross eyed! Thank you ..once again! Must sleep..