Hi @ptp. I wonder if we need to break the problem into smaller chunks so the problem is easier for Watson to solve and then string these together. We are not providing any negative classes. We only say what each card is, but not what it isn’t.

Colour Cluster. Red cards positive and Black cards negative Is it a red card or black card. this should be a relatively easy problem to solve. Assume red

Red Suit Cluster Hearts positive and diamonds negative. Again relatively easy problem to solve. Assume hearts.

Hearts Suit Cluster Picture positive Numeric Negative. Assume Picture.

Hearts Picture Cluster. Is it jack queen king or ace of hearts.

If we could do this and then somehow feed that back into a machine learning I am wondering if this would be very accurate and quick to process?

Hi @ptp, Do you think you might be able to build an ARC skill plugin that can run TensorFlow like this:

https://www.youtube.com/watch?v=_zZe27JYi8Y

and return the objects' names and their x,y coordinates?

Thomas

Sorry the delay... I'm away for the holidays, school break for Passover / Easter.

subjects:

1. playing cards I'll get this playing cards: https://www.amazon.com/Bicycle-Playing-Card-Deck-2-Pack/dp/B010F6BAES They are available in the amazon US,UK,CA. It will be more easy to share (not public) the training pictures.

2. plugin roadmap soon i plan to update the plugin to support training with negative samples, and the assistant (formerly conversation) API, although there are some gaps to fill.

3. offline object detection This will take a little longer, still researching, most implementations e.g. libraries are 64 bits and require some resources (memory & cpu and when possible a gpu), some plumbing is needed between ARC/plugins and an external application.

@Thomas:

Watson: I presume you managed to find and setup the watson visual recognition.

Machine Learning: The main problem is the Hype regarding machine learning... we are far from machine learning, and AI, and the robots seeing and taking the world ... What we have is massive data dumped to massive computational hardware to obtain some clues...

Tensorflow: With a core I7 without a nvidia GPU and a custom compilation for windows x64 and AVX2 extension enabled (not available in all cpus https://en.wikipedia.org/wiki/Advanced_Vector_Extensions) the quickest model (less accuracy) took 3.5 seconds and a more accurate model took 45 seconds to classify/detect objects in a single photo.

Unless i'm doing something wrong, less time requires a decent GPU and or a different model.

I'll post in another thread more details.

Have you considered building a plugin that expands the capability of ezrobot's existing object training? It's much faster than using tensorflow or yolo on darknet. That's built using Yeremeyev method: http://edv-detail.narod.ru/AVM_main.html

I ordered these ones from amazon.ca I think they are the same. I don't want to get hit with customs and duties for cross border. https://www.amazon.ca/gp/offer-listing/B00001QHVP/ref=olp_twister_child?ie=UTF8&mv_style_name=1&qid=1522716936&sr=8-4

Conversations/Assistant WOW this is cool. Amazing thanks @ptp I did a quick voice to text => Assistant => Text to voice. Works well despite my strong accent. I can see this very valuable when controlling and interacting with robot using voice recognition and general conversation.

Found small problem In the Car example under dialogue there was a dialogue "anything else" true and it had the statement I am not sure about that you can "Turn on my lights" with quotation marks that caused script to crash so I just deleted that dialogue response as it was causing errors. All good.

@Nink, Fixed. EZ-Script does not like quotes, quotes are replaced with ( ' ).

One simple example: Init script (Run before the Watson Assistant)

#Initialize context/environment variables
$RadioStatus=0

Assistant Script:

IF ($WatsonAssistIntents[0]="turn_on" )
  IF ($WatsonAssistEntities[0]="appliance" )
    IF ($WatsonAssistEntitiesValues[0]="music" )
      if ($RadioStatus=0)
        $RadioStatus=1
        SayWait("Radio is ON" ) 
      else
        SayWait("Dear master, the radio is already ON; May I suggest an appointment with an otolaryngologist ?" ) 
      EndIf 
    ENDIF
  ENDIF
ElseIf ($WatsonAssistIntents[0]="turn_off" )
  IF ($WatsonAssistEntities[0]="appliance" )
    IF ($WatsonAssistEntitiesValues[0]="music" )
      if ($RadioStatus=1)
        $RadioStatus=0
        SayWait("Radio is OFF" ) 
      else
        SayWait("Dear master, the radio is already OFF" ) 
      EndIf 
    ENDIF
  ENDIF
ENDIF

I called him Jarvis

Listen what happens when you try to switch on the radio when the radio is already on

To help the tests you can replay a previous assistant message response:

ControlCommand("IBM Watson Services", ReplayMessage, "1522815312")

1522815312 is a previous CaptureId.