Canada
Asked — Edited

Ibm Watson Services Plugin

The IBM Watson Services plugin created by @PTP currently allows you to perform Speech to Text and Text to Speech as well as visual recognition using Watson Services.

You can download and install the plugin here https://www.ez-robot.com/EZ-Builder/Plugins/view/251

Before you can use the plugin, you will need to apply for a free 30 day trial of IBM Speech to Text Account here https://www.ibm.com/watson/services/speech-to-text and a free 30 day trial of IBM Text to Speech https://www.ibm.com/watson/services/text-to-speech/

I will create some examples as it moves forward and try to answer any how to questions.

Thanks for creating this PTP, as with all your plugins this is an excellent piece of work and showcase of your talents.

User-inserted image


ARC Pro

Upgrade to ARC Pro

Discover the limitless potential of robot programming with Synthiam ARC Pro – where innovation and creativity meet seamlessly.

PRO
Canada
#49  

Here is a quick watson assist project I started writing. Sorry learning both EZ-Script and Watson assist so it is really rough but will give everyone an idea. I gave him a bad attitude because he never listens to me. I need to go back and do a lot more work to record what position he is currently in etc and take multiple instructions but if others want to work on together would be great. This is for JD robot.

call from speech to text plugin before speech to text


#call watson to recognize the current capture in the $WatsonCaptureId variable
ControlCommand("IBM Watson Services", RecognizeSpeech, $WatsonCaptureId)

after speech to text


#Stop speech recognition to avoid a loop
ControlCommand("IBM Watson Services", StopSpeechToText)
#call Watson Assist
ControlCommand("IBM Watson Services", Message, $WatsonPhrase)

Put in Watson Assist Script in the plugin.


# get number of intents and number of enteties
$NumOfIntents=GetArraySize("$WatsonAssistIntents")
$NumOfEntities=GetArraySize("$WatsonAssistEntitiesValues")

# Check if there is something to do
if ($NumOfIntents<1 && $NumOfEntities<1)
  Halt()
endif
  # check if we need to move
if ($WatsonAssistIntents[0] = "move")
  goto(move)
  # check if we need to stop
ELSEif ($WatsonAssistIntents[0] = "stop")
  goto(stop)
  # check if we need to perform an action
ELSEif ($WatsonAssistIntents[0] = "actions")
  goto(action)
endif

  # Say what watson says
SayEZBwait($WatsonAssistOutputText)

# Call Speech to Text
ControlCommand("IBM Watson Services", StartSpeechToText)

Halt()

:move
if ($WatsonAssistEntitiesValues[0] = "forward")
  SetSpeed(100, 100)
  Forward()
endif

if ($WatsonAssistEntitiesValues[0] = "backward")
  SetSpeed(100, 100)
  Reverse()
endif

if ($WatsonAssistEntitiesValues[0] = "right")
  SetSpeed(100)
  Right()
  Sleep(7000)
  Forward()
endif

if ($WatsonAssistEntitiesValues[0] = "left")
  SetSpeed(100)
  Left()
  Sleep(7000)
  Forward()
endif
return()

:stop

stop()
return()

:action

if ($WatsonAssistEntitiesValues[0] = "sit")
  ControlCommand("Auto Position", AutoPositionAction, "Sit Down")
ELSEif ($WatsonAssistEntitiesValues[0] = "bow")
  ControlCommand("Auto Position", AutoPositionAction, "Bow")
ELSEif ($WatsonAssistEntitiesValues[0] = "dance")
  ControlCommand("Auto Position", AutoPositionAction, "Disco Dance")
ELSEif ($WatsonAssistEntitiesValues[0] = "head_bob")
  ControlCommand("Auto Position", AutoPositionAction, "Head Bob")
ELSEif ($WatsonAssistEntitiesValues[0] = "play_music")
  ControlCommand("Auto Position", AutoPositionAction, "Singing")
ELSEif ($WatsonAssistEntitiesValues[0] = "stand")
  ControlCommand("Auto Position", AutoPositionAction, "Stand From Sit")
ELSEif ($WatsonAssistEntitiesValues[0] = "wave")
  ControlCommand("Auto Position", AutoPositionAction, "Wave")
ELSE
  ControlCommand("Auto Position", AutoPositionAction, "Thinking")
endif

return()

import as a robotest.json file to watson assist


{"name":"robot demo","intents":[{"intent":"stop","examples":[{"text":"stop believe music please"},{"text":"set off lights"},{"text":"radio stop"},{"text":"Put off the lights"},{"text":"power off the radio"},{"text":"please stop the call"},{"text":"please stop music"},{"text":"ok stop music."},{"text":"ok can you stop music?"},{"text":"Off lights"},{"text":"off"},{"text":"no more music"},{"text":"no jazz please"},{"text":"no jazz no"},{"text":"music stop"},{"text":"lights off plz"},{"text":"lights off now"},{"text":"Lights off!"},{"text":"Lights off"},{"text":"lights be off"},{"text":"I would like you to turn off the lights"},{"text":"hi off"},{"text":"close"},{"text":"cancel"},{"text":"stop walking"},{"text":"stop running"},{"text":"stop dancing"},{"text":"halt"},{"text":"freeze"},{"text":"hold still"},{"text":"turn off"},{"text":"tunr off lights"},{"text":"stop voice"},{"text":"Stop the radio"},{"text":"stop the music now"},{"text":"stop the music for a while"},{"text":"Stop the music"},{"text":"stop the"},{"text":"stop rock music"},{"text":"stop radio"},{"text":"stop pop music"},{"text":"STop playing the music"},{"text":"Stop playing music"},{"text":"stop play"},{"text":"stop my lights"},{"text":"stop music please"},{"text":"Stop Music"},{"text":"stop music?"},{"text":"stop lights"},{"text":"stop it now."},{"text":"stop de radio"},{"text":"wait"},{"text":"robot wait"},{"text":"stop moving"},{"text":"exit"},{"text":"quit"},{"text":"robot stop"},{"text":"watson halt"},{"text":"robot halt"},{"text":"robot don't move"},{"text":"robot stop moving"},{"text":"watson stop moving"},{"text":"close music"},{"text":"stop"},{"text":"sop music"},{"text":"sitch off the rear lights"},{"text":"shutt off lights"},{"text":"shut off"},{"text":"shut"}],"description":null},{"intent":"goodbyes","examples":[{"text":"gtg"},{"text":"Have a nice day"},{"text":"hey stop here"},{"text":"Hi, Watson. I want to stop car"},{"text":"I'm leaving"},{"text":"i said goodbye"},{"text":"later"},{"text":"laters"},{"text":"leave"},{"text":"logging off"},{"text":"my time is up"},{"text":"nice day"},{"text":"ok bye"},{"text":"out of time"},{"text":"over and out"},{"text":"run"},{"text":"see ya"},{"text":"see ya later"},{"text":"see ya soon"},{"text":"see you"},{"text":"should be going"},{"text":"should go"},{"text":"shutdown"},{"text":"shut down"},{"text":"signing off"},{"text":"signing out"},{"text":"so long"},{"text":"soon"},{"text":"swag out"},{"text":"thanks byebye"},{"text":"then bye"},{"text":"toodles"},{"text":"no, bye!"},{"text":"adieu"},{"text":"adios"},{"text":"au revoir"},{"text":"bye"},{"text":"bye bye"},{"text":"bye now"},{"text":"cya"},{"text":"farewell"},{"text":"finally reached home.. lock up and lovely up.. good nite and good bye for ever"},{"text":"go"},{"text":"going"},{"text":"goodbye"},{"text":"good bye"},{"text":"good day"},{"text":"good night"},{"text":"gotta go"},{"text":"gotta run"}],"description":null},{"intent":"greetings","examples":[{"text":"What's up ?"},{"text":"good how are you"},{"text":"good morning"},{"text":"aloha"},{"text":"bonjour"},{"text":"buenas dias"},{"text":"buenos dias"},{"text":"ciao"},{"text":"fdsafsaHi watson"},{"text":"feeling bit low"},{"text":"g'day"},{"text":"good"},{"text":"Good afternoon."},{"text":"greetings"},{"text":"good day"},{"text":"good evening"},{"text":"Hello"},{"text":"Hello, how are you"},{"text":"hello, my name is esteban"},{"text":"Hello, My name is John?"},{"text":"Hello Watson"},{"text":"hey"},{"text":"heya"},{"text":"hey there"},{"text":"hi"},{"text":"hi how are u"},{"text":"Hi, my name is Diego"},{"text":"Hi, my name is Michel"},{"text":"hi there"},{"text":"hi to whom had like"},{"text":"Hi watson"},{"text":"Hi, Watson, my name is John"},{"text":"hiya"},{"text":"Hola"},{"text":"hola como estas"},{"text":"How are you doing"},{"text":"howdy"},{"text":"I would like you to say hello"},{"text":"yo my man"},{"text":"yo"},{"text":"yello"},{"text":"What's up?"},{"text":"What's up"},{"text":"what r u doing"},{"text":"what doing"},{"text":"sup"},{"text":"say hello to me"},{"text":"namaste"},{"text":"hello robot"},{"text":"hi robot"},{"text":"hey robot"},{"text":"what you doing robot"}],"description":null},{"intent":"positive_reaction","examples":[{"text":"Alright. Thanks!"},{"text":"you are funny"},{"text":"This is good"},{"text":"This is awesome"},{"text":"Thank you very much"},{"text":"excellent, thanks"},{"text":"great, thanks"},{"text":"great, thanks!"},{"text":"great! thanks!"},{"text":"nice. thanks."},{"text":"ok, thanks"},{"text":"OK thanks"},{"text":"thankfully so"},{"text":"Thanks"},{"text":"Thank you"},{"text":"thanks you are  funy"},{"text":"Thanks Watson"},{"text":"Thanks verymuch"},{"text":"Thanks u"},{"text":"Thanks mate"},{"text":"Thanks man"},{"text":"thanks for your support"},{"text":"thanks for"},{"text":"thanks dude"},{"text":"thanks, man!"},{"text":"Thanks!"},{"text":"Thanks."},{"text":"thanks a truck"}],"description":null},{"intent":"compound_questions","examples":[{"text":"turn off the heater and turn on the AC"},{"text":"turn off wipers and turn on lights"},{"text":"turn off wipers and turn on the lights"},{"text":"turn on off the ac"},{"text":"turn on the lights and speed up the wipers"},{"text":"turn on the lights and turn up the wipers"},{"text":"turn on the lights, then turn them off."},{"text":"turn on the wipers then turn them off"},{"text":"turn on wipers and stop the car"},{"text":"Turn the lights on off"},{"text":"turn up the music and slow down the wipers"},{"text":"turn up the radio off"},{"text":"Turn up the radio.Turn on my wipers."},{"text":"what can you do . turn off lights"},{"text":"what can you do. turn off lights"},{"text":"what is my speed"},{"text":"can you please turn the light  either on of off ?"},{"text":"can you turn on the turn off the AC"},{"text":"heater up and volume down"},{"text":"Increase speed and turn wiper on"},{"text":"increase the speed of the wipers and turn up the music"},{"text":"Increase the volume or turn off the AC"},{"text":"lower the volume then speed up the wipers"},{"text":"can you please turn the light on off ?"},{"text":"off on my lights"},{"text":"OK, can you lower the AC to turn off the sound?"},{"text":"radio on and lights off"},{"text":"sorry turn off the lights and turn on the AC"},{"text":"speed up the wipers then slow down the wipers"},{"text":"start stop wipers"},{"text":"switch on the ac then turn up the music"},{"text":"turn down the heat and play some jazz"},{"text":"Turn left"},{"text":"turn off on off the music"},{"text":"turn off the headlights and on the air con"},{"text":"turn off the music and then turn it up"}],"description":null},{"intent":"actions","examples":[{"text":"start dancing robot"},{"text":"let me watch you dance"},{"text":"robot play music"},{"text":"robot stand"},{"text":"can you bow"},{"text":"robot can you dance"},{"text":"robot sit"},{"text":"sit down robot"},{"text":"let me see you wave"},{"text":"show me how you wave"},{"text":"robot wave"},{"text":"robot wave to me"},{"text":"robot bob your head"},{"text":"can you sit"},{"text":"lets dance"}],"description":"actions we can control robot body components"},{"intent":"decision_replies","examples":[{"text":"no thanks watson"},{"text":"not a clue"},{"text":"no"},{"text":"maybe"},{"text":"yes definitely"},{"text":"yes please"},{"text":"yes thanks"},{"text":"yes"},{"text":"No thank you"},{"text":"no thank"}],"description":null},{"intent":"capabilities","examples":[{"text":"so what did you learn?"},{"text":"what do you have?"},{"text":"what did you learn"},{"text":"What devices are you able to connect with?"},{"text":"what cayou do?"},{"text":"what care you capablities"},{"text":"what capabilities you have"},{"text":"what can you turn on things?"},{"text":"what can you help me with"},{"text":"what can you do for me"},{"text":"what canyou do"},{"text":"what can you do"},{"text":"What can i say"},{"text":"what can I do"},{"text":"What ca I ask?"},{"text":"What are your functions?"},{"text":"what are your capabilities Watson"},{"text":"what are your benefits"},{"text":"what are you capable of"},{"text":"What are you"},{"text":"What a can asc iu?"},{"text":"turn ac when rain ends?"},{"text":"testing om"},{"text":"test"},{"text":"tell me what you can do"},{"text":"Tell me what to do."},{"text":"tell me what things you can do"},{"text":"do you know something about cognitive?"},{"text":"what do you know"},{"text":"What do you have"},{"text":"Hello can i have some help"},{"text":"Hello Watson! Can you bring me home?"},{"text":"help"},{"text":"help me"},{"text":"how close is"},{"text":"Howdy mny Tieres Do you have"},{"text":"how far is"},{"text":"how far is the moon"},{"text":"how far to"},{"text":"how many licks does it take to get to the center of a tootsie roll"},{"text":"I'd like to have dinner with you"},{"text":"I enjoy petting cats"},{"text":"I love dolphins"},{"text":"i need a new wheelchair"},{"text":"I need to shut it down"},{"text":"it's too dark"},{"text":"I want to eat tacos everyday"},{"text":"i want to see how this demo works"},{"text":"lets go"},{"text":"Make it rain"},{"text":"Make it stop raining."},{"text":"make me a sandwich"},{"text":"need help"},{"text":"ok watson, why should I use you"},{"text":"tell me a joke"},{"text":"tell me joke"},{"text":"tell me jokes"},{"text":"Can you drive anywhere else?"},{"text":"Do you do anything else?"},{"text":"do you do anything else"},{"text":"Can you tell me random facts?"},{"text":"can you tell me about problem"},{"text":"can you speak something with me?"},{"text":"can you read me"},{"text":"can you learn something new?"},{"text":"can you help me find a candidate?"},{"text":"Can you hear me?"},{"text":"can you harm me?"},{"text":"tell me some jokes"},{"text":"can you do xyz?"},{"text":"can you do this?"},{"text":"CAN YOU DO OTHER THING?"},{"text":"can you do more than that?"},{"text":"can you do it?"},{"text":"can you do coding ?"},{"text":"can u please do that"},{"text":"can i training you?"},{"text":"Can I teach you"},{"text":"can I manipulate the"},{"text":"but can I ask you"},{"text":"book a flight for NY on sunday"},{"text":"you can say what is php"},{"text":"you can not change yourself?"},{"text":"why should I use you"},{"text":"what things can you do"},{"text":"what should i ask"},{"text":"what question"},{"text":"What makes you different from Siri or Google"},{"text":"what else"}],"description":null},{"intent":"move","examples":[{"text":"start walking forward"},{"text":"Go South"},{"text":"Go North"},{"text":"West"},{"text":"East"},{"text":"south"},{"text":"north"},{"text":"go forward"},{"text":"robot move backward"},{"text":"move backward"},{"text":"go forwards"},{"text":"move backwards"},{"text":"robot start moving"},{"text":"robot move"},{"text":"robot walk"},{"text":"robot run"},{"text":"robot start walking"},{"text":"start walking"},{"text":"forwards"},{"text":"hey robot"},{"text":"move forward"},{"text":"move arm"},{"text":"robot go forward"},{"text":"turn around"},{"text":"turn"},{"text":"move right"},{"text":"move left"},{"text":"go right"},{"text":"Go Left"},{"text":"go backwards"}],"description":null}],"entities":[{"entity":"sys-date","values":[],"metadata":null,"description":null},{"entity":"component","values":[{"type":"synonyms","value":"arms","metadata":null,"synonyms":["elbows, arm, arms, shoulder"]},{"type":"synonyms","value":"hand","metadata":null,"synonyms":["hand","hands","fingers","finger","claw","gripper","palm"]},{"type":"synonyms","value":"volume","metadata":null,"synonyms":["sound","speaker","speakers","vol"]},{"type":"synonyms","value":"Legs","metadata":null,"synonyms":["legs","leg","feet","foot","knees","ancles"]},{"type":"synonyms","value":"head","metadata":null,"synonyms":["see","head","nod","nods","face","look"]},{"type":"synonyms","value":"Eyes","metadata":null,"synonyms":["lights","eye","led","leds","eyes","bulb","colored eyes","bright eyes","eye color","blue eyes","brown eyes","green eyes","vision","see"]}],"metadata":null,"description":null},{"entity":"response_types","values":[{"type":"synonyms","value":"negative","metadata":null,"synonyms":["definitely not","no","nope","not at all","no way"]},{"type":"synonyms","value":"uncertain","metadata":null,"synonyms":["don't know","maybe","no idea","not sure","unknown"]},{"type":"synonyms","value":"positive","metadata":null,"synonyms":["absolutely","definitely","yeah","yep","yeppers","yes"]}],"metadata":null,"description":null},{"entity":"option","values":[{"type":"synonyms","value":"fifth","metadata":null,"synonyms":["5th","farthest","fifth","last","lowest rated","worst"]},{"type":"synonyms","value":"second","metadata":null,"synonyms":["2nd"," second","second best","second rated"]},{"type":"synonyms","value":"third","metadata":null,"synonyms":["3rd","average","cheap","cheapest","middle"," third"]},{"type":"synonyms","value":"first","metadata":null,"synonyms":["1st","any","best","closeby","close by","closest","finest"," first","hgihest rated","near","nearby","nearest","recommended","top rated","whatever"]},{"type":"synonyms","value":"fourth","metadata":null,"synonyms":["4th","fourth","penultimate","second to last"]}],"metadata":null,"description":null},{"entity":"sys-number","values":[],"metadata":null,"description":null},{"entity":"component_bad","values":[{"type":"synonyms","value":"waist","metadata":null,"synonyms":["middle, stomach, abs, waist"]},{"type":"synonyms","value":"wrist","metadata":null,"synonyms":["wrists"]}],"metadata":null,"description":null},{"entity":"sys-time","values":[],"metadata":null,"description":null},{"entity":"skill","values":[{"type":"synonyms","value":"play_music","metadata":null,"synonyms":["song","sing","songs","jazz","rock","pop","singing","play music","play","music","radio"]},{"type":"synonyms","value":"Dance","metadata":null,"synonyms":["waltz","disco","jive","cut a rug","twerk","twist","dance","dancing"]},{"type":"synonyms","value":"head_bob","metadata":null,"synonyms":["bob","nodd","nod","nods","head bob","shake head","head bang"]},{"type":"synonyms","value":"bow","metadata":null,"synonyms":["bow","curtsie","bend","bows"]},{"type":"synonyms","value":"wave","metadata":null,"synonyms":["wave","waves"]},{"type":"synonyms","value":"sit","metadata":null,"synonyms":["sits","sit","bottom","chair","rest","sit down","sitdown","sitting","sits down"]},{"type":"synonyms","value":"stand","metadata":null,"synonyms":["stands","standing","stand up","standup","get up","on your feet"]}],"metadata":null,"description":null,"fuzzy_match":false},{"entity":"capabilities_subject","values":[{"type":"synonyms","value":"time","metadata":null,"synonyms":["hour","minutes","seconds","the time","time","what time"]},{"type":"synonyms","value":"date","metadata":null,"synonyms":["date","day","month","the date","what date","year"]}],"metadata":null,"description":null},{"entity":"direction","values":[{"type":"synonyms","value":"left","metadata":null,"synonyms":["east","left","eastern"]},{"type":"synonyms","value":"forward","metadata":null,"synonyms":["Walking","running","walk","walks","hike","run","forward","forwards","hiking","climbing"]},{"type":"synonyms","value":"backward","metadata":null,"synonyms":["backwards","backward","reverse","south"]},{"type":"synonyms","value":"right","metadata":null,"synonyms":["west","right","western"]}],"metadata":null,"description":null}],"language":"en","metadata":{"api_version":{"major_version":"v1","minor_version":"2017-05-26"},"from-sample":true},"description":"Robot Demo work in progress.","dialog_nodes":[{"type":"standard","title":null,"output":{},"parent":"node_2_1487280430136","context":null,"metadata":{},"next_step":null,"conditions":"true","description":null,"dialog_node":"node_1_1467919680248","previous_sibling":null},{"type":"response_condition","title":null,"output":{"text":{"values":["I can only perform one operation at a time. What would you like me to do?"],"selection_policy":"sequential"}},"parent":"node_1_1485920032937","context":null,"metadata":{},"next_step":null,"conditions":" ","description":null,"dialog_node":"node_2_1485920042146","previous_sibling":null},{"type":"slot","title":null,"output":{},"parent":"node_1_1523070447532","context":null,"metadata":{},"variable":"$skill","next_step":null,"conditions":null,"description":null,"dialog_node":"slot_6_1523070944204","previous_sibling":"node_9_1523071020182"},{"type":"event_handler","title":null,"output":{"text":{"values":[]}},"parent":"node_1_1523070447532","context":null,"metadata":null,"next_step":null,"conditions":"#actions","event_name":"generic","description":null,"dialog_node":"handler_5_1523070785328","previous_sibling":"slot_6_1523070944204"},{"type":"standard","title":"perform action","output":{"text":{"values":["If I have to I will @skill","I am going to @skill under protest","You just want me to make a fool of myself as I @skill"],"selection_policy":"sequential"}},"parent":"node_1_1523070447532","context":null,"metadata":{},"next_step":null,"conditions":"@skill","description":null,"dialog_node":"node_9_1523071020182","previous_sibling":null},{"type":"response_condition","title":null,"output":{"text":{"values":["Try asking your question in a different way."]}},"parent":"node_1_1467919680248","context":{"default_counter":0},"metadata":{},"next_step":null,"conditions":"$default_counter>2","description":null,"dialog_node":"node_13_1485227255152","previous_sibling":null},{"type":"event_handler","title":null,"output":{"text":"What action do you want me to perform?"},"parent":"slot_6_1523070944204","context":null,"metadata":null,"next_step":null,"conditions":null,"event_name":"focus","description":null,"dialog_node":"handler_8_1523070944204","previous_sibling":"handler_7_1523070944204"},{"type":"event_handler","title":null,"output":{},"parent":"slot_6_1523070944204","context":{"skill":"@skill"},"metadata":{},"next_step":null,"conditions":"@skill","event_name":"input","description":null,"dialog_node":"handler_7_1523070944204","previous_sibling":null},{"type":"standard","title":null,"output":{"text":{"values":["I can only perform one operation at a time. We can start with the first one. What would you like me to do?","I am not a multi tasker, lets take this one at a time ok"],"selection_policy":"sequential"}},"parent":"Entry Point For On Off Commands","context":null,"metadata":{},"next_step":null,"conditions":"entities.size()>1","description":null,"dialog_node":"node_4_1469816307739","previous_sibling":"node_5_1469049934217"},{"type":"standard","title":null,"output":{"text":{"values":["I can only move forwards, backwards, left and right, but I can't move that way"],"selection_policy":"sequential"}},"parent":"Entry Point For On Off Commands","context":null,"metadata":{},"next_step":null,"conditions":"true","description":null,"dialog_node":"node_1_1467310860502","previous_sibling":"node_4_1469816307739"},{"type":"standard","title":"Move in a direction","output":{"text":{"values":["OK I will move @direction if I have to","I am moving @direction why do you always tell me what to do","Why should I move @direction? OK I am going","I am walking @direction , Give me a break","I am tired, can't I just stay here instead of moving @direction"],"selection_policy":"sequential"}},"parent":"Entry Point For On Off Commands","context":null,"metadata":{},"next_step":null,"conditions":"@direction","description":null,"dialog_node":"node_5_1469049934217","previous_sibling":null},{"type":"standard","title":null,"output":{},"parent":null,"context":null,"metadata":{},"next_step":null,"conditions":"#compound_questions","description":null,"dialog_node":"node_1_1485920032937","previous_sibling":"node_8_1468608349230"},{"type":"standard","title":null,"output":{},"parent":null,"context":{"default_counter":"<?$default_counter+1?>"},"metadata":{},"next_step":{"behavior":"jump_to","selector":"condition","dialog_node":"node_1_1467919680248"},"conditions":"anything_else","description":null,"dialog_node":"node_2_1487280430136","previous_sibling":"node_1_1485920032937"},{"type":"standard","title":null,"output":{"text":{"values":["I can do all sorts of things, ask me to do something"],"selection_policy":"sequential"}},"parent":null,"context":null,"metadata":{},"next_step":null,"conditions":"#capabilities","description":null,"dialog_node":"node_11_1468608786372","previous_sibling":"node_7_1468608329601"},{"type":"standard","title":null,"output":{"text":{"values":["What do you want?","Seriously,  I was taking a nap.","Hello, inferior human being.","Why can't you just leave me alone?"],"selection_policy":"sequential"}},"parent":null,"context":null,"metadata":{},"next_step":null,"conditions":"#greetings","digress_in":"does_not_return","description":null,"dialog_node":"node_7_1468608329601","previous_sibling":"node_1_1523070447532"},{"type":"standard","title":"Move Commands","output":{"text":{"values":[""],"selection_policy":"sequential"}},"parent":null,"context":{"appl_action":"on"},"metadata":{},"next_step":{"behavior":"jump_to","selector":"condition","dialog_node":"node_5_1469049934217"},"conditions":"#move","description":null,"dialog_node":"Entry Point For On Off Commands","previous_sibling":"node_1_1487022155950"},{"type":"standard","title":null,"output":{"text":{"values":["Okay! Speak to you soon.","Finally your going to leave me alone"],"selection_policy":"sequential"}},"parent":null,"context":null,"metadata":{},"next_step":null,"conditions":"#goodbyes","description":null,"dialog_node":"node_8_1468608349230","previous_sibling":"node_11_1468608786372"},{"type":"standard","title":"stop moving","output":{"text":{"values":["OK I have stopped","I am no longer doing that any more","I will never do that again","Make up your mind"],"selection_policy":"sequential"}},"parent":null,"context":{"appl_action":"off"},"metadata":{},"next_step":null,"conditions":"#stop","digress_in":"does_not_return","description":null,"dialog_node":"node_1_1487022155950","previous_sibling":"Start And Initialize Context"},{"type":"frame","title":"Robot Actions","output":{},"parent":null,"context":null,"metadata":{"fallback":"leave"},"next_step":{"behavior":"jump_to","selector":"condition","dialog_node":"node_9_1523071020182"},"conditions":"#actions","digress_in":"does_not_return","description":null,"dialog_node":"node_1_1523070447532","digress_out":"allow_all","previous_sibling":"Entry Point For On Off Commands","digress_out_slots":"not_allowed"},{"type":"standard","title":"Start And Initialize Context","output":{"text":{"values":["Hi. I am your friendly robot,  What would you like me to do?"]}},"parent":null,"context":{"eyes":"blue","musiconoff":"off","appl_action":"","wavingonoff":"off","sittingonoff":"off","walkingonoff":"off","default_counter":0},"metadata":{},"next_step":null,"conditions":"conversation_start","description":null,"dialog_node":"Start And Initialize Context","previous_sibling":null}],"workspace_id":"6a9191bd-620a-4370-b93b-b9e68556b4aa","counterexamples":[{"text":"aho"},{"text":"asdasdasda"},{"text":"asdasidjiwe"},{"text":"cats are my favorite animal"},{"text":"when will it be funny"},{"text":"which color is best for wedding"}],"learning_opt_out":false}
PRO
USA
#50  

Regarding the microphone subject (quality)

Anyone tested the Kinect Microphone Array ?

It can't be added to a small robot... and soon later they will stop selling...:(

PRO
Canada
#51  

What model kinect do you have? I have an old kinect 360 missing a power supply I can hack something together and test. Hopefully the openkinect or Primesense Mate NI drivers still work with windows 10. I use a PS3 eye on my desktop and works really well with voice recognition (great mic) although it would be good to get a kinect working especially if we get a unity plugin.

#52  

I have a kinect 2, but I'm having trouble getting the microphone array to pick up sound in windows. I'll look into today and test the recognition if I can get it to work.

PRO
USA
#53  

Kinect: I'm curious how good is the Kinect in a noisy/open environment.

@Nink: I have: PS3Eye, Asus Xtion, Kinect 1, Kinect 2. All of them have microphone arrays, and kinect has a sound localization api. One can use to turn the robot head towards the sound/person.

Does the PS3Eye work for long distances and/or environment noise ?

I'm evaluating a few microphone arrays, and one of the cheapest solutions is to use the PS3Eye with a Raspberry PI Zero and forward the sound to the PC (wifi microphone)

Post #19 https://synthiam.com/Community/Questions/10781&page=2

PRO
Canada
#54  

Not sure about background noise but PS3 eye is good from a distance (nothing works well with background noise). I think we need to just do a "Launch Name" (like "hey siri", "OK Google" or "echo" etc) using ezb voice rec and hope for the best.

This doesn't solve depth sense issue though.

I am happy to go for a 2 for 1 on a depth sensor (I will buy 2 and send you one) if you want to work on something. I have been waiting for EZ-Robot to provide a LIDAR to do a SLAM. This in conjunction with the unity work going on would be exciting. Maybe we should just look at getting a couple of https://click.intel.com/realsense.html for now.

Off topic or on topic (Not sure any more) I have my latest photos of bicycle cards Ace to 6. I can send you a link to cards off line as you own a deck, but results still are not good. I think I need to string together in multiple AI searches but time delay is an issue and Watson Visual recognition does not seem to support a VR pipeline or linking requests so I have to call multiple VR requests from a single EZB Script based on previous VR outcome ,so takes A LONG TIME. First find Suit (Hearts, Diamonds, Clubs, Spades)=> when suit derived find Picture or number (check if numbers or picture cards)=> then actual card (Number in suit) and it still gets it wrong. Maybe I work on weekend if I have time.

Australia
#56  

have you guys considered this as a mic option?

https://www.seeedstudio.com/ReSpeaker-4-Mic-Array-for-Raspberry-Pi-p-2941.html

"this 4-Mics version provides a super cool LED ring, which contains 12 APA102 programmable LEDs. With that 4 microphones and the LED ring, Raspberry Pi would have ability to do VAD(Voice Activity Detection), estimate DOA(Direction of Arrival) and show the direction via LED ring, just like Amazon Echo or Google Home"