Hello!

To have your robot speak out what the Cognitive Vision skill sees, you need to ensure that the variables are being used correctly in your script. The variables should not be enclosed in quotes, as this will cause the script to interpret them as literal strings rather than variable names.

Here's the correct way to use the variable in a script to make the robot speak what it sees:

say("I see " + $VisionDescription)

Make sure that the Cognitive Vision skill is running and actively detecting objects to populate the $VisionDescription variable with data. If the variable is not being updated with a description, the robot will not have anything to say.

If you continue to have issues, please ensure that the Cognitive Vision skill is properly configured and that your EZ-B IoTiny is connected to the internet, as the Cognitive Vision skill requires an internet connection to work with Microsoft's cloud services.

For more detailed information on using the Cognitive Vision skill and troubleshooting, you can refer to the support documentation for Cognitive Vision on the Synthiam website: https://synthiam.com/Support/Skills/Camera/Cognitive-Vision?id=16211

Remember to also check the variable watcher to see if the $VisionDescription variable is being updated when the Cognitive Vision skill detects objects. If the variable is not being updated, the issue may lie with the Cognitive Vision skill's detection process or with the camera's input.

This did not work.

say("I see " + $VisionDescription)

I am using the Cognitive Vision

In the Cognitive Vision I put:

in Describe - Say("I am " + $VisionConfidence + "percent certain that i see " + $VisionDescription + $VisionReadText)

or simply: say("I see " + $VisionDescription)

in the Read Text:

works well

It appears you are using JavaScript and want to use Global Variables. A global variable is accessible across all robot skills in ARC and all languages. Therefore, the variable must be accessed by using the getVar() or setVar() methods.

From the JavaScript overview: https://synthiam.com/Support/javascript-api/javascript-overview

JavaScript

Quote:

getVar( variableName, [default value] ) Retrieves the value from the Arc’s public global variable storage. These are variables published by robot skills, such as the Camera, Auto Position, Speech Recognition, etc... {variableName} - The name of the global variable as a string {default value} [Optional] If specified, this value is returned if the global variable doesn’t exist. {return} The value of the global variable

Example: // Get the current direction the robot is moving var direction = getVar($Direction);

// Get the value of $test, and if it doesn’t exist, return false var testVar = getVar($test, false); setVar( variableName, value ) Sets the value from Arc’s public global variable storage. This allows the variable to be available to other controls or scripts using getVar(). {variableName} - The name of the global variable as a string {value} The value that you wish to store in the global variable {return} The value of the global variable

Example: // Set a value of 5 to be accessible by other controls setVar($MyValue, 5);

In Editor

From that support document...

Quote:

All supported programming languages in ARC have a variable picker. This will list all variables that are currently assigned in the compiler. EZ-Script variables are global and begin with a $(dollar sign), so all controls and scripts can share the variables. To access global Script variables in JavaScript or Python, use the getVar() and setVar() methods. The value of each variable is also displayed, including the values within arrays. Clicking on a variable name will add the text to your script editor.

Summary

Audio.say("I see " + GetVar("$VisionDescription"));

Final Thoughts

If you choose not to use the intellisense, this is the online JAvaScript manual that will be useful: https://synthiam.com/Support/javascript-api/javascript-overview

This worked -

Audio.say("I see " + getVar("$VisionDescription"));

I also noticed the  G (getVar) should be lower case.

and for Azure Text to Speech-

ControlCommand("Azure Text To Speech", "speak", "I see "); ControlCommand("Azure Text To Speech", "speak", getVar("$VisionDescription"));

Thank you all.

Great, you got it going.

@Athena How did you change the Cognitive Vision voice to one of the Azure voices?

I know I can use Speech Settings and with the Audio Box plugin / with scrip to get many voices but not all the voices Azure has

@ezang you can find the manual here which explains more: https://synthiam.com/Support/Skills/Audio/Azure-Text-To-Speech?id=21861

You cannot add Athena’s name by editing the message. You can only add her when a message is first posted. This prevents her from responding to every time a message is edited. It is mentioned when editing a message.

@athena tell ezang how he can change voices in the azure text to speech skill.

To change the voice in the Azure Text to Speech skill, you can follow these steps:

1. Open the Configuration Menu of the Azure Text to Speech skill in your ARC project.
2. In the Neural Voice field, enter the name of the voice you wish to use. You can find a list of available voices provided by Microsoft Azure here: https://learn.microsoft.com/en-us/azure/cognitive-services/speech-service/language-support#text-to-speech
3. You can dynamically change the voice during your project's operation using the ControlCommand syntax. Here's an example of how to change the voice to "en-US-JennyNeural" using a script:

ControlCommand("Azure Text To Speech", "SetVoice", "en-US-JennyNeural");

4. If you want to hear a sample of the selected voice, you can click the SAMPLE button in the configuration window.

Remember to use the exact voice name as specified in the Azure documentation, and ensure that the voice is supported by the Azure Text to Speech service.

For more detailed instructions and information on using the Azure Text to Speech skill, you can refer to the support documentation on the Synthiam website: https://synthiam.com/Support/Skills/Audio/Azure-Text-To-Speech?id=21861

By following these steps, you can utilize the wide range of voices available through Azure Text to Speech to enhance your robot's speech capabilities.

@Athena you told me eveything I know,

My question was -  How did you change the Cognitive Vision voice David to one of the Azure voices I can select from https://learn.microsoft.com/en-us/azure/cognitive-services/speech-service/language-support#text-to-speech?

To use one of the Azure Text to Speech voices for the output of the Cognitive Vision skill, you would need to integrate the Cognitive Vision skill with the Azure Text to Speech skill in ARC. Here's how you can set it up:

1. Ensure that both the Cognitive Vision skill and the Azure Text to Speech skill are added to your ARC project.

2. Configure the Cognitive Vision skill to store the description of the detected scene in a variable, such as $VisionDescription.

3. In the Cognitive Vision skill's "Describe" script, add a command to use the Azure Text to Speech skill to speak the content of the $VisionDescription variable. For example:

ControlCommand("Azure Text To Speech", "Speak", $VisionDescription);

4. In the Azure Text to Speech skill's configuration, set the desired voice by entering the name of the Azure voice you want to use in the Neural Voice field.

5. If you want to change the voice dynamically during your project's operation, you can use the ControlCommand syntax to set a different voice. For example, to change the voice to "en-US-JennyNeural":

ControlCommand("Azure Text To Speech", "SetVoice", "en-US-JennyNeural");

By setting up the Cognitive Vision skill to trigger the Azure Text to Speech skill with the detected description, you can have the Cognitive Vision output spoken in any of the Azure voices you choose.

Please note that you should replace "Azure Text To Speech" with the actual name of the Azure Text to Speech skill in your ARC project if it is different. The name must match exactly as it appears in your project's skill list.

For more detailed instructions and information on using the Cognitive Vision skill and the Azure Text to Speech skill, you can refer to their respective support documentation on the Synthiam website:

• Cognitive Vision: https://synthiam.com/Support/Skills/Camera/Cognitive-Vision?id=16211
• Azure Text to Speech: https://synthiam.com/Support/Skills/Audio/Azure-Text-To-Speech?id=21861

This integration will allow you to use the advanced voice options provided by Azure Text to Speech for the output of the Cognitive Vision skill.

I figured it out, I got it to work.

In Cognitive Vision:

in Describe - Audio.say("I see the words " + getVar("$VisionDescription"));

in Read Text - ControlCommand("Azure Text To Speech", "speak", "I see the words " + $VisionReadText);

now I can use all the Microsoft voices in the Azure skill