How to add the Speech Recognition robot skill
- Load the most recent release of ARC (Get ARC).
- Press the Project tab from the top menu bar in ARC.
- Press Add Robot Skill from the button ribbon bar in ARC.
- Choose the Audio category tab.
- Press the Speech Recognition icon to add the robot skill to your project.
Don't have a robot yet?
Follow the Getting Started Guide to build a robot and use the Speech Recognition robot skill.
How to use the Speech Recognition robot skillUsing the Microsoft Windows Speech Recognition Engine, this skill uses your computer's default audio input device and listens for known phrases. Phrases are manually configured in the Settings menu, and custom actions (via script) are assigned to your phrases.
Most robots make a lot of noise, so locating the audio input device on a robot is not practical. It is best to find the microphone on the controlling PC/Laptop, on yourself, or somewhere in the room (away from the robot). Turning the gain higher on the input device will allow voices to be recognized across large rooms and increase false positives. Test with different audio volume gains for the best resolution. Experiment with varying locations of microphone and volumes for the best setup of your environment. Ideally, use a headset or Bluetooth mic rather than your laptop microphone.
1. Pause Button
This button pauses the detection from the audio input device. No configured commands will be executed while the skill is paused.
2. Phrase List Button
Displays the phrases that have been configured in the Settings menu to be available for detection. Here's the default phrase list:
3. Audio Waveform
This gives visual feedback that your audio input device (microphone) is configured correctly and is picking up voice/sounds.
4. Response Display
This will display feedback from the Speech Recognition skill. It will show the detected text from the phrase list or actions that have been executed in the skill.
1. Confidence Drop-down
This drop-down is the minimum percentage of confidence that the computer detects from your voice. This robot skill will ignore any detected phrases with less confidence. If your voice isn't being detected very well, decrease the confidence value. A confidence value will appear in brackets beside the phrase in the Response Display when a phrase is detected. *Note: Adjusting the confidence to a lower value can produce false positives.
2. Setup Microphone Button
This button is a shortcut to the properties of your installed audio input devices. Verify that your device is working by watching the soundbar for movement when you speak into that device.
3. Recognition Scripts
These scripts will execute every time a phrase is detected at the set confidence level or higher (All recognized) and when a phrase is detected with low confidence.
4. Enable/Disable Phrase Fields
These fields will setup the phrases to be detected to Pause/Unpause speech detection.
5. Enable/Disable Command Scripts
These scripts will execute when the Enable/Disable phrases are detected.
6. Language Drop-down
ARC uses the Microsoft Speech Recognition included with Windows. All languages supported by Windows Speech Recognition are also supported in ARC. You can configure Windows to listen to any language. ARC will default to EN-US (English) language if installed. Otherwise, ARC will default to the first installed language. If more than one language is installed, you may select a language with this drop-down.
*Note 1: This feature is only available from Windows 7 and newer (7, 8, 8.1, 10, etc.). For a detailed description of what errors your computer is receiving during Speech Recognition Init, open the DEBUG window under Utilities. Microsoft has provided assistance to configure speech recognition here.
*Note 2: Languages support by speech recognition depend on the Microsoft Windows operating system configuration. View the Microsoft speech recognition guide here to view supported languages.
7. Confidence Variable
This variable holds the value of the confidence percentage (in decimal format) of the last recognized phrase.
8. Phrase Variable
This variable holds the recognized phrase.
9. Phrase List
This is a list of default phrases with the ability to customize and add more phrases.
10. Command List
This is a list of default commands corresponding to the phrases in the same row, which can customize and add more commands.
11. List Management Buttons
These buttons manage the rows of phrases. They move the rows up and down, insert them, add more to the bottom, and delete them.
How to Use Speech Recongition
1) Install, configure and test your audio input device (see instructions below).
2) Add the Speech Recognition Skill to your ARC project (Project -> Add Skill -> Audio -> Speech Recognition). *Note: Not to be confused with Advanced Speech Recognition.
3) Set up the scripts, phrases, and commands you'd like to use in the Settings menu.
4) Save your Settings and then speak your phrases into the audio input device to activate speech recognition.
Headset or External Mic
Using a headset or external mic will produce dramatically better results compared to the internal PC/Laptop mic. Using a headset or mic will enable the recognition engine to "hear" your voice much clearer with less background noise. The background noise of the laptop, motors, radio, and room echo will cause the recognition software to return False Positives. This means the software recognizes an incorrect phrase. An external mic will also prevent the recognition software from hearing the robot speak. In short, it is important to use a Mic Headset or external Mic for a positive Speech Recognition experience.
Configure Audio Input Device
You might have to adjust the microphone input volume/gain. To adjust the mic volume use the Microsoft Windows volume mixer, and first, make sure you have selected the correct input device. Your laptop or computer may have a few different mic devices. Maybe one is on a remote camera. Find the mic you'd like to use and adjust the volume. To find the volume settings that are ideal on your computer, follow these steps:
1) Right-click on the little speaker on your system tray
2) Select "Open Sound Settings"
3) In the "Input" section of the Sound Settings, you'll notice a little VU meter beside the active device. Make sure your active device is indeed the microphone you want to use. By making sounds, the VU meter should move.
4) Click on the "Device Properties" and locate the volume slider for the microphone. We usually have our volume set for 78. Play around with different volumes until you see your voice being picked up by the VU meter. Adjust the volume input level/gain to display your voice's regular volume near the middle of the VU Display graph. The recognition software will not work if the level/gain is too high because the input audio will be distorted.
You may train your computer for speech recognition by using the training wizard. Find the training wizard under Speech Recognition within the Windows Control Panel.
Randomizing Answers In Speech Recognition
Want to make your robot respond more naturally and not the same thing every time? Here's how to make it answer...
Speech Recognition Say It Didn't Understand You
The speech recognition uses a confidence level to determine if it understood your verbal command. This tutorial...
Speech Recognition Tutorial
Speech recognition is becoming a very popular way to control robots. This tutorial will explain the EZ-Builder speech...
Synbot Plugin Tutorial - Interface To Syn Bot Software
How To install bot software, EZ builder Synbot plugin and example SIML project files
Vision Training: Object Recognition
Learn how to program a robot to learn and memorize an object.
Related Hack Events
"Robot Learn A New Object"
I'll be using the camera and speech recognition to instruct the robot to learn a new object. I'll demonstrate how new...
Brazilian Speech Recognition
Good afternoon everyone, I would like to know how do I work the command of Voice in Portuguese,? I've tried everything...
Error In Speech Recognition Window
hi all am using the speech recognition window .all works except the deactivate line ? whatever vallue i use high or low...
Speech Recognition Screen Popping Up.
So I have been tinkering with speech recognition and enjoying it. Recently after a speech interaction completes I get...