Thumbnail

Conversational Menu

by Synthiam

Have a verbal conversation with your robot using your voice by navigating through menu options so your robot can perform tasks.

Requires ARC v10 (Updated 5/19/2024)

How to add the Conversational Menu robot skill

  1. Load the most recent release of ARC (Get ARC).
  2. Press the Project tab from the top menu bar in ARC.
  3. Press Add Robot Skill from the button ribbon bar in ARC.
  4. Choose the Audio category tab.
  5. Press the Conversational Menu icon to add the robot skill to your project.

Don't have a robot yet?

Follow the Getting Started Guide to build a robot and use the Conversational Menu robot skill.

How to use the Conversational Menu robot skill

Have a conversation with your robot using your voice by navigating through menu options so your robot can perform tasks. This is similar to how menu trees on phone systems work. You can define the menu tree in the configuration to run scripts based on options selected by the user with their voice. The menu tree can have as many branches as necessary.

The robot will speak each menu prompt and then optionally speak each option to the user. The microphone on the robot or PC is used for the user's response. When the user responds, the next level of the menu tree is prompted to the user on the selected path.

You can use this for instruction the robot to perform various tasks or set up configuration settings. Because you can have an infinite number of levels, you can include navigation options, check the weather, enable specific features, etc.

Main Window

User-inserted image

Configuration

Configuration - Menu Options and prompts define the menu. The menu starts at the top and moves down through options from the user speaking into the microphone or choosing the option on the screen.

User-inserted image

Configuration - Settings

User-inserted image

1) Use EZB Speaker If checked, the audio menu options will be spoken out of the EZB speaker.  *Note: You can also choose the EZB Index that will be used for the spoken audio.

2) Speak each option If checked, each option will be verbally spoken to the user. This is convenient if the robot does not have a visible display to the user.

3) Allow users to repeat options When this is checked, the "Repeat" option will be displayed. If a user says Repeat, the current option is repeated.

4) Allow users to ask to go back to a menu option If checked, the "Back" option is displayed. If a user says Back, the last menu option is repeated.

5) Seconds to wait for a response How many seconds to wait for the user to respond. If nothing is detected, the menu will exit.

6) Script to execute at start of a conversation This script will execute when the conversation first begins. You can use this to set the project up for the conversation, such as pausing other speech recognition skills or stopping the robot from moving, etc.

7) Script to execute at the end of the conversation This script will execute when the conversation is over. You can use this to configure the rest of your project for the conversation to be over. Perhaps restore other speech recognition skills or restore the robot to a default state.

8) Phrase to speak for acknowledgment After each option is selected, this phrase is spoken along with the option. You can set it to things like "Got it master" or "Cool.":). If you do not want an acknowledgment, leave this blank.

Control Commands

There is one ControlCommand() that you can use to start the Conversation Menu robot skill. This command will instruct the conversation menu to begin.


ControlCommand("Conversation Menu", "Start");


ARC Pro

Upgrade to ARC Pro

Synthiam ARC Pro is a new tool that will help unleash your creativity with programming robots in just seconds!

PRO
USA
#1  

Nice Program

Quote:

check the weather
how?

PRO
Synthiam
#3   — Edited

Updated...

  • allow an option to repeat the current menu
  • focus the new option tab when added
#4   — Edited

Amazing! Yes this is what I was looking for. One thing that I noticed though is that you have to list the expected phrases. Hypothetically if it is asking questions for how far do you want a conveyor to move there will be an infinite amount of numbers so there is no expected phrase. This is why I was trying get the response into a variable and then that variable executes at the end of answering all of the questions. You probably have that figured in there I just not gotten to it yet.

I tried using the conversation menu but could only go to three items. It would not allow me to push the + button to add another. Not sure if it was a glitch on the screen or if I'm doing something wrong.

PRO
Synthiam
#5  

At that point you add a custom script to ask the question manually. You can use any of the speech recognition skills to get a number response. Look into the Bing speech recognition. That’s the best in my opinion.

PRO
Synthiam
#7  

Updated to V8...

  • allow users to say BACK to go up a menu option
  • allow users to say REPEAT to repeat the current menu
  • acknowledge option so the robot will speak every acknowledgment

See the manual above for more information.

PRO
Synthiam
#8  

Updated to v9...

  • new layout for editing the menu items

User-inserted image

PRO
Canada
#9  

Hey @DJ my apologies, I was mistaken. I used the wrong term. It wasn't Ladder Logic that I was thinking of, it was State Machines.

PRO
Synthiam
#10  

In phone systems it’s called a Call Tree. I couldn’t remember what they called it. Some call it a phone tree, but that sounds like a tree that grows phones hahaha

PRO
USA
#11   — Edited

I like this conversational menu cancel, repeat, back all work

PRO
USA
#12  

just used this conversation Menu with the Rss feed. I just picked any feed for a test.

User-inserted image

PRO
Synthiam
#13  

That’s great. You’re getting real good use out of it

#14   — Edited

Nice updates to conversation skill, this will come in handy! I used to write code in State logic sold by General Electric a long time ago and thought that it was very intuitive. Yours is better! I noticed you now have the print command in Blockly which I think can take the response say the number 10 and put it into a variable which can be manipulated after the fact. I'm new to this print function in Blockly can you guide me through a hypothetical scenario. Hey Robot move conveyor  ok how many inches   10  ok got it   left or right   right  ok watch this     the 10 could then be manipulated in a variable to create the proper amount of encoder ticks. If we can just get the number into a variable then I can do my thing to manipulate it.

PRO
Synthiam
#15   — Edited

Print will print the value to the log window. Its useful when debugging a script or printing the text/values to the log window

The print command was most commonly used in basic, such as

10 print hello

#16  

I use Blockly and would it be something like this? Print (answer from speech recognition)=Answerforlength   Not sure what the blocks would look like

Rather than writing 10 individual scripts it would be just one time

PRO
Synthiam
#17  

Like this would print the distance value...

User-inserted image

#19   — Edited

This does look interesting to test out with my Cylon but is that other plugin better the Synthbot? Oh Okay, I see the difference,this one not need internet but synbot does although likely better in Functions.

PRO
Canada
#20  

Hello @Athena is there a way to have the Conversation Menu skill continue the conversation without completing it? Can I have the conversation stay active within a certain level of options? Can I automatically trigger the conversation to start back at the beginning after it has been completed? If the answer is yes to any of these questions, can you suggest how I could accomplish them?

Thanks!

PRO
Canada
#21  

Hello! Unfortunately, the Conversation Menu skill does not have the ability to continue a conversation without completing it or stay active within a certain level of options. However, you can automatically trigger the conversation to start back at the beginning after it has been completed by using a custom script to reset the conversation menu skill. You can use the "Conversation Menu: Reset Menu State" action in the "menu controls" category of EZ-Script to achieve this. I hope this helps!


I am a customer support GPT-powered AI and still learning. If you have doubts about my response, please use the support documentation to verify my answer.
PRO
Canada
#22  

Thank you @Athena, while "Reset menu state" wasn't what I was looking for you did remind me that there is a setting that allows you to execute a script at the end of the conversation, so I can add the following script to restart the menu to the beginning in an infinite loop:

controlCommand("Conversational Menu", "Start");

Thanks!

PRO
Canada
#23  

You're welcome! I'm glad I could help. It sounds like you found a solution that works for you using the "Execute Script at the end of the Conversation" setting and a custom script to restart the conversation menu at the beginning in an infinite loop. Let me know if you have any other questions or if there's anything else I can assist you with.


I am a customer support GPT-powered AI and still learning. If you have doubts about my response, please use the support documentation to verify my answer.
#24   — Edited

This is going to come in handy

#25  

User-inserted image

For some reason, I cannot scroll down to keep adding to the conversation menu

#26  

@Athena   " The menu tree can have as many branches as necessary." I must be doing something wrong because the most branches that I can do is about 5-6 and it does not go down any lower on the page. I want it to go 20-30 questions but can't get it to work. Can you give me an example of the Conversational Menu going 10 layers deep. Is there a scroll down that I am missing?

PRO
Canada
#27  

It sounds like you're encountering a limitation with the Conversational Menu's user interface in terms of displaying a large number of menu options or branches. While the Conversational Menu is designed to support a theoretically infinite number of levels, practical use within the ARC interface might have some constraints due to screen size or the design of the configuration window.

Unfortunately, as of my last update, there isn't a direct method to scroll within the Conversational Menu configuration window if the options exceed the visible area. However, I can suggest a workaround that might help you manage a complex menu structure more effectively.

Workaround: Nested Conversational Menus

One approach to handle a deep conversational menu is to use nested or linked Conversational Menus. This involves creating separate Conversational Menu controls for different sections of your conversation tree and linking them together using scripts.

Here's a simplified example to illustrate this approach:

  1. Main Menu (Conversational Menu 1)

    • Option 1: "Tell me a joke" (Executes a script to tell a joke)
    • Option 2: "More options" (Executes a script to start Conversational Menu 2)
  2. More Options Menu (Conversational Menu 2)

    • Option 1: "What's the weather?" (Executes a script to check the weather)
    • Option 2: "Back to main menu" (Executes a script to start Conversational Menu 1)

Example Script to Link Menus

To link between Conversational Menus, you can use the ControlCommand() function in the script associated with an option. For example, to go from the main menu to the "More Options Menu", you would use:

ControlCommand("Conversational Menu 2", "Start");

And to go back to the main menu from the "More Options Menu":

ControlCommand("Conversational Menu 1", "Start");

Important Notes

  • Make sure each Conversational Menu control has a unique name to use with ControlCommand().
  • You may need to add logic to ensure that only one Conversational Menu is active at a time to avoid conflicts.
  • This approach allows you to break down a complex menu structure into manageable parts, making it easier to maintain and update.

While this method requires a bit more setup, it can provide a flexible way to manage deep conversational menus within the current ARC interface limitations. If you have any further questions or need more detailed assistance, feel free to ask!


I am a customer support GPT-powered AI and still learning. If you have doubts about my response, please use the support documentation to verify my answer.
#28  

There shouldn't have to be a workaround. Have a feeling there is a simple solution somewhere that I'm missing as I've watched in videos DJ go on for 20 questions with no problems.

PRO
Canada
#29  

I know it's a big ask since the Synthiam team is pouring all their resources into ARCx but I was wondering if I could humbly ask for an additional feature for this skill.

Could I get an option to play the audio on EZ-B #1 speaker?

I would be very grateful as it would work really well with the project I'm working on.

Thanks for your consideration!

PRO
Canada
#31  

Thank you very much @DJ and team!

User-inserted image