Asked
— Edited
We have managed to integrate Cortana unlimited (same as dictation mode) speech recognition with ARC which now means we can input any speech into ARC (for no cost unlike Dragon). we are using the HTTP custom server as can be seen on the screendump below.
We added a Pandorabot to ARC (to use it with unlimited speech) but it always seems to use it's own (default MS) speech recognition and we can't see a way to send our speech string into the Pandorabot.
Can DJ or anyone advise how we may do this - running Pandorabot with reliable/accurate unlimited speech recognition would be very neat!
Thanks in advance for any help.
Tony
So, I'm wondering and it may be impossible but..... I've not tried Chatbots but the VR accreacery seem real high with a quick interface. Is it possible to have it trigger scripts within ARC like we can now do with the VR built into Windows? I'd like to use Chatbots VR not as a conversation tool but as a trigger for EZ scripts and sound files. My robot being a reproduction of an original TV series robot, He's dependent on sound files of the voice actor who did his voice in the series (who is now deceased) to give him authenticity. I also use the VR in ARC to script motor movement and lights. I don't like the accuracy of the windows VR and this Chatbots interface looks like a great replacement. confused
EDIT: After thinking about it I think i'm a little off here. Seems like I need to use only the Cortana Speech Recognition to trigger the scripts and voce files and cut out the Chatbots? confused
Dave, I am looking into this and will let you know as things develop.
Here is second quick (vocal) chat with DJ's Pandorabot, it is quite a lot of fun talking to a chatbot. The cortana SR makes one mistake in this session (it seems to rarely make mistakes) which is the word good - strange as it is such a simple word?
Next job is to start building my own Pandorabot thats geared towards the ALTAIR robots.
Tony
You can encode ezscript in the pandora bot responses. The pandora bot manual page explains more: https://synthiam.com/Tutorials/Help.aspx?id=189
The speed and accuracy , are what made me give up on it. But this changes things completely. I know I'm repeating myself. I'm just floored by the whole set up. Anyone here want to try and take a crack at this as a plug in or ?!
Very exciting!
Because it's UWP, it's not a compatible plugin. Microsoft is removing c# functionality and removing desktop widget functionality with UWP. The contana libraey only works UWP for some reason - it's an unusual direction to take. Considering UWP is more mobile friendly, but Microsoft doesn't actually have mobile devices anymore (other than the odd automotive gps GUI). Windows has been known for desktop usage and desktop style apps etc... they can't imagine solidworks, for example, being developed with UWP...
So it's a bit confusing direction they are taking. Contana is UWP and doesn't have desktop compatible libraries.
Guess in time we will see what's up Microsoft's sleeve
sure they have something planned that makes more sense than it does now. It's too early to tell... and we're all eager!
ah ok now I understand. We will just have to sit and wait...see what they come up with. Hopefully the solution will give us a similar or better result than Tony has shown!
Brainstorming post.
Cortana provides via cloud services:
Voice Commands e.g. Write an email to John saying Happy birthday.
Voice dictation e.g. Taking notes, writing emails (Speech To Text)
Natural Language Processing e.g. What's 17 minus two?
Custom Actions can be useful to create interactions like: Hey Cortana switch off the lights Hey Cortana go to the kitchen Hey Cortana move the camera to the right.
Voice dictation so far only makes sense if you have Bot components like Pandora. What you do with a long text ?
NLP is handled by Microsoft, there is no way to feed specific content.
I see a huge potential to integrate Cortana's voice recognition with AI Bots e.g. Pandora Bots, besides custom actions what other kind of integrations can be done with ARC ?