Community Question

We have managed to integrate Cortana unlimited (same as dictation mode) speech recognition with EZ-Builder which now means we can input any speech into EZ-Builder (for no cost unlike Dragon). we are using the HTTP custom server as can be seen on the screendump below.

User-inserted image

We added a Pandorabot to ez-builder (to use it with unlimited speech) but it always seems to use it's own (default MS) speech recognition and we can't see a way to send our speech string into the Pandorabot.

Can DJ or anyone advise how we may do this - running Pandorabot with reliable/accurate unlimited speech recognition would be very neat!

Thanks in advance for any help.

DJ Sures
Commented October 2016
Because it's UWP, it's not a compatible plugin. Microsoft is removing c# functionality and removing desktop widget functionality with UWP. The contana libraey only works UWP for some reason - it's an unusual direction to take. Considering UWP is more mobile friendly, but Microsoft doesn't actually have mobile devices anymore (other than the odd automotive gps GUI). Windows has been known for desktop usage and desktop style apps etc... they can't imagine solidworks, for example, being developed with UWP...

So it's a bit confusing direction they are taking. Contana is UWP and doesn't have desktop compatible libraries.

Guess in time we will see what's up Microsoft's sleeve :) sure they have something planned that makes more sense than it does now. It's too early to tell... and we're all eager! :D
Commented October 2016
ah ok now I understand. We will just have to sit and wait...see what they come up with. Hopefully the solution will give us a similar or better result than Tony has shown!
Commented October 2016
Brainstorming post.

Cortana provides via cloud services:
1) Voice Commands e.g. Write an email to John saying Happy birthday.
2) Voice dictation e.g. Taking notes, writing emails (Speech To Text)
3) Natural Language Processing e.g. What's 17 minus two?

1) Custom Actions can be useful to create interactions like:
Hey Cortana switch off the lights
Hey Cortana go to the kitchen
Hey Cortana move the camera to the right.

2) Voice dictation so far only makes sense if you have Bot components like Pandora. What you do with a long text ?

3) NLP is handled by Microsoft, there is no way to feed specific content.

I see a huge potential to integrate Cortana's voice recognition with AI Bots e.g. Pandora Bots, besides custom actions what other kind of integrations can be done with ez-builder ?
Commented October 2016
This might be a different way to work with Cortana:
Commented February 2017
Hello Tony,
I try to emulate you for 2.5 months. Unfortunately I am not successful, the hints in this thread are not enough, I come no further. Will you ever share your speech recognition revolution with others?

Thank you for your response.

Avatarby Toymaker
Published Monday, October 3, 2016