Canada
Asked — Edited
Resolved Resolved by Mickey666Maus!

Can I Use Custom Sounds To Trigger Actions?

Skip to comments   Jump to end

Hello wonderful Synthiam-ians!

While I see some back and forth on this from years ago, I’m wondering if there is a simple way of having our EZ-robots recognize and respond to some custom, silly sounds (rubber chicken honk, fart cushion etc.)? Like they do with speech recognition.  It would be a great way to introduce the idea to my Tech Bandits kid’s Club and could be very useful for the kids with developmental and physical disabilities we will be collaborating with in the near future.

Any help or insights would be much appreciated!

cheers,

D!

Related Hardware Roli Rover

ARC Pro

Upgrade to ARC Pro

Unlock the true power of automation and robotics by becoming a proud subscriber of Synthiam ARC Pro.

Canada
#2  

Thanks DJ,

This should work though, right? Compare frequencies?  Is there a way to do that "loosely" (is like kind of thing?) as even the same sounds will have variations?

Cheers,

D!

PRO
Synthiam
#3  

Not that I know of. Unless someone has any ideas?

#4   — Edited

In my mind - the "simple" way to do it would be think about it in terms of "faking" the robot hearing the sound.  Picture it like this, you have create a ARC mobile app with buttons to play sounds files.  Those same buttons can also trigger scripted actions to make the robot react to the sounds as if it "heard" the sound.  That's the "simple" way - is to fake it.

Comparing the frequency I don't think will produce the results you would like to see.  Sound recognition is a tricky thing and so far there are not any plug in solutions that I have read about.  Vision, speech recognition and image recognition are the hot cognitive app and dev areas.  Sound has got to be in there too in the wider cognitive development space because there are cognitive utilities that can pull music tracks apart and in my mind that kind of relates to that, but I would not consider it simple and from some of the stuff I have seen I would not consider any of it good candidates to attempt plugs ins to experiment with.

Canada
#5  

Thanks JustinRatliff... I did wonder if faking it might be the way... or even having very distinct frequencies in recorded sounds to set it off...if I have more time I might try and play with that... but I"m hoping that moving the robots by frequency, like in DJ's tutorial, should be raucous enough to keep the Tech Bandits happy!

Cheers,

D!

Canada
#7  

Mickey666maus...this looks amazing... Thanks so much!

#8  

Quote:

https://teachablemachine.withgoogle.com/

Works with ARC...:)

Came here to post this.  Haven't played with it yet, but I knew it could be trained to recognize sounds, and I know Google is already working with trained models because the "Live Transcribe" app on Android adds "laughter", "crying" "Cough", "Sneeze" and "Fart" (it is an easter egg.  Needs to be un-naturally loud) if it hears them in a conversation .

Alan

Login to post a comment