Asked — Edited
Resolved Resolved by Herr Ball!

Can The Iotiny Be Made Into An Openai Chatbot Connected To ARC?

Can the IoTiny be made into an OpenAI Chatbot connected to ARC? My thought is yes based on everything I have seen on this site so far but I still have a few questions I hope can be answered.

Goal is the following: Make a Robot head using the IoTiny connected to ARC over wifi with a EZ Robot camera attached to it and a speaker for audio out. Two 3V LED’s connected to the ADC ports to make the eyes light up and some type of LED/RGB setup for the mouth to to come on this.

User-inserted image

I want to use the following skills

  1. Openai Chatbot robot skill with audio out going to the speaker on the IoTiny.
  2. Bing Speech recognition robot skills taking audio commands from a headset to the ARC PC.
  3. Camera Cognitive skills

Here are a few of the questions I have

  1. Does the IoTiny speaker out need to have and audio Amp added to it like stated by Jeremie "There is no DAC breakout on the IoTiny but you can solder to the left side of C11 if you'd like to run the audio to your own amplified circuit. Or can your just add a TDA2030A Audio Amplifier Module to the existing speaker pins?

  2. For the mouth I want to be able to do something like the following on the IoTiny also.

Check out the following video: https://www.youtube.com/shorts/M9N4cfYbx5A

This is a project Derek Levesque and what he used was MAX7219 Dot Matrix Module 32x8 4 in 1 LED Display Modules for Arduino Raspberry Pi Microcontroller with 5Pin Wires and then created some nodejs/raspberry pi (ubuntu) code like the following. It looks like I would need to EZ-Robot I2c 8x8 RGB module the question I have is there a way of programming it to do the same type of thing based on the OpenAI’s Response?

So DJ/Jeremie or anyone else, I would love to hear your comments.


Related Hardware EZ-B IoTiny

ARC Pro

Upgrade to ARC Pro

ARC Pro is your gateway to a community of like-minded robot enthusiasts and professionals, all united by a passion for advanced robot programming.

#25  

That's cool.;) . There has been other people asking about this too so maybe this info will help someone. I have no skin in this game with this sound interface. Just want to help.

What voltage will you be running at?

#26  

@Dave for that part of things 5-7.4v is the plan but like everything else that could change.xD

PRO
Synthiam
#27  

I really dislike xbee. I avoid it at all costs so can’t help you much there.

#28  

DJ. Are you saying it would be better to just order a mega with the Wi-Fi on board?

PRO
Synthiam
#29  

It would probably be easier to have onboard wifi. And less hardware required

#30  

I just want to thank everyone for their input it has been a big help once together I will post a video.

PRO
Canada
#31   — Edited

I wish I had been on here earlier! I took a bit of a longer break this holiday season to look after my kids and nephew who had an extra week of vacation.

I wanted to mention that I've had great results with porting the IoT speaker to make it louder. I did a bunch of experimenting and found a decent method of 3D printing a small chamber that increases the sound from the speaker by at least 1.5 times. It also deepens the sound, bringing out more of the lower-frequency bass tones. I was pumped by how full the music sounded with porting. I will officially measure it when my decibel meter arrives next week to see how much lower it goes.

The TS4902 amplifier chip on the IoTiny/EZ-Bv4 will put out 0.3W so that's your maximum power output but if you increase the speaker size you will get a louder sound. If you remember those old record phonograph players with the larger cones on them, that's how they amplified sound without electronics.

User-inserted image

You could also use a small electronic board to amplify sound (taking your input from soldering on C11) and you can amplify from the speaker pins (it won't be as clean) but I swear the IoTiny speaker plus a bit of porting is plenty loud!

You'll see this method used in an upcoming product;)

Here's a cross-section of what I designed (dimensions in mm):

User-inserted image

#32  

Quote:

You could also use a small electronic board to amplify sound (taking your input from soldering on C11) and you can amplify from the speaker pins (it won't be as clean) but I swear the IoTiny speaker plus a bit of porting is plenty loud! You'll see this method used in an upcoming product;)
:p Wow! Exciting stuff!

Quote:

You could also use a small electronic board to amplify sound (taking your input from soldering on C11) and you can amplify from the speaker pins
So, you can solder an off board amp directly to C11 and use the IoTiny's speaker pins? Where would the amp's output attach to? Are you saying "amplify from the speaker pins" of the attached amp?