smiller29
Resolved by Herr Ball!
Can The Iotiny Be Made Into An Openai Chatbot Connected To ARC?
Can the IoTiny be made into an OpenAI Chatbot connected to ARC? My thought is yes based on everything I have seen on this site so far but I still have a few questions I hope can be answered.
Goal is the following: Make a Robot head using the IoTiny connected to ARC over wifi with a EZ Robot camera attached to it and a speaker for audio out. Two 3V LED’s connected to the ADC ports to make the eyes light up and some type of LED/RGB setup for the mouth to to come on this.
I want to use the following skills
- Openai Chatbot robot skill with audio out going to the speaker on the IoTiny.
- Bing Speech recognition robot skills taking audio commands from a headset to the ARC PC.
- Camera Cognitive skills
Here are a few of the questions I have
Does the IoTiny speaker out need to have and audio Amp added to it like stated by Jeremie "There is no DAC breakout on the IoTiny but you can solder to the left side of C11 if you'd like to run the audio to your own amplified circuit. Or can your just add a TDA2030A Audio Amplifier Module to the existing speaker pins?
For the mouth I want to be able to do something like the following on the IoTiny also.
Check out the following video: https://www.youtube.com/shorts/M9N4cfYbx5A
This is a project Derek Levesque and what he used was MAX7219 Dot Matrix Module 32x8 4 in 1 LED Display Modules for Arduino Raspberry Pi Microcontroller with 5Pin Wires and then created some nodejs/raspberry pi (ubuntu) code like the following. It looks like I would need to EZ-Robot I2c 8x8 RGB module the question I have is there a way of programming it to do the same type of thing based on the OpenAI’s Response?
So DJ/Jeremie or anyone else, I would love to hear your comments.
Herr Ball, that looks like it could work thanks for posting it!
If you can't use a wifi shield on your mega perhaps you could get a Arduino Mega 2560 REV3. It has built in wifi.
Arduino Mega 2560 REV3
I just don't know if Synthiam's flash firmware will work on this new MEGA and take advantage of the wifi. I've never flashed anything and turned it into an EAB.
@Dave, The firmware for Mega to ARC/EZB support is not updated I have another question posted on the site asking if that could be updated but have not seen any feedback on it yet.
On another note Dave how did you make the B9 chest light flash when it speaks.?
What do you mean the firmware for the mega ezb/arc isn’t updated? It’s a reliable and great working firmware that doesn’t need an update. What update to the mega are you expecting?
DJ, What I meant was the Mega firmware was not updated to support Wi-Fi connection to ARC at this point to Dave’s post. My other Question I posted in another thread is asking if anyone has made a firmware update that can allow the Mega attach to ARC over WI-FI like you did with the ESP32 firmware.
You can always try that with esp32. Just use the esp32 as a uart relay and connect it to the mega rx0 and tx0 pins
or you can modify the mega firmware to work with the mega wifi variant. It’s a pretty rare unit but the documentation for their wifi api should be easy enough. Look at the esp32 firmware to see how it’s done. It might be close
@DJ, I am going to try to update the firmware myself using the DFRobot Gravity I/O Expansion Shield for Arduino v7 and the DFRobot ESP8266 Wifi Bee module. I really want to be able to use the mega connected to ARC over Wifi. Can you confirm if I can still use the serial ports on the Mega with the current firmware? I want to be able to connect other Arduino's to them.
@smiller29,
The B9 Robot Builders Club has a member/vendor over in Australia, Steve Neal, that makes a small board that interfaces with an amp that will trigger the flash. Don't let the fact that he's over in Australia put you off. I've ordered several of his boards and they arrive in a week or so. Our builder members have started using his little board because they not only work great, are easy to adjust but work better then what has been commercially available in a long time.Now, here's the thing. This board has a 12volt input for power and a 12 volt output along with a trigger wire to send a signal for the flash. I've not used this board for any other purpose other then to get a neon to flash. A neon setup requires a special transformer installed after the board that will accept the 12 volt from the board to transform it into a high voltage pulses when the trigger wire sends a signal. The transformer will then deliver a pulse to the neon to get the flash.
Cost plus postage: Fully Assembled: $35 Assemble Your Self Kit: $21
I've talked to Steve many times and he has stated that this board can be used for other types of lights to get a synced flash from an audio source. You eliminate the neon transformer and change the output wiring. However again, I've never done this and don't know the proper connections. If you are driving LEDs I would imagine the proper sized resistor would have to be used to knock down the 12v to a useable voltage for the LEDs.
If you are interested I can reach out to my friend Steve and get the proper instructions on how to use this board in your application. He is very quick to respond and get the order posted. He offers these boards already assembled (takes longer to get shipped because he has to solder it al together) of as a kit that you can assemble. I'd need to know what light source you are using and what device (if any) you have it hooked to. Feel free to contact me through email but posting here would probably benefit other builders.
So, here is a link to his vendor page in our B9 Robot Builder's vendor area. You will find a lot of info about this board and how it's used in the B9 Robot build. Again, remember Steve says it can be used in other applications. You'll also find wiring drawings that show how to wire it up to an audio source and the B9 chest neon. There are also a couple videos on that page showing how it works and how to install it. The install video on that page was made by me.
:
For some reason when use Chrome and click on an embed a link I place in this post it takes me to a page that says "Page Not Found". So copy and paste this address in your browser. Hopefully that will take you there. http://www.b9robotbuildersclub.com/pub/parts/B90658/index.html
Here is the embedded link to the above address that does not work (for me) for some reason: http://www.b9robotbuildersclub.com/pub/parts/B90658/index.html
I'll go ahead and reach out to Steve and check a few thing out for you on this. I've been wanting to catchup with him anyway.