JD With New Self-Programming AI Robot Skill
Last night, I had a few friends over, and we discussed the fascinating topic of how artificial intelligence can autonomously program itself. We explored how AI can incorporate code into its responses, which can be executed within Synthiam ARC's internal scripting engines using JavaScript or Python. To illustrate this concept, I quickly recorded a video demonstrating an EZ-Robot JD being programmed in real-time by the AI to perform various actions. This capability allows the robot to become fully autonomous, enabling conversational interaction as if you were speaking to another person. The robot can program itself based on your spoken instructions.
I'm not sharing the specific details of how I achieved this just yet because we're in the process of adding more features to the robot skill. After this weekend's ARC update, it will be easier to implement this behavior with any robot. This means you can add this functionality to your InMoov, DIY robot, or any other robot project. All you need to do is define the robot configuration, and the AI will use the robot project to program it in real-time, allowing it to perform tasks as you talk to it.
Here's the video for you to check out:
Very nice! So many possibilities. When will it be available in the skill store to try?
I think the expression the right tool for the job applies to your ideas of picking stuff up. Ezrobots do not have the agility for that. Even using a wii or vr controller for a human to control an ezrobot robot to pick something up would be impossible
The right tool for the job would need several more degrees of freedom arm and the inverse kinematic robot skill. And for detecting an object to be picked up by depth and size, a 3D point cloud from a stereoscopic camera.
can be done with the correct hardware. But you’re getting into a different class of robot. The ezrobots like I’m using in my video are good for cute personality type things - not sure what usefulness it has interacting with the environment. It can’t walk straight either.
@fred, the manual above states it works with any robot. The jd robot from ezrobot is what I used in my demo. I mentioned that a few times in the video.
@rodney, the robot skill is available. You replied to the thread of the robot skill
. If it doesn’t show up in your list in ARC yet, might be because it hasn’t synced. You can force a sync using this document: https://synthiam.com/Support/ARC-Overview/robot-skills/Syncing-and-Updating-Robot-Skills
Thanks DJ, it was not showing in Arc. Forcing a sync worked.
I get what you mean DJ. Still, wouldn't mind seeing if I could integrate this into my current project (which I will eventually post on site), and have it do something just as cool (still ways off for me though). I do want my robot to be useful around the home in some capacity somehow
Look forward to seeing more.
It doesn’t require integration. You simply add it to your existing project.
looks interesting
@nink have you tried the new grok 3?
im gonna try autonomous ai on it tonight
*edit: never mind grok 3 api isn’t available yet.