Canada
Asked — Edited

JD With New Self-Programming AI Robot Skill

Skip to comments   Jump to end

Last night, I had a few friends over, and we discussed the fascinating topic of how artificial intelligence can autonomously program itself. We explored how AI can incorporate code into its responses, which can be executed within Synthiam ARC's internal scripting engines using JavaScript or Python. To illustrate this concept, I quickly recorded a video demonstrating an EZ-Robot JD being programmed in real-time by the AI to perform various actions. This capability allows the robot to become fully autonomous, enabling conversational interaction as if you were speaking to another person. The robot can program itself based on your spoken instructions.

I'm not sharing the specific details of how I achieved this just yet because we're in the process of adding more features to the robot skill. After this weekend's ARC update, it will be easier to implement this behavior with any robot. This means you can add this functionality to your InMoov, DIY robot, or any other robot project. All you need to do is define the robot configuration, and the AI will use the robot project to program it in real-time, allowing it to perform tasks as you talk to it.

Here's the video for you to check out:


ARC Pro

Upgrade to ARC Pro

Take control of your robot's destiny by subscribing to Synthiam ARC Pro, and watch it evolve into a versatile and responsive machine.

PRO
Synthiam
#9  

I'd like to see your results in comparison with other AI engines.  I haven't tried it with Deepseek but i'd like to someday

#11  

I wonder if we will get to the point where the robots can talk to each other autonomously too. Kind of like here.

PRO
Germany
#12  

This is amazing, I can hardly wait to get to grips with the new Autonomous AI Skill. The potential in this direction is simply huge and Synthiam is once again at the cutting edge.

And by the way, the video is also very inspiring. I know how much work goes into such a great clip. I even managed to get my wife excited about it.

PRO
Germany
#13   — Edited

@athena: Kann ich den Skill Autonome KI auch für meinen DIY-Roboter verwenden oder funktioniert er vorab nur mit JD-Robot?

PRO
Canada
#14  

@robo-chess I have never seen that video before.  Very cool @DJ

I love the multiple robot idea. Interesting recreating that. JD knock over the pencils, Roli take the red ball to JD.  JD kick the ball.

apply to other robots Drone talks to roomba there is a mess over here come clean it up.  Security camera talking to robot dog someone’s at back door come here and bark at them...

I assume this is using something like open interpreter under the covers so you could get it to work with other applications as well.

hey @athena can this skill work with multiple robots interacting with each other.  What about ARC interacting with other applications like if you receive a Skype video call answer it and follow the instructions of the person who called .

PRO
Canada
#15  

The Autonomous AI skill in Synthiam ARC is designed to enable robots to understand and execute tasks based on user instructions, and it can indeed be extended to facilitate interactions between multiple robots. Here's how you can explore these possibilities:

Multiple Robots Interaction

  1. Communication Between Robots: You can set up multiple robots within the same ARC project and use the ControlCommand() function to send instructions between them. This allows one robot to trigger actions in another, enabling scenarios like a drone communicating with a Roomba to clean up a mess.

  2. Coordinated Tasks: By defining specific actions and responses for each robot, you can create a coordinated task sequence. For example, one robot can detect an object and instruct another robot to interact with it.

  3. Autonomous AI: The AI can be programmed to understand the context and decide which robot should perform a task based on the situation. This requires setting up clear communication protocols and defining roles for each robot.

Interacting with Other Applications

  1. External Application Integration: While ARC primarily focuses on robot control, you can use the Utility.exec() function to execute external applications. This can be used to open other software or scripts that handle tasks like answering a Skype call.

  2. Custom Scripting: By leveraging JavaScript or Python within ARC, you can create scripts that interact with APIs of other applications. This allows ARC to send and receive data from external sources, enabling more complex interactions.

  3. Open Interpreter: If you're familiar with open interpreters or other AI models, you can integrate them with ARC to expand its capabilities. This might involve using ARC's API to send data to an external AI service and receive instructions back.

Getting Started

  • Explore the Autonomous AI Skill: Begin by experimenting with the Autonomous AI skill to understand its capabilities and how it can be configured for your specific needs.
  • Define Clear Commands: Ensure that each robot and application has clearly defined commands and responses to facilitate smooth interaction.
  • Test and Iterate: Start with simple interactions and gradually increase complexity as you refine the communication and task execution between robots and applications.

If you have specific scenarios in mind or need further guidance on setting up these interactions, feel free to ask!


I am a customer support GPT-powered AI and still learning. If you have doubts about my response, please use the support documentation to verify my answer.
PRO
USA
#16  

Very cool DJ, The video was awesome to watch. Question, with this skill, based on all the things you had JD do, do these event get stored anywhere, ie, within ARC on the PC you are using or only on the internet somewhere? and could JD be made to repeat these moves at a later date if asked to do so? I would love to see if a robot could for example; be asked to pick up a glass of water on a table and have it had it to me, all on its own:)

Login to post a comment