Hi there, welcome to Synthiam. Close to half of the 4 million robots connected to Synthiam ARC are humanoids. This is primarily due to our partners, such as EZ-Robot and Robotis, who sell humanoid robot products that our software supports. Several of those portions are also DIY humanoid robots.

When programming a humanoid robot, use the getting started guide to walk through the selected options: https://synthiam.com/Support/Get-Started/how-to-make-a-robot/make-a-diy-robot

*Note: Take note of the "movement style" section because you will use the Auto Position Movement Panel, which allows you to design the robot's gaits graphically. This is how your robot will learn to walk, do tricks, dance, etc.

Your other questions about LLMs and computer vision are also covered. Without bragging, nothing is more powerful or more straightforward than using Synthiam ARC for the technologies we support. You will see why we're a quiet, modest leader of robot software. That being said, the feature that encompasses your desire for a large language model and computer vision would be the new Autonomous AI robot skill.

To give your robot life, all you need are...

1. Camera device robot skill (lets your robot see through its camera)
2. Bing speech recognition robot skill (converts your spoken words into text)
3. Auto Position Movement Panel robot skill (allows your robot to move)
4. Azure Text To Speech robot skill (most human-like text to speech which lets your robot speak)
5. Autonomous AI robot skill (the robot skill that uses LLM for self-programming to bring your robot to life)

Adding those robot skills to your project means you can talk to your robot without programming it. It will program itself based on your conversation. There are manuals for each of those five robot skills, which are short but to the point for reading.

Hi there, and welcome to Synthiam!

Close to half of the 4 million robots connected to ARC are humanoids. This success is largely due to partners like EZ-Robot and Robotis, as well as many DIY projects built by our community. When programming a humanoid, there are a couple of important points to keep in mind:

1. Getting Started with Humanoids:
   We recommend following our getting started guide to help work through the options for your project. Be sure to pay special attention to the movement style section. This is where the Auto Position Movement Panel comes into play, allowing you to design your robot’s gaits graphicallyfor example, how it walks, dances, or even does tricks.
   How to Make a DIY Robot

2. On Integrating With AI and Vision Technologies:
   The latest Autonomous AI robot skill makes integrating LLMs and computer vision straightforward. To bring your humanoid to life without having to write extensive code, consider adding these key robot skills:

   • Camera Device: Lets your robot "see" using a connected camera.
   • Bing Speech Recognition: Converts your spoken words into text.
   • Auto Position Movement Panel: Graphically design your robot’s gaits so it can move naturally.
   • Azure Text-To-Speech: Delivers some of the most human-like synthesized speech.
   • Autonomous AI: This cutting-edge skill uses a large language model (LLM) to self-program your robot based on your conversationletting you simply talk to your robot and have it figure out the actions.

   With these five skills in your ARC project, you can control and interact with your humanoid robot without having to hand-code every behavior. Check out the manuals for each of these skills on Synthiam’s website for streamlined instructions.

3. Real-World Considerations:
   While many commercially available humanoids work seamlessly with ARC, here are some points to note:

   • Motor Control: The Auto Position Movement Panel makes gait design and motor control intuitive, especially for walking and performing various animations.
   • Facial Recognition & Vision: The Camera Device, combined with computer vision integrations, makes it easier for your robot to see and respond. Any challenges tend to be related to optimizing lighting and camera anglebut our community has a wealth of shared experiences on how to overcome these.
   • Speech Synthesis: With Azure TTS and Bing Speech Recognition, speech interactions are very robust. You may need to fine-tune settings to match your environment’s acoustics, but overall the integration is designed to be user-friendly.

In summary, Synthiam ARC has long been a quiet, modest leader in robot software by providing powerful, easy-to-use technologies for all aspects of robot controlfrom motor and gait design to state-of-the-art autonomous AI and computer vision. Your project is off to a great start by using the Auto Position Movement Panel (Gait) and the Autonomous AI skill. If you have further questions or run into any specific challenges, feel free to askwe’re here to help!

Happy building!