Integrate state of the art image generation capabilities directly into your robot apps and products.
How to add the Openai Dall-E Image robot skill
- Load the most recent release of ARC (Get ARC).
- Press the Project tab from the top menu bar in ARC.
- Press Add Robot Skill from the button ribbon bar in ARC.
- Choose the Camera category tab.
- Press the Openai Dall-E Image icon to add the robot skill to your project.
Don't have a robot yet?
Follow the Getting Started Guide to build a robot and use the Openai Dall-E Image robot skill.
How to use the Openai Dall-E Image robot skillIntegrate state-of-the-art image generation capabilities directly into your robot apps and products. DALLE 2 is a new AI system that can create realistic images and art from natural language descriptions.
Have your robot programmatically generate images from speech recognition robot skills descriptions. Or, have the image from the camera sent to Dall-e for its AI interpretation. Experience the whacky world of AI image generation with your Synthiam-powered robot or webcam.
How Does It Work?
DALLE 2 has learned the relationship between images and the text used to describe them. It uses a process called "diffusion," which starts with a pattern of random dots and gradually alters that pattern towards an image when it recognizes specific aspects of that image. DALLE 2 can create original, realistic photos and art from a text description. It can combine concepts, attributes, and styles.
1) Generate From Description
Prompts a dialog for you to enter a description of the image you would like generated. Be as detailed as possible because anything is possible.
2) Modify the Camera Image
Use an image from the camera device and run it through the AI variation. This will allow Dall-e to make a new version of a similar but different image.
1) API Settings
Enter the API Key from OpenAI's website here. This value will be saved locally on the current user account and used for any Open AI robot skills. This value will not be distributed with your project.
There are a few ControlCommand() that allow programmatic usage of this robot skill from other robot skills. For example, send the image to be described by the result of a speech recognition request. The Variation option, where the robot's camera image is modified, uses the camera device robot skills, so they are automatically queried for the control command. If no camera device name is specified, the first camera device is used.
Example: ControlCommand("OpenAI Dall-e Image", "GetImageFromText", "description of the image to generate");
Generate an image based on the provided description.
Example #1: ControlCommand("OpenAI Dall-e Image", "GetImageVariation");
Example #2: ControlCommand("OpenAI Dall-e Image", "GetImageVariation", "Camera");
*Note: When no camera device name is specified, the first camera device will be used.
An account is required on the OpenAI website to use the service. Once an account is created, you will have an API key to use in the robot skill.
1) Visit the OpenAI website and select the API option from the menu.
2) Press the SIGNUP option to create an account
3) Once the account is created, press your Username icon to view the drop-down. And select the View API Keys option.
4) Copy your API key
5) Paste the API key in the robot skill configuration menu