Programming With Pictures

Program your robot using images printed on paper.

+ How To Add This Control To Your Project (Click to Expand)
  1. Make sure you have the latest version of ARC installed.
  2. Select the Get button in this page to download the archive file.
  3. Double click the downloaded archive file to execute installer.
  4. The installer will add this control to ARC.
  5. Load ARC and press the Project -> Add Control button from the menu.
  6. Choose the Camera category tab.
  7. Press the Programming With Pictures icon to add the control to your project.


Using the camera, this skill will allow you to add programming commands by holding up pieces of paper with images printed on them. The concept is to allow programming instructions using visual representations. Each card has an image that represents a specific command, such as move forward, turn right, turn left, or reverse. Using cue cards, the robot can be programmed for specific movements to navigate a maze, for example. The order in which the cards are shown to the robot are stored in memory and determines the path the robot will take. When you're ready to run the program, show the robot the Start card and the program will begin!

*Note: This skill is in experimental stage and is released as proof of concept only. There will be future enhancements to the skill in the future.

Main Window

User-inserted image

1. Attach/Detach Camera Button
This button will attach/detach the camera configured in the camera device skill to the program with pictures skill window.

2. Status Field
This field will display the status of the connection to the camera device skill and any errors that occur.

3. Clear Button
This button will clear the program that has been added to the program field.

4. Program Field
This field will display the detected command images in top-down order. It will also highlight the active command in green when the program is executed (START image recognized). 

How To Use Programming with Pictures

1) Print the images below on full sheets of paper

3) Add a Camera Device skill to your ARC project (Project -> Add Skill -> Camera -> Camera Device).

4) Connect to the robot AND to the camera of your robot.

5) Add a Programming with Pictures skill to your ARC project (Project -> Add skill -> Camera -> Programming with Pictures).

6) Press the ATTACH button on the Programming with Pictures skill. This will attach this skill to the camera device skill. You will now see a mirror of the camera's video stream in this skill.

7) Show an DIRECTION (UP, DOWN, LEFT, RIGHT) or PAUSE image to the camera and the commands will be added to the program list.

8) Show the START image to the camera and the program will run.

Images to Print for Programming

Direction Image - hold the image in any direction you wish the robot to move (Ex: Arrow pointed up to move forward)

User-inserted image

Pause Image - robot will pause for 2 seconds between commands

User-inserted image

Start Image - the program will begin running when this image is detected

User-inserted image



An installed camera device (Integrated webcam, EZ-B camera, USB camera, etc.) and a print out of the pictures above.


The source code for this skill can be found here.