Thumbnail

Tiny Yolo2

by Synthiam

Object detection is fundemental to computer vision: Recognize what the objects are inside the robot camera and also where they are in the image.

Get Version 12 (updated 6/14/2022)

How to add the Tiny Yolo2 robot skill

  1. Load the most recent release of ARC (Get ARC).
  2. Press the Project tab from the top menu bar in ARC.
  3. Press Add Robot Skill from the button ribbon bar in ARC.
  4. Choose the Camera category tab.
  5. Press the Tiny Yolo2 icon to add the robot skill to your project.

Don't have a robot yet?

Follow the Getting Started Guide to build a robot and use the Tiny Yolo2 robot skill.

How to use the Tiny Yolo2 robot skill

Object detection is fundamental to computer vision: Recognize the objects inside the robot camera and where they are in the image. 

Demo





Directions


1) Add a Camera Device to the project

2) Add this robot skill to the project

3) START the camera device, so it is displaying a video stream

4) By default, this skill will not be active. Check the "Active" checkbox to begin processing the camera video data stream


Camera Device Integration


This robot skill integrates with the camera device by using the tracking features. If the servo tracking is enabled, this robot skill will move the servos. This is an extension of the camera robot skill.

Performance


In HD webcam resolution, Tiny Yolo is processing 30+ FPS with 38% CPU
User-inserted image



Variables


The detected objects are stored in global variables in the array provided by the camera robot skill. The number of detected objects determines the size of the array. The detected object's location, confidence, and name are all stored in variables.
User-inserted image



TODO:
- control commands for starting, stopping
- object tracking start and object tracking end scripts
- ability to specify custom training model files

Similar Skills

Camera Click Servo

Camera Click Servo

By Synthiam
Attaches to the camera control to enable servo panning by...
Camera Device

Camera Device

By Synthiam
This skill uses any camera installed on your PC or robot to...
Augmented Reality

Augmented Reality

By Synthiam
Overlay images on detected objects, colors, faces and more.

Related Questions

question
Using Variables For TY2 And Camera

Using Variables For TY2 And Camera

Hi, I may just be missing something, but how do you use variables in different skills together. As an example, If I...

ARC Pro

Upgrade to ARC Pro

ARC Pro will give you immediate updates and new features needed to unleash your robot's potential!

Load More ...
PRO
Synthiam
#12  
You'll have to press the ACTIVE button - and an active camera will need to be running. You can see the instructions in video above:)
#13  
I do have an active camera running and the ACTIVE button is depressed as in the pic above. Followed the vid to a T.
That is all I ever see in the plugin. I do notice in the variable watcher that it is detecting and the variable changes when it detects me or something else, but the plugin never changes.
PRO
USA
#14  
DJ

I tried it again, only can see "a person" , thinks my iPhone in a tv-monitor, :-)

Also the box that pops up is to the left of the "person" it sees - the person is not in the box
PRO
Synthiam
#15   — Edited
Fixed the boxes around the detected objects

Perry, the plugin doesn't change or display anything. The objects detected are in the camera view and the variable manager. They're not in the display of the plugin. Would it help if they were also listed in the plugin display for you to see in there as well?
PRO
Synthiam
#16  
Perry, I added a DEBUG checkbox that will display debug information in the plugin of detected objects as i think that's what you'd like to see? The detected object will also be highlighted in the camera device
#17  
Hi DJ. I noticed the boxes that appear around detected objects onscreen. The text was tiny and unreadable in the highest resolution I was previously stuck with. I had expected to see the plugin updating with the detected objects because that is the way it works in the video.
PRO
Synthiam
#18  
Does the new debug work for you? I can make it so the debug value saves with the project configuration as well - if it's something you'd like to see on every frame
PRO
USA
#19   — Edited
Are the pictures captured in a file, stored on your laptop like PTP's DarkNet Yolo stores the files is a captured files ?

The reason I a asking is, I like deleting the captured files to save on storage on my laptop -  I do delete the DArkNet Yolo files / pictures in the C:\...Documents\YOLO.Plugin\Captures folder

thanks

EzAng
PRO
Synthiam
#20  
There’s no files saved. Do not delete any files
PRO
USA
#21  
got it

thanks

EzAng
PRO
Netherlands
#22  
Any chance that I can load my own Yolo or ONNX trained neural network in this skill?
PRO
Synthiam
#23  
Yeah, you totally can. There's a folder that contains the data file. It'll be in the plugin folder, which should be something like...

Quote:


C:\ProgramData\ARC\Plugins\19a75b67-c593-406c-9789-464aa3ba998b


I can quickly change the robot skill to allow you to select your own data file if you'd like. I don't think that exists in this.
PRO
Synthiam
#25  
It'll be easier if we modify the robot skill to allow loading of custom files. that way you can test it and have full control of your environment.
PRO
USA
#26  
Any chance support for YOLO NAS?...it is incredible!
PRO
Canada
#27  
Looks like the trained model for YOLO NAS is non commercial use only. I wonder if that means synthiam would have to licence or provide the users a way to import the trained model into synthiam after the plugin was installed.
PRO
Synthiam
#28   — Edited
It wouldn't matter about the license because robot skills are not part of the ARC software - there is no commercial use of robot skills. They redistribute technology, not a product - which is why we have "plugin" robot skills, because they're add-ons and not part of the ARC software. If they were included in ARC's installation and/or required a subscription, then it would fall under commercial use.

*edit: I looked around a bit about the yolo-nas - not a lot of info bout it yet. It looks to be specific to opencv, and we looked into an open cv wrapper for ARC before, but i don't think it'll be very useful to anyone without advanced programming skills. i'd have to put some thought on how to make that available to ppl who don't want to be writing a bunch of single-use code hmmm
PRO
Netherlands
#29  
Was this one made available? "It'll be easier if we modify the robot skill to allow loading of custom files. that way you can test it and have full control of your environment." Then I will test it
PRO
Synthiam
#30  
You can load custom files with this one. Give it a shot. Is the yolo-nas just a different data file?
PRO
USA
#31   — Edited
I jumped too fast at posting. Watched a video, and it is VERY new. You can play around with training models in Google Collab. And dev in RoboFlow. I think its early release. But really so good at object detection..a portion of Yolo is used in Tesla cars.
Login to post a comment