Object detection is fundemental to computer vision: Recognize what the objects are inside the robot camera and also where they are in the image.
Get
Version
12
How to add the Tiny Yolo2 robot skill
- Load the most recent release of ARC (Get ARC).
- Press the Project tab from the top menu bar in ARC.
- Press Add Robot Skill from the button ribbon bar in ARC.
- Choose the Camera category tab.
- Press the Tiny Yolo2 icon to add the robot skill to your project.
Don't have a robot yet?
Follow the Getting Started Guide to build a robot and use the Tiny Yolo2 robot skill.
How to use the Tiny Yolo2 robot skill
Object detection is fundamental to computer vision: Recognize the objects inside the robot camera and where they are in the image.Demo
Directions
1) Add a Camera Device to the project
2) Add this robot skill to the project
3) START the camera device, so it is displaying a video stream
4) By default, this skill will not be active. Check the "Active" checkbox to begin processing the camera video data stream
Camera Device Integration
This robot skill integrates with the camera device by using the tracking features. If the servo tracking is enabled, this robot skill will move the servos. This is an extension of the camera robot skill.
Performance
In HD webcam resolution, Tiny Yolo is processing 30+ FPS with 38% CPU
Variables
The detected objects are stored in global variables in the array provided by the camera robot skill. The number of detected objects determines the size of the array. The detected object's location, confidence, and name are all stored in variables.
TODO:
- control commands for starting, stopping
- object tracking start and object tracking end scripts
- ability to specify custom training model files
Loading models: C:\ProgramData\ARC\Plugins\19a75b67-c593-406c-9789-464aa3ba998b\models\TinyYolo2_model.onnxSet Configuration: Error initializing model :Microsoft.ML.OnnxRuntime.OnnxRuntimeException: [ErrorCode:RuntimeException] Exception during initialization: bad allocation
at Microsoft.ML.OnnxRuntime.NativeApiStatus.VerifySuccess(IntPtr nativeStatus)
at Microsoft.ML.OnnxRuntime.InferenceSession.Init(String modelPath, SessionOptions options)
at Microsoft.ML.OnnxRuntime.InferenceSession..ctor(String modelPath)
at Microsoft.ML.Transforms.Onnx.OnnxModel..ctor(String modelFile, Nullable`1 gpuDeviceId, Boolean fallbackToCpu, Boolean ownModelFile, IDictionary`2 shapeDictionary)
at Microsoft.ML.Transforms.Onnx.OnnxTransformer..ctor(IHostEnvironment env, Options options, Byte[] modelBytes)
Also the box that pops up is to the left of the "person" it sees - the person is not in the box
Will keep trying
That is all I ever see in the plugin. I do notice in the variable watcher that it is detecting and the variable changes when it detects me or something else, but the plugin never changes.
I tried it again, only can see "a person" , thinks my iPhone in a tv-monitor, :-)
Also the box that pops up is to the left of the "person" it sees - the person is not in the box
Perry, the plugin doesn't change or display anything. The objects detected are in the camera view and the variable manager. They're not in the display of the plugin. Would it help if they were also listed in the plugin display for you to see in there as well?
The reason I a asking is, I like deleting the captured files to save on storage on my laptop - I do delete the DArkNet Yolo files / pictures in the C:\...Documents\YOLO.Plugin\Captures folder
thanks
EzAng
thanks
EzAng
I can quickly change the robot skill to allow you to select your own data file if you'd like. I don't think that exists in this.
Maybe I can send you a trained NN first to test.