Object detection is fundemental to computer vision: Recognize what the objects are inside the robot camera and also where they are in the image.
+ How To Add This Control To Your Project (Click to Expand)
Manual
Object detection is fundemental to computer vision: Recognize what the objects are inside the robot camera and also where they are in the image.
*Note: This version (created 2020/11/19) is still in development. View the To Do items at the bottom of this manual. However, do give this a try and let us know what you think!
Demo
Directions
1) Add a Camera Device to the project
2) Add this robot skill to the project
3) START the camera device so it is displaying a video stream
4) By default, this skill will not be active. Check the "Active" checkbox to begin processing the camera video data stream
Performance
In HD webcam resolution, Tiny Yolo is processing 30+ FPS with 38% cpu
Variables
The detected objects are stored in global variables in an array. The number of detected objects determines the size of the array. The location of the detected object, confidence and name are all stored in variables. See this example...
TODO:
- control commands for starting, stopping
- object tracking start and object tracking end scripts
- ability to specify custom training model files
will try again
Loading models: C:\ProgramData\ARC\Plugins\19a75b67-c593-406c-9789-464aa3ba998b\models\TinyYolo2_model.onnxSet Configuration: Error initializing model :Microsoft.ML.OnnxRuntime.OnnxRuntimeException: [ErrorCode:RuntimeException] Exception during initialization: bad allocation
at Microsoft.ML.OnnxRuntime.NativeApiStatus.VerifySuccess(IntPtr nativeStatus)
at Microsoft.ML.OnnxRuntime.InferenceSession.Init(String modelPath, SessionOptions options)
at Microsoft.ML.OnnxRuntime.InferenceSession..ctor(String modelPath)
at Microsoft.ML.Transforms.Onnx.OnnxModel..ctor(String modelFile, Nullable`1 gpuDeviceId, Boolean fallbackToCpu, Boolean ownModelFile, IDictionary`2 shapeDictionary)
at Microsoft.ML.Transforms.Onnx.OnnxTransformer..ctor(IHostEnvironment env, Options options, Byte[] modelBytes)
Also the box that pops up is to the left of the "person" it sees - the person is not in the box
Will keep trying
That is all I ever see in the plugin. I do notice in the variable watcher that it is detecting and the variable changes when it detects me or something else, but the plugin never changes.
I tried it again, only can see "a person" , thinks my iPhone in a tv-monitor, :-)
Also the box that pops up is to the left of the "person" it sees - the person is not in the box