It is really good at facial recognition. It is better than what I have seen from OpenCV, Aforge, ARC or RoboRealm. I don't have this piece implemented yet but Toymaker does and the Example Project works wonderfully even in different lighting conditions (within reason). The sensor can store up to 500 faces for recognition.

In addition to this, it does human body detection - Number of human bodies within view of the camera Age estimation - Does a really good job of identifying the approximate age of the people in the view of the camera. Gender Estimation - Is the person male, female or unknown. Hand detection - can differentiate between how many fingers you are holding up Expression estimation - is the person happy, sad, upset, neutral or whatever eye estimation - location of the eyes and how open they are Gaze estimation- where is the person looking?

Any or all of these can be enabled or disabled. This helps to make the robot smarter. Tracking would be done by another camera while this one handles the person recognition. This reduces the load on the computer running ARC. Also, it allows ARC to still do color tracking and whatever through other cameras.

All of this is done on the sensor so very little processing load in handled by the light weight tablets that people put on their robots.

Here is a sample of the data returned.

Detection execution:

body: num_detections: 0

face: detect_size: 106 reliability: 632 num_detections: 1 coord_y: 379 coord_x: 245

gaze_estimation: left_and_right_angle: -2 up_and_down_angle: 0

gender_estimation: gender: man reliability: 1000

age_estimation: age: 51 reliability: 285

face_orientation: face_inclination_angle: -1 vertical_angle: 13 reliability: 43 left_and_right_direction: -6

facial_expression: neg_pos_degree: -57 top_score: 43 expression: expressionless

eyes_estimation: eyes_head_right: 337 eyes_head_left: 399

hand: num_detections: 0

David really looking forward to the plug in.

video removed

Hello David!

it´s sounds good!

I am still have this omron board. But tell me, your plugin work only with your USB board (800 ,-) or also with my cheap Board without the USB connection?

Best Boris

the board I use is about $10 USD and is very common. I should have the first version of the plugin out in a day or so.

Hello David,

still it sound really good!

Slowly i must work again on my Inmoov after 4 Month break!

So some days waiting is no problem! ;-)

Boris

just posted it. The description has the information you need to use. I will update the description more in time.

@RentaPrinta, this will show you how to use the plugin when you are ready. Sorry it took so long to get to you. I have been really busy with other things and finally got back to this. I will work on adding Facial Recognition in the future, but you now have a control in ARC that allows you to use this sensor.