Asked — Edited

Multi Object Camera Tracking

can i use ARC to track multiple red objects and to report the location of each one they are not custom colors they are red


ARC Pro

Upgrade to ARC Pro

ARC Pro is your gateway to a community of like-minded robot enthusiasts and professionals, all united by a passion for advanced robot programming.

PRO
Synthiam
#1  

only one object at a time

#2  

so i can tell it to track red objects and then it will track an object and make the x-y variables and then it will track the other one and so on and if not what can i do

PRO
Synthiam
#3  

Just like your eyes, the robot can only track one object at a time.

#4  

ok now i understand is there a way to do it easily

PRO
Synthiam
#5  

ARC can track one object at a time. You can specify multiple tracking types - but only one will be tracked at a time.

#8  

Is there a radar that judges size as well distance? Or a sensor that judges size? If so, you could, IN THEORY, write a script that defines objects by size (as well as some other conditions as well) and have it take tracking priority based on object, or object and distance.

I don't have my ping hooked up yet so I can't test this theory. (next few days I swear it)

PRO
Synthiam
#9  

I'd like to know what you are looking to accomplish. Maybe I can help with a new feature of some sort. What are you attempting to have your EZ-Robot do?

#10  

The Kinect can track multiple objects at one time.

PRO
Synthiam
#11  

So can our ez-sdk, by using the kinect or our camera. Ez-sdk can do absolutely anything and is important for our industry and educational partners.

However, the question still remains: what is the goal? Because I do not understand how multiple object tracking at the same time can integrate with hardware.

Let me be more specific. If your robot is tracking a red ball, how do you expect it to behave with two red balls? Are there two heads on your robot? What is the robot doing with the second ball?

My question is what are you attempting to have your robot do with more than two objects at a time. This question is specifically relevant considering no one has pushed the limits of the existing camera control. Asking for more features when the existing features haven't been utilized is skipping a few important steps :)

#12  

I "believe" what kudo48pa is trying to accomplish is to prioritize 2 objects within the same camera frame to "determine" based on EZ-SDK software (variables) which item to talk to or kick or point at. Even 2 faces within the same camera frame, one may be close (large) square and one maybe furthur away(small) square and the programmer might want to talk to the close one then the far one. Or kick/move the closest red ball:) I hope that helps clarify the topic.....I know thats a "feature" alot of people may want to incorporate. :)

#13  

i want to get exam papers to be checked

PRO
Synthiam
#14  

In Ed-sdk you can do that. I do not feel it is a feature for ARC. It would not be a very intuitive way to allow the average user to select the object to track.

To correct your example of the face... The software currently selects the closest (largest) face. This means that face is in front of the other face. This means the face in the back is far away. A far away face means it will move behind the face in the front if it tried to move. At least, if it tried to move enough to get a reaction from the robot. So a face behind a person cannot be tracked because the robot camera can't see it.

I think it's best if you picture yourself as a human and pretend you're a robot. What exactly does a human do with tracking two objects? We are only able to track one focal point at a time - that's not a limitation - because were good at it.

Using ControlCommand a you can already specify which object tracking method to use. You can also add multiple colors. There are more than enough features to fulfill your interactive requirements :)

Until my innovative little brain can find an appropriate and simplified use for multi object tracking, ARC will remain human-like by limiting to one object (focal point) at a time :)

#15  

Thanks DJ for the speedy and Clarified reply:) "I think it's best if you picture yourself as a human and pretend you're a robot. What exactly does a human do with tracking two objects? We are only able to track one focal point at a time - that's not a limitation - because were good at it. "......good idea!.....Call me MR RobotO :)

PRO
Synthiam
#16  

Haha, maybe that's why I've been successful at designing robot skill controls... My alter ego is a robot! This must apply to all of you also... Guess we're all robots :)

#17  

While not practical in a general sense, and I'm not asking or pushing for it but if you were making some sort of targeting system it may be handy to track at least vertical movement for 2 object. One left arm/side and one right/side. So if targetA is at one Y on the left and targetB is at a different Y on the right you could dynamically fire them at different angles at the same time.

I'm still trying to dial in the tracking features. They work, kinda. Well that's not fair, they work. I just, am not very good at working with them. Any tips anyone may have are welcome.

#18  

@Antron007 This thread on Dual cameras might help your project! https://synthiam.com/Community/Questions/2069 ....rather then track 2 objects with one camera, why not use 2 cameras to track 2 objects! :)...just a thought