Asked
— Edited
Does anyone know if the SDK of the Oculus Rift package would work with EZB if there was a plug in developed for it? It doesn't really need to be something as big and bulky as that. Very unfortunate that Vuzix is no longer offering support with EZB. That would work great.
Like the Vuzix, I'd like to pull from the IMU data to move servos and transfer the camera feed from the EZ camera to the goggles over two complete separate computers in different places.
Any ideas or suggestions on how to POC this, would be grateful.
Done
@fxrtst What makes you think that Unity is the better option compared to eg Blender?
Also if you are just looking for an option to drive and record servos out of a virtual environment, we are already having two free options at hand...which are 3ds max, and Maya!
As far as I understood, you accomplished driving servos using Maya?
I am currently using 3ds max to drive my servos and it works just as the Unity examples you posted...
In any 3d application you will have to find a way to extract the servo angles out of your imported .bhv or .fbx, there is no black magic which will do this for you!
I think the key to success is always to build an exact replication of the mechanics within the 3d environment to get it all work correctly!
But if there is an option to link ARC with Unity, it would for sure open up a ton of new options and I would be very happy to put time in for learning and testing!
I double checked the clips...Unity could be actually a bit better for live control, 3ds max is a bit slow for this!
Also with Unity you can add Machine Learning to your robot...I will have a look!
Correct me if I am wrong, but I think since ARC has the option to retrieve data thru the Custom HTTP Server, there is no need for a plugin! Unity can connect to ARC by using a GET or POST request right?
No need for an Arduino either!
https://answers.unity.com/questions/11021/how-can-i-send-and-receive-data-to-and-from-a-url.html
https://docs.unity3d.com/Manual/UnityWebRequest-SendingForm.html
Yes! Check out this $20 Unity plug in. This guy works for a robotics company and wrote an incredible IK solver. Watch this video and then watch his other longer set up videos. Its pretty east to set up the IK. Then there is always FBX if you wanted to bake out your animations in 3D Max then use Unity to port out the animation to your robots.
I have to look at your links, would be amazing to hook thru http server!
Edit: added a longer video with VR goggles at around 4:00
It looks like http server could in fact be used...from what i understand from the links you posted. I did see the post from the guy who posted code was from 2010 and someone at bottom said it was not compiling with the next version which at that time looked like 4.2. Hopefully it could be altered to work with todays version of Unity.
This would open up a whole new world for how you could use EZ products.
I have a series of servos moving live within Unity environment right now using the plug in i had links to posted above. I also recorded motion and was able to play it back using the time line. It took awhile to figure it out as the docs are lacking, but managed to get enough info from their videos. It is buggy and crashed Unity often. Also it kept losing the com port after a certain amount of time, then you would have to reconnect. Def feels like unfinished software.
Another problem I had, was when I tried to set up IK for a series of servos. I found out there is no built in IK in Unity, only joints, ie hinge etc. That's when I stumbled on to the Bio Ik plug in from the assets store. I will try and set up an IK chain with the servos with it this weekend.
Maybe someone can look into connecting Unity and ARC via "Post" and "get", cuz i can tell you its beyond my skill set. We would have to figure out how to convert arbitrary rotation and translate values to 1-180 degrees for the servo positions?!