Like this?  https://synthiam.com/Community/HackEvents/Live-Hacking-Microsoft-Mixed-Reality-VR-to-control-a-robot-18086

I believe the "feature" is very broad and maybe there are some misconceptions, and to be honest does not seem a simple "feature" to implement. I'll break the topic in multiple posts.

Unity 3d Engine https://en.wikipedia.org/wiki/Unity_(game_engine)

Quote:

Overview Unity gives users the ability to create games and experiences in both 2D and 3D

Quote:

Licensing model During its first ten years as a product, the paid versions of Unity were sold outright; in 2016, the corporation changed to a subscription model.[46] Unity has free and paid licensing options. The free license is for personal use or smaller companies generating less than $100,000 annually, and the subscriptions are based on revenues generated by the games using Unity.[53][35]

Quote:

As of 2018, Unity had been used to create approximately half of the mobile games on the market and 60 percent of augmented reality and virtual reality content,[31] including approximately 90 percent on emerging augmented reality platforms, such as Microsoft HoloLens, and 90 percent of Samsung Gear VR content.[53] Unity technology is the basis for most virtual reality and augmented reality experiences, and Fortune said Unity "dominates the virtual reality business".

Quote:

Creators can develop and sell user-generated assets to other game makers via the Unity Asset Store. This includes 3D and 2D assets and environments for developers to buy and sell.[61] Unity Asset Store launched in 2010. By 2018, there had been approximately 40 million downloads through the digital store.[62]

In short Unity 3D is a developing tool to create application or game experiences, is licensed and is used "free" for learning, but the ultimate goal is to create an application, is not a robot simulation tool, neither a learning tool.

The op wrote this:

Quote:

So we will be able to explore more use cases if a customized Unity scene is provided.

1. To have an Unity application e.g. Game to explore the virtual world
2. Expect ARC to develop an Unity scene (project) and make it available for other savvy users to change, adapt or even create an application ?

The first option you don't need Unity, if you go to your iphone or android, there are thousands of applications developed with Unity. I believe that is the case for ARC VR application:

Quote:

The ARC software just provides a head movement feature.

So @smondal I guess you are looking for a more featured ARC VR app ?

Improvements to the ARC VR APP: 

Quote:

So if it is possible to have some scenes where a humanoid robot can perform actions like grab, move, or throw some object

Quote:

A human controller should be able to control JD with VR googles like HTC Vive and hand movements with paddles or other VR gloves.

I've used Unity, and is fantastic development environment but the effort you put on development is to create an Application, regarding VR and virtual robots, you need to build a 3D model of the robot.  So you can't create an abstract 3d model you need to hard-code/create in the application 3D models for different robots: EZ-Robot JD, Cozmo Robot, Robotis Humanoid, etc etc.

If is a humanoid, more or less the design is similar but there are different Joints, materials, and connections, so you can't easily design one application to fit multiple designs, that is the job for the Unity Editor Tool.

So if you pick EZ-Robot JD robot the application is locked to that model, than you need to add the other stuff Kinematics, physic engines e.g. https://en.wikipedia.org/wiki/Bullet_(software) and create all the goodies to allow a end user to play the game with the controllers.

In the end what you really want is a VR game application.

maybe we can summarize and ask Synthiam what is their roadmap to improve the VR Application ?

Maybe the words used by the original poster were incorrect. Perhaps by "Unity Scene" and such, what they're really asking for is to have VR controller support embedded in the VR skill?

If that is the request - then yes, it's actually been on the roadmap for a while. I believe it's scheduled for August to have VR controller support in the VR robot skill. This skill: https://synthiam.com/Docs/Skills/Virtual-Reality/Virtual-Reality-Robot?id=15982

However, if the original poster is requesting that Synthiam creates a Unity Scene in source code and gives it to them, that's not within the scope of feature request.

@DJ, The confusion is the Unity part, you don't need Unity to run the existent plugin neither future updates right ? Can you spoil more ... ? What kind of controls will be supported ? And what can we expect from the VR side ?

All Open VR controllers - including valve index for individual fingers, etc... It's been requested a number of times on the forum but before the feature request existed.

You're right - the Unity isn't necessary for the end user

I did some stuff with Unity where servo positions are being send to ARC...but this is just personal use, no idea about all the licencing stuff!! :)

Hello everyone, thank you very much for all your input and helping me understand more on this. Now, I have much better clarity on these aspects and I believe we don't really need a Unity scene to control JD humanoid robot. I have edited the wordings of the feature request now. However, as DJ sure has correctly pointed out, an extended feature that provides a way to control JD with VR goggle and controllers like paddles (e.g., HTC Vive) or VR gloves (e.g., Manus VR) etc. will be really of great help.

Okay - you can still do that now in the meantime using wiimote controllers. See the virtual reality skill referenced a few times in this thread.

you can use what’s available now until the controllers are supported