TVE VR Project

During 2020, some funding was put into the team to experiment and test the use of VR and MR with the typhoon simulator. The idea of having a more lightweight simulator, still using the facsimile cockpit, but without the very large, delicate and expensive projection systems is very appealing to some customers who have deployability needs as the target of their training.

Using Unity as the main interaction point between the VR hardware and the simulator, we were able to render the sim visuals in Genesis and pick them back up as a texture in Unity to then be tracked and displayed into the VR hardware.

Once the initial leg work of getting the visuals working with the 4k and 8k headsets was done, I got the chance to take some time to work with the more advanced features of these headsets. Since we needed to be able to see the cockpit during MR operation, I experimented with different passthrough and occlusion methods to get the best results. I found that I was able to use the knowledge I have from my degree and also knowledge I have picked up over the year from my hobbies. Knowing about filming techniques came in handy when discussing proper green screen usage. Knowing about cameras and optics aided in my understanding and explanation of lighting environments and how certain conditions will effect the overall image.

Unfortunately, I cannot go into any more detail on this project and it has not had any media coverage yet so if there are any specific questions you have, you can ask them and I may be able to answer.

Platform: Windows

Languages/Technology: Unity, C#, Genesis, XTAL, Varjo