VRSUN

VRSun

Microsoft

Microsoft Files Patent To Bring Real-World Objects To VR

From vrscout.com

The proposed system would bring physical environment awareness to VR by creating virtual representations of real-world objects.

According to a patent filed to the United States Patent & Trademark Office, Microsoft has been working on a computer system that automatically converts physical objects into digital models viewable in VR.

The patent, entitled “Transitioning into a VR environment and warning HMD users of real-world physical obstacles,” details a system capable of generating virtual representations of real-world objects that come within a certain range of the head-mounted display (HMD). According to the documentation, a proximity detection system would be used to identify physical objects before warning the user in VR by creating a relevant digital model layered over the aforementioned object.

Image Credit: United States Patent & Trademark Office

“Optimizations are provided for facilitating an improved transition between a real-world environment and a virtual reality environment,” states the patent. “Initially, use of a HMD is detected and one or more real-world physical objects within a threshold proximity to the HMD are identified. Subsequently, a replicated environment, which includes virtual representations of the real-world physical object(s), is obtained and rendered in a virtual reality display. The replicated environment is transitioned out of view and a VR environment is subsequently rendered in the virtual reality display. In some instances, rendering of virtual representations of real-world physical objects into the VR environment occurs is response to detected triggering event.”

In theory, this could be a game-changer for VR users dealing with limited free space. Whether it be a small apartment or a cluttered bedroom, any location could become a virtual playing field made unique by its surrounding objects.

Image Credit: Microsoft

Facebook has already begun implementing its own form of physical object detection on Oculus Quest headsets. Recent updates have included new features such as desk and couch detection, allowing users to mark the real-world locations of said objects and generate virtual representations which can be viewed while in VR.

The system described in Microsoft’s patent sounds as though it could take the technology even further with an automatic object-detection system that improves not only the players’ safety but their level of immersion as well.

For more information check out the patent here.

Feature Image Credit: Microsoft

Microsoft Patent Suggests Live Detection & Rendering of Real Objects in VR

From vrfocus.com

No matter what virtual reality (VR) system you use they’ve all got some sort of barrier/guardian system which you can set up to stop you from walking into walls or furniture. Oculus’ even goes so far as to point out potential obstacles in the setup process. But none of this helps when it comes to real-world variables, like the cat walking in and trying to trip you up. A newly published patent issued to Microsoft aims to solve this dilemma.

Microsoft Patent

This week saw the United States Patent and Trademark Office publish Microsoft’s patent titled Transitioning into a VR environment and warning HMD users of real-world physical obstacles. Unlike a lot of patents VRFocus sees – like the recent Sony Shadow banning one – Microsoft’s is fairly recent, only submitted just over a year ago.

The Microsoft patent aims to solve two problems, where users transition when putting on a VR headset from the real to the virtual, and the aforementioned hazard issue. When it comes to the first task Microsoft suggests rather than using passthrough cameras which it says can be disorienting, instead, users will see a simplified replication of their own environment, helping them adjust by viewing something familiar; just digitally. Some sort of triggering event would then take them into the main experience. Whilst that might be useful when showcasing VR to complete newbies at an event, VRFocus isn’t too sure how many people would need this at home.

Real-world object tracking, on the other hand, is far more interesting. Microsoft proposes using a headset’s sensors to track real-world objects and actually bring them into VR as a virtual representation if you get too close. As the images highlight, that could mean a stationary object like a sofa appearing into view or even something moving like another person or a pet. The system could take into account a user’s velocity and orientation in relation to the object. So guardian systems would be active, rather than a passive wall.

Microsoft Patent

However, this does open up the issue of immersion loss, as a real-world object suddenly being placed in your virtual one would be distracting – or maybe that’s the point. So one minute you could be deeply engrossed in a Half-Life: Alyx session, fighting off headcrabs left and right then suddenly the pet pooch appears in the corridor wondering what the hell you’re doing.

Could this be a useful feature VR gamers would want? You’ll have to wait and see if Microsoft implements it into its Windows Mixed Reality (WMR) headsets as the patent is very much VR-oriented. For further updates keep reading VRFocus.