News

Report: Apple’s Rumored VR Headset Could Feature 3,000 PPI MicroOLED

September 14, 2021 From roadtovr

Apple is hosting what promises to be its big iPhone 13 event today. While we’re once again holding out hope for that ‘one more thing’ to see if the company reveals anything about its upcoming AR or VR wearables, it seems a supply chain rumor contends that Apple’s alleged VR headset may be gearing up to sport a microOLED display with a pretty high pixel density.

Apple has a tight reign on internal leaks, which typically force tech pundits to look at the greater supply chain to get an idea of where the Cupertino tech giant is headed next. That typically also means you’ll have to take whatever pops out of those rumors with a big grain of salt.

Just this year multiple reports have maintained that Apple’s long-rumored VR headset may arrive as early as 2022, cost $3,000, and include limited AR capabilities, something that’s said to act as a precursor to a full-fledged AR device.

Korean publication The Elec is now reporting that Apple has requested a sample of a display component called a fine metal mask (FMM) from the South Korean company APS Holdings, something that’s used for depositing organic RGB material onto OLED displays. The type allegedly requested by Apple is supposed to reach a pixel density of 3,000ppi.

It’s not unusual for micro displays to features pixel densities of that size, so the notable bit here is Apple may be looking to maintain a slim and light profile for its VR headset, which may depart from the high resolution smartphone-size displays used in current consumer VR headsets.

Apple intends on testing the FMM sample, and then forming a more concrete plant for the VR device’s development, The Elec maintains in its report.

Japan’s Dai Nippon Printing is widely considered the number one manufacture of the sort of FMM (Gen 6) reportedly requested by Apple, however these are produced using a process called ‘wet etching’. It’s thought that Apple instead wanted a laser patterning FMM from ABS Holding, as laser drilling the holes “will make 3000ppi more achievable,” The Elec reports.

We’ll be watching the Apple event today and keeping our eyes peeled for AR/VR news. You can follow along live here on YouTube.

Xiaomi Unveils Smart Glasses Vision Featuring MicroLED Waveguides

September 14, 2021 From vrfocus

Xiaomi is one of China’s leading technology companies, previously partnering with Facebook during the Oculus Go era to create the Mi VR Standalone for its home market. Today, the company has teased plans for a future entry into the smart glasses market, a very compact looking device brimming with tech.

Simply called Xiaomi Smart Glasses, the device is being designed as an augmented reality (AR) system that can connect to a smartphone to display key information like calls and messages. Crucially, Xiaomi also notes that the smart glasses won’t just function as a second screen, it’ll have independent functionality to make it a true smart wearable supposedly.

The core component of the (very thin looking) Xiaomi Smart Glasses is its microLED optical waveguide technology, allowing for a compact, monochrome (green) display solution with a peak brightness of 2 million nits. The information displayed won’t be in 3D, however, as the waveguide only features on the right side of the glasses, on the other are components including the camera.

Xiaomi claims the smart glasses “integrates a total of 497 components including miniature sensors and communication modules,” powered by a quad-core ARM processor. Those modules include a touch pad and Wi-Fi/Bluetooth, all weighing in at a respectable 51g. Then there’s the built-in dual beamforming microphone and speaker to take calls. And let’s not forget the 5MP camera that can be used for taking pictures as well as services like translating text.

When it comes to all those software options Xiaomi plans on ensuring the glasses are feature-rich. Apart from getting those basic notifications off your phone, the device can be used for navigation on its own, you can tap the side to take a pic or use the glasses hands-free with the XiaoAi AI Assistant – the company envisions this as the primary interaction method.

Sound too good to be true considering others like Nreal Light and Rokid still have to cable to a smartphone, whilst Facebook’s new Ray-Ban Stories isn’t even AR? While the spec roster of the Xiaomi Smart Glasses is impressive, the announcement is missing crucial details such as the battery life, the actual ARM processor and when the company plans on making it available.

The announcement could be to get the jump on Apple which is holding a press event later today, widely expected to feature an AR component considering some of the PR teasing that’s been going on. When further details have been made available regarding Xiaomi and Apple’s AR plans, VRFocus will let you know.

Horizon Workrooms to Introduce Zoom Meetings in 2022

September 14, 2021 From vrfocus

Several weeks ago Facebook launched its vision for work-based collaboration in virtual reality (VR), Horizon Workrooms. Designed to help colleagues connect remotely, this week it has been revealed that the highly popular video conferencing service Zoom will be integrated into Horizon Workrooms next year.

Horizon Workrooms is currently in open beta for Oculus Quest headsets, allowing anyone to test the new software. With the integration of Zoom, users will be able to join Zoom Meetings and use Zoom Whiteboard directly within VR, to create what could be a seamless experience between the two platforms.

With companies having to switch to remote working during the course of 2020, many have turned to video platforms such as Zoom to stay connected. This has helped Zoom’s popularity soar but has also meant a new term being coined in the process, “Zoom fatigue”. Whereby people find themselves in so many video meetings that it just becomes mentally draining, lacking the fluidity of being together in person. So it’s no surprise that Zoom aims to combat such an issue with initiatives like this with Facebook.

A sneak peek was shown at Zoomtopia this week, Zoom’s annual conference (taking place virtually, of course!). Inside Horizon Workrooms users will be able to dial into those video calls as they normally would, so they can sit around a virtual desk with others in VR whilst talking to even more over Zoom. And with Zoom Whiteboard on hand, brainstorming new ideas shouldn’t be too difficult either as everyone in the meeting can add their input.

Zoom and Facebook haven’t said when they plan to integrate this functionality into Horizon Workrooms during 2022 but the software has plenty of features to keep you busy. There’s the mixed-reality desk and keyboard tracking, which alongside Oculus Quest’s hand tracking means you can see your desk and keyboard to naturally type as you would outside of VR. There’s also remote desktop streaming, spatial audio, and the new Oculus Avatars for that immersive feel.

There are plenty of other ways to collaborate in VR with Horizon Workrooms joining the likes of Spatial, MeetinVR and Arthur to name a few. For continued updates in this field, keep reading VRFocus.

Xiaomi Teases Smart Glasses Concept with MicroLED Display & 5MP Camera

September 14, 2021 From roadtovr

Chinese tech giant Xiaomi unveiled its first pair of smart glasses today, sensibly called Xiaomi Smart Glasses. They aren’t a product you can buy for now, as the company calls the concept device “an engineer’s look into an advanced future.” With the world’s largest smartphone manufacture expressing interest though, it may mean we’ll be hearing a lot more about consumer smart glasses in the years to come.

Hot on the heels of Facebook & Ray-Ban’s Stories camera glasses, Xiaomi released a video showing off its own concept smart eyewear which not only includes a 5MP camera and speakers, but also a microLED display that serves up information such as notifications, turn-by-turn directions, and real-time text and photo translations.

Based around a quad-core ARM processor running Android, Xiaomi Smart Glasses are said to contain a microLED on silicon chip measuring 2.4mm × 2.02mm, something the company says is roughly the size of a grain of rice, with individual pixels sized at 4μm.

For a concept that may or may not be built, Xiaomi doesn’t boast specs like a full RGB display, rather showing one in green monochrome that’s supposed to optimize for brightness—2 million nits, Xiaomi says—serving info to the user’s right eye via waveguide optics.

Xiaomi Smart Glasses house a single 5MP camera for taking photos and doing machine learning tasks like translating text between languages. Like Ray-Ban Stories, an adjacent indicator light is included so others know when its in-use. The whole package is said to weigh in at only 51g, which is about the weight of two alkaline AA batteries.

The company is positioning it as a standalone device that won’t act as a “second screen” for your smartphone. That’s a bit of a stretch for now though since it only has a few functions, such as displaying basic notifications, incoming calls, turn-by-turn navigation, taking photos, and serving up what it claims is “real-time text and photo translations.”

Optical wearables such as smart glasses and AR headsets (learn about the difference here) are still in such an early state that input is far from solved. Xiaomi says its primary input will be handled by XiaoAi AI voice assistant, which can do things like audio-to-text transcription. It’s also said to contain a touchpad, which is ostensibly integrated into one of the glasses’ arms.

It’s uncertain if Xiaomi Smart Glasses are simply a “what if” at this point, or if it’s truly looking to productize the fledgling wearable in the near future. Xiaomi generally seems at home making smaller design risks to better differentiate itself from Samsung and Apple, with things like retracting selfie cameras and edge-to-edge displays making headlines. That said, if Xiaomi is gearing up to enter a market, you can bet they’ll bring their patent one-upmanship to the table in any class of smart device they produce.

Zoom Meetings Heading To VR On Oculus Quest 2 Next Year

September 13, 2021 From vrscout

One of the most popular teleconferencing programs in the world joins Facebook’s new VR co-working platform.

Facebook today announced a partnership with Zoom Video Communications to bring the company’s popular teleconferencing software program to Horizon Workrooms, marking a major milestone for the recently released VR co-working platform.

Image Credit: Zoom Video Communications

Horizon Workrooms launched this past August on Oculus Quest 2 headsets. The platform makes excellent use of the headset’s many unique features to offer a one-of-a-kind VR co-working solution unlike anything currently available on the market.

A combination of remote desktop streaming and hand-tracking technology allows you to access your personal computer and type on your real-world keyboard without having to remove your headset. There’s also a virtual whiteboard, notetaking capabilities, support for video calls, and more.

Beginning next year, Horizon Workrooms will feature support for Zoom Meetings, allowing you to more easily connect with those outside of VR. Zoom Whiteboard integration lets you jot down notes and brainstorm with other users across multiple platforms. Hopefully, we’ll be able to interact with the Zoom Whiteboard by flipping the Touch controller around and using the end as a makeshift stylus, similar to the default Horizon Workrooms whiteboard.

You can learn more about Zoom Meetings on Horizon Workrooms at Zoomtopia, an annual celebration of the platform and its partners and users. The event runs from September 13-14th remotely via Zoom Events.

“The way we work is changing, and we’re excited that Zoom and Workrooms are coming together to help you and your colleagues defy distance to stay connected and productive, across realities,” states the company in an official blog post.

Zoom Meetings will be available on Horizon Workrooms beginning next year. Facebook’s VR coworking platform is available now in open beta.

Feature Image Credit: Zoom Video Communications

Zoom Support Coming to Facebook’s VR Meeting App ‘Workrooms’ Starting Next Year

September 13, 2021 From roadtovr

Facebook’s Horizon Workrooms connects both VR and video chat users together in the same space. Although it’s still in beta, the company says that it’s gearing up to integrate Workrooms with popular video chat platform Zoom.

Starting in 2022, Workrooms users will be able to join Zoom Meetings and use Zoom Whiteboard from within VR, positioning the platform to connect a much broader userbase to users of the VR productivity app.

The company says in an Oculus blogpost that integration with Zoom will let users “dial into any existing Zoom Meeting right from Workrooms in VR,” which means you might have a legitimate reason to hang out in VR during work or school, provided you’re still distance learning or teleworking.

Zoom Whiteboard will also let you sketch out things in VR for all to see. We still need to learn more, however if it integrates seamlessly with Workrooms already robust toolset, it’ll be on a good path to make interacting with Zoom feel like a native VR experience.

Horizon Workrooms already supports up to 16 VR users and 36 video chat users simultaneously. It’s unclear whether Workrooms will allow for a mixed meeting point between Zoom and the app’s 2D video chat users in addition to VR users.

The companies say more information will arrive today at Zoom’s annual Zoomtopia conference. We’ll post an update here once we learn more.

Oculus Quest ‘Space Sense’ Feature Discovered, Provides Play Area Incursion Alert

September 13, 2021 From vrfocus

Before playing any virtual reality (VR) experience at home it’s always advisable to clear the area because once that headset is on you’ll quickly forget how you’re oriented in the room and where stuff is. What you can’t plan for is those moving variables, like kids running in or a curious cat suddenly appearing. Facebook aims to solve that issue with a feature unearthed in the most recent v32 software update, Space Sense.

German Twitter user Basti564 discovered in the firmware a video detailing how the feature works and reference to the ‘Space Sense’ name, which has previously been referred to as Guardian Intrusion Detection. As you can see, it’s all about notifying a VR player as to when a new obstruction comes into the play area. There’s also some text accompanying the video:

“See Your Real-World Surroundings in VR“

“Enable Space Sense to see outlines of people and things in your Room-scale boundary. Staying aware of what’s around you while in VR helps keep you and others safe.

“You can see outlines up to 9 feet away as long as it’s still within your boundary, and directly in front of your headset. You can turn this feature off anytime in Settings.”

Certainly beneficial for anyone playing in a busy home or area where footfall is more likely, the system is, of course, limited to the front tracking area which the cameras cover. So it won’t help if someone walks up behind you but at least you’re less likely to punch them in the face whilst VR boxing.

Now, the files Basti564 found were hidden so this is a feature currently still in the works. However, by the looks of the video and the accompanying text it certainly appears as if Facebook is gearing up for a release, in which case Space Sanse would be a big content addition to a future software update.

The last major enhancement to Oculus Quest’s Guardian system came just over a year ago, ‘Playspace Scan’ detecting objects like tables or chairs still within the boundary. Being able to detect active objects would be a first for any VR system, another boon for the standalone headset.

As further details arise regarding Oculus Quest’s next update, VRFocus will let you know.

Oculus Quest Pro Reference Hidden in Latest Software, Mentions Face & Eye Tracking

September 13, 2021 From roadtovr

Facebook CEO Mark Zuckerberg spoke about the idea of a ‘Quest Pro’ headset back in May, saying that it could include sensors for both face and eye tracking. The v32 firmware release for Oculus Quest last month ostensibly confirms that the company is moving forward with the device, as it contains hidden reference to an “Oculus Quest Pro” headset along with text mentioning both eye and face-tracking.

Reddit user ‘Reggy04’ did some deep-dive sleuthing and has posted a number of strings found within the Quest v32 firmware which not only includes Quest Pro by name, but also notes a few features that would mean a dramatic increase in the number of sensors embedded within the alleged headset.

Sensors are said to improve hand tracking, something that feels a bit like a hit and miss on current-day Quests.

“QUEST PRO ESTIMATES YOUR HAND SIZE AND HOW THEY MOVE SO YOU USE YOUR HANDS INSTEAD OF CONTROLLERS IN VR.””

Eye-tracking sensors, which can be used for a number of tasks like foveated rendering and smarter UI navigation, are also supposedly onboard. This string of text below refers to an eye-tracking setup which, like many such calibration tests, requires you to look and hold your gaze on virtual objects so the system can correctly model your unique eye movement.

“”FOLLOW THE TARGET WITH YOUR GAZE””
“”EYE CALIBRATION FAILED””

“”EYE MOVEMENT ESTIMATION COMPLETE””

Mentions of facial tracking, which is important to social VR interactions, are also found in the v32 firmware. It seems a calibration test is needed here too to get a good bead on how you smile, frown, bare your teeth in anger, and act surprised.

“COPY THE DIFFERENT EXPRESSIONS””

“”SMILE NATURALLY UNTIL THE CALIBRATION IS COMPLETE. YOU MAY NEED TO HOLD THIS POSE FOR A FEW SECONDS.””

“”SHOW AN ANGRY EXPRESSION UNTIL THE CALIBRATION IS COMPLETE. YOU MAY NEED TO HOLD THIS POSE FOR A FEW SECONDS.””

“”FROWN NATURALLY UNTIL THE CALIBRATION IS COMPLETE. YOU MAY NEED TO HOLD THIS POSE FOR A FEW SECONDS.””

“”SHOW A SURPRISED EXPRESSION UNTIL THE CALIBRATION IS COMPLETE. YOU MAY NEED TO HOLD THIS POSE FOR A FEW SECONDS.””

“”FAILED TO CALIBRATE THE EXPRESSION. RETRYING…””

“”FACE MOVEMENT ESTIMATION COMPLETE””

Further in the firmware, Reggy04 also find mention of sliding lenses, which could denote that Quest Pro will include some form of interpupillary distance (IPD) hardware adjustment that, much like the original Oculus Rift, will require you to move the lenses to get a clear picture.

“”SLIDE THE LENSES CLOSER TOGETHER OR FURTHER APART TO IMPROVE VISUAL CLARITY.””

There’s mention of depth adjustment too, which sounds similar to how it’s done in Rift S. Reggy04 notes that the string below was specifically added in v32, so it’s possible it’s also referring to Oculus Quest Pro too.

“”PRESS AND HOLD THE DEPTH BUTTON AND MOVE THE HEADSET CLOSER OR FURTHER AWAY FROM YOUR FACE. THE LENSES SHOULD BE CLOSE TO YOUR EYES, BUT NOT CAUSE DISCOMFORT.””

“”ADJUST LENS DEPTH””

“”TURN THE WHEEL LEFT OR RIGHT TO ADJUST TIGHTNESS. THE FRONT PADDING SHOULD FIT DIRECTLY OVER YOUR FOREHEAD.””

An all-digital version of Facebook Connect, the company’s AR/VR developer conference, is coming October 28th. We’re hoping to learn more then since Connect has been a historic venue for insights into the company’s research.

We’re also hoping to learn more about the company’s Project Aria AR glasses, future plans for its new Ray-Ban Stories camera glasses, and how experimental pass-through AR capabilities are coming on Quest 2.

Oculus Quest ‘Space Sense’ Feature Will Alert You When Someone Invades Your Play Area

September 13, 2021 From roadtovr

Oculus Quest just got its v32 software update last month which brought changes to file syncing, friends lists, and a few other things. Now it’s been discovered that within v32 is a video showing off what could be an upcoming feature to Quest’s roomscale Guardian system, which appears to alert you when someone wanders into your play area.

Guardian, the playspace boundary for Quest, may be getting a facelift and a name change to go along with an upcoming feature, which could arrive in Quest’s upcoming v33 software update.

Called Space Sense, the feature was first discovered by German programmer ‘Basti564’. Mining through hidden v32 files, Basti found a video buried within that shows off Space Sense’s features.

Under the video was also menu text explaining what Space Sense does:

See Your Real-World Surroundings in VR

Enable Space Sense to see outlines of people and things in your Room-scale boundary. Staying aware of what’s around you while in VR helps keep you and others safe.

You can see outlines up to 9 feet away as long as it’s still within your boundary, and directly in front of your headset. You can turn this feature off anytime in Settings.

The implementation isn’t foolproof; someone can always walk up behind you outside of the sensors’ field of view. Considering the number of videos of people getting blasted by Touch controller punches, it’s undoubtedly good news for people with pets, kids, and people unfamiliar with how VR works though.

Space Sense isn’t live yet, however it’s slated to be one of the biggest additions to Quest’s roomscale detection system as of late. Guardian has mostly remained the same since launch of the Quest platform in 2019, save a feature added last year which detects static objects within a playspace such as tables or chairs left in the way during the setup process.

Facebook’s Ray-Ban Smart Glasses Don’t Support AR, And That’s Okay

September 10, 2021 From vrscout

Capture photos and videos, listen to music, and take calls with the new Ray-Ban Stories smart glasses.

Yesterday, Facebook CEO Mark Zuckerberg andLuxottica Chief Wearables Officer Rocco Basilico unveiled Ray-Ban Stories, a new line of stylish smart glasses that allow you to capture and share photos and videos on nearly every major social media platform, including Twitter, Snapchat, TikTok, and—of course—Facebook, Instagram, and WhatsApp.

Not only that, but you can also make hands-free phone calls and listen to your favorite music thanks to a set of high-quality micro-speakers and built-in microphone. All-in-all, Ray-Ban Stories is an impressive piece of hardware that—while not an AR headset—represents a major step in the right direction for immersive technology.

Let’s dive into this exciting piece of hardware, shall we?

Features

Ray-Ban Stories allows you to capture photos as well as 30-second video clips thanks to a pair of built-in 5MP cameras. Using a combination of HDR and low light fusion, video stabilization, and denoising, Facebook and Ray-Ban promise high-quality images and video, enhanced even further by machine-learning technology. The glasses also feature a three-microphone audio array complete with a bass reflex system, offering crisp audio calls and more engaging video.

All of the aforementioned technology is powered by a Snapdragon® processor and controlled using a capacitive touchpad located on the temple—or arm—of the glasses. To help manage your content, Facebook has launched a new app called Facebook View. Available on iOS and Android, the companion experience allows you to import photos and videos from your glasses to your smartphone and edit your content before sharing it with friends and family on your preferred platforms.

Design

Facebook worked closely with Ray-Ban parent companyLuxottica to ensure the glasses featured the signature Ray-Ban look without compromising on technology. That being said, the results are pretty incredible. Excluding the two forward-facing cameras located near the end pieces of the glasses, there are little to no physical differences between Ray-Ban Stories and a regular pair of Ray-Bans. To charge the glasses, you simply place the device in the included charging case.

“We had to re-engineer components so that everything — that’s two cameras, a set of micro-speakers, a three-microphone audio array, an optimized Snapdragon® processor, a capacitive touchpad, a battery, and more — fit into the smallest possible space and the lightest possible frame. The form factor drove a lot of decisions, from speaker architecture to the camera selection,” states Facebook in an official release.

You can choose from three different models at launch, each featuring unique colors, finishes, and materials. The glasses themselves weigh five grams more than the original Ray-Ban Wayfarer glasses.

No AR. And that’s okay.

Ray-Ban Stories is not an AR headset, Facebook and Ray-Ban want to make that perfectly clear. That being said, the device represents a major step forward for wearable technology; a baby step, but a step nonetheless. Facebook has made its commitment to AR technology perfectly clear in the past. In September of 2019, the company announced that its Facebook Reality Lab is currently in development of its own AR headset.

Based on the adoption rates of existing AR/MR headsets, it makes sense Facebook would takes its time lauching its own AR device.The Microsoft HoloLens and Magic Leap One: Creator Edition—while impressive pieces of hardware—have yet to capture the attention of mainstream audiences. Most recently, Snapchat unveiled the latest version of its Snapchat Spectacles, AR smart glasses capable of generating AR visuals. The only problem is the device is only available to select influencers.

By prioritizing design over technology, Facebook improves its chance of attracting mainstream consumers who may be weary of wearables. While not an AR headset per sey, Ray-Ban Stories represents a major step forward for the technology.

Ray-Ban Stories are available now for $299. For more information visit here.

Feature Image Credit: Facebook