AR Headset

Microsoft to Supply US Army More AR Combat Headsets Following Positive Field Test

September 19, 2023 From roadtovr

Microsoft’s HoloLens-based headset built on contract for the US Army has passed an important round of field testing by soldiers. The company is now set to fulfill a larger order to be used in more rigorous testing slated to take place in 2025.

Awarded in 2019, Microsoft’s $22 billion defense contract is aiming to supply the US Army with a tactical AR headset for soldiers based on HoloLens 2 technology, or what’s called an Integrated Visual Augmentation System (IVAS),

According to Bloomberg, 20 prototype versions of the newer 1.2 IVAS headsets were field tested by two squads of solders in late August specifically to check for improvements in reliability, low-light performance and ergonomics. It was reported in early 2022 that Microsoft was bracing for negative field testing, citing concerns with low-light performance and nausea.

Taking place at Fort Drum, New York, those tests “demonstrated improvements in reliability, low light sensor performance, and form factor,” a US Army spokesperson told Bloomberg, saying further that “soldier feedback was positive.”

The Army awarded Microsoft another contract on September 5th for the 1.2 IVAS to see if the company could scale production. Its $22 billion contract indicates an upper target, and not the full amount granted to Microsoft at present.

Report: Meta in Talks with Magic Leap for Multiyear AR Headset Tech Deal

May 22, 2023 From roadtovr

A report from the Financial Times maintains Meta is currently in talks with AR headset creator Magic Leap to strike a multiyear deal, which could include intellectual property licensing and contract manufacturing of AR headsets in North America.

The AR unicorn is said to possess valuable IP regarding custom components, including its optics, waveguides, and software.

It’s said a potential deal may also allow Meta to lessen its reliance on China for component manufacturing. In 2019, Magic Leap partnered with manufacturing solutions company Jabil to create a Guadalajara, Mexico plant which the report maintains can assemble headsets in “the tens of thousands a year.”

Citing people with knowledge of the talks, the report maintains however a specific joint Meta-Magic Leap headset isn’t expected.

While both companies didn’t comment on a potential partnership, Magic Leap said this to the Financial Times:

“Given the complexities of developing true augmented reality technologies and the intricacies involved with manufacturing these optics, as well as the issues many companies experience with overseas supply chain dependencies, we have entered into several non-exclusive IP licensing and manufacturing partnerships with companies looking to enter the AR market or expand their current position.”

Since it exited stealth in 2014, Magic Leap has released two AR headsets, Magic Leap 1 and Magic Leap 2, which have been compared in functionality to Microsoft’s HoloLens AR headsets.

The company has raised over $4 billion, with minority investors including Google, Alibaba, Qualcomm, AT&T, and Axel Springer. Its majority stakeholder is Saudi Arabia’s state-owned sovereign wealth fund.

In addition to Quest Pro mixed reality headset, Meta has confirmed it’s currently working on its next iteration of Quest, likely Quest 3, as well as its own AR glasses. Meta started real-world testing of Project Aria in 2020, a platform for training its AR perception systems and asses public perception of the technology.

Xiaomi Unveils Wireless AR Glasses Prototype, Powered by Same Chipset as Meta Quest Pro

February 27, 2023 From roadtovr

Chinese tech giant Xiaomi today showed off a prototype AR headset at Mobile World Congress (MWC) that wirelessly connects to the user’s smartphone, making for what the company calls its “first wireless AR glasses to utilize distributed computing.”

Called Xiaomi Wireless AR Glass Discovery Edition, the device is built upon the same Qualcomm Snapdragon XR2 Gen 1 chipset as Meta’s recently released Quest Pro VR standalone.

While specs are still thin on the ground, the company did offer some info on headline features. For now, Xiaomi is couching it as a “concept technology achievement,” so it may be a while until we see a full spec sheet.

Packing two microOLED displays, the company is boasting “retina-level” resolution, saying its AR glasses pack in 58 pixels per degree (PPD). For reference, Meta Quest Pro has a PPD of 22, while enterprise headset Varjo XR-3 cites a PPD of 70.

The company hasn’t announced the headset’s field of view (FOV), however it says its free-form light-guiding prisms “minimizes light loss and produces clear and bright images with a to-eye brightness of up to 1200nit.”

Electrochromic lenses are also said to adapt the final image to different lighting conditions, even including a full ‘blackout mode’ that ostensibly allows it to work as a VR headset as well.

As for input, Xiaomi Wireless AR Glass includes onboard hand-tracking in addition to smartphone-based touch controls. Xiaomi says its optical hand-tracking is designed to let users to do things like select and open apps, swipe through pages, and exit apps.

As a prototype, there’s no pricing or availability on the table, however Xiaomi says the lightweight glasses (at 126g) will be available in a titanium-colored design with support for three sizes of nosepieces. An attachable glasses clip will also be available for near-sighted users.

In an exclusive hands-on, XDA Developers surmised it felt near production-ready, however one of the issues noted during a seemingly bump-free demo was battery life; the headset had to be charged in the middle of the 30-minute demo. Xiaomi apparently is incorporating a self-developed silicon-oxygen anode battery that is supposedly smaller than a typical lithium-ion battery. While there’s an onboard Snapdragon XR 2 Gen 1 chipset, XDA Developers also notes it doesn’t offer any storage, making a compatible smartphone requisite to playing AR content.

This isn’t the company’s first stab at XR tech; last summer Xiaomi showed off a pair of consumer smartglasses, called Mijia Glasses Camera, that featured a single heads-up display. Xiaomi’s Wireless AR Glass is however much closer in function to the concept it teased in late 2021, albeit with chunkier free-form light-guiding prisms than the more advanced-looking waveguides teased two years ago.

Xiaomi is actively working closely with chipmaker Qualcomm to ensure compatibility with Snapdragon Spaces-ready smartphones, which include Xiaomi 13 and OnePlus 11 5G. Possible other future contributions from Lenovo and Motorola, which have also announced their intentions to support Snapdragon Spaces.

Qualcomm announced Snapdragon Spaces in late 2021, a software tool kit which focuses on performance and low power devices which allows developers to create head-worn AR experiences from the ground-up, or add head-worn AR to existing smartphone apps.

Qualcomm Partners with 7 Major Telecoms to Advance Smartphone-tethered AR Glasses

February 27, 2023 From roadtovr

Qualcomm announced at Mobile World Congress (MWC) today it’s partnering with seven global telecommunication companies in preparation for the next generation of AR glasses which are set to work directly with the user’s smartphone.

Partners include CMCC, Deutsche Telekom, KDDI Corporation, NTT QONOQ, T-Mobile, Telefonica, and Vodafone, which are said to currently be working with Qualcomm on new XR devices, experiences, and developer initiatives, including Qualcomm’s Snapdragon Spaces XR developer platform.

Qualcomm and Japan’s KDDI Corporation also announced a multi-year collaboration which it says will focus on the expansion of XR use cases and creation of a developer program in Japan.

Meanwhile, Qualcomm says OEMs are designing “a new wave of devices for operators and beyond” such as the newly unveiled Xiaomi Wireless AR Glass Discovery Edition, OPPO’s new Mixed Reality device and OnePlus 11 5G smartphone.

At least in Xiaomi’s case, its Wireless AR Glass headset streams data from compatible smartphones. Effectively offloading computation to the smartphone, the company’s 126g headset boasts a wireless latency of as low as 3ms between the smartphone device to the glasses, and a wireless connection with full link latency as low as 50ms which is comparable to wired solution.

US Congress Halts Orders of Microsoft AR Combat Goggles Amid Reports of Headaches & Eyestrain

January 13, 2023 From roadtovr

In 2021, Microsoft won a United States Army defense contract worth up to $22 billion which would support the development of an Integrated Visual Augmentation System (IVAS), a tactical AR headset for soldiers based on HoloLens 2. Now Congress has rejected the Army’s request for $400 million to buy as many as 6,900 more of the AR combat goggles this year, a Bloomberg report maintains.

The rejection cites rocky tests conducted last year. Testing was done over a three-week period ending June 18th, where the Army assessed Microsoft’s IVAS with a cadre of 70 Army infantry soldiers, who were tasked with using the device during three 72-hour combat scenarios.

Complaints included “mission-affecting physical impairments,” with more than 80 percent of soldiers experiencing headaches, eyestrain and nausea after less than three hours using the goggles.

None of this comes as a giant surprise though, as Microsoft was reportedly bracing for negative field tests back in early 2022 due to alleged quality problems.

Softening the blow somewhat, lawmakers have earmarked $40 million to develop a new IVAS model, Army spokesman David Patterson said in an email obtained by Bloomberg.

This comes only a few weeks after the Army awarded a $125 million “task order” for the development of a new model, dubbed version 1.2, which is said to include software improvements for better reliability and reduced power demand.

The 1.2 version task order is said to provide “improvements based on completed test events” which aim at a developing a “lower profile Heads-Up Display with distributed counterweight for improved user interface and comfort.”

In the meantime, the Army will be using its first batch of 5,000 goggles for training—only a small fraction of the max 121,000 devices, spares and support services stipulated in the $22 billion deal.

Report: Apple’s MR Headset Said to Include 120-Degree FOV, Waist-mounted Battery & Tons of Biometric Trackers

January 4, 2023 From roadtovr

Apple’s long-awaited mixed reality headset is still deep under wraps, although a recent report from The Information has shed what appears to be new light on some of the features coming to the fruit company’s first AR/VR headset.

There’s a lot of new information here, and of course, we can’t substantiate it even if we tried. We’ve restructured the main takeaways, courtesy of MacRumors, into a sort of fantasy spec sheet:

Reported Apple MR Specs

Resolution: Dual Micro OLED displays at 4K resolution (per eye)
FOV: 120-degrees, similar to Valve Index
Chipset: Two 5nm chips. Includes a main SoC (CPU, GPU, and memory) and a dedicated image signal processor (ISP). Chips communicate via a custom streaming codec to combat latency.
Battery: Waist-mounted battery, connected via MagSafe-like power cable to the headset’s headband. Two-hour max battery life, although hotswappable for longer sessions.
Passthrough: ISP chip contains custom high-bandwidth memory made by SK Hynix, providing low latency color passthrough
Audio: H2 chip, providing ultra-low latency connection with the second-generation AirPods Pro and future AirPods models. No 3.5mm and possible no support for non-AirPod BT headphones.
Controller: Apple is said to favor hand-tracking and voice recognition to control the headset, but it has tested a “wand” and a “finger thimble” as alternative control input methods.
Prescription Lenses: Magnetically attachable custom prescription lenses for glasses-wearers.
IPD Adjustment: Automatic, motorized adjustment to match the wearer’s interpupillary distance.
Eye Tracking: At least one camera per-eye for things like avatar presence and foveated rendering
Face & Body Tracking: More than a dozen cameras and sensors capture both facial expressions and body movements, including the user’s legs.
Room Tracking: Both short- and long-range LiDAR scanners to map surfaces and distances in three dimensions.
App Compatibility: Said to have the ability to run existing iOS apps in 2D.

Then there are some design rumors, which don’t fit so well into our fantasy spec sheet. The Information says it has reconfirmed these previously reported rumors.

Design Rumors

Outer Shell: Aluminum, glass, and carbon fiber to reduce its size and weight. Cameras are largely concealed for aesthetic reasons.
Presence Displays: Outward-facing display can show user’s facial expressions and also presumably eye movements. Said to be an always-on display similar in latency and power draw of Apple Watch or iPhone 14 Pro.
Dedicated Passthrough Switch: Digital Crown-like dial on its right side to switch between VR and passthrough.
Headstrap: Various available, including consumer-focused headstrap similar in material to Apple Watch sport bands with built-in speakers. Unspecified, but different headstrap targeted at developers.

Apple supplier Pegatron is said to have already assembled “thousands of prototype units of the headset” over the course of 2022 at its Shanghai-based facility.

According to four people with knowledge of the matter, The Information reports that Apple could price its MR headset around $3,000 or more depending on its configuration.

The report maintains the headset was initially supposed to launch in 2022, although by now it’s clear it’s obviously been delayed. A previous Bloomberg report alleged this was due to “overheating, cameras and software” having been stumbling blocks along the way to launch.

Qualcomm Reveals Snapdragon AR2 Processor for Glasses-sized AR Devices

November 16, 2022 From roadtovr

Qualcomm today announced Snapdragon AR2, its “purpose-built headworn augmented reality platform.” Differentiating from the company’s existing Snapdragon XR2 chips, Qualcomm says the AR2 architecture is better suited for creating AR glasses with low power consumption and compact form factors.

Today during Qualcomm’s Snapdragon Summit event, the company revealed the Snapdragon AR2 platform which consists of a trio of chips which the company says will help make truly glasses-sized AR devices possible.

Qualcomm was early to the standalone VR space and has been dominant with its Snapdragon XR2 chips which have found their way into many of the leading standalone headsets on the market, and are now in more than 60 devices total, the company says.

Aiming to take a similar bite out of the forthcoming AR glasses segment, Qualcomm has created a new Snapdragon AR2 platform with a distributed processing design. The platform consists of three chips:

AR processor (for sensor perception and video output)
AR co-processor (for sensor fusion and dedicated computer vision tasks)
Wi-Fi 7 chip (for communication to a host processing device)

By creating a more distributed workload across a main processor and a co-processor, Qualcomm claims AR2 is up to 50% more power efficient while offering 2.5 times better AI performance, and a more compact form-factor, compared to the single-chip Snapdragon XR2 solution.

Not only will the AR processor and co-processor help share a workload, Qualcomm also sees AR2 devices using the speedy Wi-Fi 7 chip to communicate with a host device like a smartphone or wireless compute puck that will do the heavy lifting like application processing and rendering. Qualcomm claims the Wi-Fi 7 chip (FastConnect 7800) can achieve 5.8 Gbps bandwidth with just 2ms of latency.

Using this three-chip framework for distributed processing, Qualcomm claims it will be possible to build compact AR glasses that consume less than one watt of power.

The AR2 platform supports up to nine concurrent cameras for a bevy of head-tracking, environment-sensing, and user-tracking tasks.

“We built Snapdragon AR2 to address the unique challenges of headworn AR and provide industry leading processing, AI and connectivity that can fit inside a stylish form factor,” said Hugo Swart, vice president of XR product management at Qualcomm. “With the technical and physical requirements for VR/MR and AR diverging, Snapdragon AR2 represents another metaverse-defining platform in our XR portfolio to help our OEM partners revolutionize AR glasses.”

There’s no word yet on when the first AR2 devices will hit the market, but Qualcomm lists a handful of partners actively working with the platform: Lenovo, LG, Niantic, Nreal, Oppo, Pico, Qonoq, Rokid, Sharp, TCL, Vuzix, and Xiaomi.

Quest Pro Revealed with Snapdragon XR2+, Face-tracking, & More; Ships October 25th for $1,500

October 11, 2022 From roadtovr

Today during Meta Connect the company finally revealed its high-end Quest Pro headset (formerly called Project Cambria). Priced at $1,500, the headset packs a new Snapdragon XR2+ processor along with a bevy of sensors for tracking the user’s expressions and the world around them for improved passthrough AR capabilities. Alongside new and improved controllers, the company also revealed the full Quest Pro specs, pre-order date, and release date.

Key Quest Pro Coverage:

Quest Pro Hands-on – The Dawn of the Mixed Reality Headset Era

Quest Pro Technical Analysis – What’s Promising & What’s Not

Touch Pro Controllers Revealed – Also Compatible with Quest 2

Quest Pro was just announced and is already available for pre-order starting today in 22 countries. Priced at $1,500 and with a release date of October 25th, Quest Pro is fully compatible with Quest 2 content while bringing improvements that will enhance passthrough AR functionality and social interactions thanks to face-tracking capabilities. Let’s take a look at the on-paper specs:

Quest Pro Specs
Resolution	1800 × 1920 (3.5MP) per-eye, LCD (2x)
Refresh Rate	72Hz, 90Hz
Lenses	Pancake non-Fresnel
Field-of-view (claimed)	106ºH × 96ºV
Optical Adjustments	Continuous IPD, contiguous eye-relief
IPD Adjustment Range	55–75mm
Processor	Snapdragon XR2+
RAM	12GB
Storage	256GB
Connectors	USB-C
Weight	722g
Battery Life	1–2 hours
Headset Tracking	Inside-out (no external beacons)
Controller Tracking	Inside-out (headset line-of-sight not needed)
Expression Tracking	Yes (eyes, face)
On-board cameras	5x external, 5x internal
Input	Touch Pro controllers (rechargeable), hand-tracking, voice
Audio	In-headstrap speakers, dual 3.5mm aux output
Microphone	Yes
Pass-through view	Yes (color)
MSRP	$1,500

Compact Optics & Form-factor

From a resolution and field-of-view standpoint, Quest Pro is actually quite similar to Quest 2, boasting an almost identical resolution of 1800 × 1920 (3.5MP) per-eye, but with a much more compact optical pipeline thanks to the use of ‘pancake’ lenses which moves the headset more toward a ‘goggle’-like form-factor than the old box-on-the-face of its predecessor. At 722g, Quest Pro is heavier than Quest 2, but may actually be more comfortable thanks to a rear-mounted battery for balance and a rigid headstrap.

And while the resolution isn’t higher, Meta claims Quest Pro has better clarity thanks to the headset’s new optics: a 25% improvement in sharpness at the center of the field-of-view, and a 50% improvement across the periphery (meaning larger ‘sweet-spot’ of clarity). As of now we’re not sure if those claims are merely about the lenses, or if they include the display as well, though we’ve reached out to Meta for clarity (pun intended).

Meta also claims Quest Pro includes a 500-element local dimming backlight which enables improved contrast up to 75% compared to Quest 2, while also allowing for a 1.3 times larger range of color.

New Controllers & Capabilities

Quest Pro’s controllers, which Meta is calling Touch Pro, are similar in shape but majorly upgraded under the hood. Gone are the tracking rings, which are instead replaced by three cameras which allow the controller to perform its own inside-out tracking. Not only does this make the Touch Pro controllers more compact, it also means they don’t need line-of-sight to the headset in order to maintain their position.

What’s more, the Touch Pro controllers feature improved haptics and new capabilities. The thumb rest of the controller has been angled and now includes a pressure sensor which allows for a natural pinch-like gesture. The controllers come with stylus tips which can be attached to the bottom, allowing you to flip the controller over to use like a bulbous white-board marker. The stylus even has a pressure sensor to determine how hard or soft you’re pushing against a surface.

Despite the new capabilities, the Touch Pro controllers maintain the same button and trigger layout as the Quest 2 controllers for full backwards compatibility with Quest 2 content. Touch Pro controllers are also the first from Meta that are rechargeable.

Though they are included with Quest Pro, the Touch Pro controllers are compatible with Quest 2 and can be purchased as an accessory for $300 starting later this year.

Better Sensing, Inside and Out

Quest Pro doesn’t just bring improved form-factor and controllers, the headset is also equipped with a bevy of sensors for better integrating the real world into the user’s experience, and better integrating the user into the virtual world.

Quest Pro packs five external sensors for passthrough AR capabilities, offering a higher resolution color view with improved depth-detection, making the headset better at understanding the geometry of the room around the user, and allowing it to more convincingly merge the virtual and real world.

The headset also includes five internal sensors for tracking the user’s eyes and face. In addition to using eye-tracking as input (potentially for things like foveated rendering), the sensors track much more information about the user’s face, allowing for significantly more expressive avatars than what’s possible on Quest 2.

Powered Up Processor

Given all the new and processing happening on Quest Pro, it’s a good thing the headset also sees both a processor and RAM upgrade. Quest Pro uses the newly revealed Snapdragon XR2+, an upgraded version of the processor that’s in Quest 2 but with better cooling, allowing for 50% more processing power. The headset also doubles the RAM over Quest 2 from 6GB to 12GB. As of now it isn’t clear how much of this increase in performance will be available to developers vs. how much will be retained for system functions like tracking.

More Features, Less Battery

Though Quest Pro includes a heap of enhancements over Quest 2, it comes with a cost… and not just in price. Meta says users can expect 1–2 hours of Quest Pro battery life. Luckily the headset includes a charging dock for both the headset and controllers, hopefully ensuring it’s ready to go whenever you are. Meta says the headset can charge to full from the dock in about 2 hours.

Complement Not Replacement, Says Meta

Meta says Quest Pro represents the company’s first entry in a line of “high-end” headsets, while Quest 2 and its progeny will continue to co-exist as an entry-level option.

Quest Pro is fully compatible with Quest 2 content, and while the headset is designed with an emphasis on passthrough AR (with an open peripheral view to keep users more grounded in their environment), the headset also includes magnetically attachable peripheral blinders to dial up the immersion for VR. A separate ‘full light blocker’, which blocks out even more of the surrounding view is available as a separate accessory.

– – — – –

Quest Pro is priced at $1,500 and pre-orders are available today, with headsets poised to ship starting on October 25th.