VRSUN

Hot Virtual Reality News

HOTTEST VR NEWS OF THE DAY

AR News

ZEISS Takes Majority Stake in AR/VR Optics Creator Tooz Technologies

From roadtovr

ZEISS, the German optical systems manufacturer, announced it’s acquired majority share of the joint venture Tooz Technologies, an AR/VR optics creator founded by Zeiss and Deutsche Telekom in 2018.

Zeiss and Deutsche Telekom previously had an even 50% stake in Tooz, which has functioned as a sort of AR optics skunkworks for the companies. Zeiss is now sole owner of the startup.

Zeiss says Tooz will continue to exist independently as it focuses on serial production and visual correction in its imaging systems, further calling Tooz its “AR/VR competence center.”

Image courtesy Tooz Technologies, ZEISS Group

Today, Tooz principally creates smart lenses that integrate curved, reflective waveguides and “invisible” combiners that can also be sandwiched into a vision correction layer.

“In the future, tooz will also equip optical systems from other manufacturers of AR/VR optics with prescription lenses to place products with an integrated prescription on the global markets,” the company say in a press statement.

“tooz covers specific competencies and technologies for design, engineering and manufacturing processes, which complement the existing capabilities at ZEISS quite well,” says Gerrit Schulte, Head of Zeiss Ventures. “tooz will benefit in particular from production and process know-how and the significant experience in the approval of medical optics, and is slated to be better positioned on the international market in the future.”

While Zeiss isn’t a household name is VR or AR headsets, the Oberkochen, Germany-based company has produced a number of head-mounted devices in the past, including its Zeiss VR One Plus created in the vein of Samsung Gear VR and Carl Zeiss Cinemizer multimedia glasses. Zeiss also creates aftermarket VR prescription lenses, sold through VR Optician.

Xiaomi Unveils Wireless AR Glasses Prototype, Powered by Same Chipset as Meta Quest Pro

From roadtovr

Chinese tech giant Xiaomi today showed off a prototype AR headset at Mobile World Congress (MWC) that wirelessly connects to the user’s smartphone, making for what the company calls its “first wireless AR glasses to utilize distributed computing.”

Called Xiaomi Wireless AR Glass Discovery Edition, the device is built upon the same Qualcomm Snapdragon XR2 Gen 1 chipset as Meta’s recently released Quest Pro VR standalone.

While specs are still thin on the ground, the company did offer some info on headline features. For now, Xiaomi is couching it as a “concept technology achievement,” so it may be a while until we see a full spec sheet.

Packing two microOLED displays, the company is boasting “retina-level” resolution, saying its AR glasses pack in 58 pixels per degree (PPD). For reference, Meta Quest Pro has a PPD of 22, while enterprise headset Varjo XR-3 cites a PPD of 70.

The company hasn’t announced the headset’s field of view (FOV), however it says its free-form light-guiding prisms “minimizes light loss and produces clear and bright images with a to-eye brightness of up to 1200nit.”

Electrochromic lenses are also said to adapt the final image to different lighting conditions, even including a full ‘blackout mode’ that ostensibly allows it to work as a VR headset as well.

Image courtesy Xiaomi

As for input, Xiaomi Wireless AR Glass includes onboard hand-tracking in addition to smartphone-based touch controls. Xiaomi says its optical hand-tracking is designed to let users to do things like select and open apps, swipe through pages, and exit apps.

As a prototype, there’s no pricing or availability on the table, however Xiaomi says the lightweight glasses (at 126g) will be available in a titanium-colored design with support for three sizes of nosepieces. An attachable glasses clip will also be available for near-sighted users.

In an exclusive hands-on, XDA Developers surmised it felt near production-ready, however one of the issues noted during a seemingly bump-free demo was battery life; the headset had to be charged in the middle of the 30-minute demo. Xiaomi apparently is incorporating a self-developed silicon-oxygen anode battery that is supposedly smaller than a typical lithium-ion battery. While there’s an onboard Snapdragon XR 2 Gen 1 chipset, XDA Developers also notes it doesn’t offer any storage, making a compatible smartphone requisite to playing AR content.

This isn’t the company’s first stab at XR tech; last summer Xiaomi showed off a pair of consumer smartglasses, called Mijia Glasses Camera, that featured a single heads-up display. Xiaomi’s Wireless AR Glass is however much closer in function to the concept it teased in late 2021, albeit with chunkier free-form light-guiding prisms than the more advanced-looking waveguides teased two years ago.

Xiaomi is actively working closely with chipmaker Qualcomm to ensure compatibility with Snapdragon Spaces-ready smartphones, which include Xiaomi 13 and OnePlus 11 5G. Possible other future contributions from Lenovo and Motorola, which have also announced their intentions to support Snapdragon Spaces.

Qualcomm announced Snapdragon Spaces in late 2021, a software tool kit which focuses on performance and low power devices which allows developers to create head-worn AR experiences from the ground-up, or add head-worn AR to existing smartphone apps.

US Congress Halts Orders of Microsoft AR Combat Goggles Amid Reports of Headaches & Eyestrain

From roadtovr

In 2021, Microsoft won a United States Army defense contract worth up to $22 billion which would support the development of an Integrated Visual Augmentation System (IVAS), a tactical AR headset for soldiers based on HoloLens 2. Now Congress has rejected the Army’s request for $400 million to buy as many as 6,900 more of the AR combat goggles this year, a Bloomberg report maintains.

The rejection cites rocky tests conducted last year. Testing was done over a three-week period ending June 18th, where the Army assessed Microsoft’s IVAS with a cadre of 70 Army infantry soldiers, who were tasked with using the device during three 72-hour combat scenarios.

Complaints included “mission-affecting physical impairments,” with more than 80 percent of soldiers experiencing headaches, eyestrain and nausea after less than three hours using the goggles.

None of this comes as a giant surprise though, as Microsoft was reportedly bracing for negative field tests back in early 2022 due to alleged quality problems.

Softening the blow somewhat, lawmakers have earmarked $40 million to develop a new IVAS model, Army spokesman David Patterson said in an email obtained by Bloomberg.

This comes only a few weeks after the Army awarded a $125 million “task order” for the development of a new model, dubbed version 1.2, which is said to include software improvements for better reliability and reduced power demand.

The 1.2 version task order is said to provide “improvements based on completed test events” which aim at a developing a “lower profile Heads-Up Display with distributed counterweight for improved user interface and comfort.”

In the meantime, the Army will be using its first batch of 5,000 goggles for training—only a small fraction of the max 121,000 devices, spares and support services stipulated in the $22 billion deal.

Magic Leap 2 Gains Certification so Doctors Can Use AR During Surgery

From roadtovr

Magic Leap, the storied unicorn developing enterprise AR headsets, announced at CES 2023 that its flagship device Magic Leap 2 earned a certification that clears it for use in the operating room.

The company first intimated it had pursued IEC 60601-1 certification at SPIE’s XR conference in January 2022, however the news largely went unreported since the information was presented in a single slide at the conference.

At AMD’s CES 2023 keynote, Magic Leap CEO Peggy Johnson confirmed Magic Leap 2 has indeed obtained IEC 60601-1 certification for its flagship AR headset.

As explained by TÜV Rheinland, the IEC 60601-1 certification specifies a device that is “intended to diagnose, treat, or monitor a patient under medical supervision and, which makes physical or electrical contact with the patient and/or transfers energy to or from the patient and/or detects such an energy transfer to or from the patient.”

Magic Leap says this certification allows Magic Leap 2 to be used both in an operating room as well as in other clinical settings, allowing medical professionals such as surgeons to focus on the patient and not have to refer to 2D screens.

By and large, this gives software developers a non-inconsequential inroad into gaining FDA certification for apps that could be used during surgery, and not just for pre-surgical training.

One such Magic Leap partner, SentiAR, is currently under review by the FDA for its app which connects physicians to live clinical data and images, allowing them do operations such as navigating a catheter through blood vessels of the heart using a 3D map of a patient’s heart and the location of the catheter in real time.

Founded in 2010, the Plantation, Florida-based company initially exited the gate with consumer ambitions for its first AR headset, Magic Leap 1 (previously styled ‘One’). After awkwardly straddling the segment with its $2,300 AR headset, the company made a decisive pivot in mid-2020 when CEO and co-founder Rony Abovitz announced he would be stepping down as CEO, positioning the company to reprioritize its future devices away from consumers. It has since released Magic Leap 2, which is largely targeted at enterprise.

The well-funded company, which has amassed $4 billion in lifetime funds to date, has recently taken on $450 million from Saudi Arabia’s sovereign wealth fund, giving the country a majority share in the US-based augmented reality company.

Meta Acquires 3D Lens Printing Firm Luxexcel to Bolster Future AR Glasses

From roadtovr

Meta has acquired the Belgian-Dutch company Luxexcel, a 3D printing firm creating complex glass lenses for use in AR optics.

As first reported by Belgian newspaper De Tijd (Dutch), the Turnhout, Belgium-based company was quietly acquired by Facebook parent Meta in an ostensible bid to bolster the development of its in-development AR glasses.

Details of the acquisition are still under wraps, however confirmation by Meta was obtained by English language publication The Brussels Times.

“We are delighted that the Luxexcel team has joined Meta. This extends the partnership between the two companies,” Meta says.

Founded in 2009, Luxexcel first focused on 3D printing lenses for automotive, industrial optics, and the aerospace industry. Over the years Luxexcel shifted to using its 3D printing tech to create prescription lenses for the eyewear market.

In 2020, the company made its first entry into the smart eyewear market by combining 3D printed prescription lenses with the integration of technology. One year later, Luxexcel partnered with UK-based waveguide company WaveOptics, which has since been acquired by Snapchat parent Snap.

Meta’s interest in Luxexcel undoubtedly stems from its ability to print complex optics for both smart glasses and AR headsets; Meta’s Project Aria is rumored to house Luxexcel-built lenses. Project Aria is a sensor-rich pair of glasses which the company created to train its AR perception systems, as well as asses public perception of the technology.

Qualcomm Reveals Snapdragon AR2 Processor for Glasses-sized AR Devices

From roadtovr

Qualcomm today announced Snapdragon AR2, its “purpose-built headworn augmented reality platform.” Differentiating from the company’s existing Snapdragon XR2 chips, Qualcomm says the AR2 architecture is better suited for creating AR glasses with low power consumption and compact form factors.

Today during Qualcomm’s Snapdragon Summit event, the company revealed the Snapdragon AR2 platform which consists of a trio of chips which the company says will help make truly glasses-sized AR devices possible.

Qualcomm was early to the standalone VR space and has been dominant with its Snapdragon XR2 chips which have found their way into many of the leading standalone headsets on the market, and are now in more than 60 devices total, the company says.

Aiming to take a similar bite out of the forthcoming AR glasses segment, Qualcomm has created a new Snapdragon AR2 platform with a distributed processing design. The platform consists of three chips:

  • AR processor (for sensor perception and video output)
  • AR co-processor (for sensor fusion and dedicated computer vision tasks)
  • Wi-Fi 7 chip (for communication to a host processing device)

By creating a more distributed workload across a main processor and a co-processor, Qualcomm claims AR2 is up to 50% more power efficient while offering 2.5 times better AI performance, and a more compact form-factor, compared to the single-chip Snapdragon XR2 solution.

Not only will the AR processor and co-processor help share a workload, Qualcomm also sees AR2 devices using the speedy Wi-Fi 7 chip to communicate with a host device like a smartphone or wireless compute puck that will do the heavy lifting like application processing and rendering. Qualcomm claims the Wi-Fi 7 chip (FastConnect 7800) can achieve 5.8 Gbps bandwidth with just 2ms of latency.

Using this three-chip framework for distributed processing, Qualcomm claims it will be possible to build compact AR glasses that consume less than one watt of power.

The AR2 platform supports up to nine concurrent cameras for a bevy of head-tracking, environment-sensing, and user-tracking tasks.

“We built Snapdragon AR2 to address the unique challenges of headworn AR and provide industry leading processing, AI and connectivity that can fit inside a stylish form factor,” said Hugo Swart, vice president of XR product management at Qualcomm. “With the technical and physical requirements for VR/MR and AR diverging, Snapdragon AR2 represents another metaverse-defining platform in our XR portfolio to help our OEM partners revolutionize AR glasses.”

There’s no word yet on when the first AR2 devices will hit the market, but Qualcomm lists a handful of partners actively working with the platform: Lenovo, LG, Niantic, Nreal, Oppo, Pico, Qonoq, Rokid, Sharp, TCL, Vuzix, and Xiaomi.

Google to Publicly Test AR Prototypes Starting in August

From roadtovr

Google announced that the company will be conducting real world tests of its early AR prototypes starting next month.

The company says in a blog post that it plans to to test AR prototypes in the real world as a way to “better understand how these devices can help people in their everyday lives.”

Some of the key areas Google is emphasizing are things like real-time translation and AR turn-by-turn navigation.

“We’ll begin small-scale testing in public settings with AR prototypes worn by a few dozen Googlers and select trusted testers,” the company says. “These prototypes will include in-lens displays, microphones and cameras — but they’ll have strict limitations on what they can do. For example, our AR prototypes don’t support photography and videography, though image data will be used to enable experiences like translating the menu in front of you or showing you directions to a nearby coffee shop.”

Critically, Google says the research prototypes look like “normal glasses.” This was no doubt partially informed by their rocky experience with Google Glass starting in 2013 which spawned the neologism ‘glasshole’ due to the device’s relative high visibility and supposed privacy concerns of wearing a camera. Glass is still around, albeit only for enterprise users.

Google says it wants to take it slow with its AR glasses though and include a “strong focus on ensuring the privacy of the testers and those around them.” Although the units will clearly pack camera sensors to do its job, Google says after translating text or doing turn-by-turn directions, the image data will be deleted unless it will be used for analysis and debugging.

“In that case, the image data is first scrubbed for sensitive content, including faces and license plates. Then it is stored on a secure server, with limited access by a small number of Googlers for analysis and debugging. After 30 days, it is deleted,” the company says in a FAQ on the program.

Testers will also be prohibited from testing in public places such as schools, government buildings, healthcare locations, places of worship, social service locations, areas meant for children (e.g., schools and playgrounds), emergency response locations, rallies or protests, and other similar places. For navigation, testers are also banned from using AR prototypes while driving, operating heavy machinery, and engaging in sports.

Google’s inclusion of displays in its public prototypes is a step beyond Meta’s Project Aria, which started on-campus testing of AR prototypes in 2020 that notably included everything you’d expect from AR glasses but the displays. We’re waiting to hear more about Meta’s Project Nazare however, which are said to be “true augmented reality glasses.”

As for Apple, well, there’s only rumors out there for now on specifications and target launch dates for the company’s MR headset and follow-up AR glasses. It’s clear however we’re inching ever closer to a future where the biggest names in established tech will directly compete to become leading forces in what many have hailed as a class of device which will eventually replace your smartphone.

Apple Quietly Released One of The Most Impressive AR Room-mapping Tools

From roadtovr

Apple has barely mentioned augmented or virtual reality in its big keynotes lately, however at WWDC 2022 earlier this month, the company quietly released probably one of the best 3D room-mapping tools for mobile AR yet.

Called RoomPlan, the ARKit Swift API uses the camera and LiDAR scanner on recent iPhones and iPads to create a 3D floor plan of a room, including key characteristics such as dimensions and types of furniture.

It’s not for consumers (yet) though. Apple says it’s aiming to appeal to professionals like architecture and interior designers for conceptual exploration and planning, as well as developers of real estate, e-commerce, or hospitality apps; developers can integrate RoomPlan directly into their AR-capable apps.

When it was released earlier this month, Jonathan Stephens, Chief Evangelist at spatial computing company EveryPoint, took RoomPlan for a test drive to see what it could do. The results are pretty surprising.

RoomPlan seems to be able to deal with a number of traditionally difficult situations, including the mirror seen above, but also messy spaces, open and closed doors, windows, and generally complex architecture. Still, Stephens’ house isn’t just a bunch of cube-shaped rooms, so there’s a few bits that just didn’t match up.

Vaulted ceilings, wall openings, multifloor areas like you might find in foyers were all a bit too difficult for RoomPlan to correctly digest. Although not perfect, it seems to at least autocorrect to some degree based on some assumptions of how things might best fit together.

RoomPlan isn’t just for app integrations though. Apple says it outputs in USD or USDZ file formats which include dimensions of each component recognized in the room, such as walls or cabinets, as well as the type of furniture detected.

If you’re looking to finetune the scan, dimensions and placement of each individual components can be adjusted when exported into various USDZ-compatible tools, such as Cinema 4D, Shapr3D, or AutoCAD, Apple says.

We’re still no closer to learning when the company plans to release its rumored mixed reality headset or its full-fledged AR glasses, however either AR or MR headset would need extremely robust space-mapping capabilities. Seeing Apple make these sorts of strides using its existent platforms certainly shows they’re on the right track.

If you haven’t been following along with the Apple rumor mill, check out some of the links below regarding the company’s mixed reality headset, codenamed N301:

What We (think we) Know About N301 Mixed Reality Headset

A special thanks to Hrafn Thorisson for pointing us to the news!

HoloLens Chief Alex Kipman to Leave Microsoft Amid Misconduct Allegations

From roadtovr

Alex Kipman is leaving Microsoft amid what an Insider report alleges to have stemmed from misconduct allegations leveled at the HoloLens co-creator.

The report maintains that Microsoft Cloud head Scott Guthrie is planning a reorganization of the departments, as Kipman is set to leave the company in the next two months as a part of transition process.

According to an email obtained by Insider, the company’s mixed reality hardware teams will join the Windows and Devices organization, which will be led by Panos Panay, whilst MR software teams will join the Experiences and Devices division under Jeff Teper.

The report details alleged actions by Kipman, including inappropriate behavior such as  “unwanted touching” of women employees and an instance wherein Kipman viewed an adult VR video in front of other employees.

“Managers warned employees not to leave women alone around Kipman,” the report maintains, according to three affected sources.

Insider says “[m]ore than 25 employees shared their experiences as part of a report that was compiled about Kipman.”

Military version of HoloLens (IVAS) | Image courtesy Microsoft

A former colleague told Insider that the pandemic was “[t]he best thing that happened, sadly,” as no one on the team had to interact with him personally.

Kipman hasn’t responded to any of these allegations. Microsoft also declined to confirm or deny the specific allegations against Kipman, however the company says it’s investigating every report and “for every claim found substantiated there is clear action taken.”

This follows a Business Insider report from earlier this year that cast doubt on a prospective HoloLens 3 amid an internal division that may have hobbled the company’s efforts to release its next AR headset as planned.

That earlier report maintained that progress on fulfilling its $22 billion US defense contract, which aims to put HoloLens in battlefield roles over the next 10 years, has been stymied by internal production issues.

An alleged internal rift stemming from competing designs, one of which would completely reposition HoloLens as a consumer AR device, were citied as reasons for the lack of progress on release of the next-gen device.