Toggle light / dark theme

Meta AI Researchers Upgrade Their Machine Learning-Based Image Segmentation Models For Better Virtual Backgrounds in Video Calls And Metaverse

When video chatting with colleagues, coworkers, or family, many of us have grown accustomed to using virtual backgrounds and background filters. It has been shown to offer more control over the surroundings, allowing fewer distractions, preserving the privacy of those around us, and even liven up our virtual presentations and get-togethers. However, Background filters don’t always work as expected or perform well for everyone.

Image segmentation is a computer vision process of separating the different components of a photo or video. It has been widely used to improve backdrop blurring, virtual backgrounds, and other augmented reality (AR) effects. Despite advanced algorithms, achieving highly accurate person segmentation seems challenging.

The model used for image segmentation tasks must be incredibly consistent and lag-free. Inefficient algorithms may result in bad experiences for the users. For instance, during a video conference, artifacts generated by erroneous segmentation output might easily confuse persons utilizing virtual background programs. More importantly, segmentation problems may result in unwanted exposure to people’s physical environments when applying backdrop effects.

Report: Microsoft HoloLens 3 is dead as its mixed-reality vision implodes

A report by Business Insider says Microsoft has scrapped plans for its own HoloLens 3 and has instead partnered with Samsung—but that no one really knows what’s going on.


Microsoft has reportedly scrapped its third-generation HoloLens, leaving the company’s “metaverse” plans in disarray.

According to a report from Business Insider, Microsoft killed off the HoloLens 3 in 2021, shifting to a planned device with Samsung instead. The problem? According to the publication, the company’s mixed-reality/augmented reality/virtual-reality division isn’t sure what it plans to do. That’s resulted in employees leaving for Meta and other companies instead.

The company told BI that it remains committed to HoloLens and future HoloLens development. It said the same to PCWorld in a statement. “Microsoft HoloLens remains a critical part of our plans for emerging categories like mixed reality and the metaverse,” the company said. “We remain committed to HoloLens and future HoloLens development.”

Ethereum-based AR metaverse ecosystem adopts Polygon to address scaling

Peter Nesswhy is he so eager for Biden’s approval? Doesn’t he have parents?

Eric KlienAdmin.

Peter Ness Biden keeps saying that GM is the U.S. leader in EVs and this ticks off Elon. In fact, the old GM plant in California that Tesla bought for a big $42 million produced more cars than any other U.S. factory last year. (All EVs, of course.)

Genevieve Klien shared a link.


While the second leading cryptocurrency is getting ready for its highly anticipated upgrade, platforms keep moving away to other networks.

Listen to article.

Mixed Reality and AI for Safer Surgeries

Surgeries require a lot of planning, practice, and precision. Doctors cannot afford to get distracted or lose focus when operating on a person. The use of AI in surgery aims to support doctors and supply them with the necessary information and surgical tools without disturbing them at any point.

Mixed reality makes it possible to use technology to assist doctors during surgeries and minimize risks.

Paul Milgram and Fumio Kishino first introduced the term mixed reality in 1994 in their paper titled A Taxonomy of Mixed Reality Visual Displays. MR combines computer vision, cloud computing, graphical processing, etc., to blend the physical and virtual worlds. Many companies have been developing MR applications that can be used in various industries.

Meta says its new AI supercomputer will be the world’s fastest

Has the first phase of a new AI. Once the AI Research SuperCluster (RSC) is fully built out later this year, the company believes it will be the fastest AI supercomputer on the planet, capable of “performing at nearly 5 exaflops of mixed precision compute.”

The company says RSC will help researchers develop better AI models that can learn from trillions of examples. Among other things, the models will be able to build better augmented reality tools and “seamlessly analyze text, images and video together,” according to Meta. Much of this work is in service of its vision for the metaverse, in which it says AI-powered apps and products will have a key role.

“We hope RSC will help us build entirely new AI systems that can, for example, power real-time voice translations to large groups of people, each speaking a different language, so they can seamlessly collaborate on a research project or play an AR game together,” technical program manager Kevin Lee and software engineer Shubho Sengupta wrote.

The Metaverse Set Off A Battle Between Tech Giants Google, Apple, Microsoft And Meta To Build Virtual And Augmented Reality Headsets

Google’s AR headsets, internally codenamed Project Iris, are expected to be released in 2024. Its device uses “outward-facing cameras to blend computer graphics with a video feed of the real world, creating a more immersive, mixed reality experience than existing AR glasses.” The hardware is “powered by a custom Google processor, like its newest Google Pixel smartphone, and runs on Android, though recent job listings indicate that a unique OS is in the works.”

Google Glass, the prior foray into AR, didn’t gain widespread consumer interest or adoption. The Verge says that the work on the project began to pick up speed recently. As of now, there isn’t a “clearly defined go-to-market strategy.” According to the Verge, Google is keeping the project secret, requiring “special keycard access” and “non-disclosure agreements.”

Facebook said it would hire around 10,000 workers around the world to build Meta and related products. A search on LinkedIn’s job board for “metaverse” shows thousands of listings. For people looking for fast-growing opportunities, you may want to look at pivoting into virtual and augmented reality and related opportunities in the metaverse.

The Metaverse Is Money and Crypto Is King—Why You’ll Be on a Blockchain When You’re Virtual-World Hopping

Major brands are also getting into the NFT mix, including Dolce & Gabbana, Coca-Cola, Adidas, and Nike. In the future, when you buy a physical world item from a company, you might also gain ownership of a linked NFT in the metaverse.

For example, when you buy that coveted name-brand outfit to wear to the real-world dance club, you might also become the owner of the crypto version of the outfit that your avatar can wear to the virtual Ariana Grande concert. And just as you could sell the physical outfit secondhand, you could also sell the NFT version for someone else’s avatar to wear.

These are a few of the many ways that metaverse business models will likely overlap with the physical world. Such examples will get more complex as augmented reality technologies increasingly come into play, further merging aspects of the metaverse and physical world. Although the metaverse proper isn’t here yet, technological foundations like blockchain and crypto assets are steadily being developed, setting the stage for a seemingly ubiquitous virtual future that is coming soon to a ‘verse near you.

HoloLens Optics Chief Joins Google Amid Reported Push for Upcoming Google AR Headset

Bernard Kress, principal optical architect on Microsoft’s HoloLens team, has left the company to take on the role of Director of XR Engineering at the recently formed Google Labs. A report by The Verge maintains Google is also now gearing up to produce an AR headset that could directly compete with similar offerings from the likes of Apple and Meta.

Before joining Microsoft in 2015, Kress worked as principal optical architect behind Google Glass, the company’s smartglasses that found marked success in the enterprise sector after a rocky reception by consumers in 2013.

At Microsoft, Kress continued his work—principally focused on micro-optics, wafer scale optics, holography and nanophotonics—as partner optical architect on the HoloLens team, overseeing the release of both HoloLens and HoloLens 2.