Meta Quest: The Ultimate High-Quality Mixed Reality Experience and Future Innovations

Meta Quest: The Ultimate High-Quality Mixed Reality Experience and Future Innovations

This is the new Meta Quest. It offers high-quality mixed reality for $2.99. Hell yeah! I’ve been waiting for this one for a long time. You know, when we built Quest, we delivered the first high-quality mainstream mixed reality experience where you can see the world around you. You can reach out and touch digital things as if they’re right there. Quest is the best mixed reality device that you can buy today, and I am really proud of it.

Key Features of Quest

Quest has the same defining features as Quest: high-resolution color mixed reality powered by the same processor, vivid passthrough, and hand tracking that feels natural. Touch plus controllers provide precision. You get the full range of experiences from Horizon OS gaming, social, fitness, watching videos, productivity, and more.

So whether you’re looking to get started with the base Quest or if you want the top-of-the-line Quest with 512 GB and 4K displays, which is now just $4.99, the Quest family is not just the best value; it is the best product available. Everything you’re going to see up here is streamed from this headset live. This is what he is seeing. Yeah, it’s sharp.

Expanding Content Quality and Volume

All right, Kenny, what do we got? Now, the first thing that you can see is that we have expanded the quality and the volume of content massively. Sorry to the dude next to him; live demo artifact. All right, you can now run everything from 2D mobile apps to remote desktop for PC, to fully immersive experiences, all on one device. You can open screens and put them anywhere around you. You can have pretty much as many of them running as you want. We have also rebuilt all of our social apps for mixed reality.

We’ve got all-new Instagram and Facebook experiences to bring your feeds and your reels with you into mixed reality. It’s a really nice interface, so you can lean back and enjoy your content on nice big screens. There’s a bunch more, too. We’ve been working with Microsoft to upgrade remote desktop. Soon, you’re going to be able to easily connect to any Windows 11 PC. You just look at the keyboard, and it’ll start pairing. So if you want to work on a giant virtual display or a bunch of virtual displays, or if you want to work on your projects without distractions or with other people, Quest is going to be a natural extension of your PC.

Photorealistic Spaces in the Metaverse

We’re also bringing photorealistic spaces to the metaverse, and we call this hyperscape. The way this works is you can use your phone to scan a room and then recreate it, or you can step into a room that someone else has scanned and shared. Now, of course, there’s gaming. We have some really good ones coming, showing off what the Quest family can do, like Batman: Arkham Shadow, which is exclusively on the Quest family and is included in any purchase of a Quest or Quest S that you buy this fall. Lots of great experiences and a lot more are coming soon.

Enhancements to Meta AI

Today, we are making Meta AI even smarter with our new open-source Llama 3.2 models. I’m going to get into more details about Llama 3.2 in just a minute, but one of the headlines is that they’re multimodal. So now, Meta AI can natively understand images as well as text. We are using this new capability to build some features that I haven’t seen anyone else build. This is pretty interesting and novel stuff. Creative tools that we’re adding to Imagine Edit let you upload any photo and edit it precisely with natural language in Meta AI across the apps.

I think that voice is going to be a way more natural way of interacting with AI than text, and I think it has the potential to be one of, if not the most frequent ways that we all interact with AI. It is just a lot better. Now you’re going to be able to have natural voice conversations with Meta AI across all the major apps like Instagram, WhatsApp, Messenger, and Facebook.

Live Demos and Creator AI

Hey, our live demos can be risky. Yes, they can be unpredictable, prone to technical issues, and potentially embarrassing. However, they can also be engaging and memorable. I’m going to do it anyway. Just be prepared for anything to happen. So you were one of the first creators to build one of these Creator AIs with the text-only platform. Can you tell us what it does and your experience with it?

Yeah, so for me, I’ve been treating my Creator AI kind of like my digital assistant. I’ve trained it on how I respond and how to engage with my audience. It can send DMs, share links to relevant resources, and it guides people through conversation. It’s great. Congrats on the new book that you just released! What’s the main thing that you’re hoping people take away from it?

Thank you so much. The main thing I want people to take away from my book is the idea that you have the power to create your own opportunities by combining curiosity, adaptability, and resilience in a rapidly evolving digital world. We are experimenting with automatic video dubbing on Reels, starting with English and Spanish. This is going to be a way that you can see more of the content that’s out there, no matter what language you speak. As a creator, this will let you reach a lot more people around the world, regardless of language.

Now you’re going to be able to take your content, and it’s going to be in your authentic voice speaking other languages if you want. We’re also doing automatic lip syncing so that it actually looks like you are speaking the other language.

Meta Glasses: Live Translation and AI Integration

My native language is Spanish, but check it out; now I can also speak English through AI automatic dubbing. Glasses are kind of the perfect form factor for AI, right? They let an AI assistant see what you see, hear what you hear, and communicate with you privately. It can help you out with whatever you’re doing throughout the day.

I am about to have a conversation with Brandon Moreno, former UFC flyweight champion of the world, where he is speaking Spanish and I am speaking English. All right, Brandon, do you want to come out here and show us this live translation from Spanish to English?

Hey, how are you? How is your knee? Back training doing well? My knee is doing well. It feels strong; I’m ramping up training. How are you doing? Are you getting ready for your next fight?

New Limited Edition Glasses

Today, we are dropping a limited edition of clear transparent frames. I think this is neat because it has a cool vibe. You can see the technology in them. For the first few versions, we spent so much energy designing the glasses to hide the technology and make them look like normal stylish glasses. But now, I think people are starting to appreciate what makes them special, and having a design that celebrates that is pretty awesome.

Orion Glasses: A Game-Changer in AR Technology

This is our first fully functioning prototype, and if I do say so, the most advanced glasses the world has ever seen. You know, not a headset, no wires, less than 100 grams. They need a wide field of view, holographic displays sharp enough to pick up details, bright enough to see in different lighting conditions, and large enough to display a cinema screen or multiple monitors for working wherever you go, whether you’re in a coffee shop or on a plane.

You need to be able to see through them, and people need to be able to see you through them too and make eye contact. This isn’t passthrough; this is the physical world with holograms overlaid on it. It is a completely new kind of display architecture with these tiny projectors in the arms of the glasses that shoot light into waveguides that have nanoscale 3D structures etched into the lenses. This allows them to diffract light and put holograms at different depths and sizes into the world in front of you. All of that is directed by custom silicon and sensors that we designed, powered by a battery that fits in the arm of the glasses.

It is an absolutely incredible amount of technology to be able to miniaturize and fit into a pair of glasses and a small puck that goes with it to help power the whole thing. They’re going to do voice and AI. They’re going to do hand tracking and eye tracking so that you can select UI elements by looking at them. Voice is great, but sometimes you’re in public and you don’t want to say what you’re trying to do with your computer out loud. Hand tracking is neat for controlling different interfaces, but you don’t want to walk down the street like this, right?

I think that you need a device that allows you to just send a signal from your brain to the device. So this isn’t just the first full-screen, wide-field view holographic AR glasses. This is also the first device that is powered by our wrist-based neural interface. We do still have a few things that I want us to keep pushing on before we ship this as a consumer product. We’re going to keep tuning the display system to make it sharper. I want to keep working on the design to make it smaller and a bit more fashionable. We also need to keep working on manufacturing to make it a lot more affordable.

We have line of sight to all of those things. We are going to use Orion as a dev kit. We are going to use it mostly internally to build out the software that we need, but we’re also going to work with a handful of partners externally to make sure that we get a diversity of content. This way, we can really dial in the software and the experience, so that when we have the next version of this hardware, it is going to be ready to be our first consumer full holographic AR glasses.

 

Leave a Reply

Your email address will not be published. Required fields are marked *