Watch Everything Revealed at Meta Connect 2024 video

This is the new meta Quest Three S high quality mixed reality for 299. Hell yeah, I've been waiting for this one for a long time. Um You know, when, when we build Quest Three, we delivered the first high quality mainstream mixed reality experience where you can see the world around you, you can reach out and touch digital things as if they're right there. Um Quest Three is the best mixed reality device that you can buy today and, and I am really proud of it. Quest Three S has the same defining features as Quest Three, high resolution color, mixed reality powered by the same processor, vivid, pass through hand tracking, feels natural touch plus controllers for precision. You get the full range of experiences from Horizon Os gaming, social fitness, watching videos, productivity and more. So whether you're looking to get started with the base Quest Three S or if you want the top of the line Quest three with 512 gigabytes and four K displays, which is now just 499 the Quest Three family. It's not just the best value. It is the best product available. Everything you're gonna see up here is streamed from his headset live. This is what he is seeing. Yeah, it's sharp. All right, Kenny, what do we got? All right. Now, the first thing that you can see is that we have expanded the quality uh the, the, the, the volume of content massively. Yeah. Sorry to the dude next to him live demo artifact. All right. Um You can now run everything from two D mobile apps to remote desktop for PC. Uh to fully immersive experience is all on one device. You can open screens, you can put them anywhere around you. You can have pretty much as many of them running as you want. And we have also rebuilt all of our social apps for mixed reality too. We've got all new Instagram and Facebook experiences to bring your feeds and your reels uh with you into mixed reality, a really nice interface. Uh So you can lean back, enjoy your content on nice big screens. Um So, and there's, there's a bunch more too. Uh We've been working with Microsoft uh to upgrade remote desktop soon. So now you're soon you're gonna be able to easily connect to any windows 11 PC. You just look at the keyboard and um and you and it'll start pairing. So if you want to work on a giant virtual display or a bunch of virtual displays or, you know, if you wanna work on your projects without distractions or with other people you know, this is Quest is gonna be able to be a natural extension of your PC. We're also bringing photorealistic spaces to the metaverse and we call this hyper scape and the way this works is you can use your phone to scan a room and then recreate it or you can step into a room that someone else has scanned and shared. Now, of course, there's gaming. Um So we got some really good ones coming showing off what the Quest Three Family can do. Uh Batman Arkham Shadow up here um exclusively on the Quest Three Family. It's gonna be included in any purchase of a quest three or three s uh that you buy this fall. Lots of great experiences a lot more coming soon. Today, we're making meta A I even smarter uh with our new open source Llama 3.2 models and I'm gonna get into more details about Llama 3.2 in just a minute. But one of the headlines is that uh they're multimodal. Um So now me a I can natively understand images as well as text. Now, we're using this new capability to build some features that, that I, I haven't seen anyone else build. I mean, this is, this is pretty interesting and novel stuff, creative tools that we're adding to imagine, edit it, lets you upload any photo and edit it precisely um with natural language in meta A I across the apps. I think that voice is going to be a way more natural way of interacting with A I than text. And probably I, I think it has the potential to be one of if not the most frequent ways that we all interact with A I. Um, it is just a lot better. So now you're gonna be able to have natural voice conversations with me A I across all the major apps you got, you know, Instagram, whatsapp Messenger, Facebook, hey, are live demos, risky, live demos can be risky. Yes, they can be unpredictable, prone to technical issues and potentially embarrassing. However, they can also be engaging, memorable, but I'm gonna do it anyway. Go for it, just be prepared for anything to happen. So you were one of the first creators to build. One of these creator a is with the text only platform. Um You know, can you can you tell us what it, what it does and, and your experience with it? Yeah. So like for me, I've, I've been treating my creator A I kind of like, like my digital assistant. So, you know, I've trained it on how I respond and how to engage with my audience. And then, yeah, I can like send D MS and share links to relevant resources and then uh what else am I having to do? Oh, yeah, I can just, it guides people through conversation. It was great. Congrats on the new book that you just released, you know, what, what's the main thing that you're hoping that people take away from it? Thank you so much. Yeah, the main thing I want people to take away from my book is the idea that you have the power to create your own opportunities by combining curiosity, adaptability and resilience in a rapidly evolving digital world. We are experimenting with automatic video dubbing on reels uh starting with English and Spanish. Um So this is gonna be a way that you can see more of the content that's out there no matter what language you speak. And as a creator, this is gonna let you reach a lot more people around the world, no matter what language you speak. So now you're gonna be able to take your content and it's going to be in your authentic voice um speaking other languages if you want and we're also doing automatic lip syncing. Um So it actually looks like you were speaking the other language. So let's check this one out, Mile Materna es Espanol, Pero A ta and Puebla Ingles Atras de Lola automatico de uh my native language is Spanish, but check it out. Now, I can also speak English through A I automatic dubbing. So glasses are, they're kind of the perfect form factor for A I, right? For letting an A I assistant see what you see, hear what you hear, be able to communicate you with you privately. Um So it can help you out with whatever you're doing throughout the day. I am about to have a conversation with Brandon Moreno, former UFC flyweight champion of the world where he is speaking Spanish and I am speaking English. All right, Brandon, you wanna come out here and show us this starting live translation from Spanish to English. Hey comas com to Rodil as well. Internal. Hey, how are you? How is your knee back training? Doing well? Knee is, is doing well. It feels strong. I'm ramping up training. Um How are you doing? Are you getting ready for your next fight? Haciendo Vien la Roja Esta Esta Haciendo Vien Ice Fuerte. So today we are dropping a limited edition of clear transparent frames. Um You know, I think this is neat because it's, it's, it's a neat vibe, right? You can see the technology in them, you know, for the first few versions, we spent so much energy designing the glasses to basically hide the technology um to make them look like normal stylish glasses. But now I think people are starting to appreciate what makes them special. And I think having a design that celebrates that um is pretty awesome. This is Orion our first fully functioning prototype. And if I do say so the most advanced glasses the world has ever seen, they're not a headset, no wires less than 100 g. Uh They need wide field of view, holographic displays, sharp enough to pick up details bright enough to see in different lighting conditions, large enough to display a cinema screen or multiple monitors for working wherever you go, whether you're, you're in a coffee shop or on a plane or wherever you are and you need to be able to see through them and people need to be able to see that through them too and make eye contact with you where this isn't passed through. This is the physical world with holograms overlaid on it. It is a completely new kind of display architecture with these tiny projectors and the arms of the glasses that shoot light into wave guides that have, you know, nanoscale 3d structures etched into the lenses so they can drac light and put holograms at different um depths and sizes into the world in front of you. And all of that is directed by custom silicon and sensors that we designed and powered by a battery that fits in the arm of the glasses. It is a absolutely incredible amount of technology to be able to miniaturize and fit into a pair of glasses and a small puck that goes with it to help power the whole thing. They're gonna do voice and A I, they're gonna do hand tracking and eye tracking. So you can select U I elements by looking at them. Voice is great. But the thing is sometimes you're in public and you don't wanna say what you're trying to do with your computer. Out loud. Hand tracking is neat for controlling different interfaces, but you don't wanna like walk down the street like this, right? So I think that you need a device that allows you to, you know, just send a signal from your brain to the device. So this isn't just the first full screen like uh you know, full wide field of view, holographic A R glasses. This is also the first device that is powered by our wrist based neural interface. We do still have a few things that I want us to keep pushing on before we ship this as a consumer product. Uh We're gonna keep tuning the display system to make it sharper. I wanna keep working on the design to make it smaller and a bit more fashionable. Um And we are going to keep making, we need to keep working on the, the uh manufacturing to make it a lot more affordable too. But we have line of sight to all of those things. So we are going to use Orion as a DEV kit. Um We are going to use it mostly internally to build out the software that we, that we need to. But we're also going to work with a handful of partners externally to make sure that we get a diversity of content and, and um you know, just that we can really dial in the software and the experience. So that way we have the next version of this hardware, it is going to be ready to be our first consumer, full holographic AR glasses.