Meta's New Aria 2 AI Glasses Are Incredible

so most smart glasses usually sound cooler than they actually are but meta's new ARA Gen 2 glasses are genuinely a different ball game Let's actually take a look at what Mark Zuckerberg and the amazing people at meta have done and why these glasses are a complete GameChanger so meta's ARA Gen 2 are glasses that apparently feel genuinely different they're not just strapped to your face they've actually got sensors that track your eyes your hands and even your heartbeat and the tech Behind these things is absolutely insane but what's impressive is that researchers are actually using

them to shape the future of AI and Robotics and it feels like we've just jumped ahead 5 years by putting these glasses on so one of the things that actually is really impressive about these glasses is that they're not AI in the traditional sense they are essentially not really like chat gbt or virtual assistant but they're actually a lot better than that they're packed with Advanced sensors and on device AI processing capabilities that gather tons of detailed information from your perspective which is you know what you're seeing what you're hearing and even how you're moving

and the Technologies inside them like slam which is simultaneous localization and mathing you know it's got eye tracking it's or speak recognition all of that happens directly on the glasses themselves with means that you don't need to actually connect to the internet and researchers actually take all of that detailed data and then create AI models or even train AI robots to react and interact with the world more naturally so these glasses are basically like a portable air research lab which gives scientists and developers the tools to experiment with new ideas improve robots and build smarter

AI system with project area we reimagined a wearable device with a sensor Suite that could perceive as you perceive and in doing so enables the development of a new generation of artificial intelligence that is a better understanding of who you are and makes possible new advancements in robotics project Harrier from the outset was designed to begin a re ution around always on human Centric Computing we're excited to announce the next step in our journey the second generation of ARA glasses with Gen 2 glasses we are building AI capabilities with a deeper understanding of the we's

context and the environment ARA Gen 2 is the perfect tool for researchers pushing the boundaries of AI and AR what you see here is the same as this we have upgraded the sensor Suite with additional computer vision camera for announced location and embody tracking we have increased battery capacity by over 40% without a weight increase the device features a contact microphone and special microphones it can distinguish between your voice and those of bystanders are gentu determines your location both indoors and Outdoors Advanced side tracking camera tracks your gaze to understand what you're looking at and

tracks your hand to identify the object you're interact with or while monitoring your heart rate for a comprehensive understanding of your webe we introduce the ability to process a lot of the signals on the device in in real time as soon as you do that you move away from the context of data collection and processing later then we can start to interact with the user not just research what might be possible but actually experience it help me pick up some red onions taking you to red onions red onions are here very important parts of Project

Ara has been building Partnerships with companies and academic research Labs that have reached far beyond our own we stay committed to research processes that safeguard no information the journey with second January glasses is just a beginning imagine what the research Community can achieve with a device that closes the gap between machine and human perception together we can unlock an understanding of what it is to experience reality as we do now one of the things that meta doesn't get enough credit for or simply any company that is operating in the area where they are providing services

to those who are disadvantaged is of course how these glasses are actually going to be used by people who have a certain disability and this company in vision is actually taking the ARA 2 glasses and is actually basically making the glasses so that they can be super useful to someone with blindness we've seen early you know examples of this with be my eyes with chat gbt but this demonstration where we actually get to see one of the major positive use cases for AI this is something that I found super super impressive especially since the way

how the censers and all those things were working together were able to essentially help this woman be able to walk through a store and essentially have a real sense of space this isn't the first time companies have done this I've also s seen another company called Lumen that did something pretty similar to this but this is something that I think is so important for the AI industry because while CS chat gbt and other things are interesting this is where largely value creation comes for the everyday average person you know it's one of those things that

you don't know what you got till it's gone and that was kind of the case with my vision when I lost it at 31 the challenges that we face you know just simply with visual navigation you lose a level of independence with that for a lot of people who have blind and have a low vision Independence almost always meant access to information Arya enables us to combine Technologies like artificial intelligence and spatial audio that make the visual World accessible for people who are blind or have a low vision it was amazing to see how a

lot of our feedback was incorporated in building a to device and also by keeping accessibility as one of the focus points this this is a truly collaborative effort between Envision Lighthouse San Francisco and meta we really want to go out and co-design with the community and try to learn from their experience they actually want to try out these Technologies they're really excited Sharon has been testing these features giving us early feedbacks GPS just doesn't work indoors we need a different mapping and navigation technology usually when you listen to sounds over headphones they'll sound like they're

inside your head spatial audio is a technology that lets you play sounds over headphones that seem like they're coming from a real location out in the world and all you have to do is follow that side you put the glasses on and you just talk to it like you talk to a friend hey meta help me pick up some apples certainly follow the sound to locate the apples in the store it'll start playing a beacon sound from the location within the store the glasses can actually mat as they are being used we can allocate different

points and label it with items that should be there in that space apples are here you can ask any kind of a question what apples are here they have Granny Smith Cosmic crisp and honey crisp apples I'll get Granny Smith apples help me pick up red onions taking you to red onions red onions are here is this a red onion yes this is a red onion in your hand just to have the freedom to walk into a grocery store and navigate to what I wanted it was efficient it was fast it was just amazing that's

all I need today take me to the checkout counter sure guiding you to the checkout this isn't ready to ship out the door this second but what's exciting is for how many people this appears to be working really well without these Partners we would have not been able to do what we did today thank you have a great day when we look at someone like Sharon pick the groceries that she wants on her own that emotion is incredible now if you're a fan of meta you'll probably want to know about their recent glasses update they've

actually updated the Rayban ones actually do have a pair and they are super useful so you may want to take a look at how they've actually embedded AI into those ones and the reason I'm talking about this is because this is something you can actually purchase the ARA generation 2 aren't available for consumers just yet but these ones currently are hey meta play some music hey meta look and translate this send a voice message to Laura on WhatsApp hey Dad what you doing just taking on you just hurry back when you can are you guys

cooking say hi to Mom hey y'all guess where we're at Festival oh look who is here you look amazing hey meta take a video nice hey meta how many tablespoons are in a cup hey meta look can tell me what kind of butterfly that is okay yes sir my [Music] turn now it wouldn't be fair not to mention meta's other glasses the Orion glasses and these ones aren't like the others they are actually Advanced AR glasses that were unveiled at meta connect 2024 so these ones are super interesting because they're a different platform but I

do think that they'll probably become mainstream once they're released and they do have a prize Target SL relase date for 2027 which is two years from now but I do think the AR is pretty hard to get right especially in such a thin pair of glasses about a decade ago I uh you I started putting together a team of the best people in the world to uh to build these glasses and the the requirements are actually pretty simple but the technical challenges to make them are insane um you know they they need to be glasses

you know not a headset no wires less than 100 Gams uh they need wide field of view holographic displays sharp enough to pick up details bright enough to see in different lighting conditions large enough to display a cinema screen or multiple monitors for working wherever you go whether you're you in a coffee shop or on a plane or wherever you are and you need to be able to see through them and people need to be able to see them through them too and make eye contact with you right this isn't pass through this is the

physical world with holograms overlaid on it so if someone messages you uh you will see that and instead of having to pull out your phone there will just be a little hologram and with a few subtle gestures you can reply with without getting pulled away from the moment or if you want to be with someone who is far away um they're going to be able to teleport as a hologram into your living room as if they're right there with you you're going to be able to tap your fingers and bring up a game of cards

or chests or holographic pingpong or whatever it is that you want to do together you can work or play or whatever now for those of you who are wondering about the future of glasses in 2030 take a look at what Nom Shea Google's co-lead on Gemini says by 2030 that there actually will be AI assistants in glasses that provide advice and solve problems for you in real time and I actually think that that probably will be the default form factor as well as like Alexa because having your phone out every single time is just rather

inconvenient and glosses already a staple thing that you already wear it's in 2030 I I think just more is always going to be better like like like if you just kind of think about okay like what fraction of world GDP will be you know uh will people decide to spend on on AI at that point and then like okay what what do the AI systems look like well maybe it's some sort of personal assistant like thing that is in your glasses and can see everything around you and has access to all your digital information and

the world's digital information and like maybe it's like your Jo Biden and you have the earpiece in the cabinet that can advise you about anything in real time um and solve problems for you and give you helpful pointers or you could talk to it and you know it it wants to analyze like anything that it sees around you for any potential useful uh impact that it has on you so I mean I can imagine okay and then then say it's like your okay your personal assistant or your personal cabinet or something and that every time

you spend 2x's much money on compute the thing gets like 5 10 IQ points smart smarter or something like that and okay do you would you rather spend like $10 a day and have an assistant or $20 a day and have a smarter assistant uh you know and not only is it an assistant in life but an assistant in getting your job done better because now it makes you from a 10x engineer to a 100x or 10 so let me know what you guys think about the integration for AI there hopefully you enjoyed this video

and I will see you guys in the next one