Mark Zuckerberg shared updates on Meta’s leading work in AI, Wearables

HIGHLIGHTS INCLUDE:

• Orion: True AR glasses have finally arrived. We believe Orion is the most advanced pair of AR glasses ever made and the result of breakthrough inventions in virtually every field of modern computing. It combines the look and feel of a regular pair of glasses with the immersive capabilities of augmented reality. At approximately 70 degrees, Orion has the largest field of view in the smallest AR glasses form factor. This unlocks immersive use-cases for people to experience in glasses for the first time, like large multi-tasking windows, holograms of lifesize people and immersive big-screen entertainment. Orion’s input system seamlessly combines voice, eye gaze, and hand tracking with an EMG wristband that lets you swipe, click, and scroll, allowing you to stay present in the world and with the people around you.
  • As a product prototype, we’re now expanding access to Orion for Meta employees and select external audiences so our development team can learn, iterate and build towards our consumer AR glasses product line, which we plan to begin shipping in the near future.
  • Read more about Orion here.

• Meta Quest 3S, Horizon OS Updates, & More: The Meta Quest 3 family is growing with the introduction of Meta Quest 3S, a headset with the same high-resolution full-color mixed reality capabilities and fast performance as Quest 3 but starting at just $299.99 USD (128GB). Quest 3S pre-orders are available starting today, September 25, and it hits shelves October 15.
  • Discover the world of mixed reality with Quest 3S, our entry-level headset. Perfect for families, newcomers to mixed reality, and Quest or Quest 2 owners ready for a more affordable upgrade.
  • The upcoming Batman: Arkham Shadow comes bundled with the purchase of any Quest 3 family device, including the 128GB Quest 3S, 256GB Quest 3S ($399.99 USD), or the 512GB Quest 3 (at a new lower price of $499.99 USD).
  • Read more about the launch of Quest 3S and the continually-improving Quest 3 platform here.
• Meta AI/Llama Updates: Over 400 million people are already using Meta AI with 185 million people using it across our products each week. With the updated Meta AI, users can now talk to Meta AI using Messenger, Facebook, WhatsApp, and Instagram, and Meta AI will talk back to you! Iconic voices like Awkwafina, Dame Judi Dench, John Cena, Keegan Michael Key, and Kristen Bell can be selected as your AI voice of choice to answer you any time you ask Meta AI something.
  • Meta AI: Meta AI can now see and speak with features that help it better understand the world around you and get you answers faster.
  • It now has a voice on WhatsApp, Instagram, Facebook, and Messenger so you can do less typing and more talking if that’s your preference. As voice rolls out in the US, Canada, Australia, and New Zealand over the next month, talk to Meta AI and it will talk back – get advice, hear a story or talk through something.
  • Forthose based in the US, Meta AI can also see. As we roll this out, Meta AI will be able to reply to your photos you share in chat, tell you more about what’s in them, or even edit them. Say you took a photo of a cool bird on a hike but don’t know what it is – ask your assistant. Meta AI can edit this photo for you, too, like remove an object, add a hat or a necklace to the bird, or change the background to outer space. There are lots of options!
  • We’re testing lots of new Meta AI features that make our product experiences on Instagram, Facebook, and Messenger more fun and useful.
  • We’reexperimenting with automatic video dubbing and lip syncing on Reels as a way for you to see more of the content out there in your preferred language. And as a creator, this feature will let you reach more people around the world and connect with your followers in a more meaningful way through more engaging content.
  • We’restarting to test content imagined for you by Meta AI that will appear in your Facebook and Instagram Feeds. You can tap a post to take that content in a new direction or swipe to see more content imagined for you in real time. Some of the images will be based on your interests, so you can dive deep into what you care about. And others may feature you, so you can be the star of your own story and share your favorites with friends.
  • Introducing Llama 3.2: Meta also released the new open-source Llama 3.2 models, our first major vision models (11B & 90B) which means it understands both images and text.
    • We’re also releasing smaller (1B and 3B), more efficient models that can run on edge and mobile devices. These models are enabled on day one for Qualcomm and MediaTek hardware and optimized for ARM processors.
    • We’re sharing the first official Llama Stack Distributions, which will greatly simplify the way developers work with Llama models in different environments – single-node, on-prem, cloud, and on-device – allowing turnkey deployment of retrieval-augmented generation (RAG) and tooling-enabled applications with integrated safety.
    • We’ve been working closely with partners like AWS, Databricks, Dell, Fireworks, Infosys, and Together AI to build Llama Stack Distributions for their downstream enterprise clients. On-device distribution is via PyTorch ExecuTorch, and single-node distribution is via Ollama.
    • We’re making Llama 3.2 models available for download on llama.com and Hugging Face, as well as available for immediate development on our broad ecosystem of partner platforms, including AMD, AWS, Databricks, Dell, Google Cloud, Groq, IBM, Intel, Microsoft Azure, NVIDIA, Oracle Cloud, Snowflake, and more.
    • Read more about Meta’s AI product updates here, Llama 3.2 here and AI responsibility here.
    • Businessss AIs:
    • We’re expanding regionally in English to our businesses using click-to-messaging ads on WhatsApp and Messenger, so they can quickly stand up an AI that can talk to their customers, provide support, and facilitate commerce.
  • • Meta continues to see strong adoption of our generative AI ad creative tools, with more than 1 million advertisers using the tools and more than 15 million ads created with the tools last month. Many advertisers are seeing strong results heading into the holiday season. On average, ad campaigns using Meta’s generative AI ad features resulted in an 11% higher click-through-rate and 7.6% higher conversion rate compared to campaigns that didn’t use the features.

• Ray-Ban Meta Updates: Our Ray-Ban Meta glasses keep getting better with AI improvements that will roll out in updates over the next few months, including:
  • Reminders which let you ask Meta AI to remember or remind you of things you see – like when you’re running low on your favorite cereal.
  • The ability to scan QR codes or phone numbers from the glasses.
  • We’re adding video to Meta AI so, when asked to do so, the glasses will be able to see what you see in-real time. Meta AI will be able to help you more naturally, in real-time as you’re doing things like exploring a city or preparing a meal. [*coming later this year]
  • Live language translation to allow people to communicate effortlessly between English and French, Italian or Spanish, to start. [*coming later this year]
  • Integrations with Spotify, Amazon Music, Audible, and iHeart so people can enjoy more of their content, all the time
  • A new range of Transitions® lenses from EssilorLuxottica.
  • Read more about Ray-Ban Meta updates here.