We’re open-sourcing Perception Encoder Audiovisual (PE-AV), the technical engine that helps drive SAM Audio’s state-of-the-art audio separation. Built on our Perception Encoder model from earlier this year, PE-AV integrates audio with visual perception, achieving state-of-the-art results across a wide range of audio and video benchmarks. Its native multimodal support can assist people in everyday tasks, including sound detection and richer audio-visual scene understanding. 🔗 Read the paper: https://go.meta.me/e541b6 🔗 Download the code: https://go.meta.me/7fbef0
AI at Meta
Research Services
Menlo Park, California 1,048,285 followers
Together with the AI community, we’re pushing boundaries through open science to create a more connected world.
About us
Through open science and collaboration with the AI community, we are pushing the boundaries of artificial intelligence to create a more connected world. We can’t advance the progress of AI alone, so we actively engage with the AI research and academic communities. Our goal is to advance AI in Infrastructure, Natural Language Processing, Generative AI, Vision, Human-Computer Interaction and many other areas of AI enable the community to build safe and responsible solutions to address some of the world’s greatest challenges.
- Website
-
https://ai.meta.com/
External link for AI at Meta
- Industry
- Research Services
- Company size
- 10,001+ employees
- Headquarters
- Menlo Park, California
- Specialties
- research, engineering, development, software development, artificial intelligence, machine learning, machine intelligence, deep learning, computer vision, engineering, computer vision, speech recognition, and natural language processing
Updates
-
AI at Meta reposted this
🚀 Announcing Meta Seal: Invisible Watermarking for Every Modality 🚀 https://lnkd.in/dWeb7CCs TL;DR: We are open-sourcing Meta Seal - production-ready, Invisible watermarking suite for Image, Video, Audio, Text. SOTA performance, MIT license, full weights & code. We are thrilled to unveil the open-source release of Meta Seal—a comprehensive, production-ready framework for invisible watermarking. Already widely adopted, Meta Seal empowers researchers and developers to build better provenance and attribution tools that can help distinguish between human and AI-generated content across all major modalities: images, video, audio, and text. 🌟 THE SUITE 🌟 📷 1️⃣ PIXEL Seal : Flagship Image & Video Watermarking Uses novel adversarial-only training to achieve SOTA robustness and imperceptibility. 🔗 Code: https://lnkd.in/duzXr7ig 📷 2️⃣ CHUNKY Seal: High-Capacity Image watermarking increasing the hidden message payload to 1024 bits (4x improvement). 🔗 Code: https://lnkd.in/duzXr7ig 3️⃣ DIST Seal: Unified Latent Space Watermarking that Enables a 20x inference speedup + in-model distillation perfect for securing open models at scale. 🔗 Code: https://lnkd.in/dCkeXbMx 🔊 4️⃣ AUDIO Seal: The first model for localized audio watermarking at the sample level with a specialized streaming architecture. 🔗 Code: https://lnkd.in/e_YaRkRi 📝 5️⃣ TEXT Seal: A complete toolkit for post-hoc watermarking and detecting benchmark contamination via "radioactivity." 🔗 Code: https://lnkd.in/dnF9V9US 🙏 Meta Seal is the culmination of a multi-year effort to bridge the gap between fundamental research and scalable, production-ready systems. It has been a privilege to see this come to life through the hard work of this exceptional team: Tom Sander, Tomáš Souček, Tuan Tran, Valeriu Lacatusu, Pierre Fernandez, Alexandre MOURACHKO, Hongyan C., Sylvestre Rebuffi #Watermarking #GenerativeAI #OpenSource #Deepfakes #AISecurity
-
🔉 Introducing SAM Audio, the first unified model that isolates any sound from complex audio mixtures using text, visual, or span prompts. SAM Audio represents a new era in audio separation technology, outperforming previous models across a wide range of benchmarks and tasks. We’re sharing SAM Audio with the community, along with a perception encoder model, benchmarks and research papers, to empower others to explore new forms of expression and build applications that were previously out of reach. 🔗 Learn more: https://go.meta.me/65b5a3
-
AI at Meta reposted this
☀️ We’re heading to #NeurIPS2025 in San Diego ☀️ Visit us at booth #1223 to connect with Meta researchers, engineers, and recruiters. Throughout the conference, our booth will be the hub for thought leadership sessions and live demos. Get hands-on with innovations like Meta Ray-Ban Display and DINO V3, and join our experts for engaging talks. 🗣️ Here’s what’s on the schedule: 🗓️ Tuesday, Dec 2 ◆ The Magic Behind the Lens: Ray-Ban Meta 1 PM & 2 PM | Kaushik Patnaik ◆ Let’s Take it A Click Deeper: DINO 3 PM & 4 PM | Joséphine Raugel 🗓️ Wednesday, Dec 3 ◆ Let’s Take it A Click Deeper: Universal Models for Atoms (UMA) 10 AM & 11 AM | Daniel Levine, Brandon Wood, and Ray G. ◆ Scaling Self-Supervised Models: Insights from Joint Embedding Predictive Architecture (JEPA) 12 PM & 1 PM | Randall Balestriero and Koustuv Sinha ◆Let’s Take it a Click Deeper: SAM 3D Objects & Body 1:30 PM & 2:30 PM | Kevin Liang, Jinkun Cao and Weiyao Wang ◆ Let’s Take it A Click Deeper: Omnilingual ASR 3 PM & 4 PM | Gil Keren 🗓️ Thursday, Dec 4 ◆ AI Career Journeys: Insights from a Meta Research Scientist 10 AM & 11 AM | Ali Reiff, Adderlyn Lora and Jamelle Watson-Daniels ◆ Let’s Take it A Click Deeper: SAM3 12PM & 1 PM | Kate Saenko ◆ Collective Governance for LLMs: The Community Alignment Dataset 2 PM & 3PM | Claudia Shi and Jack Kussman ◆ Let’s Take it a Click Deeper: SAM 3D Objects & Body 3:40 PM & 4:30 PM | Kevin Liang, Jinkun Cao, Weiyao Wang We’re hiring! If you’re passionate about advancing AI and want to help build the future, check out some of our open opportunities and join us in building the future of technology: Full time roles: 👉 Research Scientist, Machine Learning (PhD) https://lnkd.in/gXCq2dAk 👉 Research Engineer, Conversational AI - Reality Labs https://lnkd.in/gD2BuvGx Internships: 👉 Research Scientist Intern PhD, Applied Research https://lnkd.in/gCb3cmuM 👉 Research Scientist Intern, Multimodal Generative AI and Robotics (PhD) https://lnkd.in/gUWrZuCy #MetaCareers #NeurIPS #AIResearch #MachineLearning #MetaAI
-
-
SAM 3D is helping advance the future of rehabilitation. See how researchers at Carnegie Mellon University are using SAM 3D to capture and analyze human movement in clinical settings, opening the doors to personalized, data-driven insights in the recovery process. 🔗 Learn more about SAM 3D: https://go.meta.me/40d7ab
-
SAM 3’s ability to precisely detect and track objects is helping Conservation X Labs measure the survival of animal species around the world and prevent their extinction. 🔗 Learn more about the work: https://lnkd.in/g-mN5NSB We partnered with Conservation X Labs to build the SA-FARI dataset with 10,000+ annotated videos including over 100 species of animals. We’re sharing this dataset to help with conservation efforts around the globe. 🔗 Find it here: https://lnkd.in/eXCjmScP
-
The Segment Anything Playground is a new way to interact with media. Experiment with Meta’s most advanced segmentation models, including SAM 3 + SAM 3D, and discover how these capabilities can transform your creative projects and technical workflows. 🔗 Try it now: https://lnkd.in/gBfFvz3R
-
We’re advancing on-device AI with ExecuTorch, now deployed across devices including Meta Quest 3, Ray-Ban Meta, Oakley Meta Vanguard and Meta Ray-Ban Display. By eliminating conversion steps and supporting pre-deployment validation in PyTorch, ExecuTorch accelerates the path from research to production, ensuring consistent, efficient AI across a diverse hardware ecosystem. Read the full technical deep dive: https://lnkd.in/gjCzabnE
-
-
SAM 3 tackles a challenging problem in vision: unifying a model architecture for detection and tracking. Christoph, a researcher on SAM 3, shares how the team made it possible. 🔗 Read the SAM 3 research paper: https://go.meta.me/6411f7
-
Introducing SAM 3D, the newest addition to the SAM collection, bringing common sense 3D understanding of everyday images. SAM 3D includes two models: 🛋️ SAM 3D Objects for object and scene reconstruction 🧑🤝🧑 SAM 3D Body for human pose and shape estimation Both models achieve state-of-the-art performance transforming static 2D images into vivid, accurate reconstructions. 🔗 Learn more: https://go.meta.me/40d7ab