Table of Contents
Meta’s AI video model Segment Anything Model 2 AI lets you add special effects to objects in a video
Meta introduced a new AI model – its Segment Anything Model 2 (SAM 2) – that has potential applications for both social media users as well as scientists and researchers
Demo samples show how SAM 2 tracks and isolates video elements
| Photo Credit: Screenshots sourced from Meta and compiled on Canva
Meta has introduced a new AI model called Segment Anything Model 2, or SAM 2, which it says can tell which pixels belong to a certain object in videos.
The Facebook-parent’s previously released Segment Anything Model from last year helped in the development of features in Instagram, such as ‘Backdrop’ and ‘Cutouts.’ SAM 2 is meant for video media, with Meta claiming that SAM 2 could “segment any object in an image or video, and consistently follow it across all frames of a video in real-time.”
Apart from social media and mixed reality use cases, however, Meta explained that its older segmentation model was used in oceanic research as well as disaster relief, apart from cancer screening.
Meta Q2 ad sales expected to rise; focus on AI roadmap, costs
(Unravel the complexities of our digital world on The Interface podcast, where business leaders and scientists share insights that shape tomorrow’s innovation. The Interface is also available on YouTube, Apple Podcasts and Spotify.)
How segmentation works in Meta’s SAM 2
| Photo Credit:
Meta
“SAM 2 could also be used to track a target object in a video to aid in faster annotation of visual data for training computer vision systems, including the ones used in autonomous vehicles. It could also enable creative ways of selecting and interacting with objects in real-time or in live videos,” said Meta in a blog post.
The social media company invited users to try out the model, which is being released under a “permissive” Apache 2.0 license.
Meta CEO Mark Zuckerberg discussed the new model with Nvidia CEO Jensen Huang, hailing its scientific applications, reported TechCrunch.
Read Comments
- Copy link
- Telegram
READ LATER
Remove
SEE ALL
PRINT
Related stories
- Apple used Google’s chips to train new AI models
- Nasscom and Meta partner to launch Open-Source and GenAI in India
- Mistral AI’s new AI model Large 2 is on par with Anthropic’s Claude 3, Meta’s Llama 3 and OpenAI’s GPT-4o
- Meta AI in Hindi, company rolls out ‘Imagine me’ prompt in U.S.
Related Topics
technology (general)
/
internet
/
Artificial Intelligence