Close Menu
Ztoog
    What's Hot
    Gadgets

    Fake AI law firms are sending fake DMCA threats to generate fake SEO gains

    Crypto

    Arthur Hayes Predicts Bitcoin Price To Hit $750,000, Here’s When

    Technology

    Bird loses its NYSE wings, Uber gets tight with taxis and Tesla gets sued again for racial discrimination

    Important Pages:
    • About Us
    • Contact us
    • Privacy Policy
    • Terms & Conditions
    Facebook X (Twitter) Instagram Pinterest
    Facebook X (Twitter) Instagram Pinterest
    Ztoog
    • Home
    • The Future

      Any wall can be turned into a camera to see around corners

      JD Vance and President Trump’s Sons Hype Bitcoin at Las Vegas Conference

      AI may already be shrinking entry-level jobs in tech, new research suggests

      Today’s NYT Strands Hints, Answer and Help for May 26 #449

      LiberNovo Omni: The World’s First Dynamic Ergonomic Chair

    • Technology

      A Replit employee details a critical security flaw in web apps created using AI-powered app builder Lovable that exposes API keys and personal info of app users (Reed Albergotti/Semafor)

      Gemini in Google Drive can now help you skip watching that painfully long Zoom meeting

      Apple iPhone exports from China to the US fall 76% as India output surges

      Today’s NYT Wordle Hints, Answer and Help for May 26, #1437

      5 Skills Kids (and Adults) Need in an AI World – O’Reilly

    • Gadgets

      8 Best Vegan Meal Delivery Services and Kits (2025), Tested and Reviewed

      Google Home is getting deeper Gemini integration and a new widget

      Google Announces AI Ultra Subscription Plan With Premium Features

      Google shows off Android XR-based glasses, announces Warby Parker team-up

      The market’s down, but this OpenAI for the stock market can help you trade up

    • Mobile

      Microsoft is done being subtle – this new tool screams “upgrade now”

      Wallpaper Wednesday: Android wallpapers 2025-05-28

      Google can make smart glasses accessible with Warby Parker, Gentle Monster deals

      vivo T4 Ultra specs leak

      Forget screens: more details emerge on the mysterious Jony Ive + OpenAI device

    • Science

      Analysts Say Trump Trade Wars Would Harm the Entire US Energy Sector, From Oil to Solar

      Do we have free will? Quantum experiments may soon reveal the answer

      Was Planet Nine exiled from the solar system as a baby?

      How farmers can help rescue water-loving birds

      A trip to the farm where loofahs grow on vines

    • AI

      Rationale engineering generates a compact new tool for gene therapy | Ztoog

      The AI Hype Index: College students are hooked on ChatGPT

      Learning how to predict rare kinds of failures | Ztoog

      Anthropic’s new hybrid AI model can work on tasks autonomously for hours at a time

      AI learns how vision and sound are connected, without human intervention | Ztoog

    • Crypto

      GameStop bought $500 million of bitcoin

      CoinW Teams Up with Superteam Europe to Conclude Solana Hackathon and Accelerate Web3 Innovation in Europe

      Ethereum Net Flows Turn Negative As Bulls Push For $3,500

      Bitcoin’s Power Compared To Nuclear Reactor By Brazilian Business Leader

      Senate advances GENIUS Act after cloture vote passes

    Ztoog
    Home » EfficientViT-SAM: A New Family of Accelerated Segment Anything Models
    AI

    EfficientViT-SAM: A New Family of Accelerated Segment Anything Models

    Facebook Twitter Pinterest WhatsApp
    EfficientViT-SAM: A New Family of Accelerated Segment Anything Models
    Share
    Facebook Twitter LinkedIn Pinterest WhatsApp

    The panorama of picture segmentation has been profoundly remodeled by the introduction of the Segment Anything Model (SAM), a paradigm identified for its exceptional zero-shot segmentation functionality. SAM’s deployment throughout a wide selection of functions, from augmented actuality to information annotation, underscores its utility. However, SAM’s computational depth, notably its picture encoder’s demand of 2973 GMACs per picture at inference, has restricted its utility in situations the place time is of the essence.

    The quest to boost SAM’s effectivity with out sacrificing its formidable accuracy has led to the event of fashions like MobileSAM, EdgeSAM, and EfficientSAM. These fashions, whereas lowering computational prices, sadly, skilled drops in efficiency, as depicted in Figure 1. Addressing this problem, the introduction of EfficientViT-SAM makes use of the EfficientViT structure to revamp SAM’s picture encoder. This adaptation preserves the integrity of SAM’s light-weight immediate encoder and masks decoder structure, culminating in two variants: EfficientViT-SAM-L and EfficientViT-SAM-XL. These fashions provide a nuanced trade-off between operational velocity and segmentation accuracy, educated end-to-end utilizing the excellent SA-1B dataset.

    EfficientViT stands on the core of this innovation, a imaginative and prescient transformer mannequin optimized for high-resolution dense prediction duties. Its distinctive multi-scale linear consideration module replaces conventional softmax consideration with ReLU linear consideration, considerably lowering computational complexity from quadratic to linear. This effectivity is achieved with out compromising the mannequin’s skill to globally understand and be taught multi-scale options, a pivotal enhancement detailed within the unique EfficientViT publication.

    The structure of EfficientViT-SAM, notably the EfficientViT-SAM-XL variant, is meticulously structured into 5 levels. Early levels make use of convolution blocks, whereas the latter levels combine EfficientViT modules, culminating in a function fusion course of that feeds into the SAM head, as illustrated in Figure 2. This architectural design ensures a seamless fusion of multi-scale options, enhancing the mannequin’s segmentation functionality.

    The coaching course of of EfficientViT-SAM is as rigorous as it’s modern. Beginning with the distillation of SAM-ViT-H’s picture embeddings into EfficientViT, the mannequin undergoes end-to-end coaching on the SA-1B dataset. This part incorporates a combination of field and level prompts, using a mixture of focal and cube loss to fine-tune the mannequin’s efficiency. The coaching technique, together with the selection of prompts and loss perform, ensures that EfficientViT-SAM not solely learns successfully but in addition adapts to varied segmentation situations.

    EfficientViT-SAM’s excellence is just not merely theoretical; its empirical efficiency, notably in runtime effectivity and zero-shot segmentation, is compelling. The mannequin demonstrates an acceleration of 17 to 69 occasions in comparison with SAM, with a major throughput benefit regardless of having extra parameters than different acceleration efforts, as proven in Table 1.

    The zero-shot segmentation functionality of EfficientViT-SAM is evaluated by meticulous checks on COCO and LVIS datasets, using each single-point and box-prompted occasion segmentation. The mannequin’s efficiency, as detailed in Tables 2 and 4, showcases its superior segmentation accuracy, notably when using further level prompts or floor reality bounding containers.

    Moreover, the segmentation within the Wild benchmark additional validates EfficientViT-SAM’s robustness in zero-shot segmentation throughout various datasets, with efficiency outcomes encapsulated in Table 3. The qualitative outcomes, depicted in Figure 3, spotlight EfficientViT-SAM’s adeptness at segmenting objects of various sizes, affirming its versatility and superior segmentation functionality.

    In conclusion, EfficientViT-SAM efficiently merges the velocity of EfficientViT into the SAM structure, leading to a considerable effectivity acquire with out sacrificing efficiency. This opens up prospects for wider-reaching functions of highly effective segmentation fashions, even in resource-constrained situations. To facilitate and encourage additional analysis and growth, pre-trained EfficientViT-SAM fashions have been made open-source.


    Check out the Paper. All credit score for this analysis goes to the researchers of this mission. Also, don’t neglect to comply with us on Twitter and Google News. Join our 37k+ ML SubReddit, 41k+ Facebook Community, Discord Channel, and LinkedIn Group.

    If you want our work, you’ll love our e-newsletter..

    Don’t Forget to hitch our Telegram Channel


    Vineet Kumar is a consulting intern at MarktechPost. He is at present pursuing his BS from the Indian Institute of Technology(IIT), Kanpur. He is a Machine Learning fanatic. He is keen about analysis and the newest developments in Deep Learning, Computer Vision, and associated fields.


    🚀 LLMWare Launches SLIMs: Small Specialized Function-Calling Models for Multi-Step Automation [Check out all the models]

    Share. Facebook Twitter Pinterest LinkedIn WhatsApp

    Related Posts

    AI

    Rationale engineering generates a compact new tool for gene therapy | Ztoog

    AI

    The AI Hype Index: College students are hooked on ChatGPT

    AI

    Learning how to predict rare kinds of failures | Ztoog

    AI

    Anthropic’s new hybrid AI model can work on tasks autonomously for hours at a time

    AI

    AI learns how vision and sound are connected, without human intervention | Ztoog

    AI

    How AI is introducing errors into courtrooms

    AI

    With AI, researchers predict the location of virtually any protein within a human cell | Ztoog

    AI

    Google DeepMind’s new AI agent cracks real-world problems better than humans can

    Leave A Reply Cancel Reply

    Follow Us
    • Facebook
    • Twitter
    • Pinterest
    • Instagram
    Top Posts
    Crypto

    Who Accepts Bitcoin as Payment?

    Over the course of its existence, Bitcoin has steadily risen to turn into the unequalled…

    Crypto

    Ethereum Bloodbath Incoming? Celsius’ $125 Million Move Threatens ETH Price

    The Ethereum value may be doing properly post-spot Bitcoin ETF launch, however latest strikes by…

    Crypto

    Quant Explains How These Indicators Affect Ethereum Price

    A quant has defined how the indications like taker purchase/promote ratio and Coinbase premium index…

    Gadgets

    The best binoculars in 2023

    We could earn income from the merchandise obtainable on this web page and take part…

    Mobile

    New leak reiterates Google Pixel 8 Pro specs

    If Google sticks to its standard schedule, and thus far we have seen no indication…

    Our Picks
    AI

    Researchers from the University of Washington Developed a Deep Learning Method for Protein Sequence Design that Explicitly Models the Full Non-Protein Atomic Context

    Technology

    Stellar Blade – Release date, trailers, editions, platforms, and everything we know

    Technology

    Machine Learning Turns Up COVID Surprise

    Categories
    • AI (1,493)
    • Crypto (1,753)
    • Gadgets (1,804)
    • Mobile (1,850)
    • Science (1,866)
    • Technology (1,802)
    • The Future (1,648)
    Most Popular
    Technology

    Best Online Glasses and Contacts Deals: Savings You’ll Have to See to Believe

    Mobile

    Get $50 for reserving the Galaxy Ring right now ahead of Samsung Unpacked

    Mobile

    Acefast Z4 218W review: This 4-port charging station has a unique feature I’ve always wanted

    Ztoog
    Facebook X (Twitter) Instagram Pinterest
    • Home
    • About Us
    • Contact us
    • Privacy Policy
    • Terms & Conditions
    © 2025 Ztoog.

    Type above and press Enter to search. Press Esc to cancel.