Close Menu
Ztoog
    What's Hot
    The Future

    Tencent seems unaffected by US AI chip export ban, research shows

    Crypto

    Here Are The Factors That Could Be Behind The Latest Bitcoin Wipeout

    AI

    Brain surgery training from an avatar | Ztoog

    Important Pages:
    • About Us
    • Contact us
    • Privacy Policy
    • Terms & Conditions
    Facebook X (Twitter) Instagram Pinterest
    Facebook X (Twitter) Instagram Pinterest
    Ztoog
    • Home
    • The Future

      JD Vance and President Trump’s Sons Hype Bitcoin at Las Vegas Conference

      AI may already be shrinking entry-level jobs in tech, new research suggests

      Today’s NYT Strands Hints, Answer and Help for May 26 #449

      LiberNovo Omni: The World’s First Dynamic Ergonomic Chair

      Common Security Mistakes Made By Businesses and How to Avoid Them

    • Technology

      Gemini in Google Drive can now help you skip watching that painfully long Zoom meeting

      Apple iPhone exports from China to the US fall 76% as India output surges

      Today’s NYT Wordle Hints, Answer and Help for May 26, #1437

      5 Skills Kids (and Adults) Need in an AI World – O’Reilly

      How To Come Back After A Layoff

    • Gadgets

      8 Best Vegan Meal Delivery Services and Kits (2025), Tested and Reviewed

      Google Home is getting deeper Gemini integration and a new widget

      Google Announces AI Ultra Subscription Plan With Premium Features

      Google shows off Android XR-based glasses, announces Warby Parker team-up

      The market’s down, but this OpenAI for the stock market can help you trade up

    • Mobile

      Microsoft is done being subtle – this new tool screams “upgrade now”

      Wallpaper Wednesday: Android wallpapers 2025-05-28

      Google can make smart glasses accessible with Warby Parker, Gentle Monster deals

      vivo T4 Ultra specs leak

      Forget screens: more details emerge on the mysterious Jony Ive + OpenAI device

    • Science

      Do we have free will? Quantum experiments may soon reveal the answer

      Was Planet Nine exiled from the solar system as a baby?

      How farmers can help rescue water-loving birds

      A trip to the farm where loofahs grow on vines

      AI Is Eating Data Center Power Demand—and It’s Only Getting Worse

    • AI

      The AI Hype Index: College students are hooked on ChatGPT

      Learning how to predict rare kinds of failures | Ztoog

      Anthropic’s new hybrid AI model can work on tasks autonomously for hours at a time

      AI learns how vision and sound are connected, without human intervention | Ztoog

      How AI is introducing errors into courtrooms

    • Crypto

      GameStop bought $500 million of bitcoin

      CoinW Teams Up with Superteam Europe to Conclude Solana Hackathon and Accelerate Web3 Innovation in Europe

      Ethereum Net Flows Turn Negative As Bulls Push For $3,500

      Bitcoin’s Power Compared To Nuclear Reactor By Brazilian Business Leader

      Senate advances GENIUS Act after cloture vote passes

    Ztoog
    Home » Making AI models more trustworthy for high-stakes settings | Ztoog
    AI

    Making AI models more trustworthy for high-stakes settings | Ztoog

    Facebook Twitter Pinterest WhatsApp
    Making AI models more trustworthy for high-stakes settings | Ztoog
    Share
    Facebook Twitter LinkedIn Pinterest WhatsApp

    The ambiguity in medical imaging can current main challenges for clinicians who’re making an attempt to establish illness. For occasion, in a chest X-ray, pleural effusion, an irregular buildup of fluid within the lungs, can look very very like pulmonary infiltrates, that are accumulations of pus or blood.

    An synthetic intelligence mannequin may help the clinician in X-ray evaluation by serving to to establish refined particulars and boosting the effectivity of the analysis course of. But as a result of so many doable circumstances might be current in a single picture, the clinician would doubtless wish to contemplate a set of prospects, fairly than solely having one AI prediction to guage.

    One promising method to produce a set of prospects, known as conformal classification, is handy as a result of it may be readily applied on prime of an current machine-learning mannequin. However, it will probably produce units which can be impractically giant. 

    MIT researchers have now developed a easy and efficient enchancment that may scale back the scale of prediction units by as much as 30 % whereas additionally making predictions more dependable.

    Having a smaller prediction set could assist a clinician zero in on the appropriate analysis more effectively, which may enhance and streamline remedy for sufferers. This methodology might be helpful throughout a spread of classification duties — say, for figuring out the species of an animal in a picture from a wildlife park — because it supplies a smaller however more correct set of choices.

    “With fewer classes to consider, the sets of predictions are naturally more informative in that you are choosing between fewer options. In a sense, you are not really sacrificing anything in terms of accuracy for something that is more informative,” says Divya Shanmugam PhD ’24, a postdoc at Cornell Tech who performed this analysis whereas she was an MIT graduate pupil.

    Shanmugam is joined on the paper by Helen Lu ’24; Swami Sankaranarayanan, a former MIT postdoc who’s now a analysis scientist at Lilia Biosciences; and senior creator John Guttag, the Dugald C. Jackson Professor of Computer Science and Electrical Engineering at MIT and a member of the MIT Computer Science and Artificial Intelligence Laboratory (CSAIL). The analysis can be offered on the Conference on Computer Vision and Pattern Recognition in June.

    Prediction ensures

    AI assistants deployed for high-stakes duties, like classifying ailments in medical pictures, are usually designed to supply a chance rating together with every prediction so a consumer can gauge the mannequin’s confidence. For occasion, a mannequin may predict that there’s a 20 % likelihood a picture corresponds to a specific analysis, like pleurisy.

    But it’s tough to belief a mannequin’s predicted confidence as a result of a lot prior analysis has proven that these possibilities might be inaccurate. With conformal classification, the mannequin’s prediction is changed by a set of essentially the most possible diagnoses together with a assure that the proper analysis is someplace within the set.

    But the inherent uncertainty in AI predictions usually causes the mannequin to output units which can be far too giant to be helpful.

    For occasion, if a mannequin is classifying an animal in a picture as considered one of 10,000 potential species, it’d output a set of 200 predictions so it will probably provide a powerful assure.

    “That is quite a few classes for someone to sift through to figure out what the right class is,” Shanmugam says.

    The approach may also be unreliable as a result of tiny adjustments to inputs, like barely rotating a picture, can yield totally completely different units of predictions.

    To make conformal classification more helpful, the researchers utilized a method developed to enhance the accuracy of laptop imaginative and prescient models known as test-time augmentation (TTA).

    TTA creates a number of augmentations of a single picture in a dataset, maybe by cropping the picture, flipping it, zooming in, and many others. Then it applies a pc imaginative and prescient mannequin to every model of the identical picture and aggregates its predictions.

    “In this way, you get multiple predictions from a single example. Aggregating predictions in this way improves predictions in terms of accuracy and robustness,” Shanmugam explains.

    Maximizing accuracy

    To apply TTA, the researchers maintain out some labeled picture knowledge used for the conformal classification course of. They be taught to mixture the augmentations on these held-out knowledge, routinely augmenting the photographs in a means that maximizes the accuracy of the underlying mannequin’s predictions.

    Then they run conformal classification on the mannequin’s new, TTA-transformed predictions. The conformal classifier outputs a smaller set of possible predictions for the identical confidence assure.

    “Combining test-time augmentation with conformal prediction is simple to implement, effective in practice, and requires no model retraining,” Shanmugam says.

    Compared to prior work in conformal prediction throughout a number of normal picture classification benchmarks, their TTA-augmented methodology diminished prediction set sizes throughout experiments, from 10 to 30 %.

    Importantly, the approach achieves this discount in prediction set measurement whereas sustaining the chance assure.

    The researchers additionally discovered that, although they’re sacrificing some labeled knowledge that may usually be used for the conformal classification process, TTA boosts accuracy sufficient to outweigh the price of shedding these knowledge.

    “It raises interesting questions about how we used labeled data after model training. The allocation of labeled data between different post-training steps is an important direction for future work,” Shanmugam says.

    In the long run, the researchers wish to validate the effectiveness of such an method within the context of models that classify textual content as an alternative of pictures. To additional enhance the work, the researchers are additionally contemplating methods to scale back the quantity of computation required for TTA.

    This analysis is funded, partly, by the Wistrom Corporation.

    Share. Facebook Twitter Pinterest LinkedIn WhatsApp

    Related Posts

    AI

    The AI Hype Index: College students are hooked on ChatGPT

    AI

    Learning how to predict rare kinds of failures | Ztoog

    AI

    Anthropic’s new hybrid AI model can work on tasks autonomously for hours at a time

    AI

    AI learns how vision and sound are connected, without human intervention | Ztoog

    Science

    Liquid physics: Inside the lab making black hole analogues on Earth

    AI

    How AI is introducing errors into courtrooms

    AI

    With AI, researchers predict the location of virtually any protein within a human cell | Ztoog

    AI

    Google DeepMind’s new AI agent cracks real-world problems better than humans can

    Leave A Reply Cancel Reply

    Follow Us
    • Facebook
    • Twitter
    • Pinterest
    • Instagram
    Top Posts
    Technology

    Who could buy TikTok if Congress enacts a ban?

    The Senate is now contemplating a bipartisan invoice that could power a sale of TikTok,…

    Science

    Students search desert for lost rocket after attempted launch to space

    The Aurora rocket launched within the Mojave desert on 24 SeptemberKarman Space Programme A group…

    Gadgets

    Digital frame maker Aura introduces the Aspen, a $229 frame with more intelligent features

    Aura, a digital photograph frames firm based by early Twitter staff, is introducing its newest…

    Science

    Zombie star’s strange behavior ascribed to what it’s eating

    Enlarge / Pulsars are spinning neutron stars, the relics of large stars gone supernova. NASA’s…

    Mobile

    Enjoy top-quality sound with the Marshall Emberton II — now at its lowest price on Amazon

    Looking for a flowery speaker with a smooth and distinctive design? You’ll undoubtedly like this…

    Our Picks
    Technology

    Amazon to invest as much as $4 billion in AI startup Anthropic

    AI

    Differentially private median and more – Google Research Blog

    Crypto

    Why Did Bitcoin Price Crash 10% After Reaching $69,000 All-Time High?

    Categories
    • AI (1,492)
    • Crypto (1,753)
    • Gadgets (1,804)
    • Mobile (1,850)
    • Science (1,865)
    • Technology (1,801)
    • The Future (1,647)
    Most Popular
    Gadgets

    Samsung Galaxy Watch Ultra Could Cost Almost A Flagship Phone’s Price

    Mobile

    Suunto Race review: Near the finish line

    The Future

    OpenAI CEO Sam Altman lands new job at Microsoft after surprise firing

    Ztoog
    Facebook X (Twitter) Instagram Pinterest
    • Home
    • About Us
    • Contact us
    • Privacy Policy
    • Terms & Conditions
    © 2025 Ztoog.

    Type above and press Enter to search. Press Esc to cancel.