Close Menu
Ztoog
    What's Hot
    The Future

    5 Factors To Consider Before Buying An Electric Car

    Technology

    IEEE’s TryEngineering Summer Institute Provides Hands-On Experiences

    AI

    Can Large Language Models Truly Act and Reason? Researchers from the University of Illinois at Urbana-Champaign Introduce LATS for Enhanced Decision-Making

    Important Pages:
    • About Us
    • Contact us
    • Privacy Policy
    • Terms & Conditions
    Facebook X (Twitter) Instagram Pinterest
    Facebook X (Twitter) Instagram Pinterest
    Ztoog
    • Home
    • The Future

      JD Vance and President Trump’s Sons Hype Bitcoin at Las Vegas Conference

      AI may already be shrinking entry-level jobs in tech, new research suggests

      Today’s NYT Strands Hints, Answer and Help for May 26 #449

      LiberNovo Omni: The World’s First Dynamic Ergonomic Chair

      Common Security Mistakes Made By Businesses and How to Avoid Them

    • Technology

      Gemini in Google Drive can now help you skip watching that painfully long Zoom meeting

      Apple iPhone exports from China to the US fall 76% as India output surges

      Today’s NYT Wordle Hints, Answer and Help for May 26, #1437

      5 Skills Kids (and Adults) Need in an AI World – O’Reilly

      How To Come Back After A Layoff

    • Gadgets

      8 Best Vegan Meal Delivery Services and Kits (2025), Tested and Reviewed

      Google Home is getting deeper Gemini integration and a new widget

      Google Announces AI Ultra Subscription Plan With Premium Features

      Google shows off Android XR-based glasses, announces Warby Parker team-up

      The market’s down, but this OpenAI for the stock market can help you trade up

    • Mobile

      Microsoft is done being subtle – this new tool screams “upgrade now”

      Wallpaper Wednesday: Android wallpapers 2025-05-28

      Google can make smart glasses accessible with Warby Parker, Gentle Monster deals

      vivo T4 Ultra specs leak

      Forget screens: more details emerge on the mysterious Jony Ive + OpenAI device

    • Science

      Do we have free will? Quantum experiments may soon reveal the answer

      Was Planet Nine exiled from the solar system as a baby?

      How farmers can help rescue water-loving birds

      A trip to the farm where loofahs grow on vines

      AI Is Eating Data Center Power Demand—and It’s Only Getting Worse

    • AI

      The AI Hype Index: College students are hooked on ChatGPT

      Learning how to predict rare kinds of failures | Ztoog

      Anthropic’s new hybrid AI model can work on tasks autonomously for hours at a time

      AI learns how vision and sound are connected, without human intervention | Ztoog

      How AI is introducing errors into courtrooms

    • Crypto

      GameStop bought $500 million of bitcoin

      CoinW Teams Up with Superteam Europe to Conclude Solana Hackathon and Accelerate Web3 Innovation in Europe

      Ethereum Net Flows Turn Negative As Bulls Push For $3,500

      Bitcoin’s Power Compared To Nuclear Reactor By Brazilian Business Leader

      Senate advances GENIUS Act after cloture vote passes

    Ztoog
    Home » In a New AI Paper, CMU and Google Researchers Redefine Language Model Outputs: How Delaying Responses with Pause Tokens Boosts Performance on QA and Reasoning Tasks
    AI

    In a New AI Paper, CMU and Google Researchers Redefine Language Model Outputs: How Delaying Responses with Pause Tokens Boosts Performance on QA and Reasoning Tasks

    Facebook Twitter Pinterest WhatsApp
    In a New AI Paper, CMU and Google Researchers Redefine Language Model Outputs: How Delaying Responses with Pause Tokens Boosts Performance on QA and Reasoning Tasks
    Share
    Facebook Twitter LinkedIn Pinterest WhatsApp

    Tokens are generated in fast succession utilizing causal language fashions primarily based on transformers. The mannequin takes within the Okay previous tokens and then iteratively calculates Okay intermediate vectors in every hidden layer to supply the (Okay + 1)th token. The module operates on the earlier layer’s output vectors, and every vector in itself is the output of a module. Despite the complexity of your entire process, one uncommon restriction have to be met: the variety of operations required to find out the following token is constrained by the variety of tokens already seen. 

    A current examine by Carnegie Mellon University and Google investigated the technique of including faux tokens to the enter of a decoder-only mannequin to postpone its output. In this work, they determined to choose a (learnable) pause token and append it to the enter in a sequence of a number of instances. To receive the mannequin’s reply after the final token has been seen, they merely ignore the matching outputs till then.

    Importantly, the researchers take into consideration inserting such delays at inference and throughout downstream fine-tuning and pretraining. What impact this seemingly little adjustment may need in the actual world can’t be recognized now. The delay creates a probably “wider” computational channel, which the Transformer could use to its benefit. A less complicated end result could possibly be that the mannequin ignores the tokens’ capacity to trigger delays and continues operating. After all, neither the tokens themselves nor the small variety of new parameters launched by embedding a single token are satisfactory to encode any further data from the coaching knowledge. These meaningless tokens could obscure helpful indicators and weaken the mannequin. 

    The group undertook an empirical evaluation to know the result of introducing (appended) delays in all coaching and inference phases. They look at pause coaching on a 1B and 130M parameter decoder-only mannequin initially skilled on C4 (Raffel et al., 2019) and then fine-tuned on 9 downstream duties masking extractive query response, reasoning, normal understanding, and reality recall. Most considerably, this methodology raises the 1B mannequin’s precise match rating by 18% on the SQuAD extractive question-answering job. Similarly, they noticed an 8% improve within the normal understanding job of CommonSense QA and a 1% accuracy achieve on the reasoning job of GSM8k over the usual mannequin’s accuracy of seven.5%. 

    On the opposite hand, when tokens are launched solely through the closing fine-tuning stage (utilizing the baseline pretrained mannequin), enhancements are seen in simply a small fraction of circumstances. The group additionally carried out a sequence of key ablations, together with:

    1. Discovering that appending tokens is mostly superior to prepending them.
    2. Discovering that there’s an optimum variety of tokens for any downstream job.
    3. Discovering that lowering the variety of inference-time tokens ends in a sleek efficiency degradation. 

    The group believes that the important subsequent step could be creating methods to straight make delays useful on a regular pretrained mannequin. They envision a number of new theoretical and utilized analysis instructions opening up due to their work increasing the paradigm of delayed next-token prediction.


    Check out the Paper. All Credit For This Research Goes To the Researchers on This Project. Also, don’t overlook to affix our 31k+ ML SubReddit, 40k+ Facebook Community, Discord Channel, and Email Newsletter, the place we share the most recent AI analysis information, cool AI initiatives, and extra.

    If you want our work, you’ll love our publication..

    We are additionally on WhatsApp. Join our AI Channel on Whatsapp..


    Dhanshree Shenwai is a Computer Science Engineer and has a good expertise in FinTech firms masking Financial, Cards & Payments and Banking area with eager curiosity in functions of AI. She is passionate about exploring new applied sciences and developments in as we speak’s evolving world making everybody’s life simple.


    ▶️ Now Watch AI Research Updates On Our Youtube Channel [Watch Now]

    Share. Facebook Twitter Pinterest LinkedIn WhatsApp

    Related Posts

    AI

    The AI Hype Index: College students are hooked on ChatGPT

    AI

    Learning how to predict rare kinds of failures | Ztoog

    AI

    Anthropic’s new hybrid AI model can work on tasks autonomously for hours at a time

    AI

    AI learns how vision and sound are connected, without human intervention | Ztoog

    AI

    How AI is introducing errors into courtrooms

    AI

    With AI, researchers predict the location of virtually any protein within a human cell | Ztoog

    AI

    Google DeepMind’s new AI agent cracks real-world problems better than humans can

    AI

    Study shows vision-language models can’t handle queries with negation words | Ztoog

    Leave A Reply Cancel Reply

    Follow Us
    • Facebook
    • Twitter
    • Pinterest
    • Instagram
    Top Posts
    Science

    Mars was icy and wet billions of years ago, new study suggests

    Today, Mars is chilly and dry. Billions of years in the past, nonetheless, there was…

    Science

    Spinach and Sunlight, the Ingredients for Converting Carbon Dioxide into Fertilizer

    The expression “green technologies” is normally thought-about a determine of speech. Still, in the case…

    Science

    Big Pharma is “coming to the table” on price negotiations as it loses in court

    Federal well being officers this week trumpeted progress in negotiating decrease Medicare drug costs as…

    Science

    A macroscopic amount of matter has been put in a quantum superposition

    The sapphire crystal resonator used to probe the bounds of quantum mechanicsMatteo Fadel/ETH Zurich Quantum…

    Crypto

    Former Alameda CEO Caroline Ellison explains how FTX hid losses, sandbagged lenders

    Caroline Ellison’s testimony at Sam Bankman-Fried’s trial unfold right into a second day, digging deep…

    Our Picks
    Gadgets

    Start the year on a high note by mastering Excel with this $35 training bundle

    Science

    Orionids: How to see the Halley’s comet meteor shower this weekend

    Technology

    What your credit score actually means

    Categories
    • AI (1,492)
    • Crypto (1,753)
    • Gadgets (1,804)
    • Mobile (1,850)
    • Science (1,865)
    • Technology (1,801)
    • The Future (1,647)
    Most Popular
    Mobile

    GameSir X3 vs Razer Kishi V2

    Science

    Why Balcony Solar Panels Haven’t Taken Off in the US

    Technology

    The best phone deals May 2023

    Ztoog
    Facebook X (Twitter) Instagram Pinterest
    • Home
    • About Us
    • Contact us
    • Privacy Policy
    • Terms & Conditions
    © 2025 Ztoog.

    Type above and press Enter to search. Press Esc to cancel.