Close Menu
Ztoog
    What's Hot
    The Future

    OpenAI CEO Sam Altman lands new job at Microsoft after surprise firing

    AI

    After Amazon, an ambition to accelerate American manufacturing | Ztoog

    Mobile

    Alexa vs Google Assistant: What’s different, and what’s better?

    Important Pages:
    • About Us
    • Contact us
    • Privacy Policy
    • Terms & Conditions
    Facebook X (Twitter) Instagram Pinterest
    Facebook X (Twitter) Instagram Pinterest
    Ztoog
    • Home
    • The Future

      JD Vance and President Trump’s Sons Hype Bitcoin at Las Vegas Conference

      AI may already be shrinking entry-level jobs in tech, new research suggests

      Today’s NYT Strands Hints, Answer and Help for May 26 #449

      LiberNovo Omni: The World’s First Dynamic Ergonomic Chair

      Common Security Mistakes Made By Businesses and How to Avoid Them

    • Technology

      Gemini in Google Drive can now help you skip watching that painfully long Zoom meeting

      Apple iPhone exports from China to the US fall 76% as India output surges

      Today’s NYT Wordle Hints, Answer and Help for May 26, #1437

      5 Skills Kids (and Adults) Need in an AI World – O’Reilly

      How To Come Back After A Layoff

    • Gadgets

      8 Best Vegan Meal Delivery Services and Kits (2025), Tested and Reviewed

      Google Home is getting deeper Gemini integration and a new widget

      Google Announces AI Ultra Subscription Plan With Premium Features

      Google shows off Android XR-based glasses, announces Warby Parker team-up

      The market’s down, but this OpenAI for the stock market can help you trade up

    • Mobile

      Microsoft is done being subtle – this new tool screams “upgrade now”

      Wallpaper Wednesday: Android wallpapers 2025-05-28

      Google can make smart glasses accessible with Warby Parker, Gentle Monster deals

      vivo T4 Ultra specs leak

      Forget screens: more details emerge on the mysterious Jony Ive + OpenAI device

    • Science

      Do we have free will? Quantum experiments may soon reveal the answer

      Was Planet Nine exiled from the solar system as a baby?

      How farmers can help rescue water-loving birds

      A trip to the farm where loofahs grow on vines

      AI Is Eating Data Center Power Demand—and It’s Only Getting Worse

    • AI

      The AI Hype Index: College students are hooked on ChatGPT

      Learning how to predict rare kinds of failures | Ztoog

      Anthropic’s new hybrid AI model can work on tasks autonomously for hours at a time

      AI learns how vision and sound are connected, without human intervention | Ztoog

      How AI is introducing errors into courtrooms

    • Crypto

      GameStop bought $500 million of bitcoin

      CoinW Teams Up with Superteam Europe to Conclude Solana Hackathon and Accelerate Web3 Innovation in Europe

      Ethereum Net Flows Turn Negative As Bulls Push For $3,500

      Bitcoin’s Power Compared To Nuclear Reactor By Brazilian Business Leader

      Senate advances GENIUS Act after cloture vote passes

    Ztoog
    Home » How DeepSeek ripped up the AI playbook—and why everyone’s going to follow it
    AI

    How DeepSeek ripped up the AI playbook—and why everyone’s going to follow it

    Facebook Twitter Pinterest WhatsApp
    How DeepSeek ripped up the AI playbook—and why everyone’s going to follow it
    Share
    Facebook Twitter LinkedIn Pinterest WhatsApp

    There’s extra. To make its use of reinforcement studying as environment friendly as potential, DeepSeek has additionally developed a brand new algorithm referred to as Group Relative Policy Optimization (GRPO). It first used GRPO a 12 months in the past, to construct a mannequin referred to as DeepSeekMath. 

    We’ll skip the particulars—you simply want to know that reinforcement studying includes calculating a rating to decide whether or not a possible transfer is sweet or unhealthy. Many current reinforcement-learning strategies require a complete separate mannequin to make this calculation. In the case of huge language fashions, which means a second mannequin that might be as costly to construct and run as the first. Instead of utilizing a second mannequin to predict a rating, GRPO simply makes an informed guess. It’s low-cost, however nonetheless correct sufficient to work.  

    A typical method

    DeepSeek’s use of reinforcement studying is the major innovation that the firm describes in its R1 paper. But DeepSeek shouldn’t be the solely agency experimenting with this system. Two weeks earlier than R1 dropped, a crew at Microsoft Asia introduced a mannequin referred to as rStar-Math, which was skilled in the same method. “It has similarly huge leaps in performance,” says Matt Zeiler, founder and CEO of the AI agency Clarifai.

    AI2’s Tulu was additionally constructed utilizing environment friendly reinforcement-learning strategies (however on prime of, not as an alternative of, human-led steps like supervised fine-tuning and RLHF). And the US agency Hugging Face is racing to replicate R1 with OpenR1, a clone of DeepSeek’s mannequin that Hugging Face hopes will expose much more of the components in R1’s particular sauce.

    What’s extra, it’s an open secret that prime companies like OpenAI, Google DeepMind, and Anthropic could already be utilizing their very own variations of DeepSeek’s method to practice their new technology of fashions. “I’m sure they’re doing almost the exact same thing, but they’ll have their own flavor of it,” says Zeiler. 

    But DeepSeek has a couple of trick up its sleeve. It skilled its base mannequin V3 to do one thing referred to as multi-token prediction, the place the mannequin learns to predict a string of phrases directly as an alternative of one by one. This coaching is cheaper and seems to increase accuracy as effectively. “If you think about how you speak, when you’re halfway through a sentence, you know what the rest of the sentence is going to be,” says Zeiler. “These models should be capable of that too.”  

    It has additionally discovered cheaper methods to create massive knowledge units. To practice final 12 months’s mannequin, DeepSeekMath, it took a free knowledge set referred to as Common Crawl—an enormous variety of paperwork scraped from the web—and used an automatic course of to extract simply the paperwork that included math issues. This was far cheaper than constructing a brand new knowledge set of math issues by hand. It was additionally simpler: Common Crawl consists of much more math than every other specialist math knowledge set that’s out there. 

    And on the {hardware} aspect, DeepSeek has discovered new methods to juice outdated chips, permitting it to practice top-tier fashions with out coughing up for the newest {hardware} on the market. Half their innovation comes from straight engineering, says Zeiler: “They definitely have some really, really good GPU engineers on that team.”

    Share. Facebook Twitter Pinterest LinkedIn WhatsApp

    Related Posts

    AI

    The AI Hype Index: College students are hooked on ChatGPT

    AI

    Learning how to predict rare kinds of failures | Ztoog

    AI

    Anthropic’s new hybrid AI model can work on tasks autonomously for hours at a time

    AI

    AI learns how vision and sound are connected, without human intervention | Ztoog

    AI

    How AI is introducing errors into courtrooms

    AI

    With AI, researchers predict the location of virtually any protein within a human cell | Ztoog

    AI

    Google DeepMind’s new AI agent cracks real-world problems better than humans can

    AI

    Study shows vision-language models can’t handle queries with negation words | Ztoog

    Leave A Reply Cancel Reply

    Follow Us
    • Facebook
    • Twitter
    • Pinterest
    • Instagram
    Top Posts
    Gadgets

    Save hundreds on flights with this lifetime travel bundle, now only $59.97

    We could earn income from the merchandise obtainable on this web page and take part…

    AI

    Using societal context knowledge to foster the responsible application of AI – Google Research Blog

    Posted by Donald Martin, Jr., Technical Program Manager, Head of Societal Context Understanding Tools and…

    Technology

    Why are fictional presidents from Succession to Homeland so young?

    Welcome to Noticed, Vox’s cultural pattern column. You know that factor you’ve been seeing far…

    Technology

    Downsizing and Rightsizing: How to Simplify Your Life in Retirement

    Part of retirement means re-evaluating your wants and transitioning to a brand new chapter of…

    Science

    Plant-Based Meat Boomed. Here Comes the Bust

    Over the previous three years, the plant-based meat business has skilled a serious reversal in…

    Our Picks
    Science

    Has the century-old mystery of Antarctica’s “Blood Falls” finally been solved?

    Mobile

    Deck out your Nothing Phone with these new monochrome icons

    AI

    This AI Paper from China Introduces ‘AGENTBOARD’: An Open-Source Evaluation Framework Tailored to Analytical Evaluation of Multi-Turn LLM Agents

    Categories
    • AI (1,492)
    • Crypto (1,753)
    • Gadgets (1,804)
    • Mobile (1,850)
    • Science (1,865)
    • Technology (1,801)
    • The Future (1,647)
    Most Popular
    Crypto

    Bitcoin Transaction Volumes Hit New Highs Amid Signs Of A Supply Shock

    The Future

    Russell T. Davies Explains Doctor Who’s Big Davros Retcon

    Gadgets

    Best Theraguns and Other Therabody Tools (2024): Massage Guns, SmartGoggles, and TheraFace

    Ztoog
    Facebook X (Twitter) Instagram Pinterest
    • Home
    • About Us
    • Contact us
    • Privacy Policy
    • Terms & Conditions
    © 2025 Ztoog.

    Type above and press Enter to search. Press Esc to cancel.