TopheadlinesTopheadlines
    What's Hot

    Kate Beckinsale announces her mother Judy Loe has passed away aged 78 after ‘immeasurable suffering’ as she admits she is ‘paralysed’ with grief

    July 18, 2025

    Gareth Southgate leaves England job after Euro 2024 final

    July 16, 2024

    Woman diagnosed with terminal cancer aged 34 reveals the five warning signs she wished she’d never ignored

    January 2, 2025
    Facebook Twitter Instagram
    Trending
    • Simple blood markers that could detect ALS years before diagnosis
    • WNBA’s furious trans debate deepens as Seattle star takes bitter swipe at Sophie Cunningham… and protestors gather to support Indiana Fever icon
    • Cookies sold at major grocery store recalled over fears of life-threatening reaction
    • UNLV basketball program ‘not for sale’: Runnin’ Rebels coach Josh Pastner walks back wild claim
    • When Suzie hit her 40s, she put her thinning hair, irritability, wired brain and palpitations down to the perimenopause. Then she started to mysteriously lose weight…
    • Oil tumbles below $90 after pause in fighting between the US and Iran but experts still fear rates hike
    • Tour de France 2026: Pogacar makes history, cycling steps up anti-doping, and popularity grows
    • Trendy meat diet sparks explosion of crippling medieval disease in young people
    Facebook Twitter Instagram
    TopheadlinesTopheadlines
    • Latest News

      Inside Epstein’s Zorro Ranch ‘where paedophile looked to carry out human experiments and create super-race breeding facility’ and ‘buried girls who were strangled during sex’

      February 24, 2026

      Cheating Utah ‘grief author’ heard sobbing down phone to 911 operator after allegedly murdering husband with poisoned Moscow mule

      February 23, 2026

      Victim reveals how she was left with flesh-eating disease after GP did not see her face-to-face then fled to India

      February 23, 2026

      ‘Andrew, the prince of darkness’: Global media mark ‘the end of privilege’ for Mountbatten-Windsor and gloat that the royal is ‘at rock bottom’

      February 22, 2026

      Melania Trump stuns in silver pants as she arrives at controversial Governor’s Dinner with husband Donald as dozens threaten boycott after president’s turbulent week

      February 22, 2026
    • Politics

      Law enforcement says eight killed by avalanche in California mountains | Weather News

      February 18, 2026

      Bangladesh PM-to-be and lawmakers sworn into parliament | Sheikh Hasina

      February 17, 2026

      Hillary Clinton gets in testy exchange with European leader over Trump

      February 16, 2026

      At least 11 Palestinians killed in Israeli attacks across Gaza | Gaza News

      February 15, 2026

      DOJ sends letter to Congress with list of people named in Epstein files, including Trump: Report

      February 15, 2026
    • Tech

      Apple’s AI Wearables Expected to Lean Heavily on Visual Intelligence

      February 23, 2026

      What to Know About At-Home STI Tests: Pros, Cons, and Recommendations (2026)

      February 23, 2026

      10 Clever Home Appliance Innovations You’ll See in 2026

      February 22, 2026

      Runlayer is now offering secure OpenClaw agentic capabilities for large enterprises

      February 22, 2026

      Tesla's "cheaper" Cybertruck arrives at $59,990, still far from the $40K promise

      February 21, 2026
    • Business

      Oil tumbles below $90 after pause in fighting between the US and Iran but experts still fear rates hike

      July 27, 2026

      Chancellor urged to rule out pensions raid to stop repeat of damaging speculation under Reeves and back ‘people who do the right thing’

      July 24, 2026

      Does the risk of ruinous care bills deter YOU from spending or gifting money to beat inheritance tax?

      July 23, 2026

      This is the one step Andy Burnham could take now to make us all richer and happier – and it wouldn’t cost him a penny: RACHEL RICKARD STRAUS

      July 21, 2026

      Why will it take half a year to register our property purchase on the Land Registry and should we be concerned?

      July 17, 2026
    • Sports

      WNBA’s furious trans debate deepens as Seattle star takes bitter swipe at Sophie Cunningham… and protestors gather to support Indiana Fever icon

      July 29, 2026

      UNLV basketball program ‘not for sale’: Runnin’ Rebels coach Josh Pastner walks back wild claim

      July 28, 2026

      Tour de France 2026: Pogacar makes history, cycling steps up anti-doping, and popularity grows

      July 27, 2026

      The McCanns cheer on Madeleine’s brother Sean as he swims in Commonwealth Games nearly two decades after sister disappeared

      July 25, 2026

      Rockies vs. Brewers MLB picks: Keep riding same parlay in lone matinee Friday

      July 24, 2026
    • Health

      Simple blood markers that could detect ALS years before diagnosis

      July 29, 2026

      Cookies sold at major grocery store recalled over fears of life-threatening reaction

      July 28, 2026

      When Suzie hit her 40s, she put her thinning hair, irritability, wired brain and palpitations down to the perimenopause. Then she started to mysteriously lose weight…

      July 27, 2026

      Trendy meat diet sparks explosion of crippling medieval disease in young people

      July 26, 2026

      Scientists find potential cause of embarrassing condition that causes excessive sweating in 15 million people… paving way for new treatments

      July 25, 2026
    • Science

      Ever wonder where our math symbols came from? Here are their stories

      February 19, 2026

      Some dog breeds carry a higher risk of breathing problems

      February 19, 2026

      New study links early smartphone ownership to health risks

      February 18, 2026

      The Story of Stories traces the arc of storytelling across human history

      February 17, 2026

      Listen to the crackle of ‘mini-lightning’ on Mars

      February 16, 2026
    • Entertainment

      Paul McCartney and Wings Exhibit Set at Rock & Roll Hall of Fame

      February 18, 2026

      Warner Bros Latest Hollywood Studio To Warn Seedance Over AI Infringement

      February 18, 2026

      Cardi B on Stefon Diggs Relationship Status

      February 17, 2026

      Jelly Roll Will Receive Country Radio’s Humanitarian Award

      February 17, 2026

      X Down For Thousands In U.S. And UK

      February 16, 2026
    TopheadlinesTopheadlines
    Home»Tech»Qwen3-Coder-Next offers vibe coders a powerful open source, ultra-sparse model with 10x higher throughput for repo tasks
    Tech

    Qwen3-Coder-Next offers vibe coders a powerful open source, ultra-sparse model with 10x higher throughput for repo tasks

    February 4, 20266 Mins Read
    Facebook Twitter Pinterest LinkedIn WhatsApp Reddit Tumblr Email
    Qwen3-Coder-Next offers vibe coders a powerful open source, ultra-sparse model with 10x higher throughput for repo tasks
    Share
    Facebook Twitter LinkedIn Pinterest Email



    Chinese e-commerce giant Alibaba's Qwen team of AI researchers has emerged in the last year as one of the global leaders of open source AI development, releasing a host of powerful large language models and specialized multimodal models that approach, and in some cases, surpass the performance of the proprietary U.S. leaders such as OpenAI, Anthropic, Google and xAI.

    Now the Qwen team is back again this week with a compelling release that matches the "vibe coding" frenzy that has arisen in recent months: Qwen3-Coder-Next, a specialized 80-billion-parameter model designed to deliver elite agentic performance within a lightweight active footprint.

    It's been released on a permissive Apache 2.0 license, enabling commercial usage by large enterprises and indie developers alike, with the model weights available on Hugging Face in four variants and a technical report describing some of its training approach and innovations.

    The release marks a major escalation in the global arms race for the ultimate coding assistant, following a week that has seen the space explode with new entrants. From the massive efficiency gains of Anthropic’s Claude Code harness to the high-profile launch of the OpenAI Codex app and the rapid community adoption of open-source frameworks like OpenClaw, the competitive landscape has never been more crowded.

    In this high-stakes environment, Alibaba isn't just keeping pace — it is attempting to set a new standard for open-weight intelligence.

    For LLM decision-makers, Qwen3-Coder-Next represents a fundamental shift in the economics of AI engineering. While the model houses 80 billion total parameters, it utilizes an ultra-sparse Mixture-of-Experts (MoE) architecture that activates only 3 billion parameters per forward pass.

    This design allows it to deliver reasoning capabilities that rival massive proprietary systems while maintaining the low deployment costs and high throughput of a lightweight local model.

    Solving the long-context bottleneck

    The core technical breakthrough behind Qwen3-Coder-Next is a hybrid architecture designed specifically to circumvent the quadratic scaling issues that plague traditional Transformers.

    As context windows expand — and this model supports a massive 262,144 tokens — traditional attention mechanisms become computationally prohibitive.

    Standard Transformers suffer from a "memory wall" where the cost of processing context grows quadratically with sequence length. Qwen addresses this by combining Gated DeltaNet with Gated Attention.

    Gated DeltaNet acts as a linear-complexity alternative to standard softmax attention. It allows the model to maintain state across its quarter-million-token window without the exponential latency penalties typical of long-horizon reasoning.

    When paired with the ultra-sparse MoE, the result is a theoretical 10x higher throughput for repository-level tasks compared to dense models of similar total capacity.

    This architecture ensures an agent can "read" an entire Python library or complex JavaScript framework and respond with the speed of a 3B model, yet with the structural understanding of an 80B system.

    To prevent context hallucination during training, the team utilized Best-Fit Packing (BFP), a strategy that maintains efficiency without the truncation errors found in traditional document concatenation.

    Trained to be agent-first

    The "Next" in the model's nomenclature refers to a fundamental pivot in training methodology. Historically, coding models were trained on static code-text pairs—essentially a "read-only" education. Qwen3-Coder-Next was instead developed through a massive "agentic training" pipeline.

    The technical report details a synthesis pipeline that produced 800,000 verifiable coding tasks. These were not mere snippets; they were real-world bug-fixing scenarios mined from GitHub pull requests and paired with fully executable environments.

    The training infrastructure, known as MegaFlow, is a cloud-native orchestration system based on Alibaba Cloud Kubernetes. In MegaFlow, each agentic task is expressed as a three-stage workflow: agent rollout, evaluation, and post-processing. During rollout, the model interacts with a live containerized environment.

    If it generates code that fails a unit test or crashes a container, it receives immediate feedback through mid-training and reinforcement learning. This "closed-loop" education allows the model to learn from environment feedback, teaching it to recover from faults and refine solutions in real-time.

    Product specifications include:

    • Support for 370 Programming Languages: An expansion from 92 in previous versions.

    • XML-Style Tool Calling: A new qwen3_coder format designed for string-heavy arguments, allowing the model to emit long code snippets without the nested quoting and escaping overhead typical of JSON.

    • Repository-Level Focus: Mid-training was expanded to approximately 600B tokens of repository-level data, proving more impactful for cross-file dependency logic than file-level datasets alone.

    Specialization via expert models

    A key differentiator in the Qwen3-Coder-Next pipeline is its use of specialized Expert Models. Rather than training one generalist model for all tasks, the team developed domain-specific experts for Web Development and User Experience (UX).

    The Web Development Expert targets full-stack tasks like UI construction and component composition. All code samples were rendered in a Playwright-controlled Chromium environment.

    For React samples, a Vite server was deployed to ensure all dependencies were correctly initialized. A Vision-Language Model (VLM) then judged the rendered pages for layout integrity and UI quality.

    The User Experience Expert was optimized for tool-call format adherence across diverse CLI/IDE scaffolds such as Cline and OpenCode. The team found that training on diverse tool chat templates significantly improved the model's robustness to unseen schemas at deployment time.

    Once these experts achieved peak performance, their capabilities were distilled back into the single 80B/3B MoE model. This ensures the lightweight deployment version retains the nuanced knowledge of much larger teacher models.

    Punching up on benchmarks while offering high security

    The results of this specialized training are evident in the model's competitive standing against industry giants. In benchmark evaluations conducted using the SWE-Agent scaffold, Qwen3-Coder-Next demonstrated exceptional efficiency relative to its active parameter count.

    On SWE-Bench Verified, the model achieved a score of 70.6%. This performance is notably competitive when placed alongside significantly larger models; it outpaces DeepSeek-V3.2, which scores 70.2%, and trails only slightly behind the 74.2% score of GLM-4.7.

    Crucially, the model demonstrates robust inherent security awareness. On SecCodeBench, which evaluates a model's ability to repair vulnerabilities, Qwen3-Coder-Next outperformed Claude-Opus-4.5 in code generation scenarios (61.2% vs. 52.5%).

    Notably, it maintained high scores even when provided with no security hints, indicating it has learned to anticipate common security pitfalls during its 800k-task agentic training phase.

    In multilingual multilingual security evaluations, the model also demonstrated a competitive balance between functional and secure code generation, outperforming both DeepSeek-V3.2 and GLM-4.7 on the CWEval benchmark with a func-sec@1 score of 56.32%.

    Challenging the proprietary giants

    The release represents the most significant challenge to the dominance of closed-source coding models in 2026. By proving that a model with only 3B active parameters can navigate the complexities of real-world software engineering as effectively as a "giant," Alibaba has effectively democratized agentic coding.

    The "aha!" moment for the industry is the realization that context length and throughput are the two most important levers for agentic success.

    A model that can process 262k tokens of a repository in seconds and verify its own work in a Docker container is fundamentally more useful than a larger model that is too slow or expensive to iterate.

    As the Qwen team concludes in their report: "Scaling agentic training, rather than model size alone, is a key driver for advancing real-world coding agent capability". With Qwen3-Coder-Next, the era of the "mammoth" coding model may be coming to an end, replaced by ultra-fast, sparse experts that can think as deeply as they can run.



    Source link

    Share. Facebook Twitter Pinterest LinkedIn Tumblr Telegram Email

    Related Posts

    Apple’s AI Wearables Expected to Lean Heavily on Visual Intelligence

    February 23, 2026

    What to Know About At-Home STI Tests: Pros, Cons, and Recommendations (2026)

    February 23, 2026

    10 Clever Home Appliance Innovations You’ll See in 2026

    February 22, 2026
    Top Posts

    Simple blood markers that could detect ALS years before diagnosis

    July 29, 2026

    Francis Ngannou claims he is Man United’s ‘favourite heavyweight boxer’ as he teases Tyson Fury

    July 31, 2023

    Turn Your Favorite Pet Photos Into a Pawfect Portrait for Just $20

    July 31, 2023

    Mauricio Diazgranados Is a Botanist in a Hurry

    July 31, 2023
    Don't Miss
    Business

    Republicans Call on NPR’s Chief, Katherine Maher, to Testify on Bias

    Business 3 Mins Read

    Congressional Republicans on Wednesday said they had asked NPR’s new chief executive, Katherine Maher, to…

    Amazon Argues National Labor Relations Board Is Unconstitutional

    February 16, 2024

    Amid Tension Around H.H.S. Cuts, Kennedy Meets With Tribal Leader

    April 9, 2025

    Can Rory McIlroy cut through the noise to win the PGA Championship?

    May 15, 2024
    Stay In Touch
    • Facebook
    • Twitter
    • Instagram
    About Us
    About Us

    Delivering timely and accurate news updates, our website keeps you informed on the latest events, politics, entertainment, and more. Dive into captivating articles crafted by our team of expert writers, providing a comprehensive view of the world. Stay ahead with our trusted news source.

    Facebook Twitter Instagram
    Our Picks

    ICC T20 World Cup 2024 stadiums: Where’s India vs Pakistan and the final? | ICC Men’s T20 World Cup News

    May 25, 2024

    Step-by-step guide on how to master your hormones during your cycle by menstrual health expert DR COLLEEN FOGARTY-DRAPER

    April 18, 2024

    Five International Movies to Stream Now

    January 12, 2025
    © 2026 Designed by TopHeadlineSpot.
    • Business
    • Latest News
    • Politics
    • Health
    • Entertainment
    • Sports
    • Science
    • Tech

    Type above and press Enter to search. Press Esc to cancel.