TopheadlinesTopheadlines
    What's Hot

    Kody Brown’s Daughter Cries Over Estrangement

    September 29, 2025

    Edgware Road stabbing: Man in his 20s is killed in central London: Three men arrested over late night attack where a gunshot was also fired

    June 5, 2024

    Albanian gangster is granted anonymity in the UK ‘to protect him from rivals’

    August 4, 2023
    Facebook Twitter Instagram
    Trending
    • Here’s the latest.
    • Abu Dhabi Championship: McIlroy shoots 63 to move into contention on day two
    • The disturbing Mounjaro and Ozempic side effect that can make even the lightest touch feel like your skin is ‘on fire’… and why doctors think your dose may be to blame
    • Why oat and almond milks could be bad for your health
    • JJ Gabriel on the verge of joining Real Madrid: Man United wonderkid, 16, is finalising move to Spanish giants after Old Trafford quit bombshell
    • Is Heinz tomato soup healthy? Dietitians reveal the surprising benefits of canned soups – and the best pick for a filling, fibre-packed dinner
    • Client Challenge
    • Flouting Consumer Law, Insurers Refuse to Pay Medical Bills for Emergency Care
    Facebook Twitter Instagram
    TopheadlinesTopheadlines
    • Latest News

      Inside Epstein’s Zorro Ranch ‘where paedophile looked to carry out human experiments and create super-race breeding facility’ and ‘buried girls who were strangled during sex’

      February 24, 2026

      Cheating Utah ‘grief author’ heard sobbing down phone to 911 operator after allegedly murdering husband with poisoned Moscow mule

      February 23, 2026

      Victim reveals how she was left with flesh-eating disease after GP did not see her face-to-face then fled to India

      February 23, 2026

      ‘Andrew, the prince of darkness’: Global media mark ‘the end of privilege’ for Mountbatten-Windsor and gloat that the royal is ‘at rock bottom’

      February 22, 2026

      Melania Trump stuns in silver pants as she arrives at controversial Governor’s Dinner with husband Donald as dozens threaten boycott after president’s turbulent week

      February 22, 2026
    • Politics

      Law enforcement says eight killed by avalanche in California mountains | Weather News

      February 18, 2026

      Bangladesh PM-to-be and lawmakers sworn into parliament | Sheikh Hasina

      February 17, 2026

      Hillary Clinton gets in testy exchange with European leader over Trump

      February 16, 2026

      At least 11 Palestinians killed in Israeli attacks across Gaza | Gaza News

      February 15, 2026

      DOJ sends letter to Congress with list of people named in Epstein files, including Trump: Report

      February 15, 2026
    • Tech

      Apple’s AI Wearables Expected to Lean Heavily on Visual Intelligence

      February 23, 2026

      What to Know About At-Home STI Tests: Pros, Cons, and Recommendations (2026)

      February 23, 2026

      10 Clever Home Appliance Innovations You’ll See in 2026

      February 22, 2026

      Runlayer is now offering secure OpenClaw agentic capabilities for large enterprises

      February 22, 2026

      Tesla's "cheaper" Cybertruck arrives at $59,990, still far from the $40K promise

      February 21, 2026
    • Business

      Here’s the latest.

      November 6, 2026

      Retailers say Budget will make it harder to hire young people

      November 2, 2026

      Healey faces bingo backlash as Budget tax raid puts 77 sites and 1,200 jobs at risk

      October 30, 2026

      Fed Holds Rates Steady Despite ‘Elevated’ Inflation

      October 29, 2026

      ‘We cannot tax our way to prosperity’: Chancellor urged to back British business or face ‘generation of stagnation’

      October 26, 2026
    • Sports

      Abu Dhabi Championship: McIlroy shoots 63 to move into contention on day two

      November 6, 2026

      JJ Gabriel on the verge of joining Real Madrid: Man United wonderkid, 16, is finalising move to Spanish giants after Old Trafford quit bombshell

      November 4, 2026

      Client Challenge

      November 3, 2026

      Champions League: Carrick fights for Man U life, Inter’s crisis, more

      November 3, 2026

      Thierno Barry’s revival: From nightmare debut season to Everton hero

      November 2, 2026
    • Health

      The disturbing Mounjaro and Ozempic side effect that can make even the lightest touch feel like your skin is ‘on fire’… and why doctors think your dose may be to blame

      November 6, 2026

      Why oat and almond milks could be bad for your health

      November 5, 2026

      Is Heinz tomato soup healthy? Dietitians reveal the surprising benefits of canned soups – and the best pick for a filling, fibre-packed dinner

      November 4, 2026

      Flouting Consumer Law, Insurers Refuse to Pay Medical Bills for Emergency Care

      November 3, 2026

      Trouble for anxiety sufferers as Whole Foods anti-anxiety capsules are recalled over Salmonella fears

      November 3, 2026
    • Science

      Ever wonder where our math symbols came from? Here are their stories

      February 19, 2026

      Some dog breeds carry a higher risk of breathing problems

      February 19, 2026

      New study links early smartphone ownership to health risks

      February 18, 2026

      The Story of Stories traces the arc of storytelling across human history

      February 17, 2026

      Listen to the crackle of ‘mini-lightning’ on Mars

      February 16, 2026
    • Entertainment

      Paul McCartney and Wings Exhibit Set at Rock & Roll Hall of Fame

      February 18, 2026

      Warner Bros Latest Hollywood Studio To Warn Seedance Over AI Infringement

      February 18, 2026

      Cardi B on Stefon Diggs Relationship Status

      February 17, 2026

      Jelly Roll Will Receive Country Radio’s Humanitarian Award

      February 17, 2026

      X Down For Thousands In U.S. And UK

      February 16, 2026
    TopheadlinesTopheadlines
    Home»Tech»Qwen3-Coder-Next offers vibe coders a powerful open source, ultra-sparse model with 10x higher throughput for repo tasks
    Tech

    Qwen3-Coder-Next offers vibe coders a powerful open source, ultra-sparse model with 10x higher throughput for repo tasks

    February 4, 20266 Mins Read
    Facebook Twitter Pinterest LinkedIn WhatsApp Reddit Tumblr Email
    Qwen3-Coder-Next offers vibe coders a powerful open source, ultra-sparse model with 10x higher throughput for repo tasks
    Share
    Facebook Twitter LinkedIn Pinterest Email



    Chinese e-commerce giant Alibaba's Qwen team of AI researchers has emerged in the last year as one of the global leaders of open source AI development, releasing a host of powerful large language models and specialized multimodal models that approach, and in some cases, surpass the performance of the proprietary U.S. leaders such as OpenAI, Anthropic, Google and xAI.

    Now the Qwen team is back again this week with a compelling release that matches the "vibe coding" frenzy that has arisen in recent months: Qwen3-Coder-Next, a specialized 80-billion-parameter model designed to deliver elite agentic performance within a lightweight active footprint.

    It's been released on a permissive Apache 2.0 license, enabling commercial usage by large enterprises and indie developers alike, with the model weights available on Hugging Face in four variants and a technical report describing some of its training approach and innovations.

    The release marks a major escalation in the global arms race for the ultimate coding assistant, following a week that has seen the space explode with new entrants. From the massive efficiency gains of Anthropic’s Claude Code harness to the high-profile launch of the OpenAI Codex app and the rapid community adoption of open-source frameworks like OpenClaw, the competitive landscape has never been more crowded.

    In this high-stakes environment, Alibaba isn't just keeping pace — it is attempting to set a new standard for open-weight intelligence.

    For LLM decision-makers, Qwen3-Coder-Next represents a fundamental shift in the economics of AI engineering. While the model houses 80 billion total parameters, it utilizes an ultra-sparse Mixture-of-Experts (MoE) architecture that activates only 3 billion parameters per forward pass.

    This design allows it to deliver reasoning capabilities that rival massive proprietary systems while maintaining the low deployment costs and high throughput of a lightweight local model.

    Solving the long-context bottleneck

    The core technical breakthrough behind Qwen3-Coder-Next is a hybrid architecture designed specifically to circumvent the quadratic scaling issues that plague traditional Transformers.

    As context windows expand — and this model supports a massive 262,144 tokens — traditional attention mechanisms become computationally prohibitive.

    Standard Transformers suffer from a "memory wall" where the cost of processing context grows quadratically with sequence length. Qwen addresses this by combining Gated DeltaNet with Gated Attention.

    Gated DeltaNet acts as a linear-complexity alternative to standard softmax attention. It allows the model to maintain state across its quarter-million-token window without the exponential latency penalties typical of long-horizon reasoning.

    When paired with the ultra-sparse MoE, the result is a theoretical 10x higher throughput for repository-level tasks compared to dense models of similar total capacity.

    This architecture ensures an agent can "read" an entire Python library or complex JavaScript framework and respond with the speed of a 3B model, yet with the structural understanding of an 80B system.

    To prevent context hallucination during training, the team utilized Best-Fit Packing (BFP), a strategy that maintains efficiency without the truncation errors found in traditional document concatenation.

    Trained to be agent-first

    The "Next" in the model's nomenclature refers to a fundamental pivot in training methodology. Historically, coding models were trained on static code-text pairs—essentially a "read-only" education. Qwen3-Coder-Next was instead developed through a massive "agentic training" pipeline.

    The technical report details a synthesis pipeline that produced 800,000 verifiable coding tasks. These were not mere snippets; they were real-world bug-fixing scenarios mined from GitHub pull requests and paired with fully executable environments.

    The training infrastructure, known as MegaFlow, is a cloud-native orchestration system based on Alibaba Cloud Kubernetes. In MegaFlow, each agentic task is expressed as a three-stage workflow: agent rollout, evaluation, and post-processing. During rollout, the model interacts with a live containerized environment.

    If it generates code that fails a unit test or crashes a container, it receives immediate feedback through mid-training and reinforcement learning. This "closed-loop" education allows the model to learn from environment feedback, teaching it to recover from faults and refine solutions in real-time.

    Product specifications include:

    • Support for 370 Programming Languages: An expansion from 92 in previous versions.

    • XML-Style Tool Calling: A new qwen3_coder format designed for string-heavy arguments, allowing the model to emit long code snippets without the nested quoting and escaping overhead typical of JSON.

    • Repository-Level Focus: Mid-training was expanded to approximately 600B tokens of repository-level data, proving more impactful for cross-file dependency logic than file-level datasets alone.

    Specialization via expert models

    A key differentiator in the Qwen3-Coder-Next pipeline is its use of specialized Expert Models. Rather than training one generalist model for all tasks, the team developed domain-specific experts for Web Development and User Experience (UX).

    The Web Development Expert targets full-stack tasks like UI construction and component composition. All code samples were rendered in a Playwright-controlled Chromium environment.

    For React samples, a Vite server was deployed to ensure all dependencies were correctly initialized. A Vision-Language Model (VLM) then judged the rendered pages for layout integrity and UI quality.

    The User Experience Expert was optimized for tool-call format adherence across diverse CLI/IDE scaffolds such as Cline and OpenCode. The team found that training on diverse tool chat templates significantly improved the model's robustness to unseen schemas at deployment time.

    Once these experts achieved peak performance, their capabilities were distilled back into the single 80B/3B MoE model. This ensures the lightweight deployment version retains the nuanced knowledge of much larger teacher models.

    Punching up on benchmarks while offering high security

    The results of this specialized training are evident in the model's competitive standing against industry giants. In benchmark evaluations conducted using the SWE-Agent scaffold, Qwen3-Coder-Next demonstrated exceptional efficiency relative to its active parameter count.

    On SWE-Bench Verified, the model achieved a score of 70.6%. This performance is notably competitive when placed alongside significantly larger models; it outpaces DeepSeek-V3.2, which scores 70.2%, and trails only slightly behind the 74.2% score of GLM-4.7.

    Crucially, the model demonstrates robust inherent security awareness. On SecCodeBench, which evaluates a model's ability to repair vulnerabilities, Qwen3-Coder-Next outperformed Claude-Opus-4.5 in code generation scenarios (61.2% vs. 52.5%).

    Notably, it maintained high scores even when provided with no security hints, indicating it has learned to anticipate common security pitfalls during its 800k-task agentic training phase.

    In multilingual multilingual security evaluations, the model also demonstrated a competitive balance between functional and secure code generation, outperforming both DeepSeek-V3.2 and GLM-4.7 on the CWEval benchmark with a func-sec@1 score of 56.32%.

    Challenging the proprietary giants

    The release represents the most significant challenge to the dominance of closed-source coding models in 2026. By proving that a model with only 3B active parameters can navigate the complexities of real-world software engineering as effectively as a "giant," Alibaba has effectively democratized agentic coding.

    The "aha!" moment for the industry is the realization that context length and throughput are the two most important levers for agentic success.

    A model that can process 262k tokens of a repository in seconds and verify its own work in a Docker container is fundamentally more useful than a larger model that is too slow or expensive to iterate.

    As the Qwen team concludes in their report: "Scaling agentic training, rather than model size alone, is a key driver for advancing real-world coding agent capability". With Qwen3-Coder-Next, the era of the "mammoth" coding model may be coming to an end, replaced by ultra-fast, sparse experts that can think as deeply as they can run.



    Source link

    Share. Facebook Twitter Pinterest LinkedIn Tumblr Telegram Email

    Related Posts

    Apple’s AI Wearables Expected to Lean Heavily on Visual Intelligence

    February 23, 2026

    What to Know About At-Home STI Tests: Pros, Cons, and Recommendations (2026)

    February 23, 2026

    10 Clever Home Appliance Innovations You’ll See in 2026

    February 22, 2026
    Top Posts

    Here’s the latest.

    November 6, 2026

    Francis Ngannou claims he is Man United’s ‘favourite heavyweight boxer’ as he teases Tyson Fury

    July 31, 2023

    Turn Your Favorite Pet Photos Into a Pawfect Portrait for Just $20

    July 31, 2023

    Mauricio Diazgranados Is a Botanist in a Hurry

    July 31, 2023
    Don't Miss
    Tech

    Meta Reportedly Eyeing ‘Super Sensing’ Tech for Smart Glasses

    Tech 2 Mins Read

    Meta is reportedly developing what it calls a “super sensing” type of facial recognition technology…

    RAY MASSEY: Citroen’s e-C3 Urban Range is a multi-tasker

    May 16, 2026

    Many Doctors Have Never Seen Measles Before

    April 8, 2025

    The 12 Best Sheets of 2025: Tested by CNET

    January 5, 2025
    Stay In Touch
    • Facebook
    • Twitter
    • Instagram
    About Us
    About Us

    Delivering timely and accurate news updates, our website keeps you informed on the latest events, politics, entertainment, and more. Dive into captivating articles crafted by our team of expert writers, providing a comprehensive view of the world. Stay ahead with our trusted news source.

    Facebook Twitter Instagram
    Our Picks

    SEC’s X Account Hacked, Causing Frenzy Over Bitcoin ETF

    January 10, 2024

    Two AI trailblazers win the 2024 Nobel Prize in physics

    October 9, 2024

    Dana Carvey Says He’s “Working On” Elon Musk Impression

    March 22, 2025
    © 2026 Designed by TopHeadlineSpot.
    • Business
    • Latest News
    • Politics
    • Health
    • Entertainment
    • Sports
    • Science
    • Tech

    Type above and press Enter to search. Press Esc to cancel.