GitHub HydraFusion: Multi-Model Copilot Routing 2026
September 14, 2026
Project HydraFusion is a GitHub Copilot research preview that routes a single coding prompt across multiple models at runtime — drafting, critiquing, or escalating as needed. GitHub opened a placeholder community thread for it on September 1, 2026 and published the full announcement and its benchmark data on September 4, reporting cost cuts on all three benchmarks it ran and a quality gain on one.12
TL;DR
GitHub called the write-up "Project HydraFusion: Frontier quality via multi-model orchestration."1 The table under that title is more interesting than the title.
Across Terminal-Bench 2.1, DeepSWE, and an internal benchmark called CheckpointBench, HydraFusion cut estimated cost every time — 67%, 36%, and 65% against a Claude Opus 5 baseline. Verified task quality went up on one benchmark (+4.9 points) and slightly down on the other two (−1.5 and −0.1).1
That is a good result. It is a cost result, not a capability result, and GitHub's own numbers say so.
Three details did not travel with the coverage: the benchmark HydraFusion won on had already been followed by two newer Terminal-Bench releases — 3.0 and its 4.0 revision — before the announcement; the summary table reports only deltas, with the absolute scores tucked into interactive charts further down the post; and the router has a documented paper trail running back through Copilot's existing Auto mode to a Microsoft research paper.
What You'll Learn
- What GitHub actually shipped, and the three commands to turn it on
- How the Single, Cascade, and Critique patterns differ, and where the cost saving most likely comes from
- What the benchmark table says versus what the announcement headline says
- Why the benchmark HydraFusion won on already had two newer versions from its own maintainers
- The arXiv paper HydraFusion is named after, and the version history GitHub published linking the two
- How this differs from Copilot's existing Auto model selection — in GitHub's own words
- Why LangChain's and OpenRouter's numbers show the same shaped gap
- What to check before you point a team's budget at a router
What GitHub shipped
GitHub opened a Project HydraFusion thread in its community forum's Copilot News and Announcements category on September 1, 2026, with a one-line "Coming soon" placeholder as its body. On September 4 it published the engineering write-up and benchmark table and, minutes later, replaced the placeholder with the full announcement and FAQ.12
It is available on all GitHub Copilot plans through /experimental in GitHub Copilot CLI. Three commands turn it on: /update to install the latest CLI, /experimental on, then /model and select HydraFusion (Research Preview).1
Copilot CLI is the only announced surface. GitHub's September 10 changelog files HydraFusion strictly under Copilot CLI — "Project HydraFusion is now in /experimental" — and says nothing about other clients.3 The announcement thread says the Copilot app and VS Code are "both targeting September as a fast follow," but neither had an announced rollout as of September 12: VS Code 1.137 shipped on September 9 without it, and the only word in the thread since is a September 10 reply from a Microsoft employee answering on the team's behalf, telling a user asking about VS Code Insiders "yes, we are working on that" — no date attached. The code has since moved slightly ahead of the thread: on September 11, VS Code merged an off-by-default, experimental chat.copilot.hydraFusion.enabled setting for its Copilot agent host into its main development branch, though a cherry-pick into the 1.138 release branch was closed unmerged and no VS Code release notes mention it.234
Billing is simple to state and easy to underestimate. "There is no separate HydraFusion charge," GitHub's FAQ says. "You pay for the constituent models it runs, so the cost of a turn is the sum of its phases."2
That billing note deserves a second read. A router that draft-critiques-revises a task is billing three model legs where a single-model run bills one. GitHub's cost figures are net of that, but they are best-tuned per-task averages over a benchmark suite — not a promise about your next prompt. Teams already tracking spend under Copilot's AI Credits billing will want per-session visibility before switching a whole team over.
The preview is deliberately narrow. GitHub says first-turn, single-prompt coding tasks are "the best place to start," with strong multi-turn performance the next focus.1 If your workflow is a long iterative session, this preview is not aimed at you yet.
The three execution patterns
HydraFusion treats workflow selection as an optimization problem, scoring each request on capability signals for reasoning, code generation, debugging, and tool use, then picking the least complex workflow expected to clear the quality bar.1
There are three:
| Pattern | What happens | What it optimizes |
|---|---|---|
| Single | One model solves the task directly, no review or escalation | Speed and cost when one model suffices |
| Cascade | An efficient model drafts; a quality gate accepts it or escalates to a stronger model | Cheap first attempt with a path to stronger inference |
| Critique | One model drafts, an independent critic from a different model family reviews in an isolated tool-less context, the drafting model revises once | An outside perspective when review beats another unaided attempt |
Table: HydraFusion's three execution patterns. Source: GitHub, September 4, 2026.1
Cascade is the most likely home of the cost story — GitHub does not break savings down by pattern — and there the saving comes from how the traffic splits rather than from any model getting better. The cheap model runs on every Cascade request; the expensive one runs only when the gate rejects the draft. VentureBeat surfaced the same reading, quoting a developer's analysis of the published results: "You pay the cheap model on every cascade request."5
Critique is not new to Copilot. It follows the same review pattern as Rubber Duck, the CLI's built-in critic agent, generally available since June 2, 2026. GitHub's documentation calls it "a key design feature" that rubber duck "deliberately runs on a different AI model from the one driving your session," so the critic "is less likely to share the same blind spots, biases, or failure modes as the model that produced the work."6
Around those patterns sit five operating principles GitHub spells out: complete cost accounting across every leg, bounded execution with explicit timeouts, isolated review that cannot touch the repository, fail-safe application that applies no patch when a workflow fails validation, and validated routing that verifies model bindings and availability before execution begins.1
The fail-safe rule is the one that matters for repository hygiene. A partially applied multi-model patch would be worse than no patch at all.
One usability trade-off is disclosed openly. HydraFusion shows workflow stages but holds intermediate drafts until it returns a single coherent result, because those drafts may be revised or discarded. GitHub's own framing: "Waiting without enough visibility is a real trade-off for developers."1
What the benchmark table actually says
GitHub evaluated fixed HydraFusion policies across three agentic coding benchmarks, using Claude Opus 5 and GPT-5.6 Sol as comparison baselines, with all models at the same medium reasoning level.1
Cost accounting included every invoked leg — drafting, critique, revision, escalation, retry, and fallback. "Verified task quality" means the share of tasks confirmed as correctly answered.1
| Benchmark | Cost vs. Opus 5 | Quality vs. Opus 5 |
|---|---|---|
| Terminal-Bench 2.1 | 67% lower | +4.9 points |
| DeepSWE | 36% lower | −1.5 points |
| CheckpointBench (internal) | 65% lower | −0.1 points |
Table: HydraFusion quality and cost across three agentic benchmarks, relative to Opus 5. Source: GitHub, September 4, 2026.1
Read the two columns separately and the shape is clear. Cost fell three times out of three. Quality rose once out of three. GitHub summarises all three rows together as having "matched or exceeded the evaluated Opus 5 baseline," which is a fair reading of a 0.1-point gap on CheckpointBench and a generous one of 1.5 points on DeepSWE.1
VentureBeat counted it more strictly, and put that in its headline: cost cuts in every benchmark, quality matched in one.5
Three qualifications are worth adding, and none of them is fatal.
CheckpointBench is effectively parity. A 0.1-point gap at 65% lower cost is a strong result, and CheckpointBench is, on GitHub's description, the test closest to real usage: an internal multi-turn suite curated from real Copilot sessions, each anchored to a public repository and an immutable commit so every session is replayable. GitHub says it "closely mirrors production agentic sessions."1
DeepSWE is the more demanding of the two public benchmarks, and the gap there is real. GitHub's own framing is that DeepSWE contributes "more demanding repository-level tasks" to the evaluation.1 Datacurve released it on May 26, 2026: 113 original long-horizon tasks across 91 repositories in TypeScript, Go, Python, JavaScript, and Rust, with every reference solution written from scratch rather than copied or adapted from an existing pull request, commit, or public patch.7 Losing 1.5 points there while cutting cost 36% is a defensible trade, not a tie.
The table is relative; the charts are not. Table 1 expresses every figure against the Opus 5 baseline, but the interactive charts under each benchmark heading plot absolute numbers from Copilot CLI: on Terminal-Bench 2.1, HydraFusion resolves 84.7% of tasks (pass@1) at a mean $0.30 per task against Opus 5's 79.8% at $0.90; on DeepSWE, 62.6% at $2.70 against 64.1% at $4.20; on CheckpointBench, a mean session score of 77.5 at $8.50 against 77.6 at $24.10. The same charts plot GPT-5.6 Sol, the second named baseline the table leaves out. On DeepSWE it lands at 60.4% for $2.40 per task, 2.2 points below HydraFusion at a slightly lower cost.1 Those absolutes do not line up with the public leaderboard: DeepSWE's v1.1 leaderboard lists Claude Opus 5 at 74% ±4%, about ten points above the 64.1% in GitHub's chart. The details explain the gap. DeepSWE holds the harness fixed, running every model on mini-swe-agent, and by default shows each model's best configuration across effort levels. Opus 5's 74% is its [max]-effort run, and its medium-effort run on the same leaderboard scores 68.9%. GitHub ran inside its own harness, at medium reasoning. As we have written about benchmark harnesses before, the scaffolding around a model can move scores by as much as a model generation does.17
One more line from the same section belongs here: "The results below show the best tuned HydraFusion configuration."1 The published deltas are a best case, not a typical configuration. GitHub's own Terminal-Bench 2.1 development chart also labels a cluster of 11 reruns "±7.3-task noise". On an 89-task benchmark that is roughly ±8 points, wider than the 4.9-point margin in the table.1
The most quotable endorsement is also the most carefully bounded: "So far, the reasoning and task solving capability [of HydraFusion] is at or better than Opus," a Principal Software Engineer at Microsoft is quoted as saying — internally, and unnamed.1
The benchmark it won on already has two newer versions
Terminal-Bench 2.1 is the one benchmark where HydraFusion beat Opus 5. It is also the older of the two public ones — CheckpointBench is internal and undated. (GitHub renders the name "TerminalBench 2.1"; the maintainers write it Terminal-Bench.)
The Terminal-Bench team released 2.1 on May 6, 2026. It kept the 89-task collection from 2.0 and repaired 28 of those tasks, fixing external dependencies that had drifted, resource budgets too tight for valid solutions to finish, and cases where instructions did not match the tests. After the repairs, no task in the set was unsolved. The benchmark is hosted by Stanford, Harbor, and the Laude Institute, with Kelly Buchanan leading the 2.1 release.8
Then it moved on. Terminal-Bench 3.0 shipped on July 30, 2026, and Terminal-Bench 4.0 on August 28, 2026 — the latter a semantically versioned revision of 3.0 that calibrates task resources and removes saturated tasks. Snorkel AI's leaderboard now lists 2.1 as Archived, and describes 3.0 on its own page as "a harder, more domain-diverse successor to Terminal-Bench 2.1".8910
Line the dates up and the gap is specific. Terminal-Bench 3.0 had been out for nearly four weeks by August 25, the point at which GitHub says the Terminal-Bench 2.1 run series reached its strongest recorded configurations. Version 4.0 landed on August 28. GitHub published on September 4.1910
DeepSWE has a version question too. Datacurve shipped DeepSWE v1.1 on June 14, 2026 — same 113 tasks, but graded in an isolated container from the committed patch, with dependency drift fixed and flaky tests removed. GitHub's post does not say which version it evaluated.7
GitHub is not hiding from the saturation point. Its own post says Terminal-Bench 2.1's "relative saturation makes broader validation important," which is exactly why DeepSWE was included.1 The development record is candid in other ways too: between August 11 and August 25, two operational failures in the evaluation harness produced invalid runs, which were excluded and corrected.1
Still, the headline number comes from a benchmark version its own maintainers had followed with two newer releases by publication day. (The 2.1 leaderboard is still live on tbench.ai; "Archived" is Snorkel's label for its own copy, not a takedown by the Terminal-Bench team.)8
The paper underneath the product
The name is not decorative. HydraFusion takes its name from HyDRA — Hybrid Dynamic Routing Architecture — a Microsoft routing paper submitted to arXiv on May 16, 2026 and revised on June 12.511
The lineage shows in the author list. HyDRA's arXiv listing names Aashna Garg, Siddharth Singha Roy, Jinu Jang, Federico Brancasi, and Shengyu Fu; the revised June paper adds a sixth author, Giuseppe Cianci. Three of them — Garg, Roy, and Fu — appear on GitHub's HydraFusion team.111
The technical fingerprint matches too. HyDRA uses a ModernBERT encoder with four independent sigmoid heads that score each query on reasoning, code generation, debugging, and tool use, then applies shortfall matching to pick the cheapest model whose profile clears the predicted requirement.11
Those four dimensions are the same four "capability signals" GitHub says HydraFusion uses to select an execution pattern.1 The same four turn up a third time, in different words, in the July 1 changelog for Auto model selection: Copilot "evaluates your task across several dimensions like reasoning, code generation complexity, bug diagnosis difficulty, and tool orchestration needs" to pick a model.12
The version history is not speculation either. GitHub's community announcement lays it out in one line, with HyDRA hyperlinked to the arXiv PDF:
"Progression: Auto V1 (Jan 2026, capacity/SKU-aware per-request selection) → Auto V2 aka. HyDRA (May 2026, intent-scored routing) → HydraFusion (Aug 2026, per-turn orchestration and cache-aware workflows)."2
That says something more specific than "HydraFusion is HyDRA." HyDRA is Auto — Auto V2, per GitHub's own naming, shipping since May without being branded as such. The paper's deployment claim matches: HyDRA runs in Copilot's VS Code Chat auto-mode.11 HydraFusion is the generation after it, and what GitHub credits it with is per-turn orchestration and cache-aware workflows — a second decision layered on the first.
What no source states outright is that HydraFusion runs HyDRA's classifier internally. The circumstantial case is strong — shared authors, identical scoring axes, a documented direct lineage — but the paper describes a model picker and HydraFusion picks a workflow, so treat "the paper is the routing brain" as the most likely reading rather than a confirmed architecture.
Two numbers from the paper are worth carrying over.
The predictor runs at 86 ms median CPU inference latency in production, per the paper's abstract (the revised June paper body instead reports 55 ms P50 routing overhead), and is fully decoupled from the model catalog — adding or removing a model is a configuration change with zero retraining.11 If HydraFusion inherits that property, it is what would make GitHub's stated plan to evaluate and fold new models into the pool as the frontier advances credible rather than aspirational.1
And on SWE-Bench Verified with a five-model pool, HyDRA's tunable threshold spans three regimes: peak quality beat an always-Claude-Sonnet-4.6 baseline (75.4% versus 74.2% resolution) at 12.9% cost savings; iso-quality came within 0.3 points of Sonnet at 54.1% savings, a 6x improvement over Microsoft's prior in-house binary router at 9.1%; and an aggressive setting reached 72.5% savings for a 3.2-point quality trade.11
That last line is the honest generalization of the whole category. Routing gives you a dial between cost and quality. Where you set the dial determines which of those two numbers you get to brag about.
It also explains an otherwise odd asymmetry: the paper says HyDRA is deployed to all users in Copilot's VS Code Chat auto-mode, while HydraFusion is an experimental preview in the CLI only.1112 The classifier is production infrastructure. The orchestration generation after it is the part still being tested.
HydraFusion vs Auto model selection
Copilot already had a router. Auto model selection reached general availability in Copilot CLI on April 17, 2026, came to the Copilot cloud agent on May 14, and was routing on task type as well as utilization and model health — in VS Code from May 20 and in Copilot CLI from July 1.131412 Those surface dates sit alongside the version history above rather than against it: GitHub's Auto V1/V2 line tracks the routing engine, while the changelog tracks which surface got it when.2
So what is new? GitHub's chief product officer, Mario Rodriguez, drew the line for VentureBeat:
"I would say routing to the right model is quickly becoming table stakes, but where HydraFusion is different is that it is addressing the 'what's the best way to solve this task' rather than 'which model should handle this task?'"5
And on how the two coexist: "Practically, Auto is about intelligently selecting a model and HydraFusion is about orchestrating a workflow." He added that GitHub sees them as complementary and is "evaluating the possibility of converging HydraFusion into Auto."5
GitHub's own FAQ says the same thing in plainer terms: "Auto and HydraFusion are both intelligent model routing, and we expect them to come together into a single experience over time. We're still evaluating what that looks like."2
The distinction is real. Auto picks one model per request. HydraFusion decides how many model calls the request gets and what role each one plays. One is selection; the other is composition.
The convergence remark is the part to file away. If HydraFusion folds into Auto, workflow orchestration stops being an opt-in experiment and becomes the default path for anyone who leaves model selection on Auto.
The rest of the routing market has the same gap
This is not a GitHub problem. VentureBeat made the same observation about the routing market as a whole, and two other launches this summer came with numbers that tell on themselves.5
NVIDIA announced NeMo Switchyard on August 11, 2026 alongside Nemotron 3.5 Lightning. LangChain published a benchmark of it the same day — 145 multi-step agentic tasks — and found routing cut cost 74% against a Claude Opus 4.8 baseline while accuracy fell from 86.0% to 80.0%. Only 7% of calls went to the frontier model, and those carried 68.4% of the bill. We covered what that benchmark actually showed in August.15
LangChain's own framing was notably plainer than the vendor's: "Routing is a trade. 74% cheaper for about six points of accuracy reduction."15
OpenRouter shipped a rebuilt Auto router on August 10, 2026, describing model selection driven by market spend as outperforming its old router "across a wide spectrum of tasks and cost levels."16
Its own table, at the default cost tier, is more mixed than that sentence. The new router scored below the old one on MMLU Pro (85.2% versus 86.6%) and τ³-bench Banking (20.6% versus 21.0%, within the table's ±1.0 error bars), tied on SWE-Atlas QnA (30.4% both), and won clearly on WideSearch and DSQA. At the max cost tier it wins on all five — while costing more than the old router on four of them.16
Three vendors, three launches, one pattern: the quality column is split, and even the cost column depends on the setting — at its default tier, OpenRouter's new router still cost more than its old one on DSQA ($276.00 versus $147.11).16 That consistency is itself informative. Tuned for savings, routing saves money; tuned for quality, it can cost more. Whether it preserves quality depends entirely on where the gate is set.
What this changes for teams
Quality has stopped being the only axis these products are tuned on — a shift VentureBeat flagged too — and GitHub is explicit about it: HydraFusion's candidate routing policies were generated by beam search and measured against a frozen baseline "on quality, cost, and failure modes."15 Cost is a first-class objective in the optimisation, not a side effect of it.
Four things are worth settling before you route a team's budget through any of these.
Decide which number you are buying. These systems have a cost-quality dial inside them, whether or not the UI shows it. HyDRA's paper makes the trade explicit with three published threshold regimes. As of September 14, HydraFusion exposes no documented equivalent control, and that appears to be deliberate. Asked in the announcement thread for a "cost/quality temperature," a Microsoft employee answering there called it "a real dimension" the team thinks about, but replied that HydraFusion "is already deliberately willing to spend more when it raises the probability of getting it right" and that the behaviour "should already be built-in." On model choice specifically, GitHub's FAQ says "Not today," describes "a curated mix" whose roster it deliberately does not publish, and closes: "We know some teams need more control here and we're looking into it."112 Know which point on the curve you have been handed — and that today you cannot move it.
Instrument per-session spend, not per-request. A router that drafts, critiques, and revises bills several model calls for one prompt. Benchmark averages will not tell you what your worst session costs. The move toward session-level spend caps reflects the same problem: monthly, account-wide limits do not describe what a single agent run can cost.
Match the preview to your workflow. HydraFusion is tuned for first-turn, single-prompt tasks and does not yet claim strong multi-turn performance.1 Long iterative sessions are a common pattern for many teams, and they are the case GitHub says is next.
Read the benchmark table before the announcement. In all three cases above, the mixed result was public immediately — GitHub and OpenRouter put it in their own posts, and LangChain published the Switchyard numbers the day NVIDIA announced it. The marketing sentence and the table say slightly different things every time. Read the table first.
The bottom line
Runtime orchestration is a genuinely interesting bet. GitHub says so plainly: "moving from choosing the best model to dynamically constructing the best way to solve each task."1
The engineering around it is careful — isolated review contexts, bounded execution, complete multi-leg cost accounting, and no patch applied when a workflow fails validation.1 Those are the details that separate a research demo from something you would point at a repository.
But the numbers under the claim say cost three times and quality once. Three routing tables landed inside twenty-five days — OpenRouter's on August 10, Switchyard's on August 11, HydraFusion's on September 4 — and in all three the headline sentence reads broader than the table beneath it. The category is converging on a real capability — spending less on the tasks that do not need a frontier model — and on marketing language that describes it as something slightly larger than that.
For most teams the honest framing is the useful one. Routing is a cost-engineering tool with a quality setting attached. Find out where that setting has been left, and watch what a session costs on the days the gate misfires.
References
Footnotes
-
Project HydraFusion: Frontier quality via multi-model orchestration — The GitHub Blog, GitHub Staff, published September 4, 2026 (16:04 UTC), last modified September 4, 2026. Primary source for the research preview status; availability on all Copilot plans via
/experimentalin Copilot CLI; the/update,/experimental on,/modelenablement steps; token billing at each model's standard rate; the Single, Cascade, and Critique patterns; the Critique pattern following the Rubber Duck review pattern; the five operating principles (complete accounting, bounded execution, isolated review, fail-safe application, validated routing); the benchmark table (TerminalBench 2.1 67% lower cost / +4.9 points, DeepSWE 36% / −1.5, CheckpointBench 65% / −0.1); the absolute figures in the post's interactive scatter charts, each titled for GitHub Copilot CLI (TerminalBench 2.1 resolution rate, pass@1: HydraFusion 84.7% at $0.30 mean cost per task versus Opus 5 at 79.8% and $0.90; DeepSWE: 62.6% at $2.70 versus 64.1% at $4.20, with GPT-5.6-Sol at 60.4% and $2.40; CheckpointBench mean session score: 77.5 at $8.50 versus 77.6 at $24.10), which are rendered by JavaScript and do not appear in text-only copies of the page; the TerminalBench 2.1 development chart's "11 reruns · ±7.3-task noise" annotation; the "matched or exceeded the evaluated Opus 5 baseline" summary from the page's meta description; Claude Opus 5 and GPT-5.6 Sol as comparison baselines; the medium reasoning level; the definition of verified task quality and the cost-accounting scope; CheckpointBench's construction from real Copilot sessions anchored to immutable commits; the "relative saturation" comment on TerminalBench 2.1; the August 11–25 evaluation harness failures and August 25 strongest operating points; the beam-search policy search; the first-turn single-prompt scope and multi-turn roadmap; the withheld intermediate drafts and "waiting without enough visibility" quote; the unnamed Microsoft Principal Software Engineer quote; the closing "dynamically constructing the best way to solve each task" framing; and the team list including Aashna Garg, Shengyu Fu, Carlos Castro, Siddharth Singha Roy, and Andy Salerno. ↩ ↩2 ↩3 ↩4 ↩5 ↩6 ↩7 ↩8 ↩9 ↩10 ↩11 ↩12 ↩13 ↩14 ↩15 ↩16 ↩17 ↩18 ↩19 ↩20 ↩21 ↩22 ↩23 ↩24 ↩25 ↩26 ↩27 ↩28 ↩29 ↩30 ↩31 ↩32 ↩33 ↩34 ↩35 ↩36 ↩37 ↩38 ↩39 -
[Research Preview] HydraFusion is live in GitHub Copilot CLI: Frontier quality via multi-model orchestration — GitHub Community discussion #206492, opened by GitHub maintainer
ebndevin Copilot News and Announcements on September 1, 2026 with a "Coming soon" placeholder body and edited into the full announcement on September 4, 2026 (16:10–16:11 UTC, per the discussion's edit history), accessed September 14, 2026. This is the discussion the September 4 blog post directs readers to for feedback. Source for the September 1 thread-creation date; the quoted progression line, "Progression: Auto V1 (Jan 2026, capacity/SKU-aware per-request selection) → Auto V2 aka. HyDRA (May 2026, intent-scored routing) → HydraFusion (Aug 2026, per-turn orchestration and cache-aware workflows)," in which HyDRA is hyperlinked to the arXiv PDF; the billing answer, "There is no separate HydraFusion charge. You pay for the constituent models it runs, so the cost of a turn is the sum of its phases"; the model-selection answer, "Not today. HydraFusion picks from a curated mix… so we don't publish a fixed roster," which closes "We know some teams need more control here and we're looking into it"; the availability answer, "Today, only in GitHub Copilot CLI… The GitHub Copilot app and VS Code are both targeting September as a fast follow"; and the convergence statement, "Auto and HydraFusion are both intelligent model routing, and we expect them to come together into a single experience over time. We're still evaluating what that looks like." The cost/quality exchange is from the same thread's comments: userhallatore(September 5, 2026) writes "I wish I could set a cost/quality temperature," andjukasper— Julia Kasper, whose GitHub profile lists Microsoft as her organisation and who answers throughout in the first person plural on the team's behalf; her profile states no job title — replies on September 10, 2026: "This is a real dimension and we think about it a lot. As of today, HydraFusion is already deliberately willing to spend more when it raises the probability of getting it right. that's exactly what the review-and-repair passes are for. It's not trying to find the cheapest path through your request. So this should already be built-in, …" Note that the separate "yes, we are working on that" line in the same numbered reply answers a different request inhallatore's list — VS Code Insiders availability — not the temperature question, and it carries no date. Three later top-level comments — one on September 11 and two on September 12, 2026 — were unanswered as of September 14; one of the September 12 comments asks again about non-CLI availability ("Will it come to the rich client soon (non-CLI)?"). ↩ ↩2 ↩3 ↩4 ↩5 ↩6 ↩7 ↩8 ↩9 ↩10 ↩11 -
GitHub Copilot weekly releases — September 7 — GitHub Changelog, published September 10, 2026, last modified September 11, 2026, accessed September 12, 2026. Source for the quoted line "Project HydraFusion is now in
/experimental" and for the fact that every mention of HydraFusion in the entry is scoped to the CLI — the summary sentence reads "adaptive model orchestration with Project HydraFusion in Copilot CLI," and the detail sits under the GitHub Copilot CLI heading, while the GitHub Copilot app section covers Jira integration and the VS Code 1.137 section covers automations, voice mode, and issue/pull-request details, neither mentioning HydraFusion. The absence of a Copilot app or VS Code rollout as of September 12, 2026 was additionally checked against the GitHub Copilot changelog index for September 2026, the VS Code 1.137 release notes (released September 9, 2026), and GitHub's supported AI models reference, none of which mention HydraFusion outside the CLI. ↩ ↩2 -
Add experimental HydraFusion opt-in for Copilot Agent Host — microsoft/vscode pull request #335628, merged into
mainon September 11, 2026 (07:57 UTC), accessed September 14, 2026. Source for thechat.copilot.hydraFusion.enabledsetting, described in the pull request as off by default and tagged preview/experimental/advanced, and for the temporaryhydrafusionmodel it exposes. A cherry-pick of the change into therelease/1.138branch (#335785) was closed unmerged the same day. ↩ -
GitHub's HydraFusion cuts AI coding costs in every benchmark. It only matches quality in one. — VentureBeat, Sean Michael Kerner, September 4, 2026. Source for the HydraFusion-from-HyDRA naming, both Mario Rodriguez quotes (the "table stakes" distinction and the "Auto is about intelligently selecting a model" / convergence remark), Rodriguez's title as GitHub chief product officer, the cost-versus-quality framing of the benchmark table, the observation that the gap between routing marketing and routing benchmarks recurs across GitHub, NVIDIA, and OpenRouter alike, and the quoted line "You pay the cheap model on every cascade request," which VentureBeat attributes to Awan Farz, described there as a developer who analyzed HydraFusion's published results and posted the analysis on X. That underlying analysis is a social-media post rather than a published evaluation, and is treated here as a reading rather than as evidence. ↩ ↩2 ↩3 ↩4 ↩5 ↩6 ↩7 ↩8 ↩9
-
About the rubber duck agent — GitHub Docs, accessed September 12, 2026. Source for rubber duck being "a built-in agent in GitHub Copilot CLI that acts as a constructive critic" with read-only codebase access, for the quoted "key design feature" that it "deliberately runs on a different AI model from the one driving your session," and for the quoted blind-spots rationale. Note the docs use "a different AI model" in that key sentence and "a model from a different family" only in the later Benefits section; the narrower wording is quoted here. General availability on June 2, 2026 is from the Copilot CLI changelog for that date — "Copilot CLI: Improved UI, rubber duck, prompt scheduling, and voice input" — which states that rubber duck is generally available. Other items in the same release remained experimental; rubber duck did not. ↩
-
DeepSWE — Datacurve, by Wenqi Huang, Charley Lee, Leonard Tng, and Serena Ge, May 26, 2026. Source for the 113 tasks across 91 active open-source repositories in TypeScript, Go, Python, JavaScript, and Rust, and for the quoted contamination-free construction: "the reference solution is written from scratch rather than copied or adapted from an existing pull request, commit, or public patch." The v1.1 details are from DeepSWE v1.1 — Wenqi Huang and Peter Jiang, June 14, 2026 — which "keeps the same long-horizon engineering tasks as v1, but updates how agents are executed and scored by grading their committed code in a clean, isolated environment," and also fixed dependency drift and removed flaky tests on some tasks. The leaderboard figures (Claude Opus 5 at 74% ±4% at
[max]effort and 68.9% at medium effort, every model run onmini-swe-agent) are from the DeepSWE v1.1 leaderboard, data generated September 3, 2026, accessed September 14, 2026. See also the arXiv paper (arXiv:2607.07946, submitted July 8, 2026, same four authors) and thedatacurve-ai/deep-swerepository. ↩ ↩2 ↩3 -
Terminal-Bench 2.1 release notes — The Terminal-Bench Team (TB 2.1 lead: Kelly Buchanan), dated Wed May 06 2026 on the Terminal-Bench blog index, accessed September 12, 2026. Source for the May 6, 2026 release date, the 28 repaired tasks out of the 89 carried over from Terminal-Bench 2.0, the three failure categories (external dependencies, resource mismatches, misspecification), the "no task is unsolved in Terminal-Bench 2.1" result, and the hosting by Stanford, Harbor, and the Laude Institute. The 89-task figure is from that same release note ("we're releasing Terminal-Bench 2.1 to fix issues in 28 of the 89 tasks in Terminal-Bench 2.0"); the framing that 2.1 keeps the 89-task collection from 2.0 is Snorkel's ("Terminal-Bench 2.1 keeps the 89-task collection from Terminal-Bench 2.0 but repairs 28 tasks"). The Archived label is from the Snorkel AI leaderboard page (last modified September 4, 2026) and applies to Snorkel's own leaderboard copy; the Terminal-Bench team still hosts a live 2.1 leaderboard and does not use that word. Snorkel's Terminal-Bench 3.0 FAQ likewise notes that 2.1 "remains a separate, continuously validated release with its own task set and leaderboard." Secondary write-ups circulate a June 2026 date for the 2.1 release; the maintainers' own dated blog index is used here instead. ↩ ↩2 ↩3
-
Terminal-Bench 3.0 — The Terminal-Bench Team, dated Thu Jul 30 2026 on the Terminal-Bench blog index, accessed September 12, 2026. Source for the July 30, 2026 release. The description of 3.0 as "a harder, more domain-diverse successor to Terminal-Bench 2.1" is quoted from the Snorkel AI leaderboard page. ↩ ↩2
-
Terminal-Bench 4.0 — The Terminal-Bench Team, dated Fri Aug 28 2026 on the Terminal-Bench blog index, accessed September 12, 2026. Source for the August 28, 2026 release and its summary line, "Calibrating task resources, fixing tasks, and removing saturated tasks." The same post explains that 4.0 revises the 3.0 task set — "Why is this 4.0 instead of 3.1? Terminal-Bench is now a continuous benchmark and versioning is now semantic" — and reports "fewer agent timeouts and errors than 3.0." Terminal-Bench 4.0 is the currently featured version on the Snorkel AI leaderboard. ↩ ↩2
-
HyDRA: Hybrid Dynamic Routing Architecture for Heterogeneous LLM Pools — arXiv:2605.17106, Aashna Garg, Siddharth Singha Roy, Jinu Jang, Federico Brancasi, and Shengyu Fu (Microsoft), as listed on the arXiv abstract page; the v2 paper itself adds a sixth author, Giuseppe Cianci (Microsoft). Submitted May 16, 2026 (v1); last revised June 12, 2026 (v2). Source for the ModernBERT encoder with K=4 independent sigmoid heads scoring reasoning, code generation, debugging, and tool use; the shortfall-matching selection of the cheapest sufficient model; the 86 ms median CPU inference latency (stated in the abstract; the v2 paper body instead reports 55 ms P50 / 120 ms P99 offline routing overhead on CPU) and zero-retraining catalog decoupling; the SWE-Bench Verified results across the three regimes (peak-quality 75.4% versus a 74.2% Claude Sonnet 4.6 baseline at 12.9% savings; iso-quality at 54.1% savings with 74.0% resolution, within 0.3 points of Sonnet, versus 9.1% for the prior in-house binary router, a 6x improvement; aggressive at 72.5% savings for a 3.2-point quality trade); and deployment to all users in GitHub Copilot's VS Code Chat auto-mode. ↩ ↩2 ↩3 ↩4 ↩5 ↩6 ↩7 ↩8 ↩9
-
Copilot CLI auto model selection routes based on task — GitHub Changelog, July 1, 2026. Source for auto model selection routing on task type in addition to utilization and model health signals in Copilot CLI. Task-based routing reached VS Code earlier, per the May 20, 2026 changelog, "Auto model selection now routes based on your task in VS Code," which lists the same dimensions. ↩ ↩2
-
GitHub Copilot CLI now supports Copilot auto model selection — GitHub Changelog, April 17, 2026. Source for auto model selection reaching general availability in Copilot CLI. ↩
-
Copilot cloud agent supports auto model selection — GitHub Changelog, May 14, 2026. Source for auto model selection arriving in the Copilot cloud agent. ↩
-
How many of your agent's calls actually need a frontier model? — LangChain, Srimanth Tangedipalli and Karan Singh, August 11, 2026. Source for the 145-task Deep Agents evaluation (averaging 6.3 model calls each), the 74% cost reduction against a Claude Opus 4.8 baseline, the accuracy drop from 86.0% to 80.0%, the 7% of calls routed to the frontier model, those calls carrying 68.4% of total spend, and the "Routing is a trade" key takeaway. The NVIDIA announcement date and the pairing with Nemotron 3.5 Lightning are from NVIDIA's own blog, "NVIDIA Nemotron 3.5 Lightning and NeMo Switchyard Deliver Faster, Smarter, More Efficient Agentic AI" by Kari Briski, August 11, 2026, which describes Switchyard as "an open source library for smart routing inside popular agent tools." Note that the Switchyard code shipped earlier — the
NVIDIA-NeMo/Switchyardrepository has releases dated June 30, 2026 — so August 11 is the announcement date, not the first public release. Note also that LangChain labels its post a Partner post; it is not a fully independent evaluation. ↩ ↩2 -
Model Routing Powered by Wisdom of the Market — OpenRouter Blog, August 10, 2026. Source for the rebuilt Auto router, the "across a wide spectrum of tasks and cost levels" claim, and the published benchmark table used here: at the default cost tier, MMLU Pro 85.2% (new) versus 86.6% (old), τ³-bench Banking 20.6% versus 21.0%, SWE-Atlas QnA 30.4% versus 30.4%, WideSearch 61.6% versus 53.1%, and DSQA 62.9% versus 43.2%; the max-tier results (new router ahead on all five); and the cost comparison table, in which the new router's default tier cost more than the old router's on DSQA ($276.00 versus $147.11) and its max tier (
cost_tier=max, compared against the old router'scost_quality_tradeoff=0) cost more on τ³-bench Banking, WideSearch, DSQA, and SWE-Atlas QnA. The per-benchmark win/loss/tie count stated in this post is our own reading of that table. (VentureBeat reports the new router as backing its claim "in three of five test categories"; by our count of the same table it is two clear wins, two losses, and a tie at the default tier.) ↩ ↩2 ↩3

