groundy
models & research

Qwen3.7-Max's Top-Ranked Claim vs the Artificial Analysis Index

Alibaba framed Qwen3.7-Max as globally top-ranked at launch. The Artificial Analysis index scored it 56.6 and ranked it fifth overall, behind Claude and GPT.

7 min · · · 5 sources ↓

Alibaba’s launch-day framing for Qwen3.7-Max, that it sits in the global top tier and ranks first among Chinese models, does not survive contact with the independent leaderboard. On the Artificial Analysis Intelligence Index v4.0 the model scored 56.6 and placed fifth overall, the highest-ranked Chinese model at launch, with Claude Opus 4.7, GPT-5.5, and DeepSeek V4 Pro as the named frontier comparison set. The honest DeepSeek comparison is to V4 Pro, not the “V4.1” some coverage names, which no retrieved source confirms.

What did Alibaba actually claim at the May 20 summit?

At the Alibaba Cloud Summit in Hangzhou on May 20, 2026, Alibaba unveiled Qwen3.7-Max as its most powerful agent foundation model, aimed at long-cycle autonomous tasks where production agents typically crash. API access went live on Model Studio from May 19, with the formal unveiling the next day.

The “top-ranked” claim is worth reading closely. The announcement framed the model as “ranked first among its domestic peers” across coding-agent and complex-reasoning evaluations, “with performance approaching top global levels,” per cntechpost’s coverage of the launch. Two things are doing work in that framing. “Ranked first among its domestic peers” is a domestic claim, scoped to Chinese models only, and “approaching top global levels” is itself an admission that the model is not at the top globally, even in Alibaba’s own wording. The top-of-the-global-leaderboard reading that traveled through coverage is a stronger statement than the company’s phrasing supports.

That gap, between what was said and what got reported, is where the cost of model selection actually lives.

What does Artificial Analysis independently record?

On the Artificial Analysis Intelligence Index v4.0, Qwen3.7-Max scored 56.6 and ranked fifth overall, the highest-placed Chinese model at launch but not a global first. That is still a real result. The same writeup notes the model tops Claude Opus 4.6 Max on Terminal-Bench 2.0, SWE-Bench Pro, and MCP-Atlas. Its cached page truncates before the full benchmark matrix, so the specific sub-scores and competitor numbers aren’t repeated here.

The distinction that matters for a buyer is grader provenance. Those scores are vendor/AA-cited, meaning the AA Index is an aggregator whose headline figure is partly vendor-fed. “Top tier globally” is a marketing reading of that mix; “fifth on AA, first in China” is what the independent table supports.

Is the 35-hour agent demo independently verified?

It is not. The centerpiece of the launch, a roughly 35-hour autonomous coding run that logged 1,158 tool calls and achieved a 10-fold geometric-mean speedup across multiple workloads, was vendor-disclosed and ran on hardware Alibaba described only as “previously unseen.” As of retrieval, no third party has reproduced it.

Three things weaken the demo as evidence. It is a single stress test, chosen by the vendor rather than drawn from a standard suite. The 10x figure is a geometric-mean speedup across multiple workloads, so the choice of baselines does most of the work in making the number look large. And the whole run executed on Alibaba-selected hardware, which means the hardware, the software stack, and the reporting are all in one hand. Vendor demos of this shape are useful as capability signals; they are not benchmarks.

How does Qwen3.7-Max actually compare to DeepSeek?

The DeepSeek comparison in the retrieved sources is against DeepSeek V4 Pro, named alongside Claude Opus 4.7 and GPT-5.5 as one of three frontier competitors in the writeup’s benchmark matrix. The cached page truncates before that matrix, so the exact AA Index margin between Qwen3.7-Max and DeepSeek V4 Pro isn’t line-checkable here. Treat any specific point gap as unverified until the full table is sourced.

The practical reading is conservative. The two models share a frontier comparison set, and the writeup frames Qwen’s launch as a genuine top-tier showing. The specific margin between them is not line-checkable in the cached source. “Dominates” overstates what a single-cycle comparison on a mixed-provenance index can carry.

Is Qwen3.7-Max open weight?

It is not, and this is the point where the launch narrative most often drifts from the facts. Qwen3.7-Max is closed-weight and proprietary. As of May 25, 2026, the Qwen organization on HuggingFace carried no Qwen 3.7 weights; an open-weight “Plus” tier was announced but had not shipped. Anyone planning to self-host Qwen3.7-Max weights today cannot.

What is open is the broader Qwen3 family, the dense and MoE releases on Tongyi Labs and GitHub. The Tongyi model page lists Qwen3-Max, Qwen-Plus, Qwen-Flash, Qwen3-Coder-Plus, Qwen3-VL-Plus, and Qwen3-Omni-Flash, with the “Max” line as the closed flagship tier distinct from the open-weight Qwen3 releases. So a buyer comparing Qwen3.7-Max to DeepSeek is comparing two API-served, closed-frontier options, not two self-hostable open weights. The “open-weight buyers choosing between the two” framing that attends some coverage applies to the Qwen3 dense line, not to Qwen3.7-Max.

What does it actually cost?

The rate card is competitive: $2.50 per 1M input tokens and $7.50 per 1M output, roughly half Claude Opus 4.7’s list price. It also ships a 1M-token context window.

The number that can eat the price advantage is verbosity. The writeup builds its cost analysis around output-token volume, on the logic that a cheaper rate card compresses when a model generates more tokens per completed task. The cached page truncates before those figures, so the specific token counts aren’t repeated here. The rate card is the easy number; verbosity-adjusted cost-per-task is the one a budget owner should model.

ModelAA Intelligence Index v4.0Vendor demoWeights
Qwen3.7-Max56.6, ranked #5 (top Chinese at launch)35h run, 1,158 tool calls, 10x geometric-mean speedup (vendor-stated)Closed
DeepSeek V4 ProNamed as comparison; exact score not in cached sourcesNot independently sourcedNot confirmed

The 10x speedup is vendor-stated via the Alibaba announcement relayed by cntechpost, not independently reproduced.

How to grade a Chinese frontier-model launch claim

The defensible habit is to treat every headline benchmark as a question about who graded it, then cross-check against an independent aggregator before the number leaves your notes.

  1. Pin each score to its grader. “Global first” is a vendor-table reading; the AA Intelligence Index records fifth. Quote the grader with the number, every time.
  2. Treat vendor demos on vendor-selected hardware as demonstrations, not benchmarks. The 35-hour, 1,158-tool-call, 10x run executed on hardware Alibaba described as “previously unseen,” with no third-party reproduction.
  3. Verify version names before you repeat them. “DeepSeek V4.1” is unconfirmed; the sourced comparison is V4 Pro. A wrong version name travels because no one checks it.
  4. Adjust cost claims for verbosity. A cheaper rate card does not guarantee cheaper cost-per-task if the model generates substantially more output tokens. Model the verbosity-adjusted cost before committing.
  5. Confirm weight availability before assuming self-host. Qwen3.7-Max is closed; only the Qwen3 dense/MoE line is open on HuggingFace.
  6. Separate capacity from quality. A 1M context window describes how much the model can read, not how well it reasons at the frontier.

The pattern across this launch is consistent. The genuine achievements, a highest-ranked Chinese model on an independent index and a real frontier-class showing, get bundled with overclaims: global-first rankings, vendor-stated speedups, an open-weight story that does not yet have open weights. Reading them apart is the work. Qwen3.7-Max is a strong Chinese frontier model. It is not the thing the launch-day framing said it was, and the gap between those two sentences is exactly what a buyer is paying to understand.

Frequently Asked Questions

How does the 10x kernel speedup compare to DeepSeek and GLM on the same task?

On the same Triton kernel task, the vendor-cited geometric-mean speedup is 10x for Qwen3.7-Max versus 3.3x for DeepSeek V4 Pro and 7.3x for GLM 5.1. All three figures trace to the Alibaba Cloud blog rather than an independent run, so the ordering is real but the absolute gaps are Alibaba-graded.

How does Qwen3.7-Max’s real cost-per-task compare to its rate card?

During the AA Intelligence Index run Qwen3.7-Max generated roughly 97M output tokens versus a ~24M group median, about 4x the volume. At $7.50 per 1M output and $0.25 cached input, that verbosity compresses most of the rate-card edge over Claude Opus 4.7 on tasks where output dominates.

What did the 35-hour demo actually run on?

The run executed on Alibaba’s in-house Zhenwu M890 accelerator across 432 kernel evaluations and five architectural redesigns, not a standard benchmark suite. The 1,158 tool calls and 10x geometric-mean speedup are vendor-reported on that single silicon stack, with no third-party reproduction on neutral hardware.

How much did Qwen3.7-Max improve over the prior Qwen 3.6 Max?

The AA Intelligence Index moved from 51.8 on Qwen 3.6 Max Preview to 56.6, a +4.8 point single-cycle gain. Context window quadrupled from 256K to 1M tokens with a 65,536 max output cap, which is the relevant jump for long-horizon agent work but says nothing about reasoning quality at that depth.

What throughput and latency did Artificial Analysis measure?

Independent measurement put Qwen3.7-Max at 200.3 output tokens per second with 2.52s time-to-first-token in AA testing. For latency-bound agent loops where each step blocks on a fresh first token, that 2.52s TTFT is the figure to budget around, not the 200 tokens/sec decode rate.

sources · 5 cited

  1. Qwen 3.7 Max: Alibaba's New Flagship AI Model 2026 digitalapplied.com analysis accessed 2026-06-26
  2. Qwen3 — a Qwen Collection (HuggingFace) huggingface.co primary accessed 2026-06-26
  3. 通义实验室 (Tongyi Labs — Alibaba) tongyi.aliyun.com vendor accessed 2026-06-26
  4. QwenLM/Qwen3 GitHub repository github.com vendor accessed 2026-06-26