Topic

#benchmark-analysis

1 article exploring benchmark-analysis. Expert insights and analysis from our editorial team.

Showing 1–1 of 1 articles
Related topics:
llm-evaluation compositional-reasoning model-selection ibm-research scaffolded-tasks

Articles

Newest first
Models & Research

STaD Exposes What HumanEval Hides: Compositional Skill Gaps in LLMs That Aggregate Benchmarks Miss

IBM Research's STaD shows models with identical benchmark scores can fail on different subskills, making leaderboard rank a poor proxy for compositional code generation.
Browse All Topics