
How to Evaluate LLM Long-Term Memory: Repeated Judging, Negative Controls
A September 2026 preprint argues that LLM memory benchmarks require repeated judging, negative controls, and ablation arms to distinguish real gains from judge noise.
The Groundy archive · Page 9 of 43
Browse Groundy's complete archive of 1027 articles on AI, developer tools and infrastructure. Page 9 of 43.
193–216 of 1027 articles · Newest first

A September 2026 preprint argues that LLM memory benchmarks require repeated judging, negative controls, and ablation arms to distinguish real gains from judge noise.

A preprint suggests fine-tuning small models on stratified consistency distillation to replace frontier APIs for policy logic, pending independent replication.

arXiv's provisional two-per-month cap, driven by self-reported volume spikes, requires labs to rotate submitters and stagger backlogs to manage quota.

Cloudflare's rebuilt Containers add runtime image selection, vendor-reported sub-second median starts, and public beta filesystem snapshots behind ctx.container; legacy.

Vercel's tokenless domain search returns scoped availability and prices for up to 200 names, while RDAP offers neutral status checks without pricing data.

The headline architecture still rests on one preprint's mechanistic simulations, with no live-model validation or independent replication.

EuroLLM and Apertus are distinct sovereign open models with different licenses and coverage. Cloudflare's hosting is vendor-reported intent, not shipped capability.

A preprint proposes canary tokens to track prompt injection across agent stages, showing that outcome-only metrics hide distinct failure modes in LLM pipelines.

Cloudflare's HTTP 402 gateway enables per-request agent payments via USDC on Base, though vendor-reported adoption metrics and unresolved security risks remain unverified.

A 2026 preprint reports AI homogenizes code syntax but not intent, while algorithmic monoculture models show bounded welfare harm, requiring distinct policy levers.

Vercel's CLI traces search command offers fast terminal triage for recent incidents, but its one-hour window and 100-span cap require careful scope verification.

An 815-participant experiment found anthropomorphic AI verbs barely shift perception, while explicit danger framing does. Style guides should prioritize risk accuracy over ban

A new preprint proposes pricing LLM training data by measured gain rather than flat token rates, offering a hybrid contract structure for buyers and sellers.

Killing a coding agent PID fails because orphaned children and in-flight calls survive. Real containment requires kernel-enforced limits, MAC policies, and verified quiescence

MetaPermit proposes LLM-inferred attributes for auditable agent access control, reporting 31% consistency gains in a self-reported preprint.

A preprint proposes Counterfactual Rollout Replay to derive step-level rewards for coding agents by forking environments, trading labeling costs for compute without learned PR

Self-improvement claims require held-out benchmarks, lineage logs, and calibrated judges to distinguish genuine capability gains from memorized feedback in agent loops.

Research shows MCP error wording shifts agent recovery from 6% to 88%. Ship stable codes, offending parameters, and one named action to enable deterministic recovery.

TraceML pairs human and agent Kaggle logs to show agents collapse into narrow loops, supporting trajectory audits over leaderboard scores for autonomy decisions.

Cloudflare logs TLS key-exchange groups to measure hybrid post-quantum adoption. The metric tracks encryption only, not authentication, and classical shares often reflect non-

Pooled faithfulness checkers miss cross-source conflation in MCP agents. ProvenanceGuard adds per-claim source verification, though author-reported results remain unreplicated

Cloudflare Forge is a new open-source SDK pipeline for AI agents. Evidence is limited to vendor claims, so pilot one artifact before migrating from incumbent generators.

Cloudflare's cf CLI expands agent access to 3,000 operations. Grant read-only scopes by default and gate mutations behind human checkpoints to limit blast radius.

OpenAI reports GPT-6.1 Sol matches Astra on coding at one-fifth the cost, but independent verification is lacking. Route agentic work to Sol and keep Astra for hard research.