
Fixing Tool Calls in vLLM: What Actually Breaks Function Calling
Vendor data and academic studies show vLLM serving flags, not model weights, drive tool-call accuracy shifts. Constrained decoding fixes schema errors for some models but can
The Groundy archive · Page 4 of 43
Browse Groundy's complete archive of 1027 articles on AI, developer tools and infrastructure. Page 4 of 43.
73–96 of 1027 articles · Newest first

Vendor data and academic studies show vLLM serving flags, not model weights, drive tool-call accuracy shifts. Constrained decoding fixes schema errors for some models but can

An unreviewed preprint finds multi-agent orchestration yields a 23-point accuracy gain at four times the cost only for LLMs that answer before inspecting data.

A NeurIPS 2026 study shows per-user AI watermark keys enable high-accuracy tracking, urging deployers to audit key granularity and detector access for privacy.

Roku's GitLab migration exposes silent index staleness risks. The article provides a checklist for updating remotes, CI, and retrieval pipelines to prevent outdated content.

TorchTPU offers a native PyTorch backend for TPUs, enabling eager execution with minimal code changes. Vendor-reported metrics show high parity, but independent training data.

Vercel now displays build cache size and limit proximity, making uploads billable and discarding over-limit caches. This vendor-reported change requires monitoring to avoid un

Anthropic donated Agent Skills to the Agentic AI Foundation, but governance and portability remain unverified. Adopt skills for Claude, keep MCP for tools, and wait for stable

Roku moved developer repos to GitLab, breaking CI pins. The article details a checklist to fix remotes, submodules, and raw fetches, warning that stale caches fail silently.

INFUSE provides a taxonomy for indirect prompt injection surfaces. The evidence supports enumerating channels and applying deterministic controls before testing, rather than a

AfriBED provides a matched-content method for auditing speech recognition bias in Bemba and Nyanja, enabling teams to measure subgroup error gaps before launch.

Preprints show LLM memory injections persist across sessions, bypassing standard hygiene. Storage rates exceed 97.5% on OpenAI models, requiring write-time integrity controls.

Vercel CLI budgets require the --pause flag to halt production at 100% spend, a team-wide outage risk that demands explicit governance and verification of undocumented edge.

Kimi K3.1 Pro offers a documented 1M context window, while Highspeed speed claims remain vendor-reported. Route long-context tasks to Pro and verify Highspeed via shadow A/B.

Cloudflare's PQ GeoKey Manager uses geo-fenced key wrapping to meet data residency, but vendor-reported enforcement lacks independent audit verification.

A CSU preprint shows LLMs fail at pragmatic cooperation under epistemic asymmetry. The study suggests routing indirect requests to humans until models pass specific probes.

UUIDv7 IDs lack strict monotonicity due to clock skew and restarts. Teams must audit generators for persisted state or use sequencing authorities for cross-node order.

Vercel Connect managed Stripe keys reduce credential risk by scoping permissions per agent. Verify effective scope and plan rotation for the 24-hour overlap window.

Route Kimi K3.1 Pro traffic via Vercel AI Gateway now to test vendor claims, deferring self-hosting spend until weights and license terms are released on November 4.

Evidence favors Lean 4 for applied math due to Mathlib, while Arend suits univalent work but relies on vendor-reported library scope and lacks third-party formalizations.

A CCS '26 study maps SNCII supply chains, suggesting upstream LoRA bans and payment cuts are more effective than downstream takedowns, though displacement risks remain.

An ablation study shows LLM judges and experts preferred a refined corpus that reduced retrieval accuracy by 0.061, highlighting the need for downstream probes in release gate

A preprint chess study suggests LLMs memorize benchmarks. Use prior-density stratification and executable oracles to gate model selection on low-prior performance.
The AWS PHP2Shell WAF rule blocks the exact POST, PHPSESSID, and PHP_SESSION_UPLOAD_PROGRESS conjunction behind CVE-2026-109619, at the cost of legitimate upload-progress.

Hugging Face's torch-neuronx tracker verifies if Transformers models run unmodified on AWS Trainium2, but vendor-reported results exclude throughput and latency metrics.