Running LLMs in the Browser: Can Privacy Be Verified Instead of Promised?
Browser LLM inference is local but not private. The host page controls the GPU, model bytes, and network egress, making 'data never leaves device' a policy promise, not a ver
The archive · Page 2 of 7
Infrastructure & Runtime
The serving stack, network fabric, and cloud-account substrate beneath production AI, where every throughput claim collides with rebuild windows, egress invoices, and control-plane risk.
The archive
25–48 of 145 articles · Newest first
Does Cloudflare's Adaptive Intelligence Change the Bot Defense Build-vs-Buy Math?
Cloudflare's bundled bot defense changes procurement math, but efficacy claims remain self-reported. Audit standalone spend and measure false positives before migrating.
Cloudflare Compresses Its Cache With Zstandard: The Storage-vs-CPU Trade
Cloudflare's zstd cache proposal trades storage for CPU. We verify the math: zstd saves 5% over gzip but only 0.45% over brotli, while non-zstd clients pay a 10ms re-encode.
Getting an AI Agent Into Cloudflare's BotBase: What Operators Must Verify
Cloudflare's agent directory proposal shifts identity burden to operators. With 20% of the web behind its network, unlisted agents face default blocking or per-route charges,
Running GLM-5.2 on vLLM: MTP Support, Weight Errors, and Throughput
GLM-5.2 on vLLM v0.28.0: enable MTP, fix k_norm warnings, and verify FP8 precision. Measured gains from research on other models, not GLM-5.2.
Automating Kubernetes Capability Drops: What KubeCap's Rules Miss
KubeCap automates Kubernetes capability minimization via LLM-inferred rules, cutting permissions by 55% in Go workloads. Validate inferred drops against runtime behavior to CI
Alibaba's ScaleSense: When Learned Autoscaling Beats Provisioning Rules
Alibaba's ScaleSense uses learned query-level estimation to cut AnalyticDB costs by up to 5.22x. This audit covers the risks of opaque autoscalers and the limits of vendor-own
AWS Cognito Postmortem: The Real Cost of Free Managed Auth
A founder's Cognito postmortem highlights hidden auth costs. This guide maps decision axes for startups, separating verified AWS capabilities from unverified customization and
How Cloudflare Saved 100 TB in 1.1.1.1's DNS Cache and What Operators Can Copy
Cloudflare claims 100 TB saved in 1.1.1.1 cache, but the mechanism is unverified. Operators can cut memory now by tuning Redis eviction policies and admission controls, not by
Where Simple RAG Breaks: Multi-Document QA Needs Hierarchy, Not More Chunks
Flat RAG fails on similar-document corpora due to scope confusion and entity conflicts. HiQA proposes hierarchical augmentation, but hybrid retrieval remains the cheaper, unme
Codex on AWS Bedrock 10x Charges: Auditing Agent Token Bills
A user-reported 10x charge on AWS Bedrock remains unconfirmed by OpenAI or AWS. This runbook reconciles Codex client logs against provider metering to isolate cache misses, or
Cloudflare FedRAMP High Claim: Edge vs. GovCloud for Government AI
Cloudflare claims FedRAMP Class D status, but the Marketplace shows no listing. This guide maps edge security layers to impact levels and compares latency costs for.
GPU Memory Explained: Why LLM Throughput Collapses When VRAM Runs Out
LLM decode speed tracks memory bandwidth, not TFLOPS. When VRAM fills, reads shift to PCIe, causing a throughput cliff. Use this bandwidth budget worksheet to plan KV cache.
Task-Based OAuth Consent: Scoping AI Agent Permissions Per Action
Cloudflare's task-based OAuth consent moves authorization from install time to runtime. Compare blast radius, revocation, and fatigue to redesign agent API security.
V8 Isolates vs MicroVMs vs Wasm: Where Spectre Still Draws the Line
Cloudflare's 2026 Spectre revisit is unverified. This guide maps V8 isolates, Firecracker microVMs, and Wasm sandboxes to define a data-classification rule for edge secrets.
Fine-Tuning DeepSeek Without NVIDIA: What the Ascend SuperPOD Run Shows
SLAI T-Rex reports 34.22% MFU for full-parameter DeepSeek-V4 post-training on Ascend. The single-cluster result narrows the CUDA moat for fine-tuning, but cost data remains.
Cloudflare WebMCP: The Security Baseline for Agent-Ready Sites
Cloudflare's WebMCP proposal is unverified, but the MCP ecosystem is not. With 91.8% of servers unauthenticated, treat agent endpoints as strict APIs, not crawler extensions.
Cloudflare AI Search vs Self-Hosted RAG: Where the Build-vs-Buy Line Lands
Cloudflare's AI Search lacks verifiable pricing and access control docs. For Postgres 13+ teams, pgvector offers a documented, self-hosted alternative that avoids vendor.
Cloudflare H1 2026 DDoS Report: DNS Floods and Sizing Past 1 Tbps
Cloudflare's H1 2026 DDoS report claims DNS floods exceeded 1 Tbps. This article verifies the structural risks of UDP amplification and anycast absorption, while noting the.
daVinci-kernel shifts the RL kernel bottleneck from reward shaping to skill libraries
The daVinci-kernel preprint argues RL-tuned CUDA kernels plateau because skill libraries are mis-architected, not because rewards are mis-shaped. It co-evolves skill.
Calibrated LLM Monitoring: Conformal Prediction with Drift Detection
A cloud-native architecture packages conformal prediction as a sub-2ms microservice to replace raw logprob confidence with finite-sample coverage guarantees, gated by.
Cloudflare AI Crawler Controls: Block, Charge, or Allow Bots Per Route
Cloudflare ships per-route AI crawler controls for Search, Agent, and Training bots. Site owners must model pay-per-crawl yield against ad inventory and measure Agent.
Postgres LISTEN/NOTIFY Scales: When to Drop Redis for Job Fan-Out
DBOS benchmarks suggest Postgres LISTEN/NOTIFY handles high fan-out, but the 2026-07-24 data remains unverified. Use durable queues for small payloads, but keep Redis for.
Tailscale on Azure: Measure Direct vs DERP Routing to Control Latency and Egress
Tailscale on Azure VMs silently falls back to DERP relays when direct paths fail, adding latency and egress costs. Measure direct success rates to avoid hidden bills.
