groundy

infrastructure & runtime

  1. jun 14infraThe Vercel-AWS Deal Reveals Where AI Inference Runs
  2. jun 10infraRunning RAG on a Snapdragon NPU: The On-Device Retrieval Tradeoff
  3. jun 09infraGraphRAG vs VectorRAG: Does the Graph Index Earn Its Cost?
  4. jun 09infraMiniMax M3 Ships 1M Context and Desktop Control as Open Weights
  5. jun 09infraDeepSeek-V4 FlashMemory: Sparse Attention for Million-Token Context
  6. jun 08infraIs Cloudflare's Bot Traffic Surge Real? The Measurement Dispute
  7. jun 08infraHuawei's KVarN Puts KV-Cache Quantization Inside vLLM's Backend
  8. jun 06infraIndexing Images for RAG: kapa.ai's Approach to Multimodal Retrieval
  9. jun 05infraThe RTX Spark Bet on Unified Memory for Local LLMs: Where Bandwidth Caps It
  10. jun 05infraReading Vercel's Fluid Compute vs Cloudflare Workers Benchmark
  11. jun 05infraDoes CUDA Tile Match Hand-Tuned Kernels on Hopper and Blackwell?
  12. jun 05infraPod-Level Remote Attestation in Kubernetes: Confidential Workloads on dstack
  13. jun 04infraGenerating GPU Kernels for Moore Threads Silicon: Can LLMs Break CUDA Lock-In?
  14. jun 04infraMicrosoft's Azure Linux Goes General-Purpose: The Container Base-Image Play
  15. jun 04infraCloudflare Acquires VoidZero, the Company Behind Vite's Rust Toolchain
  16. jun 04infraPutting a Datacenter V100 in a Gaming PC: The Local LLM Math
  17. jun 03infraCost-Aware RAG Routing: When Deeper Retrieval Stops Paying Off
  18. jun 02infraUsing Your Nvidia GPU's VRAM as Linux Swap: Where the NBD Hack Breaks Down
  19. may 30infraCloudflare Turnstile Now Fingerprints WebGL: The Privacy CAPTCHA Tradeoff
  20. may 28infraThe Viral AWS Support Post Is a Warning About Cloud Escalation Paths
  21. may 26infraWhy LLMs Still Botch Kubernetes Manifests: The Training-Data Gap
  22. may 26infraCloudflare Flagship Is a Feature Flag Service That Deepens Platform Gravity
  23. may 26infraGemma 4 31B on Cloud TPU vs GPU: The Serving Cost Crossover Point
  24. may 25infraObjectCache Moves KV Reuse to S3-Class Storage: Why Layerwise Retrieval Beats Full-Prefix Cache Hits
  25. may 25infraVercel's CDN Origin Timeout Jumps to 2 Minutes: A Concession to LLM Streaming Workloads
  26. may 25infraFluid Compute vs PgBouncer: Vercel's Undocumented Bet on Connection Reuse
  27. may 25infraRailway's GCP Suspension Is a Reseller PaaS Problem, Not a Google One
  28. may 24infraVercel Fluid Pools Database Connections Across Invocations, Bypassing External Poolers
  29. may 24infraVercel CDN Request Collapsing: One Origin Fetch Per ISR Cache Miss
  30. may 24infraCISA Admin Leaked AWS GovCloud Keys on GitHub: What Federal Secret Scanning Missed
  31. may 23infraWhat Cloudflare's Q1 2026 Outage Data Says About Designing for State-Level Shutdowns
  32. may 22infraRailway's May 19 GCP Suspension Exposes the Single-Account Risk Underneath Every Reseller PaaS
  33. may 22infravLLM 0.21 Makes Prefill-Decode Disaggregation Actually Practical
  34. may 18infraDMax Hits 1,338 Tokens/Sec on 2x H200: Parallel Decoding Pushes dLLM Serving Past the Autoregressive Bar
  35. may 17infraKioxia and Dell's 10 PB in 2RU: What Storage Density Means for Cluster Power and Rebuild Windows
  36. may 17infraKV Cache Offloading Breaks on Context-Intensive Tasks: Text2JSON Exposes the Landmark Failure Mode
  37. apr 28infraCrawshaw's 'I Am Building a Cloud': What a Tailscale Co-Founder's Solo Stack Implies for Platform Teams
  38. apr 23infraUCCL-Zip: Lossless Compression for NCCL, 47.5% Faster RL Sync, 10% Lower vLLM Latency
  39. apr 22infraIngress-Nginx Is Dead, Not Deprecated: Final CVE Patches Shipped, But Platform Teams Need a Migration Plan
  40. mar 26infraOpenRAG: The Open-Source RAG Platform Challenging Pinecone
  41. mar 23infraMLX vs llama.cpp on Apple Silicon: Which Runtime to Use for Local LLM Inference
  42. mar 23infraPrefill-Decode Disaggregation: The Architecture Shift Redefining LLM Serving
  43. mar 14infraGoogle LiteRT: Running LLMs on Your Phone Without the Cloud
  44. mar 12infraMicrosoft's BitNet: How 1-Bit LLMs Could Make GPU Farms Obsolete
  45. feb 27infraWebAssembly AI: Running Models in the Browser
  46. feb 18infraTailscale Peer Relays: The Missing Piece for True P2P Networking
  47. feb 18infraDNS-Persist-01 Validation: Let's Encrypt's Model for Permanent ACME Certificate Authorization
  48. feb 11infraThe Complete Guide to Local LLMs