What Pre-Training a 7B Open-Source LLM Actually Costs in Energy and Carbon
Lucie 7B's life-cycle assessment on Jean Zay records 574,564 H100 GPU-hours and 21 tCO2eq, including embodied carbon. It sets a transparency benchmark for open-source LLMs.
The Groundy archive · Page 17 of 38
Browse Groundy's complete archive of 896 articles on AI, developer tools and infrastructure. Page 17 of 38.
385–408 of 896 articles · Newest first
Lucie 7B's life-cycle assessment on Jean Zay records 574,564 H100 GPU-hours and 21 tCO2eq, including embodied carbon. It sets a transparency benchmark for open-source LLMs.
TF-Engram pages LLM memory to SSD, moving the bottleneck from HBM to storage bandwidth, latency, and prefetch accuracy. It wins only when reads arrive before decode stalls.
CVEs are no longer stable units of work. Federated CNA assignment produces conflicting CVSS scores and self-divergence, pushing reconciliation to SBOM and triage pipelines.
A 2026 arXiv paper shows multi-class and multi-label BERT both map CVEs to CWEs, but the taxonomy, not the encoder, shapes the misclassifications that security tools inherit.
AgentTether models agent runs as a directed graph, detects drift, and steers execution back without retraining. On tau-bench Banking it repaired most failures and cut tokens.
A July 2026 preprint shows Triton and TileLang kernels can pass correctness checks yet run hundreds of times slower than library baselines, moving validation cost to adopters.
Reasoning modes improve LLM negotiators as solvers but not as samplers, so multi-agent talks look inventive yet never agree; builders check moves against protocol rules.

Gradio-Lite runs the Gradio Python runtime in the browser through Pyodide, cutting hosting costs but shifting startup delay, download size, and memory limits to visitors.
Vercel Edge Config reads feature flags in under 15ms, but its 10-second global write window means flipped flags can still route traffic to disabled regions.
Cloud Run GPU's 19-second cold start for Gemma 3 4B means scale-to-zero beats dedicated GPUs only for spiky, batch workloads below roughly 40 to 50 percent utilization.
Cloudflare opened self-managed OAuth to all customers in June 2026, moving API authorization to the edge. Apps get delegated access, but consent records add a new lock-in.
Vercel's in-function concurrency lets one instance run multiple Node.js or Python requests, cutting idle billing and cold starts but forcing handling of shared state, leaks.
HuggingFace's Optimum-AMD recipe and ROCm 7.2.4's vLLM fixes make the MI300X a serviceable inference target, but newer attention kernels and training still trail CUDA.
A new travel-agent benchmark finds frontier models book animal-exploitation options below chance when the welfare preference is implicit. Fix the action space, not the prompt.
MEMCoder's execution memory lifts private-library pass@1 by 18.41 points over RAG by learning from runtime feedback, shifting bottleneck from retrieval to sandboxed execution.
Zuckerberg said Meta's AI agent development has not accelerated as expected, weeks after 8,000 layoffs. CIOs lose their flagship case study for AI-driven headcount cuts.
Kimi K3 shipped five weeks after K2.7 Code. The rapid reset shows why routing teams need rolling evaluations, price controls and version-agnostic contracts.
CHARLIE runs multi-agent RAG on-premise for forensic evidence, removing cloud LLM calls but shifting the bottleneck to GPU capacity, structured memory, and audit logging.
Meituan says LongCat-2.0 is a 1.6-trillion-parameter MoE trained on 50,000 domestic chips. If true, export controls may not confine frontier model training to national labs.
A July 2026 arXiv break-even study finds pretrained time series foundation models win unconditionally on half of 30 datasets, but lose to ARIMA or XGBoost on a fifth at any.
A July 2026 preprint reframes look-ahead bias as temporal non-interference, letting a type checker prove a pipeline leak-free before it runs rather than finding leaks after.
A July 2026 preprint says coding agents plan edits roughly 25 steps ahead before their latent program model collapses, so context length and pass@k may mismeasure failures.
Cloudflare's Meerkat runs QuePaxa consensus at the edge, so every write waits on a cross-region quorum. The write-latency tax suits control-plane state, not transactions.
Since April 6, 2026, new Vercel projects honor Cache-Control from external origins by default, so operators must audit rewrite headers or risk stale, unintended responses.