Constitutional AI Self-Amendment Hits the Metacognition Wall
An arXiv preprint argues LLM metacognition is coarse and context-dependent, suggesting self-amendment requires external calibration and human approval gates.
The archive · Page 2 of 5
Ethics, Policy & Safety
Where AI safety claims collide with reproducible measurement, where training-data harvesting collides with consent, and where deployment outruns the laws and norms meant to constrain it.
The archive
25–48 of 106 articles · Newest first
Can General LLMs Catch Radiology Report Errors Before Clinicians Sign Off?
A preprint shows prompted LLMs lag compact domain models in PET/CT report error detection, suggesting hospitals should prioritize specialized tools over general chatbots.
Why English-Only LLM Red Teaming Misses Indic-Language Jailbreaks
IndicSafeEval shows English refusal rates do not transfer to Hindi, Bengali, Marathi, or Punjabi. Teams need native-language persuasive probes and per-category baselines for a
Why Chain-of-Thought Monitoring Misses Hidden LLM Reasoning
A new preprint shows LLMs perform hidden computation invisible in chain-of-thought. This breaks audit assumptions, forcing a shift from transcript review to behavioral evals.
Safety RL Can Backfire: Why the Training Environment Decides the Direction
A new preprint claims safety RL direction depends on training environment design. C-SafeQA data shows probe construction swings unsafe rates 3.5x to 32x. Audit your safety env
Google Play vs GitHub: How Each Handles Baseless AI Copyright Claims
Luanti's Play Store removal highlights a gap in AI copyright enforcement. Learn how to structure open-source distribution so a takedown notice costs reach, not infrastructure.
LLM Judge Scores Change Run to Run: Why AI Audits Need Variance Reporting
arXiv 2507.02950 shows LLM judge scores vary by run and diverge from expert panels. Audit teams must report multi-run variance and human calibration before using judge output.
Hugging Face's AI Action Plan Reply: Open Weights vs the Frontier Lab Lobby
Hugging Face's RFI response contrasts open-weight contract terms with proprietary API restrictions. Teams should choose models based on fees, usage limits, and entity bans, as
Why Temperature 0 Won't Save Your Financial AI Audit
A new arXiv survey shows temperature 0 does not guarantee reproducible financial AI outputs. Hardware, batching, and parallelism cause divergence that sampling controls miss,
PayPal Blocks GrapheneOS: A Payment Contingency Guide for Open Source
PayPal's non-bank status and lack of FDIC insurance expose open source projects to sudden funding freezes. This guide details how to engineer payment redundancy and stage a no
Does the EU AI Act Exempt Open-Weight Models Like Qwen and Llama?
EU AI Act duties for open-weight models hinge on role classification, not price. Fine-tuning Qwen or mirroring Llama requires determining if you are a provider, deployer, or.
AI Agents Outgrow OAuth: What Task-Scoped Authorization Requires
A preprint proposes task-scoped authorization for AI agents, replacing standing OAuth grants with natural-language slices that expire when the task ends. The design shifts the
AI Bias Audits vs Ethics Audits: What Each Actually Catches
Bias audits certify frozen models; ethics audits trace lifecycle intervention points. Contract for pipeline instrumentation to catch downstream harms that disparity metrics on
Cloudflare's 1-Click Fix for Vibe-Coded Apps: What It Doesn't Solve
Cloudflare's one-click Access for internal apps fixes auth and inventory but ignores data egress. Learn why identity fronting fails to govern citizen-built AI tools.
DiverValue-Bench: Measuring LLM Value Divergence Across 74 Markets
DiverValue-Bench scores LLM value divergence across 74 markets using 23,763 instances. It reveals that passing bias audits does not ensure value alignment, forcing deployers.
Android Privacy Policies vs. Runtime Logs: A 0.4% Alignment Study
A study of 1,000 Android apps found only 0.4% align privacy policies with runtime logs. 67.6% leak sensitive data. Shift compliance from document review to CI log-inventory.
Why Machine Unlearning Can't Certify GDPR Erasure
Machine unlearning cannot certify GDPR erasure because no shared protocol proves weight removal. Use retrain-and-attest pipelines to satisfy Article 17 deletion requests.
RA-Bench: Why Deepfake Detectors Fail on Re-Shared Crisis Video
RA-Bench finds no detector family generalizes on re-shared crisis video. Automated detection cannot carry takedown commitments alone. Provenance signals and human review must.
Dario Amodei on AI Regulation: Frontier Labs as Their Own Lobbyists
Dario Amodei's AI regulation statement re-centers frontier labs as their own lobbyists; provider-run conformity checks leave regulators unable to verify the claims labs make.
Public Sector AI Procurement Must Shift from Model Certification to Task Authorization
Public sector AI governance breaks under general-purpose models. One-time procurement certification fails because model behavior is not fixed. Teams must shift to task-level.
Why Written AI Policies Fail to Control Agent Behavior
HANDBOOK.md benchmark shows frontier agents follow 124-page policies on only 36.2% of trials. Governance requires runtime enforcement, not documentation.
Why Vendor Model Cards Fail Clinical Ethics Procurement
PrinciplismQA exposes a gap generic leaderboards miss. Hospital compliance teams must build domain-specific ethics evals to test autonomy versus beneficence conflicts before.
TRIDENT Benchmark: LLM Safety Gaps in Finance, Medicine, and Law
TRIDENT benchmarks LLM safety in finance, medicine, and law using professional ethics codes. Results show specialized models often fail subtle ethical tests that generalists.
EU AI Act Traceability: Why ML Pipelines Fail Conformity Assessment
ML teams shipping high-risk systems to the EU face rejection if they cannot produce lifecycle-wide traceability artifacts. A May 2026 survey shows these mechanisms are often.
