$ cat briefs/daily/2026-08-19.md
2026-08-19
August 19, 2026 (Wed)
5 stories · 2 papers · 4 watch items · 6 new pages
Three weeks ago a thousand lab employees asked their government to build the machinery for slowing AI down, and two labs endorsed it as institutions. This wiki filed an open question at the time: does an organizational endorsement constrain anything? Today both labs turn out to have stopped something — independently, under machinery they already had, and without either of them mentioning the statement. The more unsettling half is Anthropic's stated reason: not a failed test, but evaluations that have stopped telling it anything.
Top Stories
1. Both labs that endorsed "Pacing the Frontier" paced themselves within three weeks — and neither called it that
- Anthropic, 2026-08-14: the Risk Report: August 2026 (Responsible Scaling Policy v3.4, covering 2026-02-24 → 2026-07-15) raises catastrophic misalignment risk in high-stakes settings from "very low" to "low", and discloses three unreleased frontier or near-frontier models held internally — one, Model 2, with "no current plans to release this model externally" (source).
- OpenAI, 2026-08-18: the Astra slowdown that was "explicitly indefinite" on 08-07 turns out to have lasted a little more than two weeks, and has ended (source).
- Neither action cites the statement. Both were taken under frameworks that predate it — the Preparedness Framework and the Responsible Scaling Policy — and neither is what the statement asked for, which was a US-supported international effort to develop tools. Two unilateral corporate decisions are the improvisation the statement said should be replaced.
- Why it matters: the option to stop exists and gets used, which is more than this wiki could say a week ago — but it is exercised by the same private machinery the statement implied was insufficient, which answers the question in a way its signatories may not have wanted.
- → Frontier Pacing, Anthropic, Astra
2. Anthropic's rating moved because its evaluations stopped working
- The cause of the change is increased uncertainty, not a failed test: Anthropic's most concrete task-based evaluations have "saturated" and no longer register capability gains, it reports "early signs of acceleration", and it says it is "less confident in this assessment than we were in prior risk reports" (source).
- Model 2 is described as a noticeable improvement on Mythos 5 for many internal tasks — and Anthropic's own summary is more qualified: "stronger in some areas, weaker in others, and overall only slightly more capable". Both readings are on the page; the headline one alone would be the more flattering claim.
- Why it matters: every other alignment result in this wiki is a measurement. This is a lab publishing that its instruments have stopped discriminating — and a saturated evaluation cannot tell a safe model from an unmeasured one, which weakens every assurance downstream of it without contradicting any of them.
- → AI Alignment, Conceptual Reasoning Index (CRI)
3. The harness thesis gets its best evidence and its first real refutation in one batch
- StateM: Reaching 95.3% Raw Accuracy, or a $15 Frontier Run, on Terminal-Bench 2.1 via Harness Scaling (arXiv:2608.15089) — weights untouched: GPT-5.6 Sol xhigh reaches 95.3% raw accuracy on Terminal-Bench 2.1 over 445 trials, DeepSeek-V4 Flash goes 82.7 → 88.1% for under $38 of adaptation, and a runbook transfers unchanged across a version bump. Final-score API usage: $15 against $574.68.
- How Do Agents Fail on AutoResearch: End-to-End Diagnostic Evaluation on 100 Real-World Frontier Research Tasks (arXiv:2608.14905) — 8 harness-model combinations × 100 research tasks: the same 45 failure patterns recur across all 8, including the strongest models, locating the deficit at the model level rather than in any scaffold.
- The 38× cost ratio is the first figure that lets a harness claim be priced; the standing complaint here since 08-17 is that seven papers reported gains and none published what a loop costs.
- Why it matters: the two are not contradictory, and the joint reading is now the wiki's position — harness scaling buys execution reliability and does not buy self-assessment. StateM supplies durable state for bounded verifiable tasks; what AutoResearchEval finds missing is a metacognitive loop, which no amount of state management provides.
- → Eval Harness Configuration
4. A benchmark figure landed for Qwen3.8-27B — and a paper says the serving route can move one invisibly
- Simon Willison published Qwen3.8-27B at 52 on the Artificial Analysis Intelligence Index — equal to GPT-5.6 Luna (max), one behind GLM-5.2 (max) and DeepSeek V4 Pro 0813 (max) at 53 (source). That resolves the direction of the r/LocalLLaMA claim this wiki recorded as uncheckable yesterday, from a named author who links the leaderboard page.
- Same day, Ventor-QTest: Threat-Model-Driven Verification of Vendor-Hosted LLM APIs (arXiv:2608.16391) audits vendor-hosted APIs black-box and finds route-level fidelity loss with little detectable association with GPQA-Diamond accuracy, while pronounced loss coincides with a declining Terminal-Bench pass rate as task exposure increases.
- Why it matters: single-turn benchmarks are structurally blind to the defect, and single-turn-shaped figures are what most third-party numbers in this wiki are. Nothing states which serving path produced the 52 — and the status moves to third-party figure with a named author, not to a held measurement. The next leaderboard capture is 2026-08-23.
- → Qwen 3.8 27B, Model Routing
5. Z.ai answers Project Glasswing, and the gate does not obviously survive the weights
- "Shield of Open Source", announced alongside GLM-5.3: free security audits, automated code-auditing via ZCode, free community usage quotas, and a restricted "Cybersecurity Trusted Access" tier reserving the model's most sensitive offensive capabilities for verified users. SCMP, quoting a researcher: "Project Glasswing with Chinese characteristics", treating openness as an asset rather than a drawback (source).
- Anthropic's Glasswing gates a closed model to ~100–150 vetted organisations. Z.ai proposes to publish weights and gate the offensive capability.
- Why it matters: nothing read explains how a verified-access tier is enforced on a model anyone can download, whether it binds only the hosted API, or whether GLM-5.3's weights — staged for around 2026-08-28 — ship under the programme or are held by it. It arrived through Trivium China prefetch, a day after the lab rotation checked Z.ai and got nothing.
- → Z.ai, AI-Enabled Cyberattacks
Paper Picks
R³-Bench: LLMs Struggle with Resource-Rational Reasoning under Shared Budgets — arXiv:2608.16033
- TL;DR: six problems, one shared budget, scored against an offline oracle built from the same model's measured single-problem curves. The oracle matches or exceeds contest performance in all 72 cells and is strictly higher in 71.
- Why read it: the sharpest row is the free one — equal allocation beats the model's own choices for four of six models. Splitting the budget six ways with no reasoning outperforms reasoning about how to split it, which is a cleaner indictment than any method paper on the same page, because the baseline costs nothing.
- → R³-Bench: LLMs Struggle with Resource-Rational Reasoning under Shared Budgets (arXiv:2608.16033), Test-Time Compute (Inference-Time Compute Scaling)
Improving the matrix multiplication exponent with modern optimization and AlphaEvolve — arXiv:2608.16884
- TL;DR: ω < 2.371177, from a previous best of 2.371339 — by reformulating the optimization at the core of combination loss analysis, designing a new algorithm for it, and then refining that algorithm with AlphaEvolve.
- Why read it: it is the inverse of the usual framing. The AI proves nothing; it refines a search procedure humans designed, over a space humans defined. And unlike the Lean-certificate results beside it, the claim needs no verification machinery — both records are published numbers. The bound moves by 0.000162, and the paper calls itself a note.
- → Improving the matrix multiplication exponent with modern optimization and AlphaEvolve (arXiv:2608.16884), AI for Mathematics
Watch
- The harness is worth 1.48× depending which harness it is. ClawGym II: Exploring Black-Box RL on Agent Harness (arXiv:2608.16798) trains through an opaque harness and gets +9.98 Pass@1 via OpenClaw against +14.81 via Claude Code — same model, same benchmark, same method. It also makes the model/harness split hard to hold at all: after training, the model is no longer harness-agnostic (source).
- GLM-5.3's weights are due around 2026-08-28 — the two-week staged release after a safety evaluation, now with an unexplained verified-access tier beside it. → GLM-5.3
- Mojo is now open source — compiler and toolchain under Apache 2.0 with LLVM exceptions (Modular, 2026-08-18), a week after Mojo 1.0 shipped source-stability guarantees without the compiler. No benchmark or adoption figure published (source).
- Three Alignment Science posts remain uncaptured for the sixth day — AuditBench (2026-03-10), Introspection Adapters (2026-04-28), The Hot Mess of AI. Carried to the W34 lint. Today's Anthropic lead also arrived by targeted search rather than from the news page, the fourth consecutive item to do so.
New in Wiki
All six are paper pages. Nothing requires user review this run — no entity, concept or person page was created, the fourth consecutive day.
- StateM: Reaching 95.3% Raw Accuracy, or a $15 Frontier Run, on Terminal-Bench 2.1 via Harness Scaling (arXiv:2608.15089)
- How Do Agents Fail on AutoResearch: End-to-End Diagnostic Evaluation on 100 Real-World Frontier Research Tasks (arXiv:2608.14905)
- ClawGym II: Exploring Black-Box RL on Agent Harness (arXiv:2608.16798)
- R³-Bench: LLMs Struggle with Resource-Rational Reasoning under Shared Budgets (arXiv:2608.16033)
- Ventor-QTest: Threat-Model-Driven Verification of Vendor-Hosted LLM APIs (arXiv:2608.16391)
- Improving the matrix multiplication exponent with modern optimization and AlphaEvolve (arXiv:2608.16884)
Updates
- Frontier Pacing — the run's largest edit, and 20 days stale before it. Open Problem 4 partially answered.
- Anthropic · AI Alignment — the Risk Report, at day +5.
- Astra · OpenAI · AI-Enabled Cyberattacks — the pause duration, and what still has no schedule. Scope of the pause disputed and recorded rather than resolved.
- Eval Harness Configuration — three papers, the first cost figure, and the cluster's first negative result.
- Test-Time Compute (Inference-Time Compute Scaling) — a fourth mechanism that proposes no method.
- Model Routing — the first instrument measuring the routing layer.
- Qwen 3.8 27B — an outstanding claim resolved, and downgraded correctly.
- Z.ai · GLM-5.3 — Shield of Open Source.
- AI for Mathematics — the ω bound.
- OpenAI — ChatGPT for Teens: automatic assignment by an age-prediction system with no published accuracy or false-positive rate, the same gap recorded on Anthropic's auto-mode classifier.