What changed
Changes to the blueprints, models as they are released and profiled, and community proposals as they are merged or reverted. Newest first.
November 2026
Site9 Nov 2026
Proposals are now reviewed by AI and merged into the blueprints
Once a proposal has enough votes from members, an AI reviewer checks the cited evidence, the technical claims and whether the change reflects the frontier. Approved proposals are merged into the live blueprint as a commit; each blueprint now has a history page, and any commit can be reverted, like
git revert. Proposals the reviewer doesn't approve stay open for discussion and votes, with the review attached.Models9 Nov 2026
Model pages: 10 frontier models as diffs against the LLM blueprint
Each model page shows the LLM blueprint with that model's differences marked: components it replaces, adds or doesn't use, and how it configures the ones it keeps, with sources. Profiled so far: DeepSeek-V4.1-Flash, Inkling, Kimi K3, Nemotron 3 Ultra, DeepSeek-V4-Pro, Gemma 4 31B, MiniMax-M2.7, GLM-5, Qwen3.5-397B-A17B, gpt-oss-120b.
New edition8 Nov 2026
First edition of the LLM and agent blueprints (November 2026)
The Frontier LLM. A composite of the open-weight frontier: the token mixer is now chosen for KV bytes per token (hybrid linear attention, compressed or sparse softmax attention, or local/global interleaving), the residual stream became a design surface again (mHC, Attention Residuals), MoE got sparser (16 of 896 experts in Kimi K3), and Muon displaced AdamW for matrix weights at trillion-parameter scale.
The Frontier Agent. A single-threaded loop with most of the engineering in the control plane: context moved into files (skills, on-demand tools, server-side compaction), autonomy is gated by classifiers inside sandboxes, harnesses and sandboxes became disposable around a durable session log, and memory gained offline consolidation.
September 2026
Model releaseSeptember 2026
DeepSeek released DeepSeek-V4.1-Flash
Causal encoder-decoder MoE: decoder reads encoder-projected KV, CSA2 shares KV across layers, FP4 KV at 890 B/token, Engram, DSpark.
July 2026
Model releaseJuly 2026
Thinking Machines Lab released Inkling
5:1 sliding-window/global GQA with a learned relative-position bias instead of RoPE, short causal convs, encoder-free image and audio.
Model releaseJuly 2026
Moonshot AI released Kimi K3
93 layers of 3:1 KDA / gated MLA with no positional encoding, Block Attention Residuals and a 16-of-896 latent MoE in MXFP4.
June 2026
Model releaseJune 2026
NVIDIA released Nemotron 3 Ultra
Mamba-2 does most of the token mixing, 12 NoPE GQA layers anchor it, and LatentMoE routes 22 of 512 experts in a 2,048-dim latent.
April 2026
Model releaseApril 2026
DeepSeek released DeepSeek-V4-Pro
Attention over a compressed sequence: CSA (4→1, top-1,024) and HCA (128→1) layers with a 128-token window, 4-stream mHC, Muon.
Model releaseApril 2026
Google DeepMind released Gemma 4 31B
Dense 5:1 local/global stack: 1,024-token windows, global layers with K = V and p-RoPE, sandwich norms, tied 262K vocabulary.
March 2026
Model releaseMarch 2026
MiniMax released MiniMax-M2.7
Full GQA attention in all 62 layers after hybrid-attention ablations; 256-expert top-8 sigmoid MoE with 9.8B active; 3 MTP modules.
February 2026
Model releaseFebruary 2026
Z.ai (Zhipu AI) released GLM-5
MLA with DeepSeek Sparse Attention in every layer, 256-expert MoE, one MTP layer reused for 3 steps; GLM-5.2 adds IndexShare and 1M context.
Model releaseFebruary 2026
Alibaba Qwen released Qwen3.5-397B-A17B
15 × (3 Gated DeltaNet + 1 gated GQA) layers over 512 small experts: only 15 of 60 layers keep a KV cache.
August 2025
Model releaseAugust 2025
OpenAI released gpt-oss-120b
A deliberately plain MoE: alternating 128-token banded and dense GQA layers, attention sinks, MXFP4 experts.