AGI Pulse
PaperOpenAI · OpenAI

OpenAI: what affects chain-of-thought monitorability across the model lifecycle — Astra shows degradation; no-CoT capability tracks perplexity, RL raises controllability

5 reads

Published
2026-11-12
Type
Paper
Organization
OpenAI
Source
OpenAI

Why it matters

【Key points】

· Release: OpenAI’s Alignment Research Blog posted “What affects chain-of-thought monitorability across the model lifecycle?” on 2026-11-10; @OpenAI reposted it on 11-11.

  • · Observation: With GPT-6 Astra, OpenAI reports worse non-adversarial CoT monitorability, stronger adversarial evasion, and much higher no-CoT capability (reasoning in one forward pass with no chain-of-thought or tool tokens).
  • These no-CoT results use an unreleased reasoning-off variant.
  • · Findings: No-CoT capability rises smoothly as base-model test loss (log perplexity) falls.
  • UK AISI had judged Astra off-trend on a no-CoT math time horizon (footnote: 30.9-minute median vs about 7 minutes projected by end-2028)
  • OpenAI says it is not off-trend versus perplexity.
  • On Astra-class models, CoT controllability still rises substantially in RL with only length constraints and final-answer grading, and fine-tuning on rollouts can transfer a teacher’s controllability.
  • In appendix evasion tests, the more controllable model was not more successful.

【Our read】

Background

CoT monitoring is a pillar of OpenAI’s scalable oversight. This post moves “Astra is harder to monitor” from an observation to a breakdown of the training stack.

Comparison

  • This is not a new product or model.
  • UK AISI’s 30.9-minute figure is external; OpenAI’s “on-trend versus perplexity” does not cancel it.
  • The no-CoT numbers use an unreleased reasoning-off checkpoint, so they are not the public Astra’s capability.

Impact

  • If latent reasoning and CoT controllability rise with scale and can pass through model-generated data, reading the chain of thought becomes a weaker guarantee.
  • A rise in the proxy is not proven intent-hiding.
  • The authors say further pretraining will need new monitoring methods.

【Verifiable】

Read original →

Related developments

Aggregated by AGI Pulse. Titles and links only; no full text is republished. Editorial policy