English lecture · source-traced

Liang Wenfeng’s technical ladder · industry research report

**Report date**: 2026-08-13. **Genre**: industry primer + thematic deep dive. **Not** single-stock coverage; no target price; no buy/sell recommendation. **Primary source**: 2026-05-20 Liang Wenfeng investor-meeting audio transcript (audio `deepseek 0520.m4a`, about 3 hours 44 minutes; compiled 2026-07-16, ASR, speakers not diarized). Structured extract: [Liang Wenfeng Investor Meeting · Views](../../调查报告/Liang-Wenfe

EN
lecture
source
file:line
no
embellishment
中文
sibling

Report date: 2026-08-13.
Genre: industry primer + thematic deep dive. Not single-stock coverage; no target price; no buy/sell recommendation.
Primary source: 2026-05-20 Liang Wenfeng investor-meeting audio transcript (audio deepseek 0520.m4a, about 3 hours 44 minutes; compiled 2026-07-16, ASR, speakers not diarized). Structured extract: Liang Wenfeng Investor Meeting · Views (hereafter “the extract brief”). ASR risk on figures and proper nouns is inherited from §15 of the extract brief; this report does not treat accelerator counts or profit multiples from the meeting as audited facts.
Comparison materials: DeepSeek’s published technical reports, peer-reviewed papers, official lab blogs, and product notes.
How to read: anything written as “what he said” points only to the extract brief; anything written as “this report’s judgment / inference” is boxed or labeled and is not attributed back to him.

Part 1

1. Cover-page discipline: materials, method, evidence grades

1.1 What this report answers

The extract brief has already pulled Liang Wenfeng’s own judgments clean. This report only pursues three questions:

  1. Why does he order the intelligence mainline as “language model → CoT → Agent → continual learning → gradual self-iteration (he first calls this a singularity, then immediately qualifies) → embodied intelligence”? Are the reasons given in the meeting internally consistent?
  2. The most frontier research that can be checked as of August 2026—to which maturity band has each rung of this ladder been pushed?
  3. Which public evidence would support, revise, or puncture this ordering? For industry, at which rung is value more likely to settle?

This report does not rewrite the whole meeting and does not discuss open-source pricing or financing terms. Those belong to the extract brief.

1.2 Division of labor with the extract brief

Extract brief This report
Task What he said, and what he offered as reason What industry evidence says, what is inference, what would falsify
Discipline No imputed psychological motives Inferences must be labeled separately
Figures Meeting figures transcribed as-is and marked ASR Meeting capacity figures not used as external facts
Reader Someone who wants to read against the recording Someone who wants this ladder placed on a global technical map

1.3 Investment-research method (actually executed, not only written on the cover)

Benchmark the six modules of a thematic deep-dive, not the target-price page of a sell-side coverage template.

Module How this report lands it
One-pager §2: the debate, the judgment, three falsification conditions
Evidence grades P1 speaker’s own words / this lab’s papers; P2 peer-reviewed or checkable technical reports; P3 official blogs and product notes; P4 credible second-hand restatement of a public statement; P5 media and rumor (timeline only; does not support technical conclusions)
Three-column claims “What he said / this report infers / what the literature says” kept in columns, not mixed
Maturity Industrially deployed / industrially deployed in a narrow domain / lab-reproducible / problem posed, method not yet solved / concept
Comparison set OpenAI, Anthropic, Google DeepMind, Meta / LeCun, Physical Intelligence, NVIDIA embodiment stack
Scenarios and falsification Base / Bull / Bear defined by “which rung is unlocked,” not calendar prophecy as a conclusion

Strictly forbidden: writing “industry consensus” as an unsourced judgment; writing an inference as “Liang Wenfeng thinks”; cross-checking meeting accelerator counts against external financials.

1.4 Evidence-grade symbols

Later, each key judgment is, as far as possible, landed on a bibliography number. Numbers map one-to-one to the appendix table, which gives author, year, venue, URL/DOI, evidence grade, and which judgment is supported. Literature whose title and URL cannot be checked is not cited in the body.

Axis IInvestor one-pager
Part 2

2. Investor one-pager

2.1 The core debate

Frontier labs do not currently share one roadmap. At least four narratives are competing for the right to define the “intelligence ceiling”:

Narrative Representative source What mainly raises the intelligence ceiling
Language—reasoning—action—learning (Liang Wenfeng) Extract brief §6.3, §12.1 Finish checkable symbolic intelligence first, then use it to develop the next version, and only then enter the physical world
World models first LeCun 2022 position paper and Meta preview [32][33] Predict the world in latent space, rather than taking next-token as the main objective
Video / generation as simulation OpenAI Sora technical note [34] Scaled video generation is a path to a physical-world simulator
Embodiment data first Physical Intelligence π₀ [36], Open X-Embodiment [37], Gemini Robotics [39] Cross-embodiment robot data + vision–language–action models; attach a body now

Liang Wenfeng explicitly moves video generation and present-stage world models, among the latter three, off the “intelligence mainline”: commercially they can be good business, but they have “not that much relation to the intelligence ceiling either” (extract brief §8.1). This is not an aesthetic preference; it is his operational definition of what it means to raise the intelligence ceiling.

2.2 This report’s judgment (not his wording)

This report’s judgment. This ladder holds as a dependency relation: published systems at the later rungs almost all stand on language models (and, increasingly often, vision–language models). The largest unsolved gate is what he calls “continual learning”—labs worldwide acknowledge the crack between catastrophic forgetting and “weight-frozen LLMs,” but there is not yet a widely reproduced, scalable, deployable solution. His qualification of “singularity” into a gradual change breaks, in mechanism, from I. J. Good’s 1965 “intelligence explosion” hard-takeoff narrative [29], and is closer to already-appearing weak forms of “using a model to improve a model” in local links [30]. Embodiment is postponed as a leverage logic (let stronger intelligence build robots), not as a denial that the physical world has demand.

Three closing sentences:

  1. The dependency holds. The CoT paper is explicitly built on a sufficiently large language model [9]; ReAct interleaves chain of thought with action [14]; embodiment models such as π₀ take a pretrained vision–language model as backbone [36]. The later step uses the earlier step; this is not rhetoric.
  2. The bottleneck judgment points the same way as public evidence; an alternative hypothesis also holds. “Given full context it already exceeds humans, yet still cannot replace an employee” points the same way as METR’s time-horizon results: frontier agents approach a perfect score on short tasks and success rate collapses on multi-hour tasks [18]. But “what is missing is weight-updatable continual learning” is not the only explanation—what is missing may also be a longer reliable tool chain, without changing weights.
  3. The ordering is the easiest route under a resource constraint, not the only physical possibility. The ordering reason he gives is “later technique can be developed with earlier technique”; “doing embodiment first is bitter work” (extract brief §6.3). This is consistent as engineering; it does not imply “labs doing robots now have taken the wrong path.” It only implies: in a lab that is compute-tight and takes itself as first user, this path has less expected overtime.

2.3 Three falsification conditions (What would change our mind)

If any of the following events appears in a reproducible way, this report must down-weight this ladder:

# Falsification condition Observational landmark
F1 A world model or video generation, on its own, clearly raises the intelligence ceiling past the language–reasoning stack, and does not depend on the latter as backbone In a setting without a strong language-model backbone, a world model stably exceeds contemporaneous CoT+Agent systems on checkable reasoning / planning benchmarks
F2 Without updating weights, by context and tools alone, an agent can complete “about two months of on-the-job learning”-scale tasks METR-style time horizons at a high-reliability threshold (e.g. 80%) reach week–month scale [18], and this is reproducible on real enterprise jobs, without catastrophic-forgetting-style cross-task collapse
F3 A lab that does embodiment first and symbols later produces a generalizable housework / elder-care-grade system with clearly less language intelligence Cross-home, cross-embodiment success does not depend on a large-scale VLM/LLM backbone, and data efficiency is higher than the “software intelligence first, then robots” control

As of 2026-08, none of these three has been met. F2 is the nearest competing hypothesis; F1 and F3 run opposite to the direction of public papers.

2.4 Maturity dashboard (as of 2026-08)

flowchart LR
  L1["1 Language models
industrially deployed"] --> L2["2 CoT / test-time compute
industrially deployed"] L2 --> L3["3 Agent
industrially deployed in a narrow domain"] L3 --> L4["4 Continual learning
method not yet solved"] L4 --> L5["5 Self-iteration
weak form, lab-reproducible"] L5 --> L6["6 Embodied intelligence
lab-reproducible"]
Rung His time anchor (extract brief) This report’s maturity One-sentence evidence
Language models One step earlier Industrially deployed Transformer [4] + scaling laws [5][6]; DeepSeek-V3 is 671B/37B active MoE [2]
CoT “Last year” Industrially deployed o1 trains chain of thought with RL [11][12]; DeepSeek-R1 incentivizes reasoning with RL and is published in Nature [3][46]
Agent “This year” Industrially deployed in a narrow domain Coding agents are already in products; SWE-bench was once the main ruler; OpenAI in 2026 stopped reporting frontier on Verified because of contamination [20]; general desktop/job replacement is still far
Continual learning “The next bottleneck” Problem posed, method not yet solved EWC 2017 remains a classic patch [21]; Titans / Nested Learning / SEAL are 2025 new architectures, not yet the training default [24][26][27]
Self-iteration “Singularity, but gradual” Weak form, lab-reproducible AlphaEvolve improved a Gemini training kernel and entered Google infrastructure [30]; a fully automatic “next-version model” has not appeared
Embodiment After self-iteration Lab-reproducible π₀, GR00T, Gemini Robotics are all public [36][40][39]; housework/elder-care-grade generalization is not shown
Axis IIWhy he orders it this way
Part 3

3. Cognitive reconstruction: why he orders it this way, and not another way

This section does only two things: collect the reasons given in the meeting into one causal chain; then box this report’s inferences separately. The latter is not put in his mouth.

3.1 Three ordering axioms given in the meeting

In extract brief §6.3, §12.1, what he repeatedly uses is not a product roadmap; it is three axioms:

Axiom Compressed from his wording What it excludes
Dependency The later step uses the earlier step: CoT uses the language model; Agent uses CoT “Skip reasoning, go straight to agent / robot” as the mainline
Leverage “Later technique can be developed with earlier technique”; “after the singularity, embodiment need not be done by people”; doing embodiment first “is bitter work” Treating robot-body R&D as the highest current leverage
Observable bottleneck The problem is stated clearly, context is given in full, “already exceeds humans”; a person has decades of context; a hire takes about two months to get up to speed; AI does not have those two months of learning and cannot replace an employee. After Agent is exhausted it still does not reach AGI. “It must have continual learning before it counts as the next-generation model.” Treating multimodality, search, video generation, and present-stage world models as the intelligence-ceiling mainline

These three are enough to derive his ordering; no extra personality analysis is needed.

3.2 A lab-centered definition of AGI

The extract brief is clear: without embodiment, what he hopes AGI will do is “help me iterate the next model”; with embodiment, he hopes it iterates the next embodiment—the next robot. The first user of continual learning is themselves: “The first goal of the models we build is not that others use them well, but that we use them well.” (extract brief §12.1)

Inference (this report, not Liang Wenfeng’s wording). This is an AGI definition that takes research productivity as the product. Consumer-side “housework, elder care” is explicitly acknowledged as a normal person’s demand, but is placed after self-iteration. So his ladder does not look like “a graph a consumer product manager would draw,” and looks like “a graph a lab director who has to train the next set of weights would draw.” Coding agent is placed first among current vertical applications (extract brief §8.3), isomorphic with this definition: writing code, changing kernels, running experiments is the nearest task distribution to “help me iterate the next model.”

Public comparison: Google DeepMind’s AlphaEvolve turned “use a coding agent to improve algorithms and the training stack” into a deployable system, and reports speeding up a matrix-multiply kernel in the Gemini architecture by 23% and cutting training time by about 1% [30]. This is not material Liang Wenfeng cited, but it shows: “first user is ourselves” has already moved, in other top labs, from a slogan to an internal tool.

3.3 The employee analogy: he collapses “completing tasks” into “continual learning”

What he uses to pin Agent is not some olympiad-math item; it is a job:

  • Person: saying “Xiao Wang, come over” is enough to know who Xiao Wang is; about two months to learn the environment.
  • Model: each time it must be told who Xiao Wang is, the role, how to find them, what to watch. “You cannot give it all context, and it is not realistic.” (extract brief §6.2)

So “continual learning” in his usage is not a named algorithm, but “learn over a long period as a person does, without a very strong training dump each time.” He also says it “may not be one technique; it is a problem,” “the whole world has not yet found a method that really works” (extract brief §12.1). In the transcript “continual learning” and “learn to learn” are mixed; the extract brief does not force them together; this report likewise lists them separately (see the appendix glossary).

Inference. He has welded together two problems the literature keeps apart: (a) task-level agent failure (tool chain, memory, reliability); (b) weight-level continual-learning failure (a new task wipes an old task). The weld is the employee analogy. If (a) can be solved on its own by longer context, external memory, and better agent scaffolding, his “next generation = must have continual learning” will look too strict. That is exactly §2’s F2.

3.4 “The easiest roadmap”: a research strategy under a compute constraint, not the universe’s only solution

His ordering also has an organizational reason: this path “need not work overtime”; continual-learning research “does not consume accelerators, only very few; it needs ideas”; internally they call it “lottery scratching” (extract brief §12.1). Scaling is what burns cards; model size is “computed from resources” (extract brief §6.4).

Inference. Under a compute constraint tighter than the US, defining the unsolved problem as “idea-dense, card-sparse,” while handing solved problems (pre-training, test-time compute) to cards that can be bought, is a rational research portfolio—it explains why video generation, a “good business,” is still moved off the mainline: it both burns cards and (in his view) does not raise the intelligence ceiling. Sutton 2019’s The Bitter Lesson says that what finally wins is general methods that can eat compute [31]. Liang Wenfeng believes both Scaling (eating compute) and continual learning, a problem not yet scaled (eating ideas). The two are not in contradiction: Scaling has not hit a wall; the rung beyond the wall is what he names continual learning.

3.5 Qualifying “singularity → gradual”: this is a judgment with theoretical content

I. J. Good’s 1965 operational definition is: an ultraintelligent machine can design better machines, so “there would unquestionably be an intelligence explosion,” and human intelligence would be left behind; “the first ultraintelligent machine is the last invention that man need ever make” [29]. Liang Wenfeng first borrows the habitual name “singularity,” then immediately corrects: not a jump, a long gradual change; AGI has “no critical point, but [is] nonlinear,” because “AI can accelerate AI research” (extract brief §6.3, §13.1).

Alignment and break can be written in one line:

Good 1965 [29] Liang Wenfeng 2026-05 (extract brief)
Content Machines can design better machines The model can do what humans can, and can develop the next version
Dynamics Intelligence explosion Long gradual change; no critical point, can be nonlinear
Place of humans Left behind At least until continual learning is made to work, humans remain the research subject; AI “does not yet work autonomously; it still pairs with people”

Inference. This qualification moves him closer to Silver and Sutton 2025’s gradual register of an “era of experience”—continual improvement from data produced by agent–environment interaction, rather than a phase change after one freeze of weights [28]—and not closer to Good’s explosion. Public literature already has weak forms of “using a model to improve a model”: R1’s reasoning is distilled back into V3 [2][3]; AlphaEvolve optimizes Gemini’s own training stack [30]. These are evidence of gradual change, not of explosion.

3.6 Whether DeepSeek’s published trajectory is isomorphic with the ladder

Looking only at public papers, not at meeting capacity figures:

Rung Public exhibit Evidence grade
Language models DeepSeek-V3: 671B total parameters, 37B activated per token; 14.8T tokens of pre-training; full-text training 2.788M H800 GPU hours [2] P1
CoT / reasoning DeepSeek-R1-Zero: large-scale RL first, without SFT, reasoning behavior emerges; DeepSeek-R1 adds cold start and multiple stages; reasoning tasks comparable to OpenAI-o1-1217; Nature formal publication [3][46] P1 / P2
Agent The meeting says “this year”; on the public-paper side there is not yet a “DeepSeek Agent technical report” of R1’s weight. This repository’s source analysis of deepseek-harness can only show that an engineering stack exists; it cannot substitute for an official lab paper P1 from the meeting; the engineering stack is not upgraded to paper P1
Continual learning He states clearly that the world has not made it work, and internal ideas have not been made to work (extract brief §12.1) P1 (negative statement)

The isomorphic part: V3 → R1 is a public demonstration of “language model → CoT,” and R1’s training explicitly starts from V3-Base [3]. The part not yet isomorphic: Agent and continual learning still sit at the meeting’s time anchors, with no papers of equal weight. This report does not write “doing Agent this year” as an already-published fact.

3.7 Off the mainline: the place of video, world models, multimodality

Extract brief §8.1: 3D / video generation has “not that much relation to the intelligence mainline”; after Sora, large and small firms all did it, and small firms later cut it; world models “at present also not closely related to the intelligence ceiling,” and the term is “not that clear.” Multimodality is important for the consumer side; for the intelligence ceiling “it is a component… like search”; from V4 they still do native multimodality (extract brief §6.4).

Inference. The discriminant he uses is: whether the thing raises the ceiling of “solving problems in complete context,” not “whether it makes the product look better / whether it more resembles a world.” OpenAI writes Sora as “a promising path towards a general purpose simulator of the physical world” [34]; LeCun writes world models as the hub of autonomous intelligence [32][33]. Liang Wenfeng is in effect announcing: under his operational definition, these two narratives are at present components or bypasses. §5 below lays out this route contest; it does not pick a winner here.

Axis IIISix-rung ladder · SOTA dashboard
Part 4

4. Six-rung comparison: definition, frontier, agreement, and tension at each rung

Each rung is fixed at six blocks: how he defines it / why it sits at this rung / how far the 2026 frontier has gone / agreement and tension with his judgment / unsolved / key sources. Maturity is this report’s rating, not a lab self-rating.

4.1 Rung 1 · Language models

How he defines it. One step earlier; CoT uses it (extract brief §6.3). He believes in Scaling and has not yet seen a ceiling; what blocks it is compute, not will (extract brief §6.4).

Why it sits at this rung. Dependency axiom: without a base model that can predict the next token, later chain of thought and tool loops have nowhere to sit.

How far the 2026 frontier has gone.

  • The architectural base is still Transformer [4].
  • Training loss follows a power law in model scale, data, and compute; Kaplan et al. 2020 gave early scaling laws [5]; Hoffmann et al. 2022 (Chinchilla) found that parameters and tokens should be scaled in roughly equal proportion; many earlier models were undertrained [6].
  • The GPT-4 technical report used experiments two to four orders of magnitude smaller to predict large-model loss and some capabilities [7].
  • The Llama 3 Herd report gave a scaling recipe on the open-weight side [8].
  • DeepSeek-V3 uses MLA + DeepSeekMoE, 671B / 37B active, 14.8T tokens, and emphasizes training stability and controllable cost [2].

Maturity: industrially deployed. The dispute is not “whether language models hold,” but “whether scaling laws have hit a wall.” Liang Wenfeng’s judgment is that the wall is not the same distance for Silicon Valley and for him (extract brief §6.4). This is a statement of vantage, not a measured wall that can be falsified.

Agreement. The V3 paper itself is an instance of “finish the language model first, then do post-training on it” [2]. R1 starts from V3-Base [3]; the dependency is written dead in their own paper.

Tension. LeCun holds that autoregressive LLMs are not a sufficient path to autonomous intelligence; what is truly missing is a world model [32][33]. If F1 holds, rung 1 would still remain as a component, but would no longer be the first load-bearing wall of the mainline.

Unsolved. Data quality and annotation cost (he says data is almost half the model, extract brief §12.2); inference cost rises with scale (he himself also says that the US can train very large active-parameter models but “cannot actually use them… it is indeed a bit expensive”—this is his judgment, not externally verified).

Key sources. [2][4][5][6][7][8].

4.2 Rung 2 · CoT / chain of thought / test-time compute

How he defines it. “Self-thinking, raising the intelligence ceiling”; on olympiad math and writing programs it “already surpasses the top humans”; at the ceiling it still does not reach AGI. Time anchor: “last year” (extract brief §6.3).

Why it sits at this rung. Dependency: chain of thought emerges from a sufficiently large language model [9]. Leverage: the same set of weights, more test-time compute for higher accuracy, without first scaling pre-training another order of magnitude [11][13].

How far the 2026 frontier has gone.

  • Wei et al. 2022: few-shot chain-of-thought prompting substantially improves arithmetic, commonsense, and symbolic reasoning; PaLM 540B with eight chain-of-thought exemplars reached then-SOTA on GSM8K [9]. The paper describes the capability as a scale phenomenon that appears significantly around the 100B-parameter regime.
  • Kojima et al. 2022: adding only “Let’s think step by step” can elicit zero-shot chain of thought [10].
  • OpenAI o1 (from 2024-09): trains the model with large-scale reinforcement learning to use chain of thought; explicitly writes that performance rises with both training-time compute and test-time “thinking time,” a constraint different from pre-training scaling laws [11]. The system card defines the o1 series as reasoning models that “think first, then answer” [12].
  • Snell et al. 2024: optimizing test-time compute at fixed weights can, on some tasks, be more effective than scaling parameters [13].
  • DeepSeek-R1: R1-Zero shows that pure RL can elicit long reasoning; R1 uses cold start to address readability and language mixing; reasoning tasks are comparable to o1-1217; distilled small models are open-sourced [3]; 2025 Nature publication [46].

Maturity: industrially deployed. The time anchor “last year” is consistent with the public timeline of o1 in 2024 and R1 in 2025.

Agreement. Their R1 paper is almost an experimental proof of this rung: first V3-Base, then reasoning. His saying that CoT raises the intelligence ceiling but is still not AGI also matches o1/R1 remaining stuck in “one question, one answer, limited context.”

Tension.

  • Whether chain of thought faithfully reflects internal computation remains an open question; the o1 system card lists this as a monitoring premise [12].
  • “Surpasses the top humans” is limited by him to olympiad math and writing programs. This matches the distribution of strengths on public benchmarks and cannot be extrapolated to vague jobs.
  • Test-time compute partly buys “intelligence” as latency and cost. This does not negate the rung, but it changes the cost curve per unit of intelligence [11][13].

Unsolved. Stability of process reward versus outcome reward; language mixing and readability (known defects of R1-Zero [3]); moving reasoning from contest items to vague real tasks.

Key sources. [3][9][10][11][12][13][46].

4.3 Rung 3 · Agent

How he defines it. Broader range of capability, higher intelligence ceiling; uses CoT; after the step is exhausted it still cannot replace an employee. Time anchor: “this year.” Among current vertical applications “what matters most should still be a Coding Agent” (extract brief §6.3, §8.3).

Why it sits at this rung. Dependency: ReAct’s original proposition is to interleave reasoning traces with action; reasoning helps update the plan; action takes evidence from the environment [14]. Leverage: checkable feedback (tests, compilers, page state) lets the model put CoT onto the environment, rather than stopping on the page.

How far the 2026 frontier has gone.

  • Paradigm. ReAct (Yao et al., ICLR 2023) exceeds reasoning-only or acting-only on QA and decision benchmarks [14]. Anthropic’s 2024-12 engineering piece defines an agent as a model that dynamically decides tools and process and loops on environmental feedback; and separately notes coding and “computer use” as two already-landed domains [16].
  • Software-engineering ruler. SWE-bench: real GitHub issue → patch → hidden tests [15]. SWE-agent used a custom agent–computer interface to raise full-set SOTA to the then 12.5% magnitude [44]. OpenAI 2024-08 released SWE-bench Verified (500 human-screened items) [19]. By 2026, OpenAI publicly stopped reporting frontier on Verified, on the ground that contamination made scores no longer reflect real software-engineering ability, and suggested reporting SWE-bench Pro instead [20].
  • Time horizon. METR 2025: defines task length by human-expert time, and fits the duration at which a model has 50% success. The original paper reports roughly 7-month doubling; the then frontier (e.g. o3 / Claude 3.7 Sonnet, versions vary by write-up) sat at about the one-hour magnitude, with low success on multi-hour tasks [18]. The official page states that static figures go stale; take the time-horizons page as authoritative [18b].
  • General computers. OSWorld evaluates on real desktop applications [42]; GAIA tests tool-chain QA that is “simple for humans, hard for then-AI” [41]. Both still show a gap versus humans on long-horizon, vague, multi-application tasks.
  • Computer use. Anthropic treats computer use as one of the reference implementations of an agent [16][17].

Maturity: industrially deployed in a narrow domain. Coding agents are already products; general job replacement is not supported by METR or OSWorld.

Agreement.

  • “Agent uses CoT” is written both by ReAct and by Anthropic’s coding-agent practice [14][16].
  • “After the step is exhausted it still cannot replace an employee” points the same way as METR’s “near-perfect on short tasks, collapse on long tasks” [18]. The two months in the employee analogy is far longer than the measured 50% time horizon.
  • He places Coding Agent first among verticals, pointing the same way as Anthropic’s “code can be scored by tests, so agents are especially effective” [16], and also the same way as his own “first user is the lab.”

Tension.

  • Public benchmarks are failing: contamination of SWE-bench Verified makes “how far Agent has gone this year” harder to answer with a single score [20]. This report therefore does not cite any SWE-bench percentage without a dated scaffolding as a frontier level.
  • Alternative hypothesis F2: if time horizons keep extending exponentially, they may cover some “Xiao Wang” jobs without solving continual learning. Liang Wenfeng books this step’s residual entirely to continual learning’s account, perhaps too early.
  • Memory-class systems (MemGPT pages context as virtual memory [23]; Voyager accumulates a skill library in Minecraft [45]) show that part of “learning” can be impersonated by scaffolding. If he insists that “the next generation must change the learning problem itself,” he needs to exclude these impersonations—in the meeting he did not perform that conceptual surgery; he only said continual learning is a problem, with many techniques.

Unsolved. High-reliability long horizon (the 80% time horizon is far shorter than 50% [18]); vague requirements; cross-shift memory; evaluation contamination.

Key sources. [14][15][16][17][18][19][20][23][41][42][44][45].

4.4 Rung 4 · Continual learning (the load-bearing crack of this ladder)

How he defines it. Learn over a long period as a person does, without a very strong training dump each time; the same problem as “completing tasks”; the next bottleneck that can be seen after Agent; the world has not yet found a method that works; internally there are ideas that look promising, none made to work; “if continual learning is done first, general intelligence may be easy”; otherwise stacking data and labor by hand has “poor cost-performance” (extract brief §12.1). The definitional right of the next-generation model sits at this rung (extract brief §6.4).

Why it sits at this rung. Observable bottleneck: after the task distribution for which full context is already enough is eaten by CoT+Agent, what remains is adaptation across days, tasks, and jobs. Dependency: first an agent that can act, then data “learned from its own trajectories.” This points the same way as Silver & Sutton 2025’s “high-quality human data approaching a ceiling; the next step must let agents learn from their own experience” [28].

How far the 2026 frontier has gone. Several things that are often collapsed must first be cut apart:

Mechanism Weights updated? Representative work Does it count as the continual learning he means
Longer context / RAG / virtual memory Usually no MemGPT [23] His employee analogy implies “not enough”: it is neither possible nor realistic to stuff everything into context
Test-time memory (internal state of a sequence model) Memory modules updated in the forward pass Titans: neural long-term memory memorizes history at test time; attention as short-term memory [26] Closer, but still an architectural experiment, not a training default
Elastic weight consolidation and similar regularizers Yes, but old tasks are protected EWC, PNAS 2017 [21]; the classic statement of catastrophic interference is McCloskey & Cohen 1989 [22] Problem statement agrees with him; the method has not become the LLM main path
Self-edit then fine-tune Yes SEAL: the model generates a self-edit, written into weights via SFT, downstream performance as RL reward [27] Direction agrees; experimental scale far smaller than frontier pre-training
Nested optimization / self-modifying architecture Yes (multiple layers at different update frequencies) Nested Learning + Hope, NeurIPS 2025; Google’s official blog labels it a new paradigm for continual learning [24][25] Problem agrees; Hope is a proof of concept, not a V3/R1-grade recipe
Experience-data closed loop Yes; data from interaction The Era of Experience [28] Problem agrees; a program, not a deployed system

Maturity: problem posed, method not yet solved. Same sentence as his own wording. This report records 2025 Titans / Nested Learning / SEAL as “promising lab directions,” not as “solved.”

Agreement. He may be one of the lab heads who has stated this problem hardest in public: he uses it directly to define the next generation, rather than writing it as future work in a paper. The literature supports the negative fact “not yet solved” [21][22][24][27][28].

Tension.

  • Term mixing. “Continual learning / learn to learn / continuous learning” were not aligned in the meeting. Meta-learning (learn-to-learn) and online adaptation (continual / online learning) are not the same problem in the literature. This report does not align them for him.
  • He does not equate it with Recursive Improvement as raised by the questioner (extract brief §12.1). This report places recursive self-improvement at rung 5, to avoid welding rungs 4 and 5 shut.
  • Silver & Sutton’s “era of experience” emphasizes data produced by environmental interaction [28], and does not necessarily first require a completed digital agent. If their program is right, the coupling of continual learning with embodiment / simulated environments would be tighter than Liang Wenfeng’s ordering, and rung 4 could not sit cleanly before embodiment. This is mild pressure on axiom 2; it does not yet constitute F3.

Unsolved. Writing new job knowledge into weights or equivalent memory without catastrophic forgetting; reproducing SEAL / Hope-class results at model scale; turning “two months to get up to speed” into a measurable benchmark (there is at present no widely adopted “employee two months” benchmark).

Key sources. [21][22][23][24][25][26][27][28].

4.5 Rung 5 · Self-iteration (he calls this a singularity, then immediately qualifies it as gradual)

How he defines it. The model can do everything humans can, and can itself develop the next version; not a jump, a long gradual change; people are merely used to calling it a singularity. Without embodiment, the first use is iterating the next model (extract brief §6.3). AGI has no critical point and can be nonlinear, because AI can accelerate AI research (extract brief §13.1).

Why it sits at this rung. The apex of the leverage axiom: once continual learning lets the model absorb its own experimental trajectories, research itself becomes an accelerable object. Dependency: needs agent (can change code, run experiments) + continual learning (experiments are not forgotten the next day).

How far the 2026 frontier has gone.

  • Theoretical original. Good 1965: an ultraintelligent machine can design better machines → intelligence explosion [29]. Liang Wenfeng keeps “can design the next version,” drops “explosion.”
  • Weak form, already deployed. AlphaEvolve: a Gemini-driven evolutionary coding agent, screening programs with automatic evaluators; reports include improving Gemini’s own training kernel (matrix-multiply subproblem partitioning sped up 23%, training time about −1%), FlashAttention kernels up to about 32.5% faster, and over the following year entering TPU design, cache strategy, Spanner, and other infrastructure [30]. This is an existence proof of “a model improving a model’s training stack”; the object is algorithms and kernels, not a complete next-generation set of weights.
  • Weak form, training recipe. R1 reasoning distilled into V3 post-training [2][3]: a stronger reasoning model teaches the next general model. Humans still design the pipeline.
  • Weak form, self-edit. SEAL lets the model write its own fine-tuning instructions [27]. Scale far smaller than pre-training.
  • Program. Silver & Sutton: high-quality human data approaching a ceiling; experience data must become the main medium of improvement [28].

Maturity: weak form, lab-reproducible; complete “itself developing the next version” remains a concept.

Agreement. Qualifying it as gradual matches local accelerations of the AlphaEvolve kind, “a few days of automatic experiment replacing weeks of experts” [30], and does not match overnight generation change. First user is themselves, matching AlphaEvolve first serving Google’s internal training stack.

Tension. If Good’s explosion suddenly holds at some generation, his “no critical point” would be falsified. At present no public system shows cross-generation, unattended weight design. Amodei’s Machines of Loving Grace writes powerful AI as a manageable, relatively gradual social process [47], on the same side as the qualification, but that is an essay, not an experiment.

Unsolved. From “optimize one kernel” to “propose and complete the next-generation training recipe”; from a human-set fitness function to posing its own questions (he has another sentence, “the next step after that, it asks its own questions,” extract brief §8.1).

Key sources. [2][3][27][28][29][30][47].

4.6 Rung 6 · Embodied intelligence

How he defines it. Enter the real world: housework, elder care; placed after self-iteration; “for a normal person, the need is not a computer.” Doing it first is “bitter”; after the singularity “need not be done by people” (extract brief §6.3).

Why it sits at this rung. Leverage: let a system that can already iterate software iterate robots. Dependency: embodiment papers almost all start from a vision–language model, rather than inventing intelligence from zero.

How far the 2026 frontier has gone.

  • Data. Open X-Embodiment / RT-X: cross-embodiment robot datasets and models, showing that mixing data from different robots has generalization gains [37].
  • VLA. RT-2 transfers web vision–language knowledge to robot control [38]. π₀: Physical Intelligence’s flow-matching vision–language–action model; backbone is a pretrained VLM, plus an action expert; official blog and arXiv in sync [36][36b]. NVIDIA Isaac GR00T: an open cross-embodiment VLA reference stack [40]. Gemini Robotics: brings Gemini-grade models into the physical world; later 1.5 emphasizes embodied reasoning and action transfer [39].
  • World-model comparison. LeCun 2022: configurable predictive world models + JEPA, as a blueprint for autonomous intelligence [32][33]. Sora: scaled video generation “is a promising path towards a general purpose simulator of the physical world” [34]; Sora 2 still treats world-simulation ability as a key milestone in training AI that can understand the physical world [35]. Genie: learns interactive environments from unlabeled video [43].

Maturity: lab-reproducible; housework/elder-care-grade generalization not shown. Public systems show desktop manipulation, short kitchen skills, controlled labs, not “any home, any elder.”

Agreement. Almost all 2024–2026 general robot foundation models first borrow language / vision–language intelligence, then attach an action head [36][38][39]. This directly supports the dependency axiom, even if these labs’ investment timing entered hardware earlier than his.

Tension (this is where the whole ladder rubs hardest against the outside world).

  • Physical Intelligence, Figure-class companies, the Tesla Optimus narrative, Gemini Robotics, are all collecting real robot data without waiting for a “software singularity.” Their implicit judgment is: the physical-data bottleneck cannot be filled in later by intelligence from thin air; if it is not collected now, it will not exist later. This is not a logical contradiction with “doing embodiment first is bitter work”—bitter work can also be necessary—but it conflicts with the expectation that “after the singularity it need not be done by people”: if physical data must be collected by people today, later people cannot backfill it with pure software intelligence.
  • The world-model camp holds that without an internal simulator, agents in the real world will be too expensive to make [32][34]. Liang Wenfeng moves present-stage world models off the mainline. If F1 holds, rung 6 would move forward, even insert between Agent and continual learning.
  • The classic statement of Moravec’s paradox is: sensorimotor skills easy for humans are hard for machines. His “bitter work” points the same way as this tradition. His novelty is: postpone the bitter work until after self-iteration, and let stronger intelligence bear the cost of data and control. This is strategy, not a denial of the paradox.

Unsolved. Cross-home generalization; safety and contact-force control; distribution shift of data from lab to real residences; whether a world model must be a prerequisite of embodiment.

Key sources. [32][33][34][35][36][36b][37][38][39][40][43].

4.7 Six-rung comparison table

Rung Function in his wording Maturity Hardest public evidence Strongest agreement with him Strongest tension with him
1 LM Base Industrially deployed V3 [2]; scaling laws [5][6] R1 starts from V3-Base Whether LLMs are a dead end [32]
2 CoT Raise the ceiling Industrially deployed o1 [11]; R1/Nature [3][46] “Last year” contemporaneous with 2024–25 reasoning models Faithfulness of chain of thought [12]
3 Agent Widen the range Industrially deployed in a narrow domain ReAct [14]; METR [18] Coding first [16]; still cannot replace an employee Evaluation contamination [20]; F2
4 Continual learning Next-generation definition Method not yet solved EWC [21]; SEAL [27]; Nested Learning [24] “The world has not made it work” agrees with the literature External memory impersonation; coupling with embodiment [28]
5 Self-iteration Gradual, not explosion Weak form, lab-reproducible AlphaEvolve [30]; Good original [29] Qualification points the same way as the weak form Hard takeoff is not excluded, only not seen
6 Embodiment A normal person’s demand Lab-reproducible π₀ [36]; OXE [37] VLA depends on a VLM backbone Physical data must be collected now
Axis IVRoute contest, scenarios, industrial implications
Part 5

5. Route contest: four maps, not a pick-a-side essay

5.1 Comparison set

Route Operational definition of the intelligence ceiling Where money should be burned now Versus Liang Wenfeng’s ladder
Language—reasoning—action—learning Checkable tasks under complete context + eventually able to change its own weights Pre-training, test-time RL, agent scaffolding, continual-learning ideas His own
World models / JEPA Predict the world in latent space and plan Self-supervised video/multimodal, non-generative predictive architectures He: at present not the ceiling mainline
Video as simulator Pixel-level (or patch-level) world simulation Large-scale video pre-training He: video generation is good business, not the mainline
Embodiment data Cross-embodiment, cross-scene real-action success Robot bodies, teleoperation, simulation He: postponed; doing it first is bitter work

No route has been “adjudicated” by public results as of 2026-08. What can be written into a research report is only: investment timing differs, load-bearing walls differ, falsifying experiments differ.

5.2 World models first: LeCun and Sora are not the same claim

LeCun’s 2022 position paper wants a joint-embedding predictive architecture with non-pixel-level reconstruction, avoiding the waste of generative video on irrelevant detail [32][33]. OpenAI’s Sora note takes a generative, patch-level diffusion Transformer, and explicitly writes scaled video as a path to a world simulator [34]. Both are called world models; the methods are opposite.

Liang Wenfeng says the meaning of world models is “not that clear,” and many things can be called by that name (extract brief §8.1). That sentence is directly confirmed by the split above. So “he rejects world models” must be written: “he rejects treating present-stage, ill-defined world models as the intelligence-ceiling mainline,” not “he rejects all internal simulation.”

Genie makes “learn an interactive environment from video” into another generative world model [43]. If systems of this class begin to provide agents with stable, verifiable planning gains, F1’s observation window would open. Public materials still write them as research systems or product previews, not as an intelligence ceiling that has already replaced CoT+Agent.

5.3 Scaling as everything

The scaling-law literature [5][6][7] and o1’s “training-time + test-time compute both rise” [11] support “adding compute still has return.” Liang Wenfeng agrees Scaling has not hit a wall (extract brief §6.4), but refuses to let Scaling replace continual learning in defining the next generation. The tension is: if test-time compute + longer context + better scaffolding covers employee tasks in the F2 sense, continual learning as a “next generation” definition would be demoted by the market (not by physics) to an optional optimization.

5.4 Recursive self-improvement hard takeoff

Good’s explosion [29] is the theoretical comparison for rung 5, not any lab’s current recipe. AlphaEvolve [30] proves that local self-improvement exists, and also proves that today it is still nested in human-designed evaluators and evolutionary loops. This report keeps hard takeoff as a tail scenario (the extreme of Bull), and does not write it as the base scenario.

Part 6

6. Scenarios and falsification: by “which rung is unlocked,” not by year

Calendar prediction has a poor record in this field. This report only defines states. If a year appears, it is only as the METR original paper’s own extrapolation, with its assumptions marked.

6.1 Three states

Bear Base Bull
Meaning The ladder sticks at rung 4, or is rerouted by F1/F3 His dependency order is largely walked by the industry; continual learning is slowly partly solved Weak self-iteration comes early; time horizons rapidly cover jobs
Rung 4 External memory and long context are mistaken for already solved; weight-level adaptation still catastrophically forgets One of SEAL / Nested Learning / experience closed loop is reproducible at medium scale and begins to enter post-training recipes Continual learning becomes a default training item of the “next generation”; his definition is adopted by the market
Rung 5 Only distillation and kernel optimization; humans still write the entire recipe AlphaEvolve-class systems become standard equipment at multiple labs, covering local parts of the training stack Cross-generation, lightly attended search over training recipes appears; still gradual, not Good’s explosion
Rung 6 Robots stay at demos; or, conversely, the embodiment camp uses physical data to overtake software intelligence (F3) VLA keeps eating VLM dividends; housework-grade products remain narrow Self-iteration begins to design the next-version body; bitter work clearly lightens
On “coding agent” Evaluation contamination + a reliability plateau; revenue stops at assisted coding Continues as the most checkable narrow domain; time horizon climbs from hours toward working days [18] Coding agent becomes the lab’s operating system, the hand of self-iteration

6.2 Observable landmarks (public, checkable)

  1. Paper level: whether a “continual learning / experience closed loop” technical report of R1’s weight appears, including failure cases and forgetting curves, rather than only needle-in-a-haystack retrieval.
  2. Product level: whether the same weights (or the same persistent memory) can, without retraining, complete new tasks across weeks on the same codebase / the same job, and keep old tasks.
  3. Evaluation level: METR 80% time horizon; OSWorld-class desktop tasks; and—there is not yet one—a “two-month onboarding” benchmark.
  4. Evaluation integrity: whether contamination-resistant benchmarks are adopted (OpenAI has publicly left SWE-bench Verified [20]).
  5. Self-iteration: whether a second lab publishes “this system improved this system’s training cost / algorithms,” with a re-checkable evaluator.
  6. Embodiment: success rates across homes, across embodiments, without teleoperation—not clips from a lab kitchen.

6.3 How to use METR’s extrapolation, and how not to

The METR original paper writes: if the 2019–2025 trend is extrapolated, within about five years systems may automatically complete many software tasks that currently take a human a month; and emphasizes external validity and trend change as the main uncertainties [18]. This report cites that extrapolation as an extrapolation in the literature, and does not rewrite it as our forecast. It serves F2 directly: if month-scale software tasks are solved at high reliability, the pressure of “must have continual learning” in Liang Wenfeng’s employee analogy would fall, but “must have continual learning before it counts as the next generation” can still exist as a research definition—only the market may no longer pay for that definition.

Part 7

7. Industrial implications (logical implications, not prices)

This section translates the ladder into “where value may settle.” It does not write buy/sell recommendations and does not give multiples.

7.1 Coding agent: currently the only narrow domain that is both checkable and close to self-iteration

Anthropic lists coding as one of the domains where agents are most effective, on the ground that tests can score automatically [16]. Liang Wenfeng places Coding Agent first among verticals (extract brief §8.3). The two are independent and point the same way. Industrial implications:

  • Until continual learning is made to work, checkable closed loops (code, mathematics, some science) will keep absorbing budget for test-time compute and agent scaffolding.
  • Evaluation contamination [20] means buyers can no longer use a single public leaderboard as acceptance; value turns to private, contamination-resistant internal benchmarks with cost constraints. This repository’s Agent Evaluation and Benchmarks writes “highest score ≈ most expensive” into the L3 reading, consistent with this.

7.2 Once continual learning is made to work: a research-efficiency flywheel, not a consumer super-app first

His first user is himself. If rung 4 is made to work, what accelerates first is the next set of weights, not ads and e-commerce (the latter two he explicitly judges as wasting time at this stage, extract brief §8.1). Industrial implications:

  • Labs that can write “job memory” into weights or equivalent memory will open a gap versus products that, each session, explain from zero who Xiao Wang is.
  • Until then, external memory (MemGPT-class [23]) and longer context will exist as transitional rent: they impersonate continual learning and can also collect money, but by his definition they do not count as the next generation.

7.3 Weak form of self-iteration: training-stack software, not a “singularity clause in an AI-company stock”

AlphaEvolve-class systems put value into compilers, kernels, scheduling, chip-design toolchains [30]. This is infrastructure-software rent, not an overnight demand-side singularity. Consistent with his qualification: gradual, can be nonlinear, but not an explosion clause.

7.4 Implications of postponing embodiment for robot / world-model assets

Logically there are two readings, which must be placed in parallel; only one must not be written:

  • Reading A (supports postponement). Today’s VLAs already use VLM backbones [36][38][39]. Each rung software intelligence is raised, data efficiency on the same body rises. Locking capital too early into a single body may depreciate when the next version of intelligence arrives.
  • Reading B (against postponement). Real-world data is irreversible in time: if it is not collected now, there will be no 2026 household distribution later. If world models must be pretrained on video and interactive environments [34][43], then video generation and simulation are not a bypass; they are prerequisite capital expenditure for rung 6.

This report does not pick a side between A and B. In investment terms this means: the valuation of robot and world-model assets depends on whether you believe physical data can be backfilled by stronger future intelligence. Liang Wenfeng’s public judgment is closer to A; LeCun / Sora / the embodiment camp are closer to B. This is the asset version of §2’s core debate.

7.5 Multimodality and search: component pricing

He analogizes multimodality to search: important for the consumer side, not the ceiling mainline, but they will still do it (extract brief §6.4). Industrial implication: multimodal capability will be packed into products, but should not be treated as a sufficient condition for a “next-generation model.” By his definition, the sufficient condition for the next generation is continual learning.

Part 8

8. Where this report may be wrong

  1. The primary source is an ASR transcript, not a speaker-approved written statement. Proper nouns and figures take the recording as authoritative (extract brief §15). This report deliberately avoids those figures.
  2. “Guesswork” may be written too full. The boxed inferences in §3 may over-interpret “first user is ourselves.” Falsification: if DeepSeek later publicly moves the main research budget to a consumer super-app, that inference fails.
  3. Maturity is a cross-section. A single paper after 2026-08 could move rung 4 from “method not yet solved” to “lab-reproducible.” The dashboard must be updated with the literature; it cannot be treated as a permanent rating.
  4. Closed-source internals are not covered. If OpenAI, Google, Anthropic’s internal continual-learning progress is stronger than the papers, this report will systematically understate rungs 4 and 5. We are responsible only for public evidence.
  5. Coding bias. Public benchmarks and METR tasks skew to software. If “employees” in the real economy are mainly physical and social labor, rung 6’s weight is understated by both us and Liang Wenfeng.
Part 9

9. Appendix A · Glossary (not forcibly merged)

Term How this report treats it
Continual learning His central word in the meeting: learn over a long period, without a strong training dump each time. In the literature often means sequential-task learning that overcomes catastrophic forgetting [21][22]
Learn to learn Mixed in the transcript. In the literature often near meta-learning. This report lists it separately and does not equate it with continual learning
recursive improvement / recursive self-improvement Raised together by a questioner; he did not define them as the same term. This report places it as a rung-5 comparison, not merged into rung 4
Singularity He uses it first, then qualifies it as gradual. This report treats the qualification as a theoretical judgment
Agent Adopts Anthropic’s working definition: the model dynamically decides tools and process [16]; distinguished from “a pre-written-dead workflow”
World model He notes the meaning is unclear. This report splits it in §§5–6 into JEPA-style and generative classes
Embodied intelligence He: housework, elder care, enter reality. Literature: VLA, cross-embodiment, world-model simulation; the range is messier
Next-generation model His operational definition: must have continual learning. Not parameter count or multimodality
Part 10

10. Appendix B · References

The table below is this report’s complete citation set. P5 is not used to support technical conclusions. URLs were resolvable public pages as of retrieval on 2026-08-13; OpenReview PDF direct links may be intercepted by anti-bot pages, so both the forum and Meta’s official introduction are given.

# Work Type / date Evidence grade Judgment supported
1 This repository’s Liang Wenfeng Investor Meeting · Views; material is the 2026-05-20 meeting ASR transcript Internal structured extract, compiled 2026-07-16 P1 (transcription risk: see that brief) His ladder, three axioms, the qualification, the employee analogy, coding first, continual learning not yet solved
2 DeepSeek-AI. DeepSeek-V3 Technical Report. arXiv:2412.19437. https://arxiv.org/abs/2412.19437 Technical report, 2024-12 P1 Language-model rung; 671B/37B; the post-training narrative of distilling R1 into V3
3 DeepSeek-AI. DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning. arXiv:2501.12948. https://arxiv.org/abs/2501.12948 Technical report, 2025-01 P1 CoT rung; starts from V3-Base; comparable to o1-1217
4 Vaswani, A. et al. Attention Is All You Need. NeurIPS 2017. https://arxiv.org/abs/1706.03762 Conference paper, 2017 P2 Transformer base
5 Kaplan, J. et al. Scaling Laws for Neural Language Models. arXiv:2001.08361. https://arxiv.org/abs/2001.08361 ; OpenAI introduction https://openai.com/index/scaling-laws-for-neural-language-models/ 2020-01 P2 / P3 Scaling laws; the literature background of his belief in Scaling
6 Hoffmann, J. et al. Training Compute-Optimal Large Language Models. arXiv:2203.15556. https://arxiv.org/abs/2203.15556 2022-03 P2 Chinchilla: parameters and tokens in equal proportion
7 OpenAI. GPT-4 Technical Report. arXiv:2303.08774. https://arxiv.org/abs/2303.08774 ; https://cdn.openai.com/papers/gpt-4.pdf 2023-03 P3 Predicting large-model loss from small models
8 Grattafiori, A. et al. The Llama 3 Herd of Models. arXiv:2407.21783. https://arxiv.org/abs/2407.21783 2024-07 P3 Scaling recipe on the open-weight side
9 Wei, J. et al. Chain-of-Thought Prompting Elicits Reasoning in Large Language Models. NeurIPS 2022. https://arxiv.org/abs/2201.11903 2022 P2 Original CoT paper; depends on a sufficiently large LM
10 Kojima, T. et al. Large Language Models are Zero-Shot Reasoners. NeurIPS 2022. https://arxiv.org/abs/2205.11916 2022 P2 Zero-shot chain of thought
11 OpenAI. Learning to reason with LLMs. https://openai.com/index/learning-to-reason-with-llms/ Official blog, 2024-09 P3 o1; training-time and test-time compute rise together
12 OpenAI. OpenAI o1 System Card. https://arxiv.org/abs/2412.16720 ; https://cdn.openai.com/o1-system-card-20241205.pdf 2024-12 P3 Monitoring chain of thought; think first, then answer
13 Snell, C. et al. Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters. arXiv:2408.03314. https://arxiv.org/abs/2408.03314 2024-08 P2 Test-time compute vs scaling parameters
14 Yao, S. et al. ReAct: Synergizing Reasoning and Acting in Language Models. ICLR 2023. https://arxiv.org/abs/2210.03629 2022/23 P2 Original paper that Agent uses CoT
15 Jimenez, C. E. et al. SWE-bench: Can Language Models Resolve Real-World GitHub Issues? ICLR 2024. https://arxiv.org/abs/2310.06770 2024 P2 Real software-engineering benchmark
16 Anthropic. Building effective agents. https://www.anthropic.com/engineering/building-effective-agents Engineering blog, 2024-12-19 P3 agent vs workflow; coding and computer use
17 Anthropic. 3.5 models and computer use (computer-use release note). https://www.anthropic.com/news/3-5-models-and-computer-use 2024-10 P3 Computer use as an agent landing
18 Kwa, T. et al. / METR. Measuring AI Ability to Complete Long Tasks. arXiv:2503.14499. https://arxiv.org/abs/2503.14499 2025-03 P2 Time horizon; quantitative comparison for the employee analogy
18b METR. Measuring AI Ability to Complete Long Software Tasks (blog, stating static figures may go stale). https://metr.org/blog/2025-03-19-measuring-ai-ability-to-complete-long-tasks/ ; update page https://metr.org/time-horizons/ From 2025-03 P3 Original statement of roughly 7-month doubling; take the update page as authoritative
19 OpenAI. Introducing SWE-bench Verified. https://openai.com/index/introducing-swe-bench-verified/ 2024-08 P3 500 human-screened items
20 OpenAI. Why SWE-bench Verified no longer measures frontier coding capabilities. https://openai.com/index/why-we-no-longer-evaluate-swe-bench-verified/ 2026 P3 Contamination; stopped reporting frontier on Verified
21 Kirkpatrick, J. et al. Overcoming catastrophic forgetting in neural networks. PNAS 2017. https://doi.org/10.1073/pnas.1611835114 2017 P2 EWC; classic continual-learning method
22 McCloskey, M. & Cohen, N. J. Catastrophic interference in connectionist networks: The sequential learning problem. Psychology of Learning and Motivation 24:109–165 (1989). https://doi.org/10.1016/S0079-7421(08)60536-8 1989 P2 Problem statement of catastrophic interference
23 Packer, C. et al. MemGPT: Towards LLMs as Operating Systems. arXiv:2310.08560. https://arxiv.org/abs/2310.08560 2023-10 P2 External memory impersonating “learning”
24 Behrouz, A. et al. Nested Learning: The Illusion of Deep Learning Architectures. NeurIPS 2025. https://arxiv.org/abs/2512.24695 2025 P2 New paradigm for continual learning; Hope
25 Behrouz, A. & Mirrokni, V. Introducing Nested Learning. Google Research Blog. https://research.google/blog/introducing-nested-learning-a-new-ml-paradigm-for-continual-learning/ 2025-11 P3 Official labeling of NL as continual learning
26 Behrouz, A., Zhong, P. & Mirrokni, V. Titans: Learning to Memorize at Test Time. arXiv:2501.00663. https://arxiv.org/abs/2501.00663 2025-01 P2 Long-term memory at test time
27 Zweiger, A. et al. Self-Adapting Language Models (SEAL). NeurIPS 2025. https://arxiv.org/abs/2506.10943 2025 P2 Self-edit written into weights
28 Silver, D. & Sutton, R. S. Welcome to the Era of Experience. To appear in Designing an Intelligence (MIT Press). Author page https://davidstarsilver.wordpress.com/publications/ 2025 P2/P3 (chapter preprint; catalog from the author page) Experience data replacing the human-data ceiling; points the same way as rungs 4 and 5
29 Good, I. J. Speculations Concerning the First Ultraintelligent Machine. Advances in Computers 6:31–88 (1965). https://doi.org/10.1016/S0065-2458(08)60418-0 1965 P2 Original of “intelligence explosion”; comparison for the qualification
30 DeepMind. AlphaEvolve: A Gemini-powered coding agent for designing advanced algorithms. https://deepmind.google/blog/alphaevolve-a-gemini-powered-coding-agent-for-designing-advanced-algorithms/ ; paper https://arxiv.org/abs/2506.13131 ; subsequent impact https://deepmind.google/blog/alphaevolve-impact/ 2025–2026 P3 / P2 Weak-form self-iteration; improving Gemini’s training stack
31 Sutton, R. The Bitter Lesson. 2019-03-13. http://www.incompleteideas.net/IncIdeas/BitterLesson.html Essay P3 General methods eat compute; points the same way as Scaling
32 LeCun, Y. A Path Towards Autonomous Machine Intelligence (v0.9.2). OpenReview. https://openreview.net/forum?id=BZ5a1r-kVsf 2022-06 P2 (position paper, not conventional review) World-model blueprint
33 Meta AI. Yann LeCun on a vision to make AI systems learn and reason like animals and humans. https://ai.meta.com/blog/yann-lecun-advances-in-ai-research/ 2022-02 P3 Official introduction of the world-model claim
34 OpenAI. Video generation models as world simulators. https://openai.com/index/video-generation-models-as-world-simulators/ 2024-02 P3 Sora; video generation as a world-simulation path—the comparison for his moving it off the mainline
35 OpenAI. Sora 2 is here. https://openai.com/index/sora-2/ Product blog P3 Still treats world simulation as a milestone of physical understanding
36 Black, K. et al. (Physical Intelligence). π₀: A Vision-Language-Action Flow Model for General Robot Control. arXiv:2410.24164. https://arxiv.org/abs/2410.24164 2024-10 P2 Embodiment; VLM backbone—supports “the later step uses the earlier step”
36b Physical Intelligence. π₀ blog. https://www.physicalintelligence.company/blog/pi0 Official blog, contemporaneous with [36] P3 Official note corresponding to [36]
37 Open X-Embodiment Collaboration. Open X-Embodiment: Robotic Learning Datasets and RT-X Models. arXiv:2310.08864. https://arxiv.org/abs/2310.08864 2023-10 P2 Cross-embodiment data
38 Brohan, A. et al. RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control. arXiv:2307.15818. https://arxiv.org/abs/2307.15818 2023 P2 VLA paradigm
39 Google DeepMind. Gemini Robotics related paper arXiv:2503.20020. https://arxiv.org/abs/2503.20020 ; introduction https://deepmind.google/discover/blog/gemini-robotics-brings-ai-into-the-physical-world/ 2025-03 P2 / P3 Connecting a frontier model to the physical world
40 NVIDIA. Isaac GR00T. https://developer.nvidia.com/isaac/gr00t ; code https://github.com/NVIDIA/Isaac-GR00T Product / open-source stack P3 Open cross-embodiment VLA
41 Mialon, G. et al. GAIA: a benchmark for General AI Assistants. arXiv:2311.12983. https://arxiv.org/abs/2311.12983 2023 P2 General tool-chain tasks still hard
42 Xie, T. et al. OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments. arXiv:2404.07972. https://arxiv.org/abs/2404.07972 2024 P2 Real computer environments
43 Bruce, J. et al. Genie: Generative Interactive Environments. ICML 2024. https://arxiv.org/abs/2402.15391 2024 P2 Interactive world models
44 Yang, J. et al. SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering. arXiv:2405.15793. https://arxiv.org/abs/2405.15793 2024 P2 ACI raising issue-resolution rate
45 Wang, G. et al. Voyager: An Open-Ended Embodied Agent with Large Language Models. arXiv:2305.16291. https://arxiv.org/abs/2305.16291 2023 P2 Skill-library “learning”; scaffolding impersonation
46 Guo, D. et al. DeepSeek-R1 incentivizes reasoning in LLMs through reinforcement learning. Nature 645, 633–638 (2025). https://doi.org/10.1038/s41586-025-09422-z 2025 P2 Peer-reviewed version of R1
47 Amodei, D. Machines of Loving Grace. https://darioamodei.com/machines-of-loving-grace 2024-10 P3 (essay) Gradual, manageable powerful-AI narrative; same side as the qualification, not experimental evidence
48 DeepMind. Enabling Continual Learning in Neural Networks. https://deepmind.google/blog/enabling-continual-learning-in-neural-networks/ 2017 P3 Official introduction of EWC
49 Silver, D. et al. Mastering the game of Go with deep neural networks and tree search. Nature 529, 484–489 (2016). https://doi.org/10.1038/nature16961 2016 P2 The AlphaGo ground he uses to argue “can surpass already-stated human knowledge” (extract brief §12.2)

Retrieval notes

  • Material named in the plan but not used in the end to support conclusions, and therefore not listed: preprint mirrors whose full text could not be stably resolved, second-hand social-media restatements of internal accelerator counts, capacity figures in the meeting ASR.
  • A PDF direct link for [28] could not be stably retrieved from one public store on the writing day, so cataloging follows the author’s publications list; page-number citations are not fabricated.
  • A PDF direct link for [32] hit OpenReview’s anti-bot page on the writing day, so the forum and Meta’s official introduction [33] are cited together; unread page numbers are not cited.

This report does not replace the recording and does not replace the original papers. If the speaker later publishes a written technical route, the written version is authoritative.

↑