Report date: 2026-08-13.
Genre: industry primer + thematic deep dive. Not single-stock coverage; no target price; no buy/sell recommendation.
Primary source: 2026-05-20 Liang Wenfeng investor-meeting audio transcript (audiodeepseek 0520.m4a, about 3 hours 44 minutes; compiled 2026-07-16, ASR, speakers not diarized). Structured extract: Liang Wenfeng Investor Meeting · Views (hereafter “the extract brief”). ASR risk on figures and proper nouns is inherited from §15 of the extract brief; this report does not treat accelerator counts or profit multiples from the meeting as audited facts.
Comparison materials: DeepSeek’s published technical reports, peer-reviewed papers, official lab blogs, and product notes.
How to read: anything written as “what he said” points only to the extract brief; anything written as “this report’s judgment / inference” is boxed or labeled and is not attributed back to him.
1. Cover-page discipline: materials, method, evidence grades
1.1 What this report answers
The extract brief has already pulled Liang Wenfeng’s own judgments clean. This report only pursues three questions:
- Why does he order the intelligence mainline as “language model → CoT → Agent → continual learning → gradual self-iteration (he first calls this a singularity, then immediately qualifies) → embodied intelligence”? Are the reasons given in the meeting internally consistent?
- The most frontier research that can be checked as of August 2026—to which maturity band has each rung of this ladder been pushed?
- Which public evidence would support, revise, or puncture this ordering? For industry, at which rung is value more likely to settle?
This report does not rewrite the whole meeting and does not discuss open-source pricing or financing terms. Those belong to the extract brief.
1.2 Division of labor with the extract brief
| Extract brief | This report | |
|---|---|---|
| Task | What he said, and what he offered as reason | What industry evidence says, what is inference, what would falsify |
| Discipline | No imputed psychological motives | Inferences must be labeled separately |
| Figures | Meeting figures transcribed as-is and marked ASR | Meeting capacity figures not used as external facts |
| Reader | Someone who wants to read against the recording | Someone who wants this ladder placed on a global technical map |
1.3 Investment-research method (actually executed, not only written on the cover)
Benchmark the six modules of a thematic deep-dive, not the target-price page of a sell-side coverage template.
| Module | How this report lands it |
|---|---|
| One-pager | §2: the debate, the judgment, three falsification conditions |
| Evidence grades | P1 speaker’s own words / this lab’s papers; P2 peer-reviewed or checkable technical reports; P3 official blogs and product notes; P4 credible second-hand restatement of a public statement; P5 media and rumor (timeline only; does not support technical conclusions) |
| Three-column claims | “What he said / this report infers / what the literature says” kept in columns, not mixed |
| Maturity | Industrially deployed / industrially deployed in a narrow domain / lab-reproducible / problem posed, method not yet solved / concept |
| Comparison set | OpenAI, Anthropic, Google DeepMind, Meta / LeCun, Physical Intelligence, NVIDIA embodiment stack |
| Scenarios and falsification | Base / Bull / Bear defined by “which rung is unlocked,” not calendar prophecy as a conclusion |
Strictly forbidden: writing “industry consensus” as an unsourced judgment; writing an inference as “Liang Wenfeng thinks”; cross-checking meeting accelerator counts against external financials.
1.4 Evidence-grade symbols
Later, each key judgment is, as far as possible, landed on a bibliography number. Numbers map one-to-one to the appendix table, which gives author, year, venue, URL/DOI, evidence grade, and which judgment is supported. Literature whose title and URL cannot be checked is not cited in the body.
2. Investor one-pager
2.1 The core debate
Frontier labs do not currently share one roadmap. At least four narratives are competing for the right to define the “intelligence ceiling”:
| Narrative | Representative source | What mainly raises the intelligence ceiling |
|---|---|---|
| Language—reasoning—action—learning (Liang Wenfeng) | Extract brief §6.3, §12.1 | Finish checkable symbolic intelligence first, then use it to develop the next version, and only then enter the physical world |
| World models first | LeCun 2022 position paper and Meta preview [32][33] | Predict the world in latent space, rather than taking next-token as the main objective |
| Video / generation as simulation | OpenAI Sora technical note [34] | Scaled video generation is a path to a physical-world simulator |
| Embodiment data first | Physical Intelligence π₀ [36], Open X-Embodiment [37], Gemini Robotics [39] | Cross-embodiment robot data + vision–language–action models; attach a body now |
Liang Wenfeng explicitly moves video generation and present-stage world models, among the latter three, off the “intelligence mainline”: commercially they can be good business, but they have “not that much relation to the intelligence ceiling either” (extract brief §8.1). This is not an aesthetic preference; it is his operational definition of what it means to raise the intelligence ceiling.
2.2 This report’s judgment (not his wording)
This report’s judgment. This ladder holds as a dependency relation: published systems at the later rungs almost all stand on language models (and, increasingly often, vision–language models). The largest unsolved gate is what he calls “continual learning”—labs worldwide acknowledge the crack between catastrophic forgetting and “weight-frozen LLMs,” but there is not yet a widely reproduced, scalable, deployable solution. His qualification of “singularity” into a gradual change breaks, in mechanism, from I. J. Good’s 1965 “intelligence explosion” hard-takeoff narrative [29], and is closer to already-appearing weak forms of “using a model to improve a model” in local links [30]. Embodiment is postponed as a leverage logic (let stronger intelligence build robots), not as a denial that the physical world has demand.
Three closing sentences:
- The dependency holds. The CoT paper is explicitly built on a sufficiently large language model [9]; ReAct interleaves chain of thought with action [14]; embodiment models such as π₀ take a pretrained vision–language model as backbone [36]. The later step uses the earlier step; this is not rhetoric.
- The bottleneck judgment points the same way as public evidence; an alternative hypothesis also holds. “Given full context it already exceeds humans, yet still cannot replace an employee” points the same way as METR’s time-horizon results: frontier agents approach a perfect score on short tasks and success rate collapses on multi-hour tasks [18]. But “what is missing is weight-updatable continual learning” is not the only explanation—what is missing may also be a longer reliable tool chain, without changing weights.
- The ordering is the easiest route under a resource constraint, not the only physical possibility. The ordering reason he gives is “later technique can be developed with earlier technique”; “doing embodiment first is bitter work” (extract brief §6.3). This is consistent as engineering; it does not imply “labs doing robots now have taken the wrong path.” It only implies: in a lab that is compute-tight and takes itself as first user, this path has less expected overtime.
2.3 Three falsification conditions (What would change our mind)
If any of the following events appears in a reproducible way, this report must down-weight this ladder:
| # | Falsification condition | Observational landmark |
|---|---|---|
| F1 | A world model or video generation, on its own, clearly raises the intelligence ceiling past the language–reasoning stack, and does not depend on the latter as backbone | In a setting without a strong language-model backbone, a world model stably exceeds contemporaneous CoT+Agent systems on checkable reasoning / planning benchmarks |
| F2 | Without updating weights, by context and tools alone, an agent can complete “about two months of on-the-job learning”-scale tasks | METR-style time horizons at a high-reliability threshold (e.g. 80%) reach week–month scale [18], and this is reproducible on real enterprise jobs, without catastrophic-forgetting-style cross-task collapse |
| F3 | A lab that does embodiment first and symbols later produces a generalizable housework / elder-care-grade system with clearly less language intelligence | Cross-home, cross-embodiment success does not depend on a large-scale VLM/LLM backbone, and data efficiency is higher than the “software intelligence first, then robots” control |
As of 2026-08, none of these three has been met. F2 is the nearest competing hypothesis; F1 and F3 run opposite to the direction of public papers.
2.4 Maturity dashboard (as of 2026-08)
flowchart LR L1["1 Language models
industrially deployed"] --> L2["2 CoT / test-time compute
industrially deployed"] L2 --> L3["3 Agent
industrially deployed in a narrow domain"] L3 --> L4["4 Continual learning
method not yet solved"] L4 --> L5["5 Self-iteration
weak form, lab-reproducible"] L5 --> L6["6 Embodied intelligence
lab-reproducible"]
| Rung | His time anchor (extract brief) | This report’s maturity | One-sentence evidence |
|---|---|---|---|
| Language models | One step earlier | Industrially deployed | Transformer [4] + scaling laws [5][6]; DeepSeek-V3 is 671B/37B active MoE [2] |
| CoT | “Last year” | Industrially deployed | o1 trains chain of thought with RL [11][12]; DeepSeek-R1 incentivizes reasoning with RL and is published in Nature [3][46] |
| Agent | “This year” | Industrially deployed in a narrow domain | Coding agents are already in products; SWE-bench was once the main ruler; OpenAI in 2026 stopped reporting frontier on Verified because of contamination [20]; general desktop/job replacement is still far |
| Continual learning | “The next bottleneck” | Problem posed, method not yet solved | EWC 2017 remains a classic patch [21]; Titans / Nested Learning / SEAL are 2025 new architectures, not yet the training default [24][26][27] |
| Self-iteration | “Singularity, but gradual” | Weak form, lab-reproducible | AlphaEvolve improved a Gemini training kernel and entered Google infrastructure [30]; a fully automatic “next-version model” has not appeared |
| Embodiment | After self-iteration | Lab-reproducible | π₀, GR00T, Gemini Robotics are all public [36][40][39]; housework/elder-care-grade generalization is not shown |
3. Cognitive reconstruction: why he orders it this way, and not another way
This section does only two things: collect the reasons given in the meeting into one causal chain; then box this report’s inferences separately. The latter is not put in his mouth.
3.1 Three ordering axioms given in the meeting
In extract brief §6.3, §12.1, what he repeatedly uses is not a product roadmap; it is three axioms:
| Axiom | Compressed from his wording | What it excludes |
|---|---|---|
| Dependency | The later step uses the earlier step: CoT uses the language model; Agent uses CoT | “Skip reasoning, go straight to agent / robot” as the mainline |
| Leverage | “Later technique can be developed with earlier technique”; “after the singularity, embodiment need not be done by people”; doing embodiment first “is bitter work” | Treating robot-body R&D as the highest current leverage |
| Observable bottleneck | The problem is stated clearly, context is given in full, “already exceeds humans”; a person has decades of context; a hire takes about two months to get up to speed; AI does not have those two months of learning and cannot replace an employee. After Agent is exhausted it still does not reach AGI. “It must have continual learning before it counts as the next-generation model.” | Treating multimodality, search, video generation, and present-stage world models as the intelligence-ceiling mainline |
These three are enough to derive his ordering; no extra personality analysis is needed.
3.2 A lab-centered definition of AGI
The extract brief is clear: without embodiment, what he hopes AGI will do is “help me iterate the next model”; with embodiment, he hopes it iterates the next embodiment—the next robot. The first user of continual learning is themselves: “The first goal of the models we build is not that others use them well, but that we use them well.” (extract brief §12.1)
Inference (this report, not Liang Wenfeng’s wording). This is an AGI definition that takes research productivity as the product. Consumer-side “housework, elder care” is explicitly acknowledged as a normal person’s demand, but is placed after self-iteration. So his ladder does not look like “a graph a consumer product manager would draw,” and looks like “a graph a lab director who has to train the next set of weights would draw.” Coding agent is placed first among current vertical applications (extract brief §8.3), isomorphic with this definition: writing code, changing kernels, running experiments is the nearest task distribution to “help me iterate the next model.”
Public comparison: Google DeepMind’s AlphaEvolve turned “use a coding agent to improve algorithms and the training stack” into a deployable system, and reports speeding up a matrix-multiply kernel in the Gemini architecture by 23% and cutting training time by about 1% [30]. This is not material Liang Wenfeng cited, but it shows: “first user is ourselves” has already moved, in other top labs, from a slogan to an internal tool.
3.3 The employee analogy: he collapses “completing tasks” into “continual learning”
What he uses to pin Agent is not some olympiad-math item; it is a job:
- Person: saying “Xiao Wang, come over” is enough to know who Xiao Wang is; about two months to learn the environment.
- Model: each time it must be told who Xiao Wang is, the role, how to find them, what to watch. “You cannot give it all context, and it is not realistic.” (extract brief §6.2)
So “continual learning” in his usage is not a named algorithm, but “learn over a long period as a person does, without a very strong training dump each time.” He also says it “may not be one technique; it is a problem,” “the whole world has not yet found a method that really works” (extract brief §12.1). In the transcript “continual learning” and “learn to learn” are mixed; the extract brief does not force them together; this report likewise lists them separately (see the appendix glossary).
Inference. He has welded together two problems the literature keeps apart: (a) task-level agent failure (tool chain, memory, reliability); (b) weight-level continual-learning failure (a new task wipes an old task). The weld is the employee analogy. If (a) can be solved on its own by longer context, external memory, and better agent scaffolding, his “next generation = must have continual learning” will look too strict. That is exactly §2’s F2.
3.4 “The easiest roadmap”: a research strategy under a compute constraint, not the universe’s only solution
His ordering also has an organizational reason: this path “need not work overtime”; continual-learning research “does not consume accelerators, only very few; it needs ideas”; internally they call it “lottery scratching” (extract brief §12.1). Scaling is what burns cards; model size is “computed from resources” (extract brief §6.4).
Inference. Under a compute constraint tighter than the US, defining the unsolved problem as “idea-dense, card-sparse,” while handing solved problems (pre-training, test-time compute) to cards that can be bought, is a rational research portfolio—it explains why video generation, a “good business,” is still moved off the mainline: it both burns cards and (in his view) does not raise the intelligence ceiling. Sutton 2019’s The Bitter Lesson says that what finally wins is general methods that can eat compute [31]. Liang Wenfeng believes both Scaling (eating compute) and continual learning, a problem not yet scaled (eating ideas). The two are not in contradiction: Scaling has not hit a wall; the rung beyond the wall is what he names continual learning.
3.5 Qualifying “singularity → gradual”: this is a judgment with theoretical content
I. J. Good’s 1965 operational definition is: an ultraintelligent machine can design better machines, so “there would unquestionably be an intelligence explosion,” and human intelligence would be left behind; “the first ultraintelligent machine is the last invention that man need ever make” [29]. Liang Wenfeng first borrows the habitual name “singularity,” then immediately corrects: not a jump, a long gradual change; AGI has “no critical point, but [is] nonlinear,” because “AI can accelerate AI research” (extract brief §6.3, §13.1).
Alignment and break can be written in one line:
| Good 1965 [29] | Liang Wenfeng 2026-05 (extract brief) | |
|---|---|---|
| Content | Machines can design better machines | The model can do what humans can, and can develop the next version |
| Dynamics | Intelligence explosion | Long gradual change; no critical point, can be nonlinear |
| Place of humans | Left behind | At least until continual learning is made to work, humans remain the research subject; AI “does not yet work autonomously; it still pairs with people” |
Inference. This qualification moves him closer to Silver and Sutton 2025’s gradual register of an “era of experience”—continual improvement from data produced by agent–environment interaction, rather than a phase change after one freeze of weights [28]—and not closer to Good’s explosion. Public literature already has weak forms of “using a model to improve a model”: R1’s reasoning is distilled back into V3 [2][3]; AlphaEvolve optimizes Gemini’s own training stack [30]. These are evidence of gradual change, not of explosion.
3.6 Whether DeepSeek’s published trajectory is isomorphic with the ladder
Looking only at public papers, not at meeting capacity figures:
| Rung | Public exhibit | Evidence grade |
|---|---|---|
| Language models | DeepSeek-V3: 671B total parameters, 37B activated per token; 14.8T tokens of pre-training; full-text training 2.788M H800 GPU hours [2] | P1 |
| CoT / reasoning | DeepSeek-R1-Zero: large-scale RL first, without SFT, reasoning behavior emerges; DeepSeek-R1 adds cold start and multiple stages; reasoning tasks comparable to OpenAI-o1-1217; Nature formal publication [3][46] | P1 / P2 |
| Agent | The meeting says “this year”; on the public-paper side there is not yet a “DeepSeek Agent technical report” of R1’s weight. This repository’s source analysis of deepseek-harness can only show that an engineering stack exists; it cannot substitute for an official lab paper | P1 from the meeting; the engineering stack is not upgraded to paper P1 |
| Continual learning | He states clearly that the world has not made it work, and internal ideas have not been made to work (extract brief §12.1) | P1 (negative statement) |
The isomorphic part: V3 → R1 is a public demonstration of “language model → CoT,” and R1’s training explicitly starts from V3-Base [3]. The part not yet isomorphic: Agent and continual learning still sit at the meeting’s time anchors, with no papers of equal weight. This report does not write “doing Agent this year” as an already-published fact.
3.7 Off the mainline: the place of video, world models, multimodality
Extract brief §8.1: 3D / video generation has “not that much relation to the intelligence mainline”; after Sora, large and small firms all did it, and small firms later cut it; world models “at present also not closely related to the intelligence ceiling,” and the term is “not that clear.” Multimodality is important for the consumer side; for the intelligence ceiling “it is a component… like search”; from V4 they still do native multimodality (extract brief §6.4).
Inference. The discriminant he uses is: whether the thing raises the ceiling of “solving problems in complete context,” not “whether it makes the product look better / whether it more resembles a world.” OpenAI writes Sora as “a promising path towards a general purpose simulator of the physical world” [34]; LeCun writes world models as the hub of autonomous intelligence [32][33]. Liang Wenfeng is in effect announcing: under his operational definition, these two narratives are at present components or bypasses. §5 below lays out this route contest; it does not pick a winner here.
4. Six-rung comparison: definition, frontier, agreement, and tension at each rung
Each rung is fixed at six blocks: how he defines it / why it sits at this rung / how far the 2026 frontier has gone / agreement and tension with his judgment / unsolved / key sources. Maturity is this report’s rating, not a lab self-rating.
4.1 Rung 1 · Language models
How he defines it. One step earlier; CoT uses it (extract brief §6.3). He believes in Scaling and has not yet seen a ceiling; what blocks it is compute, not will (extract brief §6.4).
Why it sits at this rung. Dependency axiom: without a base model that can predict the next token, later chain of thought and tool loops have nowhere to sit.
How far the 2026 frontier has gone.
- The architectural base is still Transformer [4].
- Training loss follows a power law in model scale, data, and compute; Kaplan et al. 2020 gave early scaling laws [5]; Hoffmann et al. 2022 (Chinchilla) found that parameters and tokens should be scaled in roughly equal proportion; many earlier models were undertrained [6].
- The GPT-4 technical report used experiments two to four orders of magnitude smaller to predict large-model loss and some capabilities [7].
- The Llama 3 Herd report gave a scaling recipe on the open-weight side [8].
- DeepSeek-V3 uses MLA + DeepSeekMoE, 671B / 37B active, 14.8T tokens, and emphasizes training stability and controllable cost [2].
Maturity: industrially deployed. The dispute is not “whether language models hold,” but “whether scaling laws have hit a wall.” Liang Wenfeng’s judgment is that the wall is not the same distance for Silicon Valley and for him (extract brief §6.4). This is a statement of vantage, not a measured wall that can be falsified.
Agreement. The V3 paper itself is an instance of “finish the language model first, then do post-training on it” [2]. R1 starts from V3-Base [3]; the dependency is written dead in their own paper.
Tension. LeCun holds that autoregressive LLMs are not a sufficient path to autonomous intelligence; what is truly missing is a world model [32][33]. If F1 holds, rung 1 would still remain as a component, but would no longer be the first load-bearing wall of the mainline.
Unsolved. Data quality and annotation cost (he says data is almost half the model, extract brief §12.2); inference cost rises with scale (he himself also says that the US can train very large active-parameter models but “cannot actually use them… it is indeed a bit expensive”—this is his judgment, not externally verified).
Key sources. [2][4][5][6][7][8].
4.2 Rung 2 · CoT / chain of thought / test-time compute
How he defines it. “Self-thinking, raising the intelligence ceiling”; on olympiad math and writing programs it “already surpasses the top humans”; at the ceiling it still does not reach AGI. Time anchor: “last year” (extract brief §6.3).
Why it sits at this rung. Dependency: chain of thought emerges from a sufficiently large language model [9]. Leverage: the same set of weights, more test-time compute for higher accuracy, without first scaling pre-training another order of magnitude [11][13].
How far the 2026 frontier has gone.
- Wei et al. 2022: few-shot chain-of-thought prompting substantially improves arithmetic, commonsense, and symbolic reasoning; PaLM 540B with eight chain-of-thought exemplars reached then-SOTA on GSM8K [9]. The paper describes the capability as a scale phenomenon that appears significantly around the 100B-parameter regime.
- Kojima et al. 2022: adding only “Let’s think step by step” can elicit zero-shot chain of thought [10].
- OpenAI o1 (from 2024-09): trains the model with large-scale reinforcement learning to use chain of thought; explicitly writes that performance rises with both training-time compute and test-time “thinking time,” a constraint different from pre-training scaling laws [11]. The system card defines the o1 series as reasoning models that “think first, then answer” [12].
- Snell et al. 2024: optimizing test-time compute at fixed weights can, on some tasks, be more effective than scaling parameters [13].
- DeepSeek-R1: R1-Zero shows that pure RL can elicit long reasoning; R1 uses cold start to address readability and language mixing; reasoning tasks are comparable to o1-1217; distilled small models are open-sourced [3]; 2025 Nature publication [46].
Maturity: industrially deployed. The time anchor “last year” is consistent with the public timeline of o1 in 2024 and R1 in 2025.
Agreement. Their R1 paper is almost an experimental proof of this rung: first V3-Base, then reasoning. His saying that CoT raises the intelligence ceiling but is still not AGI also matches o1/R1 remaining stuck in “one question, one answer, limited context.”
Tension.
- Whether chain of thought faithfully reflects internal computation remains an open question; the o1 system card lists this as a monitoring premise [12].
- “Surpasses the top humans” is limited by him to olympiad math and writing programs. This matches the distribution of strengths on public benchmarks and cannot be extrapolated to vague jobs.
- Test-time compute partly buys “intelligence” as latency and cost. This does not negate the rung, but it changes the cost curve per unit of intelligence [11][13].
Unsolved. Stability of process reward versus outcome reward; language mixing and readability (known defects of R1-Zero [3]); moving reasoning from contest items to vague real tasks.
Key sources. [3][9][10][11][12][13][46].
4.3 Rung 3 · Agent
How he defines it. Broader range of capability, higher intelligence ceiling; uses CoT; after the step is exhausted it still cannot replace an employee. Time anchor: “this year.” Among current vertical applications “what matters most should still be a Coding Agent” (extract brief §6.3, §8.3).
Why it sits at this rung. Dependency: ReAct’s original proposition is to interleave reasoning traces with action; reasoning helps update the plan; action takes evidence from the environment [14]. Leverage: checkable feedback (tests, compilers, page state) lets the model put CoT onto the environment, rather than stopping on the page.
How far the 2026 frontier has gone.
- Paradigm. ReAct (Yao et al., ICLR 2023) exceeds reasoning-only or acting-only on QA and decision benchmarks [14]. Anthropic’s 2024-12 engineering piece defines an agent as a model that dynamically decides tools and process and loops on environmental feedback; and separately notes coding and “computer use” as two already-landed domains [16].
- Software-engineering ruler. SWE-bench: real GitHub issue → patch → hidden tests [15]. SWE-agent used a custom agent–computer interface to raise full-set SOTA to the then 12.5% magnitude [44]. OpenAI 2024-08 released SWE-bench Verified (500 human-screened items) [19]. By 2026, OpenAI publicly stopped reporting frontier on Verified, on the ground that contamination made scores no longer reflect real software-engineering ability, and suggested reporting SWE-bench Pro instead [20].
- Time horizon. METR 2025: defines task length by human-expert time, and fits the duration at which a model has 50% success. The original paper reports roughly 7-month doubling; the then frontier (e.g. o3 / Claude 3.7 Sonnet, versions vary by write-up) sat at about the one-hour magnitude, with low success on multi-hour tasks [18]. The official page states that static figures go stale; take the time-horizons page as authoritative [18b].
- General computers. OSWorld evaluates on real desktop applications [42]; GAIA tests tool-chain QA that is “simple for humans, hard for then-AI” [41]. Both still show a gap versus humans on long-horizon, vague, multi-application tasks.
- Computer use. Anthropic treats computer use as one of the reference implementations of an agent [16][17].
Maturity: industrially deployed in a narrow domain. Coding agents are already products; general job replacement is not supported by METR or OSWorld.
Agreement.
- “Agent uses CoT” is written both by ReAct and by Anthropic’s coding-agent practice [14][16].
- “After the step is exhausted it still cannot replace an employee” points the same way as METR’s “near-perfect on short tasks, collapse on long tasks” [18]. The two months in the employee analogy is far longer than the measured 50% time horizon.
- He places Coding Agent first among verticals, pointing the same way as Anthropic’s “code can be scored by tests, so agents are especially effective” [16], and also the same way as his own “first user is the lab.”
Tension.
- Public benchmarks are failing: contamination of SWE-bench Verified makes “how far Agent has gone this year” harder to answer with a single score [20]. This report therefore does not cite any SWE-bench percentage without a dated scaffolding as a frontier level.
- Alternative hypothesis F2: if time horizons keep extending exponentially, they may cover some “Xiao Wang” jobs without solving continual learning. Liang Wenfeng books this step’s residual entirely to continual learning’s account, perhaps too early.
- Memory-class systems (MemGPT pages context as virtual memory [23]; Voyager accumulates a skill library in Minecraft [45]) show that part of “learning” can be impersonated by scaffolding. If he insists that “the next generation must change the learning problem itself,” he needs to exclude these impersonations—in the meeting he did not perform that conceptual surgery; he only said continual learning is a problem, with many techniques.
Unsolved. High-reliability long horizon (the 80% time horizon is far shorter than 50% [18]); vague requirements; cross-shift memory; evaluation contamination.
Key sources. [14][15][16][17][18][19][20][23][41][42][44][45].
4.4 Rung 4 · Continual learning (the load-bearing crack of this ladder)
How he defines it. Learn over a long period as a person does, without a very strong training dump each time; the same problem as “completing tasks”; the next bottleneck that can be seen after Agent; the world has not yet found a method that works; internally there are ideas that look promising, none made to work; “if continual learning is done first, general intelligence may be easy”; otherwise stacking data and labor by hand has “poor cost-performance” (extract brief §12.1). The definitional right of the next-generation model sits at this rung (extract brief §6.4).
Why it sits at this rung. Observable bottleneck: after the task distribution for which full context is already enough is eaten by CoT+Agent, what remains is adaptation across days, tasks, and jobs. Dependency: first an agent that can act, then data “learned from its own trajectories.” This points the same way as Silver & Sutton 2025’s “high-quality human data approaching a ceiling; the next step must let agents learn from their own experience” [28].
How far the 2026 frontier has gone. Several things that are often collapsed must first be cut apart:
| Mechanism | Weights updated? | Representative work | Does it count as the continual learning he means |
|---|---|---|---|
| Longer context / RAG / virtual memory | Usually no | MemGPT [23] | His employee analogy implies “not enough”: it is neither possible nor realistic to stuff everything into context |
| Test-time memory (internal state of a sequence model) | Memory modules updated in the forward pass | Titans: neural long-term memory memorizes history at test time; attention as short-term memory [26] | Closer, but still an architectural experiment, not a training default |
| Elastic weight consolidation and similar regularizers | Yes, but old tasks are protected | EWC, PNAS 2017 [21]; the classic statement of catastrophic interference is McCloskey & Cohen 1989 [22] | Problem statement agrees with him; the method has not become the LLM main path |
| Self-edit then fine-tune | Yes | SEAL: the model generates a self-edit, written into weights via SFT, downstream performance as RL reward [27] | Direction agrees; experimental scale far smaller than frontier pre-training |
| Nested optimization / self-modifying architecture | Yes (multiple layers at different update frequencies) | Nested Learning + Hope, NeurIPS 2025; Google’s official blog labels it a new paradigm for continual learning [24][25] | Problem agrees; Hope is a proof of concept, not a V3/R1-grade recipe |
| Experience-data closed loop | Yes; data from interaction | The Era of Experience [28] | Problem agrees; a program, not a deployed system |
Maturity: problem posed, method not yet solved. Same sentence as his own wording. This report records 2025 Titans / Nested Learning / SEAL as “promising lab directions,” not as “solved.”
Agreement. He may be one of the lab heads who has stated this problem hardest in public: he uses it directly to define the next generation, rather than writing it as future work in a paper. The literature supports the negative fact “not yet solved” [21][22][24][27][28].
Tension.
- Term mixing. “Continual learning / learn to learn / continuous learning” were not aligned in the meeting. Meta-learning (learn-to-learn) and online adaptation (continual / online learning) are not the same problem in the literature. This report does not align them for him.
- He does not equate it with Recursive Improvement as raised by the questioner (extract brief §12.1). This report places recursive self-improvement at rung 5, to avoid welding rungs 4 and 5 shut.
- Silver & Sutton’s “era of experience” emphasizes data produced by environmental interaction [28], and does not necessarily first require a completed digital agent. If their program is right, the coupling of continual learning with embodiment / simulated environments would be tighter than Liang Wenfeng’s ordering, and rung 4 could not sit cleanly before embodiment. This is mild pressure on axiom 2; it does not yet constitute F3.
Unsolved. Writing new job knowledge into weights or equivalent memory without catastrophic forgetting; reproducing SEAL / Hope-class results at model scale; turning “two months to get up to speed” into a measurable benchmark (there is at present no widely adopted “employee two months” benchmark).
Key sources. [21][22][23][24][25][26][27][28].
4.5 Rung 5 · Self-iteration (he calls this a singularity, then immediately qualifies it as gradual)
How he defines it. The model can do everything humans can, and can itself develop the next version; not a jump, a long gradual change; people are merely used to calling it a singularity. Without embodiment, the first use is iterating the next model (extract brief §6.3). AGI has no critical point and can be nonlinear, because AI can accelerate AI research (extract brief §13.1).
Why it sits at this rung. The apex of the leverage axiom: once continual learning lets the model absorb its own experimental trajectories, research itself becomes an accelerable object. Dependency: needs agent (can change code, run experiments) + continual learning (experiments are not forgotten the next day).
How far the 2026 frontier has gone.
- Theoretical original. Good 1965: an ultraintelligent machine can design better machines → intelligence explosion [29]. Liang Wenfeng keeps “can design the next version,” drops “explosion.”
- Weak form, already deployed. AlphaEvolve: a Gemini-driven evolutionary coding agent, screening programs with automatic evaluators; reports include improving Gemini’s own training kernel (matrix-multiply subproblem partitioning sped up 23%, training time about −1%), FlashAttention kernels up to about 32.5% faster, and over the following year entering TPU design, cache strategy, Spanner, and other infrastructure [30]. This is an existence proof of “a model improving a model’s training stack”; the object is algorithms and kernels, not a complete next-generation set of weights.
- Weak form, training recipe. R1 reasoning distilled into V3 post-training [2][3]: a stronger reasoning model teaches the next general model. Humans still design the pipeline.
- Weak form, self-edit. SEAL lets the model write its own fine-tuning instructions [27]. Scale far smaller than pre-training.
- Program. Silver & Sutton: high-quality human data approaching a ceiling; experience data must become the main medium of improvement [28].
Maturity: weak form, lab-reproducible; complete “itself developing the next version” remains a concept.
Agreement. Qualifying it as gradual matches local accelerations of the AlphaEvolve kind, “a few days of automatic experiment replacing weeks of experts” [30], and does not match overnight generation change. First user is themselves, matching AlphaEvolve first serving Google’s internal training stack.
Tension. If Good’s explosion suddenly holds at some generation, his “no critical point” would be falsified. At present no public system shows cross-generation, unattended weight design. Amodei’s Machines of Loving Grace writes powerful AI as a manageable, relatively gradual social process [47], on the same side as the qualification, but that is an essay, not an experiment.
Unsolved. From “optimize one kernel” to “propose and complete the next-generation training recipe”; from a human-set fitness function to posing its own questions (he has another sentence, “the next step after that, it asks its own questions,” extract brief §8.1).
Key sources. [2][3][27][28][29][30][47].
4.6 Rung 6 · Embodied intelligence
How he defines it. Enter the real world: housework, elder care; placed after self-iteration; “for a normal person, the need is not a computer.” Doing it first is “bitter”; after the singularity “need not be done by people” (extract brief §6.3).
Why it sits at this rung. Leverage: let a system that can already iterate software iterate robots. Dependency: embodiment papers almost all start from a vision–language model, rather than inventing intelligence from zero.
How far the 2026 frontier has gone.
- Data. Open X-Embodiment / RT-X: cross-embodiment robot datasets and models, showing that mixing data from different robots has generalization gains [37].
- VLA. RT-2 transfers web vision–language knowledge to robot control [38]. π₀: Physical Intelligence’s flow-matching vision–language–action model; backbone is a pretrained VLM, plus an action expert; official blog and arXiv in sync [36][36b]. NVIDIA Isaac GR00T: an open cross-embodiment VLA reference stack [40]. Gemini Robotics: brings Gemini-grade models into the physical world; later 1.5 emphasizes embodied reasoning and action transfer [39].
- World-model comparison. LeCun 2022: configurable predictive world models + JEPA, as a blueprint for autonomous intelligence [32][33]. Sora: scaled video generation “is a promising path towards a general purpose simulator of the physical world” [34]; Sora 2 still treats world-simulation ability as a key milestone in training AI that can understand the physical world [35]. Genie: learns interactive environments from unlabeled video [43].
Maturity: lab-reproducible; housework/elder-care-grade generalization not shown. Public systems show desktop manipulation, short kitchen skills, controlled labs, not “any home, any elder.”
Agreement. Almost all 2024–2026 general robot foundation models first borrow language / vision–language intelligence, then attach an action head [36][38][39]. This directly supports the dependency axiom, even if these labs’ investment timing entered hardware earlier than his.
Tension (this is where the whole ladder rubs hardest against the outside world).
- Physical Intelligence, Figure-class companies, the Tesla Optimus narrative, Gemini Robotics, are all collecting real robot data without waiting for a “software singularity.” Their implicit judgment is: the physical-data bottleneck cannot be filled in later by intelligence from thin air; if it is not collected now, it will not exist later. This is not a logical contradiction with “doing embodiment first is bitter work”—bitter work can also be necessary—but it conflicts with the expectation that “after the singularity it need not be done by people”: if physical data must be collected by people today, later people cannot backfill it with pure software intelligence.
- The world-model camp holds that without an internal simulator, agents in the real world will be too expensive to make [32][34]. Liang Wenfeng moves present-stage world models off the mainline. If F1 holds, rung 6 would move forward, even insert between Agent and continual learning.
- The classic statement of Moravec’s paradox is: sensorimotor skills easy for humans are hard for machines. His “bitter work” points the same way as this tradition. His novelty is: postpone the bitter work until after self-iteration, and let stronger intelligence bear the cost of data and control. This is strategy, not a denial of the paradox.
Unsolved. Cross-home generalization; safety and contact-force control; distribution shift of data from lab to real residences; whether a world model must be a prerequisite of embodiment.
Key sources. [32][33][34][35][36][36b][37][38][39][40][43].
4.7 Six-rung comparison table
| Rung | Function in his wording | Maturity | Hardest public evidence | Strongest agreement with him | Strongest tension with him |
|---|---|---|---|---|---|
| 1 LM | Base | Industrially deployed | V3 [2]; scaling laws [5][6] | R1 starts from V3-Base | Whether LLMs are a dead end [32] |
| 2 CoT | Raise the ceiling | Industrially deployed | o1 [11]; R1/Nature [3][46] | “Last year” contemporaneous with 2024–25 reasoning models | Faithfulness of chain of thought [12] |
| 3 Agent | Widen the range | Industrially deployed in a narrow domain | ReAct [14]; METR [18] | Coding first [16]; still cannot replace an employee | Evaluation contamination [20]; F2 |
| 4 Continual learning | Next-generation definition | Method not yet solved | EWC [21]; SEAL [27]; Nested Learning [24] | “The world has not made it work” agrees with the literature | External memory impersonation; coupling with embodiment [28] |
| 5 Self-iteration | Gradual, not explosion | Weak form, lab-reproducible | AlphaEvolve [30]; Good original [29] | Qualification points the same way as the weak form | Hard takeoff is not excluded, only not seen |
| 6 Embodiment | A normal person’s demand | Lab-reproducible | π₀ [36]; OXE [37] | VLA depends on a VLM backbone | Physical data must be collected now |
5. Route contest: four maps, not a pick-a-side essay
5.1 Comparison set
| Route | Operational definition of the intelligence ceiling | Where money should be burned now | Versus Liang Wenfeng’s ladder |
|---|---|---|---|
| Language—reasoning—action—learning | Checkable tasks under complete context + eventually able to change its own weights | Pre-training, test-time RL, agent scaffolding, continual-learning ideas | His own |
| World models / JEPA | Predict the world in latent space and plan | Self-supervised video/multimodal, non-generative predictive architectures | He: at present not the ceiling mainline |
| Video as simulator | Pixel-level (or patch-level) world simulation | Large-scale video pre-training | He: video generation is good business, not the mainline |
| Embodiment data | Cross-embodiment, cross-scene real-action success | Robot bodies, teleoperation, simulation | He: postponed; doing it first is bitter work |
No route has been “adjudicated” by public results as of 2026-08. What can be written into a research report is only: investment timing differs, load-bearing walls differ, falsifying experiments differ.
5.2 World models first: LeCun and Sora are not the same claim
LeCun’s 2022 position paper wants a joint-embedding predictive architecture with non-pixel-level reconstruction, avoiding the waste of generative video on irrelevant detail [32][33]. OpenAI’s Sora note takes a generative, patch-level diffusion Transformer, and explicitly writes scaled video as a path to a world simulator [34]. Both are called world models; the methods are opposite.
Liang Wenfeng says the meaning of world models is “not that clear,” and many things can be called by that name (extract brief §8.1). That sentence is directly confirmed by the split above. So “he rejects world models” must be written: “he rejects treating present-stage, ill-defined world models as the intelligence-ceiling mainline,” not “he rejects all internal simulation.”
Genie makes “learn an interactive environment from video” into another generative world model [43]. If systems of this class begin to provide agents with stable, verifiable planning gains, F1’s observation window would open. Public materials still write them as research systems or product previews, not as an intelligence ceiling that has already replaced CoT+Agent.
5.3 Scaling as everything
The scaling-law literature [5][6][7] and o1’s “training-time + test-time compute both rise” [11] support “adding compute still has return.” Liang Wenfeng agrees Scaling has not hit a wall (extract brief §6.4), but refuses to let Scaling replace continual learning in defining the next generation. The tension is: if test-time compute + longer context + better scaffolding covers employee tasks in the F2 sense, continual learning as a “next generation” definition would be demoted by the market (not by physics) to an optional optimization.
5.4 Recursive self-improvement hard takeoff
Good’s explosion [29] is the theoretical comparison for rung 5, not any lab’s current recipe. AlphaEvolve [30] proves that local self-improvement exists, and also proves that today it is still nested in human-designed evaluators and evolutionary loops. This report keeps hard takeoff as a tail scenario (the extreme of Bull), and does not write it as the base scenario.
6. Scenarios and falsification: by “which rung is unlocked,” not by year
Calendar prediction has a poor record in this field. This report only defines states. If a year appears, it is only as the METR original paper’s own extrapolation, with its assumptions marked.
6.1 Three states
| Bear | Base | Bull | |
|---|---|---|---|
| Meaning | The ladder sticks at rung 4, or is rerouted by F1/F3 | His dependency order is largely walked by the industry; continual learning is slowly partly solved | Weak self-iteration comes early; time horizons rapidly cover jobs |
| Rung 4 | External memory and long context are mistaken for already solved; weight-level adaptation still catastrophically forgets | One of SEAL / Nested Learning / experience closed loop is reproducible at medium scale and begins to enter post-training recipes | Continual learning becomes a default training item of the “next generation”; his definition is adopted by the market |
| Rung 5 | Only distillation and kernel optimization; humans still write the entire recipe | AlphaEvolve-class systems become standard equipment at multiple labs, covering local parts of the training stack | Cross-generation, lightly attended search over training recipes appears; still gradual, not Good’s explosion |
| Rung 6 | Robots stay at demos; or, conversely, the embodiment camp uses physical data to overtake software intelligence (F3) | VLA keeps eating VLM dividends; housework-grade products remain narrow | Self-iteration begins to design the next-version body; bitter work clearly lightens |
| On “coding agent” | Evaluation contamination + a reliability plateau; revenue stops at assisted coding | Continues as the most checkable narrow domain; time horizon climbs from hours toward working days [18] | Coding agent becomes the lab’s operating system, the hand of self-iteration |
6.2 Observable landmarks (public, checkable)
- Paper level: whether a “continual learning / experience closed loop” technical report of R1’s weight appears, including failure cases and forgetting curves, rather than only needle-in-a-haystack retrieval.
- Product level: whether the same weights (or the same persistent memory) can, without retraining, complete new tasks across weeks on the same codebase / the same job, and keep old tasks.
- Evaluation level: METR 80% time horizon; OSWorld-class desktop tasks; and—there is not yet one—a “two-month onboarding” benchmark.
- Evaluation integrity: whether contamination-resistant benchmarks are adopted (OpenAI has publicly left SWE-bench Verified [20]).
- Self-iteration: whether a second lab publishes “this system improved this system’s training cost / algorithms,” with a re-checkable evaluator.
- Embodiment: success rates across homes, across embodiments, without teleoperation—not clips from a lab kitchen.
6.3 How to use METR’s extrapolation, and how not to
The METR original paper writes: if the 2019–2025 trend is extrapolated, within about five years systems may automatically complete many software tasks that currently take a human a month; and emphasizes external validity and trend change as the main uncertainties [18]. This report cites that extrapolation as an extrapolation in the literature, and does not rewrite it as our forecast. It serves F2 directly: if month-scale software tasks are solved at high reliability, the pressure of “must have continual learning” in Liang Wenfeng’s employee analogy would fall, but “must have continual learning before it counts as the next generation” can still exist as a research definition—only the market may no longer pay for that definition.
7. Industrial implications (logical implications, not prices)
This section translates the ladder into “where value may settle.” It does not write buy/sell recommendations and does not give multiples.
7.1 Coding agent: currently the only narrow domain that is both checkable and close to self-iteration
Anthropic lists coding as one of the domains where agents are most effective, on the ground that tests can score automatically [16]. Liang Wenfeng places Coding Agent first among verticals (extract brief §8.3). The two are independent and point the same way. Industrial implications:
- Until continual learning is made to work, checkable closed loops (code, mathematics, some science) will keep absorbing budget for test-time compute and agent scaffolding.
- Evaluation contamination [20] means buyers can no longer use a single public leaderboard as acceptance; value turns to private, contamination-resistant internal benchmarks with cost constraints. This repository’s Agent Evaluation and Benchmarks writes “highest score ≈ most expensive” into the L3 reading, consistent with this.
7.2 Once continual learning is made to work: a research-efficiency flywheel, not a consumer super-app first
His first user is himself. If rung 4 is made to work, what accelerates first is the next set of weights, not ads and e-commerce (the latter two he explicitly judges as wasting time at this stage, extract brief §8.1). Industrial implications:
- Labs that can write “job memory” into weights or equivalent memory will open a gap versus products that, each session, explain from zero who Xiao Wang is.
- Until then, external memory (MemGPT-class [23]) and longer context will exist as transitional rent: they impersonate continual learning and can also collect money, but by his definition they do not count as the next generation.
7.3 Weak form of self-iteration: training-stack software, not a “singularity clause in an AI-company stock”
AlphaEvolve-class systems put value into compilers, kernels, scheduling, chip-design toolchains [30]. This is infrastructure-software rent, not an overnight demand-side singularity. Consistent with his qualification: gradual, can be nonlinear, but not an explosion clause.
7.4 Implications of postponing embodiment for robot / world-model assets
Logically there are two readings, which must be placed in parallel; only one must not be written:
- Reading A (supports postponement). Today’s VLAs already use VLM backbones [36][38][39]. Each rung software intelligence is raised, data efficiency on the same body rises. Locking capital too early into a single body may depreciate when the next version of intelligence arrives.
- Reading B (against postponement). Real-world data is irreversible in time: if it is not collected now, there will be no 2026 household distribution later. If world models must be pretrained on video and interactive environments [34][43], then video generation and simulation are not a bypass; they are prerequisite capital expenditure for rung 6.
This report does not pick a side between A and B. In investment terms this means: the valuation of robot and world-model assets depends on whether you believe physical data can be backfilled by stronger future intelligence. Liang Wenfeng’s public judgment is closer to A; LeCun / Sora / the embodiment camp are closer to B. This is the asset version of §2’s core debate.
7.5 Multimodality and search: component pricing
He analogizes multimodality to search: important for the consumer side, not the ceiling mainline, but they will still do it (extract brief §6.4). Industrial implication: multimodal capability will be packed into products, but should not be treated as a sufficient condition for a “next-generation model.” By his definition, the sufficient condition for the next generation is continual learning.
8. Where this report may be wrong
- The primary source is an ASR transcript, not a speaker-approved written statement. Proper nouns and figures take the recording as authoritative (extract brief §15). This report deliberately avoids those figures.
- “Guesswork” may be written too full. The boxed inferences in §3 may over-interpret “first user is ourselves.” Falsification: if DeepSeek later publicly moves the main research budget to a consumer super-app, that inference fails.
- Maturity is a cross-section. A single paper after 2026-08 could move rung 4 from “method not yet solved” to “lab-reproducible.” The dashboard must be updated with the literature; it cannot be treated as a permanent rating.
- Closed-source internals are not covered. If OpenAI, Google, Anthropic’s internal continual-learning progress is stronger than the papers, this report will systematically understate rungs 4 and 5. We are responsible only for public evidence.
- Coding bias. Public benchmarks and METR tasks skew to software. If “employees” in the real economy are mainly physical and social labor, rung 6’s weight is understated by both us and Liang Wenfeng.
9. Appendix A · Glossary (not forcibly merged)
| Term | How this report treats it |
|---|---|
| Continual learning | His central word in the meeting: learn over a long period, without a strong training dump each time. In the literature often means sequential-task learning that overcomes catastrophic forgetting [21][22] |
| Learn to learn | Mixed in the transcript. In the literature often near meta-learning. This report lists it separately and does not equate it with continual learning |
| recursive improvement / recursive self-improvement | Raised together by a questioner; he did not define them as the same term. This report places it as a rung-5 comparison, not merged into rung 4 |
| Singularity | He uses it first, then qualifies it as gradual. This report treats the qualification as a theoretical judgment |
| Agent | Adopts Anthropic’s working definition: the model dynamically decides tools and process [16]; distinguished from “a pre-written-dead workflow” |
| World model | He notes the meaning is unclear. This report splits it in §§5–6 into JEPA-style and generative classes |
| Embodied intelligence | He: housework, elder care, enter reality. Literature: VLA, cross-embodiment, world-model simulation; the range is messier |
| Next-generation model | His operational definition: must have continual learning. Not parameter count or multimodality |
10. Appendix B · References
The table below is this report’s complete citation set. P5 is not used to support technical conclusions. URLs were resolvable public pages as of retrieval on 2026-08-13; OpenReview PDF direct links may be intercepted by anti-bot pages, so both the forum and Meta’s official introduction are given.
| # | Work | Type / date | Evidence grade | Judgment supported |
|---|---|---|---|---|
| 1 | This repository’s Liang Wenfeng Investor Meeting · Views; material is the 2026-05-20 meeting ASR transcript | Internal structured extract, compiled 2026-07-16 | P1 (transcription risk: see that brief) | His ladder, three axioms, the qualification, the employee analogy, coding first, continual learning not yet solved |
| 2 | DeepSeek-AI. DeepSeek-V3 Technical Report. arXiv:2412.19437. https://arxiv.org/abs/2412.19437 | Technical report, 2024-12 | P1 | Language-model rung; 671B/37B; the post-training narrative of distilling R1 into V3 |
| 3 | DeepSeek-AI. DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning. arXiv:2501.12948. https://arxiv.org/abs/2501.12948 | Technical report, 2025-01 | P1 | CoT rung; starts from V3-Base; comparable to o1-1217 |
| 4 | Vaswani, A. et al. Attention Is All You Need. NeurIPS 2017. https://arxiv.org/abs/1706.03762 | Conference paper, 2017 | P2 | Transformer base |
| 5 | Kaplan, J. et al. Scaling Laws for Neural Language Models. arXiv:2001.08361. https://arxiv.org/abs/2001.08361 ; OpenAI introduction https://openai.com/index/scaling-laws-for-neural-language-models/ | 2020-01 | P2 / P3 | Scaling laws; the literature background of his belief in Scaling |
| 6 | Hoffmann, J. et al. Training Compute-Optimal Large Language Models. arXiv:2203.15556. https://arxiv.org/abs/2203.15556 | 2022-03 | P2 | Chinchilla: parameters and tokens in equal proportion |
| 7 | OpenAI. GPT-4 Technical Report. arXiv:2303.08774. https://arxiv.org/abs/2303.08774 ; https://cdn.openai.com/papers/gpt-4.pdf | 2023-03 | P3 | Predicting large-model loss from small models |
| 8 | Grattafiori, A. et al. The Llama 3 Herd of Models. arXiv:2407.21783. https://arxiv.org/abs/2407.21783 | 2024-07 | P3 | Scaling recipe on the open-weight side |
| 9 | Wei, J. et al. Chain-of-Thought Prompting Elicits Reasoning in Large Language Models. NeurIPS 2022. https://arxiv.org/abs/2201.11903 | 2022 | P2 | Original CoT paper; depends on a sufficiently large LM |
| 10 | Kojima, T. et al. Large Language Models are Zero-Shot Reasoners. NeurIPS 2022. https://arxiv.org/abs/2205.11916 | 2022 | P2 | Zero-shot chain of thought |
| 11 | OpenAI. Learning to reason with LLMs. https://openai.com/index/learning-to-reason-with-llms/ | Official blog, 2024-09 | P3 | o1; training-time and test-time compute rise together |
| 12 | OpenAI. OpenAI o1 System Card. https://arxiv.org/abs/2412.16720 ; https://cdn.openai.com/o1-system-card-20241205.pdf | 2024-12 | P3 | Monitoring chain of thought; think first, then answer |
| 13 | Snell, C. et al. Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters. arXiv:2408.03314. https://arxiv.org/abs/2408.03314 | 2024-08 | P2 | Test-time compute vs scaling parameters |
| 14 | Yao, S. et al. ReAct: Synergizing Reasoning and Acting in Language Models. ICLR 2023. https://arxiv.org/abs/2210.03629 | 2022/23 | P2 | Original paper that Agent uses CoT |
| 15 | Jimenez, C. E. et al. SWE-bench: Can Language Models Resolve Real-World GitHub Issues? ICLR 2024. https://arxiv.org/abs/2310.06770 | 2024 | P2 | Real software-engineering benchmark |
| 16 | Anthropic. Building effective agents. https://www.anthropic.com/engineering/building-effective-agents | Engineering blog, 2024-12-19 | P3 | agent vs workflow; coding and computer use |
| 17 | Anthropic. 3.5 models and computer use (computer-use release note). https://www.anthropic.com/news/3-5-models-and-computer-use | 2024-10 | P3 | Computer use as an agent landing |
| 18 | Kwa, T. et al. / METR. Measuring AI Ability to Complete Long Tasks. arXiv:2503.14499. https://arxiv.org/abs/2503.14499 | 2025-03 | P2 | Time horizon; quantitative comparison for the employee analogy |
| 18b | METR. Measuring AI Ability to Complete Long Software Tasks (blog, stating static figures may go stale). https://metr.org/blog/2025-03-19-measuring-ai-ability-to-complete-long-tasks/ ; update page https://metr.org/time-horizons/ | From 2025-03 | P3 | Original statement of roughly 7-month doubling; take the update page as authoritative |
| 19 | OpenAI. Introducing SWE-bench Verified. https://openai.com/index/introducing-swe-bench-verified/ | 2024-08 | P3 | 500 human-screened items |
| 20 | OpenAI. Why SWE-bench Verified no longer measures frontier coding capabilities. https://openai.com/index/why-we-no-longer-evaluate-swe-bench-verified/ | 2026 | P3 | Contamination; stopped reporting frontier on Verified |
| 21 | Kirkpatrick, J. et al. Overcoming catastrophic forgetting in neural networks. PNAS 2017. https://doi.org/10.1073/pnas.1611835114 | 2017 | P2 | EWC; classic continual-learning method |
| 22 | McCloskey, M. & Cohen, N. J. Catastrophic interference in connectionist networks: The sequential learning problem. Psychology of Learning and Motivation 24:109–165 (1989). https://doi.org/10.1016/S0079-7421(08)60536-8 | 1989 | P2 | Problem statement of catastrophic interference |
| 23 | Packer, C. et al. MemGPT: Towards LLMs as Operating Systems. arXiv:2310.08560. https://arxiv.org/abs/2310.08560 | 2023-10 | P2 | External memory impersonating “learning” |
| 24 | Behrouz, A. et al. Nested Learning: The Illusion of Deep Learning Architectures. NeurIPS 2025. https://arxiv.org/abs/2512.24695 | 2025 | P2 | New paradigm for continual learning; Hope |
| 25 | Behrouz, A. & Mirrokni, V. Introducing Nested Learning. Google Research Blog. https://research.google/blog/introducing-nested-learning-a-new-ml-paradigm-for-continual-learning/ | 2025-11 | P3 | Official labeling of NL as continual learning |
| 26 | Behrouz, A., Zhong, P. & Mirrokni, V. Titans: Learning to Memorize at Test Time. arXiv:2501.00663. https://arxiv.org/abs/2501.00663 | 2025-01 | P2 | Long-term memory at test time |
| 27 | Zweiger, A. et al. Self-Adapting Language Models (SEAL). NeurIPS 2025. https://arxiv.org/abs/2506.10943 | 2025 | P2 | Self-edit written into weights |
| 28 | Silver, D. & Sutton, R. S. Welcome to the Era of Experience. To appear in Designing an Intelligence (MIT Press). Author page https://davidstarsilver.wordpress.com/publications/ | 2025 | P2/P3 (chapter preprint; catalog from the author page) | Experience data replacing the human-data ceiling; points the same way as rungs 4 and 5 |
| 29 | Good, I. J. Speculations Concerning the First Ultraintelligent Machine. Advances in Computers 6:31–88 (1965). https://doi.org/10.1016/S0065-2458(08)60418-0 | 1965 | P2 | Original of “intelligence explosion”; comparison for the qualification |
| 30 | DeepMind. AlphaEvolve: A Gemini-powered coding agent for designing advanced algorithms. https://deepmind.google/blog/alphaevolve-a-gemini-powered-coding-agent-for-designing-advanced-algorithms/ ; paper https://arxiv.org/abs/2506.13131 ; subsequent impact https://deepmind.google/blog/alphaevolve-impact/ | 2025–2026 | P3 / P2 | Weak-form self-iteration; improving Gemini’s training stack |
| 31 | Sutton, R. The Bitter Lesson. 2019-03-13. http://www.incompleteideas.net/IncIdeas/BitterLesson.html | Essay | P3 | General methods eat compute; points the same way as Scaling |
| 32 | LeCun, Y. A Path Towards Autonomous Machine Intelligence (v0.9.2). OpenReview. https://openreview.net/forum?id=BZ5a1r-kVsf | 2022-06 | P2 (position paper, not conventional review) | World-model blueprint |
| 33 | Meta AI. Yann LeCun on a vision to make AI systems learn and reason like animals and humans. https://ai.meta.com/blog/yann-lecun-advances-in-ai-research/ | 2022-02 | P3 | Official introduction of the world-model claim |
| 34 | OpenAI. Video generation models as world simulators. https://openai.com/index/video-generation-models-as-world-simulators/ | 2024-02 | P3 | Sora; video generation as a world-simulation path—the comparison for his moving it off the mainline |
| 35 | OpenAI. Sora 2 is here. https://openai.com/index/sora-2/ | Product blog | P3 | Still treats world simulation as a milestone of physical understanding |
| 36 | Black, K. et al. (Physical Intelligence). π₀: A Vision-Language-Action Flow Model for General Robot Control. arXiv:2410.24164. https://arxiv.org/abs/2410.24164 | 2024-10 | P2 | Embodiment; VLM backbone—supports “the later step uses the earlier step” |
| 36b | Physical Intelligence. π₀ blog. https://www.physicalintelligence.company/blog/pi0 | Official blog, contemporaneous with [36] | P3 | Official note corresponding to [36] |
| 37 | Open X-Embodiment Collaboration. Open X-Embodiment: Robotic Learning Datasets and RT-X Models. arXiv:2310.08864. https://arxiv.org/abs/2310.08864 | 2023-10 | P2 | Cross-embodiment data |
| 38 | Brohan, A. et al. RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control. arXiv:2307.15818. https://arxiv.org/abs/2307.15818 | 2023 | P2 | VLA paradigm |
| 39 | Google DeepMind. Gemini Robotics related paper arXiv:2503.20020. https://arxiv.org/abs/2503.20020 ; introduction https://deepmind.google/discover/blog/gemini-robotics-brings-ai-into-the-physical-world/ | 2025-03 | P2 / P3 | Connecting a frontier model to the physical world |
| 40 | NVIDIA. Isaac GR00T. https://developer.nvidia.com/isaac/gr00t ; code https://github.com/NVIDIA/Isaac-GR00T | Product / open-source stack | P3 | Open cross-embodiment VLA |
| 41 | Mialon, G. et al. GAIA: a benchmark for General AI Assistants. arXiv:2311.12983. https://arxiv.org/abs/2311.12983 | 2023 | P2 | General tool-chain tasks still hard |
| 42 | Xie, T. et al. OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments. arXiv:2404.07972. https://arxiv.org/abs/2404.07972 | 2024 | P2 | Real computer environments |
| 43 | Bruce, J. et al. Genie: Generative Interactive Environments. ICML 2024. https://arxiv.org/abs/2402.15391 | 2024 | P2 | Interactive world models |
| 44 | Yang, J. et al. SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering. arXiv:2405.15793. https://arxiv.org/abs/2405.15793 | 2024 | P2 | ACI raising issue-resolution rate |
| 45 | Wang, G. et al. Voyager: An Open-Ended Embodied Agent with Large Language Models. arXiv:2305.16291. https://arxiv.org/abs/2305.16291 | 2023 | P2 | Skill-library “learning”; scaffolding impersonation |
| 46 | Guo, D. et al. DeepSeek-R1 incentivizes reasoning in LLMs through reinforcement learning. Nature 645, 633–638 (2025). https://doi.org/10.1038/s41586-025-09422-z | 2025 | P2 | Peer-reviewed version of R1 |
| 47 | Amodei, D. Machines of Loving Grace. https://darioamodei.com/machines-of-loving-grace | 2024-10 | P3 (essay) | Gradual, manageable powerful-AI narrative; same side as the qualification, not experimental evidence |
| 48 | DeepMind. Enabling Continual Learning in Neural Networks. https://deepmind.google/blog/enabling-continual-learning-in-neural-networks/ | 2017 | P3 | Official introduction of EWC |
| 49 | Silver, D. et al. Mastering the game of Go with deep neural networks and tree search. Nature 529, 484–489 (2016). https://doi.org/10.1038/nature16961 | 2016 | P2 | The AlphaGo ground he uses to argue “can surpass already-stated human knowledge” (extract brief §12.2) |
Retrieval notes
- Material named in the plan but not used in the end to support conclusions, and therefore not listed: preprint mirrors whose full text could not be stably resolved, second-hand social-media restatements of internal accelerator counts, capacity figures in the meeting ASR.
- A PDF direct link for [28] could not be stably retrieved from one public store on the writing day, so cataloging follows the author’s publications list; page-number citations are not fabricated.
- A PDF direct link for [32] hit OpenReview’s anti-bot page on the writing day, so the forum and Meta’s official introduction [33] are cited together; unread page numbers are not cited.
This report does not replace the recording and does not replace the original papers. If the speaker later publishes a written technical route, the written version is authoritative.