Late Lessons, Jensen Huang and AI

B20 perspective notes: 2024-11-06 to 2025-01-12 (18 posts)#

These notes read the batch for how Maynard thinks, not for the concepts he names. I read all eighteen posts in full. The five Modem Futura episode posts were read for his own framing lines only; the episodes themselves were not listened to. Quotes are exact, including his typos, apart from markdown italics, which are dropped.

Evidence rules applied

Context. The batch opens the morning after Trump’s 2024 election win and runs to mid-January 2025. OpenAI’s “12 days” release o1 in full, Sora to the public and Canvas, then announce o3. Google ships Gemini 2.0 and Apple Intelligence rolls out. Altman’s Reflections predicts AI agents will “join the workforce” in 2025. Maynard is six weeks into co-hosting Modem Futura with Sean Leahy and records the tenth episode before a live audience. The ATP-Bio ethics collection comes out in JLME. He is fielding colleagues’ questions about students and AI. Three posts form a chain built across a fortnight: the MIT materials-science study and scientists’ joy (11-10), a reader’s LinkedIn reply to it, and the amanuensis thought experiment that reply set off (11-24). The chain resurfaces in the fantasy list’s footnote on joy (12-29) and, inverted, in the FAQ post (01-12).


1. How he thinks here#

He opens from something that happened to him or landed in front of him#

Nearly every substantive post starts from an encounter, not a thesis:

He is also candid about the emotional trigger. Shock, anxiety, guilt and delight are all named as the reason a piece exists.

He builds simple models to think with, and says where they break#

Three posts build deliberately small conceptual models in public and then test them against reality.

In each case the model is a way of seeing, not a claim to be right. The amanuensis post ends with “like all thought experiments, this could be completely wrong.”

“What if”, then a plausibility test#

He lets imagination run and then reins it in. That is the core move of the BCI post (2024-11-17). He singles out Gordon and Seth’s decision to “set practicality and feasibility to one side and give imagination free reign”, followed by a hard return to plausibility, and recognises it as his own method: “It’s a technique that I’ve used in the past to explore the plausible boundaries of emerging technologies, and one that works well for closing the shutters on hyperbolic speculation”. The point of the exercise is ethical: it is “a critically important step toward ensuring ethical questions and constraints are grounded in plausibility rather than hyperbole.” Their line about imagination needing to be “reined in by what is … practical, feasible, and ethical” makes him want to add “an “amen”” (fn 5).

The same pattern shows elsewhere:

Reasoning by structural analogy#

He experiments with the thing itself#

Curiosity and serendipity as drivers#

He holds tensions rather than resolving them early#

Play and wit as ways of thinking#


2. What matters to him#

Joy, wonder and curiosity, treated as things of real value#

This is the emotional centre of the batch.

He speaks from inside science here, “From my career-long experience as a scientist”, and treats wonder as “core to what makes us us”. Even so, he declines to be merely nostalgic: “Fortunately, I suspect there are ways of using AI in scientific research and discovery that spark curiosity and increase the joy and wonder”.

Human creative agency#

The amanuensis post worries about “a shift away from human-centered professional or creative agency, and toward AI-directed and human-executed implementation”. Its postscript holds on, provisionally, to “a spark of creativity that leads to novel value creation which remains uniquely human”, then immediately asks “how long it’ll be before even this aspect of what makes us uniquely human is challenged.” His deepest worry is organisational: that the model is “so compelling that organizations adopt it at scale — without fully understanding the potential long term consequences to human creativity and innovation.”

What it means to be human, held open#

Inclusion and whose future it is#

What frustrates him#

What delights him#


3. Risk as a way of thinking#

The explicit statement: risk innovation for biopreservation (2024-12-17)#

This is the clearest account of the framework in the batch, and it is his own narration of his talk.

The same logic, unlabelled, in the AI posts#

The terms appear only in the biopreservation post. But the reasoning runs through the AI posts, which is where it does its most interesting work.

A novel technology calls for new mental models, but not amnesia#

Humility against false precision#


4. Scholarship and public writing#

Turning papers into posts#

Experimenting in public#

How he treats evidence and expertise#

Transdisciplinarity#

Accessibility as principle, not packaging#


5. His role as he sees it#

Catalyst, not centre#

His 2022 statement for the initiative, quoted in 2024-12-22: “Our vision was not one of a research center, or even an educational endeavor (although we do both), but of an initiative that would catalyze thinking at scale”. The initiative answers “a “growing need for bold ideas and visionary insights that transcend the constraints of conventionality”. Modem Futura is “part of this vision of catalyzing thinking at scale.” The role is to start thinking in others, at scale, not to hand down conclusions.

Thinking out loud, with the audience as companions#

What he refuses to do#

Towards the people around him#

Changes of mind and self-revision in this batch#


6. What is distinctive#

  1. Joy and wonder as risk categories. Most AI risk discussion counts jobs, bias, safety, misinformation or catastrophe. Maynard treats the loss of delight, curiosity and meaning in human work as a serious, under-appreciated threat to value, and follows it from scientists (11-10) to organisations (11-24) to technology in general (12-29, fn 7). He also treats it as a reciprocal threat: drain the joy and you erode the societal good science is meant to produce.

  2. AI read through agency and organisation rather than mind. The amanuensis model is not about whether AI is conscious or creative. Indeed, “This model does not imply intrinsic creative ability within the AI”. It is about where AI sits in chains of delegation and accountability, and how that could quietly invert who generates and who executes. His observation that model guardrails may themselves “resist explorations that diminish the potential role or centricity of humans” is an early, unusual note: the tools shape what their users can think about the tools.

  3. Plausibility as an ethical discipline. He runs imagination to its limit and then reins it in, and he applies this both ways. It closes “the shutters on hyperbolic speculation” (BCI), but it also refuses to dismiss Altman as hype. This sits between the booster and critic camps without being a midpoint. It is a method.

  4. Responsibility as enlightened self-interest in a web of value. The risk-innovation framing lets him talk to founders, engineering centres and AI developers without moralising. Their success is “intimately intertwined” with the value they threaten for others. Under a deregulatory administration, he reads this stakeholder web (“a tapestry of soft governance mechanisms”) as where responsible AI will actually be decided.

  5. The problem is the mental model, not the machine. The third s-curve names something rarely named: a perception lag that makes policies obsolete before they are written. His answer is to teach ways of thinking that last across model generations, not rules tied to 2022’s ChatGPT.

  6. A physicist’s long memory. Few AI commentators reach back to 1889 dust counters. His insistence that “seemingly novel challenges don’t always demand novel solutions” sits deliberately beside his call for new mindsets. The skill is telling which is which.

  7. Institutional self-critique from the inside. He argues universities are the best-placed actors for “navigating advanced AI transitions” and, in the same breath, that they are “mired in tradition” and may have to justify their existence.

  8. Personality in the margins. Much of his candour and play lives in the footnotes: the “amen”, the 😄, “Sigh …”, the confession about committees, the pencil-and-paper test. The footnotes are a second voice in which the scholar admits doubt, humour and delight. The form is part of the method: it models the curious, unpreachy stance he wants readers to adopt.


7. The posts that best reveal how he thinks#

  1. 2024-11-24 artificial-intelligence-agency-human-amanuensis. Serendipity (a reader’s reply), a model built and broken in public, experiments with chatbots that push back, a plausibility argument under deep uncertainty, and the joy of work as the value at stake.
  2. 2024-11-10 is-ai-poised-to-suck-the-soul-out-of-science. The clearest statement of what he cares about: wonder, curiosity and “what if”. The argument treats scientists’ satisfaction as a stakeholder value whose loss threatens the enterprise. Also shows public correction (the 2025 caution).
  3. 2024-12-17 navigating-the-challenges-and-opportunities-of-advanced-biopreservation-technologies. Risk innovation in his own words: threat to value, the risk landscape that includes quantitative risk, orphan risks, and a tool meant to “reveal new ways of thinking”. Honest about subjective data, and non-preachy about responsibility.
  4. 2024-12-13 are-educators-falling-behind-the-ai-curve. Model-building (three s-curves), explicit talk of outdated “mental models”, and a preference for ways of thinking over brittle rules.
  5. 2025-01-07 universities-need-to-step-up-their-agi-game. Navigating AI transitions as a landscape, the anti-stovepipe argument, radical creativity freed from conventional metrics, and sharp self-critique of academia.
  6. 2024-12-22 why-modem-futura-is-more-than-just-another-tech-podcast. His own account of his public role: catalysing thinking at scale, thinking in the raw with the audience, serendipity, and refusing to be “preachy or polarizing or boring”.

Also revealing: 2024-11-17 (the imagine-then-rein-in method, in his own words), 2024-12-29 (play as critique, joy as neglected value) and 2024-12-01 (the physicist’s long memory and delight in old data).