Late Lessons, Jensen Huang and AI

B12 perspective notes: 2023-10-24 to 2023-12-01 (17 posts)#

These notes read the batch for how Maynard thinks, not for the concepts he names. All seventeen posts were read in full. Quotes are exact, including his typos. There are no Modem Futura posts in this batch.

Evidence rules applied

Context. These five weeks include: - the Biden AI Executive Order (30 Oct); - the Bletchley Park AI Safety Summit (1–2 Nov); - OpenAI DevDay and custom GPTs; - the Cruise robotaxi collapse; - Sam Altman’s firing and return (17–22 Nov); - ChatGPT’s first anniversary.

Maynard responds in several ways: - He builds things: five GPTs, and a role-play run of his own risk tool. - He checks things: he redoes the arithmetic on a Waymo safety study. - He brings back older work: the 2018 orphan-risks article. - He goes back to first principles on what “risk” means.

Across the batch, the answer to the news is rarely an opinion. It is usually an experiment, a reframing or a tool.


1. How he thinks here#

He opens by questioning his own ideas#

2023-10-24 flattening-the-learning-distribution-curve begins with doubt about a phrase he has been using on stage: “I sometimes come away from these events thinking to myself “is this really a thing?”” The post is him checking, in public, whether an intuition holds. He finds that it does: “It turns out that the concept does make sense”. Along the way he sketches a stylised diagram, and flags it as “admittedly, a somewhat stylized and over-simplified illustration.”

2023-11-26 everything-youve-heard-about-ai-risk-is-wrong runs the same move at a larger scale: - He leads with a provocation in the title. - He adapts a meme about overnight AI experts into one about overnight AI-risk experts, calling the original “snarkily accurate”. - He ends by walking the title back: “Maybe I was a little hubristic with my statement … there’s probably some stuff there that’s less wrong. Although the more I learn, the less sure I am.”

The provocation opens a door, and the self-correction shows the humility he is asking of others.

First principles, from a risk scientist’s foundations#

Faced with a year of AI-risk noise, his move in 2023-11-26 is to step back: “it’s worth going back to first principles and what we mean by risk in the first place.” He takes the textbook definition, “the probability of harm occurring from an action, process, or situation”, and unpacks it into five parts:

  1. Cause and effect: “no cause, no risk”. Hazard is not risk: “bleach is hazardous, so is a piano”.
  2. Magnitude: some sense of scale is needed, whether “quantitative, qualitative, or comparative”.
  3. Harm: extended beyond health, wealth and the environment to “mental wellbeing, happiness, sense of worth, identity, beliefs, aspirations”.
  4. Time: long timescales “mess up the lines between cause and effect”.
  5. Perception: “an understanding of risk cannot be separated from an understanding of human behavior and societal dynamics.”

The foundations are conventional risk science. What he does with them is not. Each component, followed through for AI, shows how little we know. He uses first principles to open the question up, not to settle it.

The next day he adds an addendum because the classic formulation “risk = hazard x exposure” had been “bugging me”. He explains why he had left it out: - to build “a broader understanding of risk that extends beyond the hazard-exposure paradigm”; - because dose–response can be non-linear (“threshold responses, hormesis, and other low-dose responses”); - because “I also didn’t want to fall into the trap of implying that zero exposure — as in no AI — is a default risk management strategy.”

He still gives the old paradigm a role, as something that might “reveal new ways of thinking about and understanding risk”. This is quantitative risk science built on, not thrown away, and used as a mental model rather than a calculation.

Building and experimenting to find out#

2023-11-11 a-fist-look-at-openais-gpts. Within days of the launch he has built five GPTs: - Imagination Catalyst; - two personal learning guides, one on responsible innovation and one on advanced technology transitions; - two “book guides” for Films from the Future and Future Rising.

He records what he learned the way a lab notebook would: - tricks with conversation starters (an ellipsis at the end, and a “Tell me about yourself” starter); - a workaround for GPTs answering in character; - a playful probe test, “talk to me about peanuts”, chosen because “neither book explicitly mentions peanuts” (“idiosyncratic I know”); - the rules he wrote to keep a book GPT on topic.

His verdict is balanced. GPTs are “often not as impressive as they first seem”, and “good GPTs require a lot of tweaking and experimentation”. Yet the capability is “a game changer”.

2023-11-21 ai-and-risk-innovation. Three days after Altman’s firing he does not add another opinion. He runs a counterfactual game: “just to make things more interesting, I thought I’d experiment with using ChatGPT to explore how the planner might have been used.” - He casts ChatGPT as the board of “a hypothetical company” and walks it through his Risk Innovation Planner. - He publishes the opening prompt “typos and all”, along with the source documents and the completed planner. - His own reaction: “more illuminating than I expected”. What surprised him was “just how well ChatGPT did”. - He says what the exercise cannot show: whether it would have helped OpenAI “is, of course, impossible to tell.”

Play (role-play), experiment (a counterfactual), a tool (the Planner) and full transparency are all combined in one post.

Checking the evidence himself#

2023-11-09 waymo-safety-study-shows-benefits shows his quantitative instincts at work: - Plausibility test on the source. Swiss Re’s business depends on “cold, hard analysis of risk and liability”, so “I cannot imagine a scenario where Swiss Re sacrifices the very core of its business by putting out a report based on spin”. - Separating anecdote from data. His own rides were positive, but “anecdote is no substance for data.” - Checking the method. He spots a possible bias: the human baseline included interstates, where Waymo does not drive. He was “Not convinced” by the authors’ reassurance, so he ran “back-of-the-envelope calculations” on NHTSA and FHWA data. The check showed the baseline is probably conservative, so the benefit is likely understated. - Keeping the bigger question open. “there remains the serious question of how safe self-driving cars should be, and whether comparing them to humans is the right metric.”

Reading technology through stories#

2023-11-05 dont-panic-elon-musk-launches-grok reads a product through the fiction it borrows from: - He quotes the radio Hitch-Hiker’s Guide on the Guide being “occasionally accurate”, and dryly notes the fit with “a guide that leans more toward what you want to hear than what is, strictly speaking, true”. - He does not stop at the joke. Adams is “remarkably good at holding up a mirror to humanity’s absurdities, and in doing so helping us cut through the noise of entrenched ideas and narrow thinking.” - He traces “grok” back to Heinlein (“to understand something profoundly and intuitively”). - He ends open: “I guess we’re about to find out!”

The story here is a lens that can cut both ways, not just a weapon for mockery.

Framing through intersecting lenses and holding outcomes open#

Reframing a problem to find a better option#

In 2023-10-24 flattening-the-learning-distribution-curve he looks at three responses to students at the edges of the curve: - Narrow it, by selective admission. He rejects this because it works “by excluding students at the edges”. - Broaden it, through better teaching. This “only goes so far”. - Flatten it, by raising success at the edges.

AI is then placed as a possible way to flatten the curve, not as a threat to be contained. Even its flaws are reframed as useful for learning. In a Socratic-dialogue assignment, ChatGPT’s unreliable accuracy means “each student is challenged to question and test what they are exposed to as part of a dialogue that’s unique to them.”

Setting fields side by side and letting serendipity work#

The event notices show the same design habit: - AI with cooperation science and evolutionary biology (2023-11-08 human-ai-symbiosis): “What’s really interesting me though is how bringing together expertise on cooperation between biological organisms with deep understanding of evolutionary biology and behavior will reveal new insights”. - Conversations billed as “lively, serendipitous, unscripted”. - Events expected to “go places few other conversations around AI have gone” (2023-12-01 dec-19-future-of-being-human-unplugged).


2. What matters to him#

Inclusion and the people at the edges#

“This is not an approach that sits well with me as an educator” (2023-10-24), about selecting students so that success looks high. He anchors this in ASU’s charter, measuring success “by whom we include, not by whom we exclude”, and in “the ethos of learning and education at a public university”. The same value runs through his civic writing: - AI should serve “a better future for as many as possible” (2023-11-18). - Social-justice experts must be “partners in developing responsible and beneficial AI, and not just add-ons” (2023-10-30 white-house-goes-all-in-on-responsible-ai).

Technology that serves society, benefits included#

He counts the costs of the status quo. Waymo matters to him because he “worries about how we’ve normalized loss of life, limb, and property resulting from inattentive and poorly trained humans” behind the wheel (2023-11-09). His overall verdict on ChatGPT’s first year is that we are “in a better place” (2023-11-29). His governance commentary starts from “to realize the benefits of AI, we have to understand how to navigate the risks” (2023-10-30).

What makes a human life meaningful#

His idea of harm reaches into the inner life. It includes “our sense of identity, our beliefs, our worldview, relationships, and many other things that give our lives meaning”. Risk is also about the future: “not just about protecting what we have, but protecting pathways to futures we desire” (2023-11-26).

Opening capability to more people#

He is delighted that GPT building moves creation away from “something that computer scientists do to something that anyone with a good grasp of language and how to communicate can do” (2023-11-11). He is also delighted that a book can be explored “without reading it in a linear fashion”.

Imagination matched to the scale of the technology#

His hope for the Frontier Model Forum’s $10m fund is ideas “as radically transformative as the technologies they are hoping to steer”. His fear is “yet another attempt to be radically transformative in very conventional ways” (2023-10-25). The list of what he would like funded is itself a statement of values: - “novel conceptualizations of risk”; - “inspiration from the nexus between the arts, humanities and emerging capabilities”; - ways to “radically reimagine public participation and engagement in responsible innovation”.

What frustrates him#

What delights him#


3. Risk as a way of thinking#

This is the batch where risk innovation is first brought to bear directly on AI companies. The concepts work mainly as ways of seeing and of opening options, not as procedures.

Novel technology needs a new mindset#

In his own prose, “navigate” is the working verb throughout: - “Navigating AI risks” is a section heading (2023-11-26); - “navigate a risk landscape that might otherwise be hidden” (2023-11-21); - “learn together how to navigate the coming AI technology transition” (2023-11-26).

“Manage” turns up mostly where he is describing a limit or an older paradigm. The navigation options he gives are open-ended: “remove risks, help identify ways to circumnavigate them, or strategically absorb them” (2023-11-21). “Course-correct” and “agility” (2023-11-26, 2023-11-29) complete the picture of steering through changing terrain.

The risk landscape#

The landscape is the ground “that lies between new ideas and their successful implementation” (2023-11-15). He uses the image to explain failure: the Galactica model (which he calls Google’s; it was Meta’s) was “a ground-breaking idea with substantial potential that was scuppered by a lack of awareness of a deeply complex risk landscape”. AI’s landscape “is increasingly looking unlike anything we’ve had to navigate together before” (2023-11-26).

Risk as threat to value#

Orphan risks#

He reframes Rumsfeld’s taxonomy by adding a category of risks that are ““known knowns” if you’re looking in the right place, but aren’t taken as seriously as they should be” (2023-11-15). The subtitle states the purpose: these are risks “that have a habit of getting in the way of good ideas”. Risk here is not only harm to be prevented. It is what stops beneficial ideas from succeeding.

The ethical case sits alongside the strategic one: “Quite apart from the ethical inappropriateness of ignoring actions that could present deeply impactful social risks to others”. Even here he is funny about conventional risk mantras: “don’t break the law (or at the least, don’t get caught)”.

Tools as catalysts for a mindset#

The Risk Innovation Planner is a tool, but he is clear that its job is to shift thinking: - Design brief: “if we had 30 minutes to sit down with the founder of a startup to help them develop a risk innovation mindset that provided them with a competitive advantage, how could we do this?” - What it does not do: “What the Planner does not do is provide answers to problems.” - What it is: “a catalyst”, meant to “reveal pathways forward for users than they might not see”. - Letting users adapt it. When users reframe the orphan risks in their own terms: “This can be frustrating, but as the aim of the planner is to facilitate enterprise-relevant thinking, it’s also appropriate.” - Why it is needed for AI: it helps with challenges “that previous experience in tech innovation and formal business and risk management training simply do not prepare people for.”

Humility against false precision#

Complex systems, tipping points, irreversibility#

In 2023-11-29 he names ChatGPT’s launch, and probably emergent LLM behaviours, as tipping points that “led to changes that cannot be undone, nor forgotten”. He does not condemn trial and error in general (“there’s nothing wrong with technology development that’s based on trial and error”). He worries about it in “an increasingly complex and bounded system”. The answer he gives is “agility” and “resilience in how we react to the unexpected”, not prediction.


4. Scholarship and public writing#

The Substack as a channel for his research#

The batch threads his scholarship into news commentary: - the Nature Nanotechnology paper with Sean Dudley on advanced technology transitions (2023-10-25, 2023-10-30); - the Risk Innovation Nexus, its Planner, templates and training materials (2023-11-15, 2023-11-21); - the 2018 orphan-risks article, reposted “pretty much as it was published back then”; - a National Academies-sponsored presentation, a JMIR paper on brain–machine interfaces, and the Nature Nanotechnology risk-innovation commentary (footnotes, 2023-11-15).

Old work is brought back when events make it newly relevant. The Galactica tweet triggers the orphan-risks repost, and the OpenAI crisis triggers the Planner post.

Tools given away#

He publishes the Planner template, the anonymised documents behind the role-play, and the completed planner as downloads (2023-11-21). He makes public GPTs and shares conversation links for readers without paid accounts (2023-11-11). The scholarship is meant to be used, not only cited.

Experimenting in public, method included#

He shows his workings in several ways: - the unedited GPT-building video, sped up only “to compensate for my slow typing (and stop you snoozing off)”; - prompts reproduced “typos and all”; - failed iterations: book GPTs “forgetting the book they were trained on”; - an open admission: “I’m still playing with this GPT and I’m not convinced yet” (2023-11-11).

Evidence, AI help and disclosure#

Transdisciplinarity as a demand#

Accessibility#

He works quickly: the Executive Order analysis goes up on the day it is released, and the Planner experiment three days after the OpenAI crisis. The aim is to be useful while it still matters.


5. His role as he sees it#

Authority used to show uncertainty#

He states his standing plainly: “I’ve been working in the field of risk for over thirty years and have been at the forefront of grappling with novel risks from emerging technologies for the past twenty of these” (2023-11-26). He uses that standing to say how uncertain the ground is, not to claim answers. With the OpenAI board he makes a practitioner’s claim: “this is the bread and butter of what I do” (2023-11-21).

Educator and experimenter with students#

He speaks as a teacher who designs assignments to “allow students to learn on their own terms and at their own pace” (2023-10-24). He also demonstrates new tools to “students and colleagues” (2023-11-29).

With industry: a constructive partner who sometimes pushes#

With policymakers and institutions: a supportive critic#

With readers: host and co-explorer#

He invites more than he pronounces: - “Looking forward to seeing you there!” (2023-10-27); - “I really hope you’ll join us” (2023-12-01); - a recommendation “if you are even slightly curious”; - “I’ll be pushing at the boundaries of how we think about AI and the future as I lead the conversation.”

With people he disagrees with, or might mock#

What he refuses to do#

Changes of mind, shown in the text#


6. What is distinctive#

  1. A quantitative risk scientist using first principles to widen the question. Most AI-risk voices either extrapolate to existential scenarios or list present harms. Maynard goes back to the definition of risk and shows two things. “No cause, no risk” limits speculation without a causal pathway. And “harm” and “perception” extend risk to identity, meaning and aspiration. He then refuses the “zero exposure” default (2023-11-26). The same fundamentals discipline the debate and open it up.

  2. Risk that includes the futures people want. Treating risk as a threat to value, including value “that we may aspire to”, puts risks and benefits in one frame. It lets him ask what stops good ideas from succeeding (Galactica, OpenAI), not only what harms to prevent. The distinction between “value” and “values”, and the idea that threats are reciprocal, are uncommon in AI-governance discussion.

  3. Answering a crisis with an experiment. While most commentators offered takes on the OpenAI board crisis, he ran a role-play counterfactual with a two-page planner and published every step (2023-11-21). The tool is presented as a catalyst for a mindset, not a compliance checklist.

  4. Humility as a stance of expertise, not a lack of it. “the more I study … the less certain I am”. This comes from someone with thirty years in risk, and it sits against a landscape of “dogmatic overconfidence”. His humility carries over to governance: regulations “could themselves constitute risks”.

  5. An equity lens on AI in education. In a year dominated by panic about cheating, he frames generative AI as a way to raise success “at the edges” of the learning curve. His measure is inclusion, and he treats AI’s unreliability as something that can help learning.

  6. Fiction and play used as ways of knowing, not decoration. Douglas Adams becomes a mirror for Grok. A peanuts test probes a book GPT. A remixed meme becomes an argument about expertise. The socks disclosure turns an integrity practice into a light touch.

  7. The widest call for expertise. He argues the ChatGPT year was driven by society as much as technology. So AI needs not only social scientists but experts in consciousness, personhood and biological intelligence, and he convenes cooperation scientists and evolutionary biologists to think about human–AI symbiosis.

  8. Holding experimentation and caution together. He is a constant hands-on experimenter, yet he warns against society-scale “suck it and see” in “a bounded system” with tipping points. He separates learning by trying from pushing irreversible change on everyone. Few commentators hold both positions at once.


7. The posts in this batch that best show how he thinks#

  1. 2023-11-26 everything-youve-heard-about-ai-risk-is-wrong. The clearest statement of his risk thinking: first principles from conventional risk science, risk as a social construct and a threat to value (including aspired futures), navigating rather than managing, and humility against false certainty. The addendum and the walked-back title show his self-correction.
  2. 2023-11-21 ai-and-risk-innovation. His method in action: responding to a crisis with a playful, transparent experiment. It also sets out the Planner’s design logic (“does not provide answers”) and the distinction between “value” and “values”.
  3. 2023-11-15 navigating-orphan-risks. The core risk-innovation concepts (risk landscape, threat to value, orphan risks, and innovation in how we think about risk) applied to AI. Risk is framed as what gets in the way of good ideas, and the new frame extends the old one rather than replacing it.
  4. 2023-11-09 waymo-safety-study-shows-benefits. His quantitative instincts: a plausibility test on the source, his own reanalysis, attention to benefits, and the open question of the right metric. It includes the socks disclosure.
  5. 2023-11-11 a-fist-look-at-openais-gpts. Building to find out: play, tinkering, delight and honest limits, including turning his own books into conversational guides.
  6. 2023-10-24 flattening-the-learning-distribution-curve. He questions his own idea in public, rejects exclusion, finds a third option by reframing, and experiments in the classroom.