Late lessons from early warnings: an analysis of the two EEA reports#
An audited analysis of the European Environment Agency’s reports Late lessons from early warnings (2001 and 2013), with post-publication checks to September 2026 and a technology-neutral analytical lens. Written 26 September 2026, and revised the same day after fidelity, balance and completeness reviews. One of three companion documents, with 02-huang-analysis.md (an analysis of Jensen Huang’s views on AI and society) and 03-late-lessons-and-huang.md (which reads those views against the reports using the lens set out here).
1. About this document#
1.1 Purpose#
This is a summary and analysis of the European Environment Agency’s two Late lessons from early warnings reports (2001 and 2013). It has two jobs:
- A faithful record of what the reports say and show: their cases, their lessons, their tools and their own caveats.
- An honest assessment of weight: which lessons are well evidenced, which are advocacy, which are contested, and what has happened since publication (to September 2026).
It is also built to serve as an analytical lens on how emerging technologies are developed and governed. The reports are framed around the precautionary principle, but many of their most useful insights lie elsewhere: in how knowledge is produced and contested, how interests shape evidence, how technologies lock in, who bears costs, how institutions behave, how complex systems surprise, and how actors frame problems. The document keeps these layers visible: epistemic, political-economic, institutional, economic, systemic, and cultural or cognitive.
The document does not apply the lens to any contemporary technology (the companion document 03-late-lessons-and-huang.md applies it to one position on AI safety). Section 6 states the lens in technology-neutral terms and can be used on its own.
1.2 Scope#
Both reports, every substantive section, organised into 47 sections for analysis:
- LL1 (EEA Environmental Issue Report No 22, 2001; 211 pp.): LL1-00 (Preface, front matter and Chapter 1 Introduction); LL1-02 to LL1-15 (the fourteen case chapters, Chapters 2–15); LL1-16 (Chapter 16, the twelve lessons); LL1-17 (Chapter 17, Conclusions).
- LL2 (EEA Report No 1/2013; 764 PDF pp.): LL2-00 (acknowledgements, Preface, Chapter 1 Introduction, Part A introduction); LL2-02 (Chapter 2, false alarms); LL2-03 to LL2-22 (the twenty new case chapters in Parts A–C); LL2-23 to LL2-25 (Part D: costs, justice, business); LL2-26 to LL2-28 (Part E: science, precaution, conclusions); LL2-A2 and LL2-A3 (Annexes 2 and 3).
A full list with titles and pages is in section 2.4.
1.3 Method#
The analysis was built in layers, each checked against the one below:
- Text extraction. Both reports were extracted to text and split into chunks (
working/text/), with the PDFs kept for visual checks of figures and tables. - Section-level close reading. Every substantive page was read by a reader assigned to that section, who wrote detailed notes: authors and standpoint, core argument, evidence and numbers, mechanisms, the authors’ lessons, transferable insights with strength ratings, and caveats.
- Independent audit. Each set of notes was audited against the source text and PDF, and where relevant against external primary documents (court judgments, regulatory records, cited papers). Several sections were audited twice. Each notes file ends with its audit log.
- Digests. A condensed digest of each section was written from the audited notes.
- Hindsight checks. Each section’s main claims (typically ten) were tested against evidence from publication to September 2026 and given a verdict: strengthened, held up, partly held up, contested, unclear, weakened or overturned. Several checks were done by direct retrieval of primary documents without general web search; each file states its access limits, and those caveats carry into this document.
- External work. Two files cover the reports’ institutional setting and intellectual traditions (
external/context.md) and their reception and critiques (external/critiques.md). - Thematic synthesis. Ten cross-cutting syntheses (T01–T10) each drew on all 47 digests plus targeted notes and hindsight files, with quotations re-checked against the text.
- This document, which integrates all of the above.
The analysis was prepared with extensive AI assistance, as a multi-stage process of reading, audit and review, commissioned by Andrew Maynard (section 1.5).
What was excluded. Indexes, reference lists (used only to check citations) and author biographies (consulted only to establish standpoint: LL1 pp. 195–199; LL2 Annex 1, pp. 685–700).
1.4 Conventions#
- Section ids follow the scheme used throughout this document and its companions: LL1-05 is LL1 Chapter 5; LL2-A3 is LL2 Annex 3.
- Pages are report pages. In LL1, report page = PDF page. In LL2, report page = PDF page − 2. Citations take the form (LL2-07, p. 154).
- Other sources. “Hindsight LL1-15” means the post-publication check for that section; “notes LL1-16” means the audited notes; “critiques §5” and “context §2” refer to the two external files.
- Three voices are kept apart. Reports say (what the text claims, with its hedges); Evidence and hindsight (what the cases and later record show); Analysis (inference in this document, labelled as such).
- Strength ratings apply to a claim as a transferable lesson:
- Strong: several cases across both volumes, some contemporaneous or independent support, not overturned since.
- Moderate: several cases, but with protagonist sourcing, hindsight risk, real counter-cases or a documented pattern whose causal weight is unmeasured.
- Suggestive: one or two cases, or an inference.
- Asserted: stated without case evidence, or normative.
- What a rating does not mean. A Strong rating means the mechanism is well documented in the failure histories. It does not mean that its presence distinguishes harmful from benign cases. In a corpus selected because harm occurred, a mechanism of missed harm documented in a few chapters qualifies easily and is seldom “overturned”; mechanisms on the side of precaution’s own errors are documented less often because the reports looked for them less. Qualifiers used in section 6 (“mixed”, “weak form only”, “high for existence”) map onto this scale: mixed = moderate on one reading and suggestive on another; weak form only = moderate for the weak claim, asserted for the strong one.
- Case counts illustrate a curated set. They are not frequencies (see section 5.1).
- Access levels. External works are marked where it matters: [full] read in full; [abstract] abstract only; [meta] title and metadata only; [known] the work’s established thesis, not re-read (critiques, “Access caveats”). A rating that rests on [abstract] or [meta] access is provisional.
- Quotation. LL1 is “All rights reserved”, so its wording appears only as short phrases. LL2 authorises reproduction with acknowledgement (LL2-00, p. 2); the twelve lessons are quoted in full from LL2’s reprint (p. 11).
1.5 Disclosure#
Andrew Maynard, who commissioned this analysis, co-authored LL2 Chapter 22, “Nanotechnology: early lessons from early warnings” (with Hansen, Baun, Tickner and Bowman; pp. 530–560), which updates Hansen, Maynard, Baun and Tickner (2008). The chapter was read, audited and hindsight-checked in exactly the same way as every other section, and is cited as LL2-22. A balance review of this document found that, in its first version, LL2-22 had been treated more gently than comparable protagonist chapters: its standpoint was not flagged, and a funding statistic from its hindsight file had lost its caveats. Both are corrected here (section 3.6; Appendix A, LL2-22). LL2-22 and its hindsight file carry weight in this document at these points: the nanotechnology safety-research share in the uptake-gradient argument (section 3.6), Table 22.1 (which T10 uses for the gradient), the “legacy identifiers” and “promote-and-oversee” evidence (sections 4.1, 4.3; lens entries K2, I5), and the carbon-nanotube vindication (section 5.5). The LL2-22 entries should be re-checked by a reader with no connection to the chapter.
1.6 Where to find the detail#
Everything in this document can be traced to a set of supporting working files (working/late-lessons/): notes (full readings and audit logs), digests, hindsight checks, the ten themes, the two external files and the reviews of this document. Appendix B indexes them. Where this document condenses, the theme files carry the full evidence tables.
2. The two reports at a glance#
2.1 What kind of documents they are#
- Agency reports, not EU policy. The EEA gives information and advice; it does not legislate or regulate. LL1 says its contents do not necessarily reflect the Commission’s views (LL1, p. 2). Both reports fit the Agency’s mandate to “stimulate the development and application of environmental forecasting techniques” and methods for costing environmental damage and prevention (Regulation (EC) No 401/2009, Art. 2(i)–(j); context §1.1).
- Edited collections of case histories, tied together by editorial synthesis chapters (LL1 Chapters 16–17; LL2 Chapters 27 and 28).
- Written largely by participants. Authors “would not have been approached if they had not already extensively studied the case” (LL2-00, pp. 9–10; LL1-00, p. 12). LL1 names Joe Farman, who discovered the Antarctic ozone losses, and Peter Infante, who ran the first benzene cohort study (LL1-00, p. 12). LL2’s authors include Herbert Needleman on lead, David Michaels (who headed OSHA when the report was published, but wrote the chapter from the George Washington University faculty in a personal capacity; LL2-06, fn 1, p. 131) on beryllium and Lennart Hardell on his own mobile-phone studies.
- Openly argued. LL2’s Preface opens “There is something profoundly wrong with the way we are living today” and puts “the relationship between knowledge and power” at the centre (LL2-00, pp. 6–7). The reports are best read as peer-reviewed arguments from history by a network rooted in precaution, science and technology studies and occupational health, not as systematic reviews (context §0).
2.2 The 2001 volume (LL1)#
Late lessons from early warnings: the precautionary principle 1896–2000. Copyright 2001; EEA web date 9 January 2002; trade edition by Earthscan (2002).
- Origin. Initiated by David Gee, EEA staff member on emerging issues and a former Director of Friends of the Earth (LL1, p. 5; context §1.2).
- Editorial team. Poul Harremoës (chair), David Gee, Malcolm MacGarvin, Andy Stirling, Jane Keys, Brian Wynne and Sofia Guedes Vaz. The lessons were “distilled” by the editorial team “under the guidance of the EEA Scientific Committee” (LL1-00, p. 3). Four of the seven editors also wrote case chapters (fisheries, asbestos, PCBs, MTBE).
- Method. Fourteen “well-known” hazards “where sufficient is now known”, arranged by date of first warning. Each author answered four questions: when was the first credible scientific warning; what was done or not done; who bore which costs and benefits; what are the lessons (LL1-00, p. 11). Authors were to judge by “the spirit of the times”, not “the luxury of hindsight” (p. 11).
- An acknowledged gap. Every case is a false negative. Industry was invited to propose false positives, but “no suitable examples emerged” (LL1-00, pp. 12–13).
- Framing. The initial framing came from Stirling’s EU-funded ESTO project on technological risk (LL1-16, p. 168). The editors call the lessons “illustrative, rather than definitive” (p. 169).
- Stated purposes. Better “transatlantic agreement” on precaution (LL1-00, p. 3) and response to low public trust after BSE (p. 16).
- Structure. Preface and Chapter 1 (definitions, John Snow’s pump handle as “precautionary prevention”, Table 1.2’s range of legal formulations); fourteen case chapters; Chapter 16 (the twelve lessons, plus sections on science, innovation and governance that go “beyond” the cases, p. 169); Chapter 17 (conclusions and Table 17.1).
2.3 The 2013 volume (LL2)#
Late lessons from early warnings: science, precaution, innovation. EEA Report No 1/2013, published 22 January 2013 (doi:10.2800/73322).
- Why a second volume. More cases; an analysis of false positives, “an acknowledged gap”; emerging technologies; and the use of precaution for fast-changing, systemic challenges and “sustainable innovations” (LL2-00, p. 9).
- Process. Topics chosen with advice from the editor, editorial team, advisory board, Scientific Committee and the Collegium Ramazzini (p. 9). Authors had “seven structuring questions”, which are not printed (p. 10). Reviewers are not named (p. 5).
- People. Editor David Gee; editorial team including Philippe Grandjean, Steffen Foss Hansen, Sybille van den Hove, Malcolm MacGarvin and David Quist; advisory board including Silvio Funtowicz, Jerome Ravetz and Joan Martinez Alier. Preface by Executive Director Jacqueline McGlade.
- Structure. Chapter 2 on false alarms; Part A, nine historical false negatives (lead, PCE, Minamata, beryllium, second-hand smoke, vinyl chloride, DBCP, BPA, DDT); Part B, six cases on degrading natural systems, feedback loops and systemic change (booster biocides, ethinyl oestradiol, climate, floods, neonicotinoids, ecosystems); Part C, five emerging issues (nuclear, GM crops and agroecology, invasive species, mobile phones, nanotechnology); Part D (costs of inaction, early warners and victims, business); Part E (science, precaution, conclusions); Annex 2 (summary of LL1) and Annex 3 (updates of nine LL1 cases).
- Stance. More certain and more accusatory than 2001. It keeps the twelve lessons unchanged as “highly pertinent” (LL2-00, pp. 9, 11), adds a working definition of the precautionary principle and new analytical tools, and moves from regulating hazards towards governing the direction of innovation.
- File note. The widely circulated “(05-2013)” file contains both Annex 2 (pp. 701–716) and Annex 3 (pp. 717–737); its contents page lists back matter 30 pages too high (notes LL2-00). Some copies lack Annex 3. Cite the version used.
2.4 The sections#
| Id | Chapter and subject | Pages |
|---|---|---|
| LL1-00 | Preface, Ch 1 Introduction | 1–16 |
| LL1-02 | Fisheries (MacGarvin) | 17–30 |
| LL1-03 | Radiation (Lambert) | 31–37 |
| LL1-04 | Benzene (Infante) | 38–51 |
| LL1-05 | Asbestos (Gee, Greenberg) | 52–63 |
| LL1-06 | PCBs (Koppe, Keys) | 64–75 |
| LL1-07 | Halocarbons and ozone (Farman) | 76–83 |
| LL1-08 | DES (Ibarreta, Swan) | 84–92 |
| LL1-09 | Antimicrobial growth promoters (Edqvist, Pedersen) | 93–100 |
| LL1-10 | Sulphur dioxide and acid rain (Semb) | 101–109 |
| LL1-11 | MTBE (Krayer von Krauss, Harremoës) | 110–125 |
| LL1-12 | Great Lakes contamination (Gilbertson) | 126–134 |
| LL1-13 | TBT antifoulants (Santillo, Johnston, Langston) | 135–148 |
| LL1-14 | Hormones as growth promoters (Bridges, Bridges) | 149–156 |
| LL1-15 | BSE (van Zwanenberg, Millstone) | 157–167 |
| LL1-16 | Twelve late lessons (editorial team) | 168–191 |
| LL1-17 | Conclusions (unsigned) | 192–194 |
| LL2-00 | Preface, Introduction, Part A intro | 1–16 |
| LL2-02 | False alarms (Hansen, Tickner) | 17–45 |
| LL2-03 | Leaded petrol (Needleman, Gee) | 46–75 |
| LL2-04 | PCE in water mains (Ozonoff) | 76–91 |
| LL2-05 | Minamata disease (Yorifuji, Tsuda, Harada) | 92–130 |
| LL2-06 | Beryllium (Michaels, Monforton; panel by Guidotti) | 131–150 |
| LL2-07 | Tobacco industry and second-hand smoke (Bero) | 151–178 |
| LL2-08 | Vinyl chloride (Soffritti et al.) | 179–202 |
| LL2-09 | DBCP and male infertility (Bingham, Monforton) | 203–214 |
| LL2-10 | Bisphenol A (Gies, Soto) | 215–239 |
| LL2-11 | DDT (Bouwman et al.) | 240–260 |
| LL2-12 | Booster biocide antifoulants (Price, Readman) | 261–278 |
| LL2-13 | Ethinyl oestradiol in water (Jobling, Owen) | 279–307 |
| LL2-14 | Climate change (Grassl, Metz) | 308–346 |
| LL2-15 | Floods (Kundzewicz) | 347–368 |
| LL2-16 | Neonicotinoid seed dressings and bees (Maxim, van der Sluijs; Bayer panel) | 369–406 |
| LL2-17 | Ecosystems and fisheries (McGlade, van den Hove) | 407–428 |
| LL2-18 | Chernobyl and Fukushima (Dorfman, Fucic, Thomas) | 429–457 |
| LL2-19 | GM crops and agroecology (Quist et al.) | 458–485 |
| LL2-20 | Invasive alien species (Brunel et al.) | 486–508 |
| LL2-21 | Mobile phones and brain tumours (Hardell, Carlberg, Gee) | 509–529 |
| LL2-22 | Nanotechnology (Hansen, Maynard, Baun, Tickner, Bowman) | 530–560 |
| LL2-23 | Costs of inaction (Andersen, Clubb) | 561–580 |
| LL2-24 | Early warners and late victims (Cranor) | 581–606 |
| LL2-25 | Why business did not act (Le Menestrel, Rode) | 607–620 |
| LL2-26 | Science for precautionary decisions (Grandjean) | 621–642 |
| LL2-27 | More or less precaution? (Gee) | 643–669 |
| LL2-28 | In conclusion (unsigned) | 670–684 |
| LL2-A2 | Annex 2: overview of LL1 | 701–716 |
| LL2-A3 | Annex 3: updates of nine LL1 cases | 717–737 |
2.5 How the two volumes differ#
| LL1 (2001) | LL2 (2013) | |
|---|---|---|
| Frame | “the precautionary principle 1896–2000” | “science, precaution, innovation”; knowledge and power (LL2-00, p. 7) |
| Cases | 14 historical false negatives | 20 new cases plus a false-positive review; “34 case studies” across both (LL2-27, p. 644) |
| Author brief | 4 questions (p. 11) | 7 unprinted structuring questions (p. 10) |
| Synthesis | 12 lessons; Table 17.1 | Same 12 lessons; working definition; evidence scale; criteria for action; barriers; “harm expansion”; innovation governance |
| Knowledge states | Risk, uncertainty, ignorance | Adds ambiguity, variability, indeterminacy; “knowledge-to-ignorance ratio” (LL2-27, pp. 654–656) |
| Explanation of delay | Information not delivered or discounted; interests in “some” cases (LL1-16, p. 168) | Seven barriers; “product defence”; harms “for the most part” from “irresponsible corporations” (LL2-00, p. 11) |
| Tone | Hedged (“seems”, “can help”) | More certain; some 2001 hedges dropped |
| Peer review | Reviewers named | Reviewers unnamed |
2.6 Intellectual lineage and afterlife#
- Risk, uncertainty and ignorance. From Wynne (1992) and Stirling’s ESTO work (1999). The Commission’s 2000 Communication on precaution drew on the same ESTO project but reached narrower conclusions (context §2.1, §2.7).
- Where LL1 departs from the Commission’s Communication: participation should begin at framing, not in “risk management” (LL1-16, p. 186); precaution extends to ignorance, not only data gaps; scientific uncertainty is not a private matter for scientific bodies (pp. 185–186); the level of proof is “a key political decision” (LL1-17, p. 193); precaution includes stimulating innovation (context §2.7).
- Other traditions. Post-normal science (mainly via LL2’s advisory board and Ch 19); constructive technology assessment and alternatives assessment; Bradford Hill; the “manufactured doubt” literature; responsible research and innovation (LL2-27, Box 27.5).
- Not cited. Neither report cites Collingridge, though both analyse his dilemma through “lock-in” (LL1-16, pp. 186–187; LL2-28, p. 672). The EEA’s SOER 2020 makes the link explicit (context §2.3).
- Afterlife. The European Parliament’s research service (2015) used the reports as its opening evidence and reproduced the “4 of 88” false-positive result without re-testing it (context §3.1; critiques §5.3; hindsight LL2-00). SOER 2020 and Drivers of change (2019) carry the framing of early warnings, lock-in and precaution under ignorance; both are the EEA’s own restatements, not independent uptake. No third volume was found, and no court judgment citing either report was verified (context §1.5, §3).
- Counter-frame. An industry-promoted “innovation principle”, launched by chief executives through the European Risk Forum in October 2013, entered Council conclusions (2016) and the Horizon Europe Regulation (2021), which does not mention precaution (critiques §7).
2.7 Panels and internal dissent#
LL2 prints short panels beside many chapters. Most complement their chapter; a few are the volume’s main internal counterweights. LL1 has no panels. LL2’s panel list (p. 16) omits four commentaries, including Guidotti’s and Castaño’s (digest LL2-00).
| Chapter | Panel (author and standpoint) | Argument | Complicates the chapter? | Hindsight |
|---|---|---|---|---|
| LL2-16 | Panel 16.1, Bayer CropScience (Schmuck, co-author of the disputed studies), pp. 401–402; authors’ reply pp. 403–406 | Colony losses are multifactorial; large-scale monitoring in several countries found no correlation with seed dressings; suspensions risk “stopping innovation” | Yes: the only company voice in LL2. The reply does not engage the monitoring studies (pp. 404–405) | Multifactorial framing held up, as did the narrower claim that honeybee colonies often show no measurable field harm; “no correlation” undermined at national scale in England and Wales (hindsight LL2-16, Claim 9) |
| LL2-05 | Castaño (biomonitoring scientist), p. 130; Grandjean (Faroes principal investigator, declared interest), pp. 121–124 | Castaño calls low-dose harm “assumed” and asks for robust data first, while supporting exposure reduction; Grandjean wants lower limits and faster action | Yes: the two read the same exposure data through different thresholds | Harmonised measurement narrowed the factual dispute but not the normative one (hindsight LL2-05, lesson 8) |
| LL2-05 | Selin, pp. 125–129 | Dominant framings outlive warnings; policy must be adaptive and cross-risk | Extends it | Not separately checked |
| LL2-06 | Guidotti, pp. 145–150 | Reads the producer’s conduct as “cognitive dissonance and denial rather than cupidity”; firms need “room … to turn around”; audit industry science rather than discount it | Yes: the main counter-reading of motive in Part A (though not a company voice) | Partly vindicated: the producer co-drafted the tighter 2017 US limit with the steelworkers’ union (hindsight LL2-06) |
| LL2-14 | Panel 14.1 (MacGarvin), pp. 332–335 | Expert groups systematically under-estimated structural uncertainty (p. 333) | Yes: the main text says uncertainty is resolved (p. 337) | The panel’s caution is supported over the main text: observed warming in 2023–25 ran above the assessed human-induced level, partly through weaker aerosol cooling (hindsight LL2-14) |
| LL2-17 | Panel 17.2 (EU fisheries), pp. 421–422 | Scientific advice should be a “fixed boundary condition” (p. 422) | Yes: the main text criticises science’s entrenched authority | EU catch limits still set above advice (hindsight LL2-17) |
| LL2-03 | Kovarik (alcohol fuel), Haigh (EU), von Storch et al. (Germany), Millstone (UK) | Show that phase-out depended on catalytic converters, chance alignment with forest concerns and electoral timing (Haigh, p. 63) | Yes: they “draw out” contingency the chapter’s lessons omit (digest LL2-03) | Alcohol alternative oversold (hindsight LL2-03) |
| LL2-08 | Panel 8.2 (Huff, NIEHS, a defender of animal bioassays), pp. 194–196 | Rodent bioassays predict human carcinogens and target organs “without a doubt” | Presents contested claims without the counter-view | Contested; weakened as a policy stance (hindsight LL2-08, Claim 6) |
| LL2-04 | Rudén (Panel 4.1), pp. 84–85; Onasch (Panel 4.2), p. 87 | 29 TCE assessments reach four conclusion types; substitution saves money | Rudén supports; Onasch’s economics rest on one shop over 12 months studied by the panel author | Assessors still diverge (hindsight LL2-04) |
| LL2-07 | Panel 7.1 (Smith, Gilmore, Fooks), pp. 164–165 | Tobacco lobbying to change EU risk-assessment rules | Complementary, not a dissent | Not separately checked |
| LL2-15 | Three panels | Complement the chapter; Panel 15.3 calls superlevees “unbreachable” (p. 364) | Panel 15.3 sits uneasily with the chapter’s “living with floods” lesson | — |
| LL2-24 | Three panels, including 24.2 (UK asbestos law) and 24.3 (Deepwater Horizon bond counterfactual) | Supportive | No | Deepwater Horizon is a weak test of the cap argument (hindsight LL2-24) |
Analysis. Only one panel in either volume comes from a party whose conduct is at issue (Bayer), and it proved partly right. The internal dissents that matter most (Guidotti, Castaño, Panel 14.1, Panel 17.2) are scientific or interpretive, not commercial, and the chapters rarely engage them.
3. What the reports themselves conclude#
3.1 The 2001 diagnosis#
Reports say (LL1-16, p. 168; LL1-00, pp. 3–4): - The gap between warning and effective action was “many years or decades, and in some cases over a century”. - Unequivocal precautionary action stayed “relatively scarce” even after the principle was articulated. - In “many” cases adequate information existed but was not brought to decision-makers in time, or was discounted. In “some” cases (asbestos, PCBs, the Great Lakes, sulphur dioxide) warnings were ignored because of “short-term economic and political interactions”. - Acceptance of precaution varies between institutions on both sides of the Atlantic, not between continents. - The Preface adds three claims: misplaced “certainty” about the absence of harm delayed action in “most” cases; the costs of prevention are tangible, allocated and short-term while those of inaction are diffuse and long-term; and lack of political will “seems to be an even more important factor” than trusted information (LL1-00, pp. 3–4). - Costs and benefits could not be assessed systematically; a general analysis “lay beyond the scope” of the report (LL1-16, p. 168).
Evidence and hindsight. - The long gaps hold for the confirmed-hazard cases, and several ran well past 2001: the US banned chrysotile in 2024, 126 years after the 1898 warning (hindsight LL1-00, LL1-16). - The transatlantic pattern is supported: a random-sample comparison of 100 risks found no significant average US–EU difference in relative precaution over 1970–2004, with “a modest shift toward greater relative precaution of European regulation since about 1990” and “a diversity of trends across risks” (Hammitt et al. 2005; hindsight LL1-00, LL1-17). - The “information discounted for economic reasons” strand was strengthened by documents disclosed in litigation, for PCBs and persistent chemicals generally. The BSE inquiry, however, rejected producer bias in the agriculture ministry’s policy decisions (hindsight LL1-16, Claim 3). - “Political will over information” was never tested comparatively. Later evidence suggests the two interact: countries ban asbestos once mesothelioma appears in their own data (odds of a ban 14.1 times higher; hindsight LL1-00).
Rating. Long gaps for confirmed hazards: strong. The frequency words (“most”, “many”): moderate, uncounted. Political will ranked above information: suggestive as a ranking.
3.2 The twelve lessons#
The wording is as reprinted in LL2 (LL2-00, p. 11), which matches LL1-16 (pp. 168–169) and LL1-17 (pp. 193–194). The editors call them “illustrative, rather than definitive” (LL1-16, p. 169). The reports give two accounts of how the lessons were derived. Chapter 16 says Stirling’s ESTO project “provided the initial framing”, helped in organising the lessons, and gave “an opportunity to test or elaborate” ESTO’s points against the case material (LL1-16, p. 168). The Preface says the case authors’ own lessons “were then distilled into twelve ‘late lessons’ by the editorial team, under the guidance of the EEA Scientific Committee” (LL1-00, p. 3). Analysis: no coding method or counter-case search is reported (notes LL1-16), so in practice the cases work more as illustration than as a test, whatever the stated intention.
| # | Lesson | 2001 cases named (LL1-16) | Main complications | Rating |
|---|---|---|---|---|
| 1 | “Acknowledge and respond to ignorance, as well as uncertainty and risk, in technology appraisal and public policymaking.” | ~9 | Genuinely unforeseeable harms; Great Lakes retrospective | Strong (concept); moderate (as cause of failures) |
| 2 | “Provide adequate long-term environmental and health monitoring and research into early warnings.” | ~8 | Research can compound uncertainty | Strong |
| 3 | “Identify and work to reduce ‘blind spots’ and gaps in scientific knowledge.” | ~8 | Blind-spot list compiled with hindsight | Strong |
| 4 | “Identify and reduce interdisciplinary obstacles to learning.” | 7 | Silos persisted by 2013 on the reports’ own verdict | Moderate |
| 5 | “Ensure that real world conditions are adequately accounted for in regulatory appraisal.” | ~10 | — | Strong |
| 6 | “Systematically scrutinise the claimed justifications and benefits alongside the potential risks.” | ~9 named, 2 carry the weight | Rarely applied to preferred alternatives | Moderate |
| 7 | “Evaluate a range of alternative options for meeting needs alongside the option under appraisal, and promote more robust, diverse and adaptable technologies so as to minimise the costs of surprises and maximise the benefits of innovation.” | 5–6 | Regrettable substitution; DDT withdrawn before substitute proven | Moderate (alternatives); suggestive (diversity) |
| 8 | “Ensure use of ‘lay’ and local knowledge, as well as relevant specialist expertise in the appraisal.” | 5–6 | “Pensioners’ party” fallacy; positional fishers; lay alarms that proved wrong | Moderate |
| 9 | “Take full account of the assumptions and values of different social groups.” | 3–4, selected | Public intuition credited only where it proved right | Suggestive (epistemic); moderate (legitimacy) |
| 10 | “Maintain the regulatory independence of interested parties while retaining an inclusive approach to information and opinion gathering.” | ~9, hedged | BSE inquiry; independent assessors also diverge | Strong (as a structural weakness) |
| 11 | “Identify and reduce institutional obstacles to learning and action.” | ~8 | Illustrated, not analysed | Moderate |
| 12 | “Avoid ‘paralysis by analysis’ by acting to reduce potential harm when there are reasonable grounds for concern.” | ~5 | Hormones; trigger undefined; warnings later weakened | Moderate (mechanism); asserted (as a rule) |
Brief notes on each, drawn from T10:
- Ignorance. Every case had some risk assessment; what was neglected was the “virtual certainty” that some factors lay outside its scope (LL1-16, p. 169). Where harm cannot be predicted, properties can stand in: novelty, persistence, dispersal, irreversibility, global scale with “only one ‘experimental’ model” (pp. 170–171). The editors separate institutional ignorance (knowledge exists in society but not at the point of decision; “most” cases) from societal ignorance (nobody knows; “many” cases) (p. 171). Property screening was later institutionalised (Stockholm Convention listings rising from 12 to 37; EU persistent-mobile hazard classes in 2023). Critics note that mesothelioma, ozone loss and DES cancers were unforeseeable at deployment, so the stronger charge is slow response once evidence appeared (critiques §4).
- Monitoring. Asbestos, benzene and PCBs had no systematic monitoring; BSE reassurance cited absence of evidence “when no evidence was actually being sought” (LL1-16, p. 172). EU active BSE testing from 2001 later found about 7,000 cases among about 50 million cattle; atmospheric monitoring caught illegal CFC-11 production after 2012 (hindsight LL1-16, LL1-17). The editors concede that research can “compound uncertainty” (pp. 172–173).
- Blind spots. Blind spots sit inside the discipline that owns the problem (LL1-16, pp. 173–174). LL2 lists nine initial assumptions later shown wrong, among them “safe” doses, the adult male as reference subject, acute effects standing for chronic ones, protective barriers and monotonic dose-response (LL2-26, Table 26.3, p. 630). Since 2001, the endpoints that drove action on BPA and PFAS (immune effects) lay outside earlier appraisals (hindsight LL1-17).
- Interdisciplinary obstacles. The discipline that sees effects first can hold appraisal “captive”: clinicians’ acute focus, engine and air expertise for MTBE, veterinary framing for BSE (LL1-16, p. 174). In 2013 the editors reported that silos had not gone (LL2-28, p. 670).
- Real-world conditions. Tanks leaked, “closed systems” leaked and were dumped, controls went unenforced (LL1-16, pp. 174–175), and doses for the same examination still varied up to a hundredfold between hospitals (LL1-16, p. 175; “more than an order of magnitude” in LL1-03, p. 35). The WTO accepted that “controlled use” of asbestos could not be relied on (LL1-05, p. 57). The widest case support of any lesson; lens entry K9 carries it forward.
- Benefits. DES was prescribed for two decades after a 1953 trial showed it did not work (LL1-08, p. 86); the US efficacy review still rated it “possibly effective” in 1971 (hindsight LL1-08). LL2 adds that acceptable risk belongs to a use and its beneficiaries, not to a substance (LL2-04, pp. 80, 83).
- Alternatives and diversity. Once committed, a technology is reinforced “even if markedly inferior” (LL1-16, p. 177); surprises are smaller with several technologies than with one “near monopoly” (p. 187). Alternatives assessment was later institutionalised; diversity as insurance was never tested (hindsight LL1-17).
- Lay knowledge. Workers, residents, fishers, farmers and slaughterhouse workers often knew first (LL1-16, pp. 177–178), but lay knowledge needs the same scrutiny and has its own fallacies (p. 178).
- Values. Public intuitions “may sometimes prove quite robust” (LL1-16, p. 178). The examples were chosen because intuition proved right; public rejection of irradiated foods, and the response to GMOs, appear only as illustrations of the “costs of failure” of traditional approaches (p. 188).
- Independence. Appraisal “frequently fails” because it depends on information “produced and owned” by the parties being assessed (LL1-16, p. 179). The editors hedge: not all cases show this distorting effect (p. 179). EU law later accepted the diagnosis but kept applicant-generated data, adding pre-notification and verification (Regulation 2019/1381; Blaise, 2019).
- Institutional obstacles. Short cycles, changes of government, friction between departments, agencies defending past decisions (LL1-16, pp. 180–181). In 2013 the editors named this the lesson with “less progress” (LL2-28, p. 670).
- Paralysis by analysis. The editors acknowledge the tension with “know more” (LL1-16, p. 181) and say that whether a need for more information risks “paralysis by analysis” or is part of a “prudent and careful evaluation” will be influenced by each individual’s, social group’s or interest group’s assessment of the pros and cons as they fall on it (p. 182). The trigger (“reasonable grounds for concern”) is undefined in both volumes.
Analysis. Six lessons rest on several cases and have been strengthened since: absence of search is not absence of harm; real-world conditions depart from assumed ones; blind spots sit inside the owning discipline; dependence on the regulated party’s evidence; monitoring; and evidence thresholds as choices about who bears error. The claims about innovation, diversity, public intuition and trust are thinly evidenced. The lessons work best as a checklist of failure modes, not as findings.
3.3 The 2001 conclusions (LL1-17, pp. 192–194)#
Reports say. - Regulation balances the costs of being too restrictive against being too permissive; some harms from inaction “could not have been” foreseen (p. 192). - Three recurring failures: warnings ignored, including “loud and late” ones; appraisal too narrow; actions taken without weighing alternatives or real-world implementation (p. 192). - Precaution is “an overarching framework of thinking that governs the use of foresight” under uncertainty and ignorance (p. 192). - Table 17.1 pairs risk with prevention, uncertainty with “precautionary prevention” and ignorance with “precaution”. Its precaution row does not depend on knowing the specific harm: screen on persistence and bioaccumulation, cast the information net wide, monitor over the long term, and favour diverse, adaptable technologies with fewer “monopolies” (p. 192). - The level of proof is “a key political decision with profound ethical implications”. It shifts “the size, nature and distribution of the costs of being wrong”, and should depend on the harm, the claimed benefits, the alternatives and the costs of error “in both directions” (p. 193). - Most lessons improve information; none removes the dilemma, but they “would at least increase the chances” of anticipating harm (p. 194). Precaution “can also” stimulate innovation; over-precaution “can also be expensive”. Balancing innovation and hazard is “ultimately a matter of political discourse” (p. 194).
Evidence and hindsight. The diagnosis held and was strengthened by cases the EEA did not select (PFAS toxicity known internally by 1970; BPA and PFAS endpoints outside earlier appraisals; CFCs to HFCs). The level-of-proof claim was strengthened as analysis: in Pfizer v Council (2002) the court held that a scientific committee has “neither democratic legitimacy nor political responsibilities”. Property screening and monitoring strengthened as policy. The innovation claim is contested; the twelve lessons “as a package” are untested because no institution adopted them as one (hindsight LL1-17).
Analysis. Chapter 17 drops or upgrades Chapter 16’s caveats. “Illustrative, rather than definitive” (LL1-16, p. 169) becomes cases that “both support and illustrate” the lessons (LL1-17, p. 193); appraisal scaled to the stakes and no over-reliance on one set of prescriptions (LL1-16, pp. 169, 183) disappear, as does the lowest rung of the evidence ladder, “scientific suspicion of risk” (p. 184). It does not use the report’s own hormones chapter, which calls the EU hormone ban “in reality, a political risk assessment” with “no good evidence” of health protection (LL1-14, pp. 153–154).
3.4 What the 2013 volume added#
- Preface and Introduction (LL2-00). The knowledge–power thesis (p. 7); three themes from the nine Part A cases: “more than sufficient evidence for much earlier action”, “slow and sometimes obstructive behaviour by businesses”, and the value of independent science (p. 10); four reasons for delay: novelty, poorly evaluated information, opposition by “corporate and scientific establishments”, and status-quo institutions (pp. 10–11); harms “for the most part” caused by “irresponsible corporations” (p. 11); false positives “few and far between” (p. 10).
- False alarms (LL2-02). Of 88 alleged regulatory false positives, four genuine: swine-flu immunisation (1976), saccharin labelling, Southern corn leaf blight and food irradiation (p. 25). About a third were real risks and about a third “the jury is still out” (pp. 20–21). Seven lessons (pp. 34–35; listed in the table below). See section 5.2.
- Science (LL2-26, Grandjean). Research concentrates on well-studied substances; standard design tilts towards false negatives (Table 26.4: ten features against three, p. 635); ask “how large an effect can the study have overlooked?” and treat the upper confidence limit as a plausible worst case (pp. 633–635); a research ethos called PATIO; “science does not have a good track record” (p. 640), although a footnote concedes political will may matter more (p. 624).
- Precaution (LL2-27, Gee). Two roles for the principle: justifying earlier action, and triggering debate about innovation pathways (p. 644). Seven barriers (p. 645). An EEA working definition: the principle “provides justification for public policy and other actions in situations of scientific complexity, uncertainty and ignorance”, “using an appropriate strength of scientific evidence, and taking into account the pros and cons of action and inaction and their distribution” (p. 649). Bradford Hill’s features reappraised for multicausality (pp. 651–654); twelve “criteria for action” (Box 27.4, p. 653); a strength-of-evidence scale with probability bands (Table 27.2, p. 658); a participatory risk-analysis cycle (Fig. 27.2, p. 660); “not established” judgements seldom say who bears the error, “risk takers or risk makers” (p. 658).
- Conclusions (LL2-28). Four shared features: decisions “made by a few people on behalf of many”, no mechanisms to respond to warnings, misleading prices, poor accounting across types of capital (p. 671). Three drivers of delay: what this document calls the moving-target problem (by the time evidence of harm is confirmed “the technology has often changed”, leading to assumptions that “today’s technology is now safe”), sunk-investment lock-in, and scale that overwhelms monitoring (p. 672). “Harm expansion”: confirmed hazards prove harmful in more ways and at lower doses (p. 672). Under irreversibility, tip policy “towards avoiding harm, even at the cost of more false alarms” (p. 673). Unequal power is “well beyond the scope of this report” (p. 672). Everything proposed remains “good intentions” until institutionalised (p. 680).
- Annexes. Annex 2’s Table A2.1 gives “years of substantial inaction” per LL1 case: asbestos 101, PCBs about 100, benzene 81, radiation 65, down to BSE 10–17 and TBT 5–30 (p. 702). Annex 3’s editors state that harm “expands over time”, often at exposures previously considered “safe” (p. 717).
The reports’ synthesis tools, listed. Several instruments are referred to by name elsewhere in this document; their contents are:
| Tool | Where | Contents | Comment |
|---|---|---|---|
| Seven barriers to wider use of precaution | LL2-27, p. 645 | (1) opposition from powerful corporations, “supported by some scientists, policymakers and politicians”; (2) misunderstandings of the principle’s definition; (3) complex systems with multicausality, uncertainty, ignorance and surprise; (4) tension between the high strength of evidence for causality and the lower strength needed for timely policy; (5) inadequate analysis of the costs and benefits of action and inaction, and “unrealistic market prices for hazardous agents”; (6) “political and financial short-termism”; (7) “a failure in most cases” to engage civil society and the public | The chapter groups 1, 6 and 7 as “political and economic power” and 2–5 as technical, while saying they cannot be cleanly separated (notes LL2-27) |
| Twelve criteria for precautionary action (Box 27.4) | LL2-27, p. 653 | Intrinsic toxicity or ecotoxicity; novelty (a low knowledge-to-ignorance ratio); persistence; bioaccumulation; large spatial range; seriousness; irreversibility; analogy with known hazards; inequitable distribution across regions, people and generations; feasible alternatives; potential for stimulating innovation; potential and timescales for future learning | Unweighted, with no decision rule. Mixes evidence about hazard with policy considerations (alternatives, innovation), though the box is titled as evidence. “Novelty” invites a presumption against the new; the chapter’s answer (act on “credible early warnings”, p. 655) is not built into the box. No criteria for lifting a measure (notes LL2-27). Lens entry K7 draws on it |
| Strength-of-evidence scale (Table 27.2) | LL2-27, p. 658 | Very strong (90–99%): “beyond all reasonable doubt”, including the Swedish 1973 chemicals law for manufacturers’ evidence of safety. Strong (65–90%): “reasonably certain”; “sufficient scientific evidence” (WTO SPS Art. 2). Moderate (33–65%): “balance of evidence” (IPCC); “balance of probabilities”; “reasonable grounds for concern” (Commission 2000). Weak (10–33%): “scientific suspicion of risk” (the same Swedish law, for regulators to act); “available pertinent information” (WTO SPS Art. 5.7). Very weak (1–10%): “low risk”; “negligible and insignificant” | Titled “some examples and illustrations”; bands adapted from the IPCC’s 2001 scale. It describes existing regimes rather than setting an EEA threshold. The Swedish law at both ends shows that burden and standard of proof can be split between parties (notes LL2-27) |
| Ladder of proof (Table 16.1) | LL1-16, p. 184 | Four rungs: “beyond all reasonable doubt”; “balance of evidence”; “reasonable grounds for concern”; “scientific suspicion of risk” | The 2013 bands are its quantified successor |
| Three “opportunities” | LL2-28, pp. 671–672 | Correct the priority given to economic and financial capital over social, human and natural capital (precaution, prevention, polluter pays, better accounting); broaden the nature of evidence and public engagement in choices about innovation pathways; build adaptability and resilience in governance | Programmatic |
| Six findings | LL2-28, pp. 672–680 | Reduce delays between early warnings and actions; acknowledge complexity when dealing with multiple effects and thresholds; rethink and enrich environment and health research; improve the quality and value of risk assessments; foster cooperation between business, government and citizens; correct market failures using the polluter-pays and prevention principles | Each mixes findings with recommendations; section 3.4 above summarises the first |
| Seven false-alarm lessons | LL2-02, pp. 34–35 | (1) be open about disagreement, not suggest consensus where there is none; (2) be transparent about what is known, unknown and uncertain, and keep alternatives open; (3) “the availability of options minimises the total impact of false positives”, so assess alternatives including no action; (4) take particular care when introducing a new substance or technology at large scale; (5) research should supplement risk-reducing measures, not be a regulatory measure in itself; (6) precautionary actions, necessary or not, can spur innovation; (7) be flexible, with re-evaluation built in | Analysis: the reports’ lesson set most attentive to the costs of precaution (lessons 3, 4 and 7) |
| PATIO research ethos (Table 26.5) | LL2-26, p. 638 | Participatory, accessible, transparent, inventive, open-minded; set against academic (CUDOS) and “industrial” research norms | A normative proposal, not tested |
3.5 How the lessons evolved#
| Dimension | 2001 | 2013 | Assessment |
|---|---|---|---|
| Frame | Regulatory failure and precaution | Knowledge, power and the governance of innovation | Widened |
| Lesson list | 12 lessons | Same 12, unchanged; six new “findings” (LL2-28) | Not revised in light of 2001–13 |
| Knowledge states | Risk, uncertainty, ignorance | Adds ambiguity, variability, indeterminacy | Closes the ambiguity gap; re-dates asbestos “risk” from 1965 to 1930 |
| Evidence thresholds | Verbal ladder (Table 16.1, p. 184) | Probability bands (Table 27.2, p. 658); criteria for action | More operational in form; trigger still unweighted |
| Causes of delay | Information failures; interests in “some” cases; “Not all” show distortion (LL1-16, p. 179) | Seven barriers; product defence; “irresponsible corporations” | More accusatory; hedges dropped |
| False positives | None found; “smaller” risk asserted (LL1-00, p. 16) | 4 of 88 | Gap addressed from within the same network; method contested |
| Innovation | “can help stimulate” (LL1-00, p. 4) | “increasing evidence” precaution does not stifle innovation (LL2-28, p. 670) | Stronger claim on similar evidence |
| Participation | Early, with caveats about capture and paralysis (LL1-16, p. 188) | Participatory cycle; public choice of pathways | Ambition up, caveats down |
Analysis. LL2 adds real tools: the working definition, the evidence scale, the ambiguity category, and the “risk takers or risk makers” question. It also expresses more certainty than its evidence had gained, and Chapter 28’s three most-cited statistics are fragile. One misreads its source (“half of all articles” is overstated about fourfold). One is unsourced and unverifiable, though a 1–2% share is plausible and its direction very likely right (the 1% research-funding figure, which conflicts with Chapter 27’s 3%). One has never been independently re-analysed and was restated without its caveats (“4 of 88”) (hindsight LL2-28; section 5). Some 2001 candour survived: the business chapter warns against blaming “with hindsight” (LL2-25, p. 616); Grandjean calls himself “part of the inertia” (LL2-26, p. 628); the Bayer panel is printed with the authors’ reply (LL2-16); Chapter 28 admits power is out of scope.
3.6 What the reports recommended, and what happened#
| Addressee | Main recommendations | Uptake to September 2026 (hindsight) |
|---|---|---|
| Regulators and governments | Separate assessment from sponsorship; graded, explicit, possibly asymmetric standards of proof; polluter pays; integrate health and environment (LL1-16, pp. 176–184; LL1-17, p. 193). Working definition; evidence scale; pollution taxes; natural-capital accounting; pre-funded no-fault compensation and liability bonds; protection for early warners; a place to analyse value conflicts (LL2-27, LL2-28, pp. 676–680) | Independent food agencies (UK FSA 2000; EFSA 2002); REACH reversed the burden (2006); Transparency Regulation (2019); Blaise (2019); graded hazard classes (2023); Whistleblower Directive (2019), covering breaches of law only. No-fault schemes and bonds: essentially no uptake. EU environmental-tax share fell about 17% relative to 2014. Physical ecosystem accounts adopted (2024) |
| Risk assessors | Characterise uncertainty and ignorance; account for real-world use; explain divergence; consider consequences as well as causation (LL2-27, p. 658; LL2-28, pp. 677–678) | EFSA uncertainty guidance (2018), with a carve-out for standardised assessments; divergence persisted (BPA, glyphosate, TiO2, aspartame) |
| Scientists and funders | Correct the bias against false negatives; long-term monitoring; research on emerging hazards; open, independent research; rebalance funding towards hazards (LL1-16, p. 184; LL2-26, p. 639; LL2-28, p. 679) | ASA statement on p-values (2016), but significance testing entrenched; European biomonitoring partnerships (HBM4EU, PARC); open access grew; the reports’ warning that transparency rules can be used to exclude studies (LL2-07, p. 163) was borne out in a US rule (2018–21, vacated) that its supporters presented as a transparency measure; no evidence protection got faster |
| Business | Separate business from political actions; transparency of lobbying; “room to turn around” (LL2-25, pp. 615–617; LL2-06, p. 150) | EU lobbying register (2021) and study pre-notification; reporting rules later narrowed (2026); industry counter-frame of an “innovation principle” |
| Public and civil society | Early, framing-stage participation; lay knowledge; citizen-science monitoring (LL1-16, pp. 186–188; LL2-28, p. 675) | Engagement widened mainly through transparency and legal standing (NGO internal-review rights 2021), not framing-stage participation; legitimacy gains conditional on outcomes |
Analysis (T10 P3; moderate). Uptake followed a gradient. Lessons that were cheap to adopt and asked least of existing producers and institutions (monitoring, uncertainty statements, transparency) went furthest. Lessons that would re-price risk or shift the burden of producing evidence (alternatives by default, polluter-pays tax shifts, pre-funded compensation, independent generation of data) moved least. Several explanations fit this pattern, and the working files do not separate them: resistance from incumbents; cost and administrative feasibility; thin evidence that the instruments themselves work (no-fault schemes and liability bonds have no track record; section 5.7); and public or political preference.
Changes since 2013 ran in both directions. They are better classified by whether they followed evidence than by their direction: - Protective measures weakened or removed. France abolished its health and environment alert commission in 2026; the Commission proposed in 2025 to make most pesticide approvals unlimited in time (hindsight LL1-16, LL2-24, LL2-16, LL2-28). In the US nanotechnology programme, the environmental, health and safety (EHS) share of agency funding fell from about 10% (2016) to about 4% (2020); the broader “responsible development” line, which includes EHS, was 2.3–2.4% in 2023–25 and 1.1% of the FY2026 request, within a total that itself fell from $2,122m (2025) to a requested $1,449m. The two series are not strictly comparable. The 2020 National Academies review judged that the programme “has performed exceptionally well” on responsible development and that EHS research “relieved some unfounded early concerns” (hindsight LL2-22; see the disclosure in section 1.5). - Measures relaxed after evidence-led, costed review. The UK’s Over Thirty Months rule was replaced by testing after a review put its cost at about £2bn per death prevented (hindsight LL1-15).
T09 notes that policy moving against the reports’ prescription “is not evidence against their diagnosis” (T09 §12.6). Equally, it is not evidence for it.
3.7 Tensions the reports acknowledge but do not resolve#
- Know more against don’t wait (LL1-16, p. 181). No rule for when enough is known; Box 27.4’s criteria are unweighted.
- Independence against inclusion (lessons 10 against 8–9).
- A ratchet. Lifting a restriction needs research that “genuinely reveals” a concern is unfounded (LL1-16, p. 173); keeping one needs only unresolved uncertainty (p. 181).
- Diagnosis against remedy. The Preface ranks political will above information (LL1-00, p. 4); the remedies are mostly informational (LL1-17, p. 194); LL2 names power and puts it out of scope (LL2-28, p. 672).
- Proportionality. Chapter 1’s account of the German Vorsorgeprinzip, as elaborated for the Clean Air Act, includes proportionality among its elements (LL1-00, p. 13); Chapter 17 sets “proportionate and precautionary” public policies against each other (LL1-17, p. 194).
- Uncertainty as a two-edged sword. Acknowledged, but every example of misuse given is uncertainty deployed against regulation (LL2-28, p. 675).
4. Cross-cutting analysis#
This section condenses the ten thematic syntheses (T01–T10). Each subsection names the layer it mainly belongs to, sets out the essential patterns with their evidence and strength, and records what hindsight and counter-evidence do to them. T10 (the canonical lessons) is covered in section 3, and T09 (false positives and limits) in section 5; sections 4.9 and 4.10 point to them.
Two standing caveats apply to every pattern below. Both reports select cases in which harm occurred, so the patterns show how things went wrong, not how often. And most case chapters were written by participants, which is a strength for detail and a weakness for balance (section 5.1).
4.1 Knowledge, uncertainty, ignorance and surprise (epistemic layer; T01)#
In brief. The reports’ most distinctive conceptual move is to insist that “uncertainty” hides different states of knowledge that need different responses. Their best-evidenced epistemic finding, however, is not about genuine ignorance. It is about knowledge that existed but was not generated, assembled or admitted. In nearly every case the longest delay came after a credible signal.
The typology. Risk (outcomes and probabilities known), uncertainty (no sound basis for probabilities) and ignorance (some outcomes unknown; “a continual prospect of surprise”) (LL1-16, Box 16.1, p. 170; LL1-17, Table 17.1, p. 192). LL2 adds ambiguity (answered by “participatory precaution”), variability and indeterminacy (LL2-27, Table 27.1, p. 656), and a qualitative “knowledge-to-ignorance ratio” (pp. 654–655). Strong as a concept; taken up in scholarship and advisory guidance, not in law, and its most influential successor (Stirling’s four-way scheme) adds ambiguity (hindsight LL1-17). LL2 offers the knowledge-to-ignorance ratio to decide where precautionary measures and novel research are most needed (p. 655), not as a forecast of harm. Used as a trigger (novelty is criterion 2 of Box 27.4), a low ratio proved a weak signal of eventual harm: nanotechnology, GM food and mobile phones, all grouped as low-ratio fields (p. 655), later diverged in outcome (hindsight LL2-27). Analysis: assign knowledge states to sub-questions, not whole technologies, and split the editors’ “institutional ignorance” into two: knowledge not assembled (remedy: channels and duties to consult) and knowledge delivered but discounted (remedy: standards, independence, accountability).
| Pattern | Key evidence | Rating | Hindsight |
|---|---|---|---|
| “No evidence of harm” is produced by the search (not looking, low power, short follow-up, detection limits, narrow endpoints) | BSE reassurance cited absence of evidence “when no evidence was actually being sought” (LL1-16, p. 172; LL1-15, pp. 163–164); asbestos lung-cancer excess clear only after 25 years (LL1-05, p. 55); no DBCP studies below 5 ppm (LL2-09, p. 205); “the greatest error” (LL2-26, p. 631); monitoring would miss a halving of most whale stocks (p. 634); 14+ cases | Strong | Strengthened: EU active BSE testing found hidden disease; ASA 2016 on significance. Counterpart: well-powered independent nulls followed long enough can cap risk (mobile phones, hindsight LL2-21) |
| The question asked decides what can be found: endpoint, assessor scope, evidence-admission rules, legacy categories, averages | Acute endpoints for radiation, TBT, beryllium, lead (LL1-03, p. 33; LL1-13, pp. 136–141; LL2-06, pp. 133–134); JECFA confined to authorised use, single substances, manufacturers’ data (LL1-14, p. 150); Gaucho “solely responsible, at national level, for all” losses (LL2-16, p. 379); BPA guideline-only evidence (LL2-10, pp. 220–223); nano forms invisible under chemical identifiers (LL2-22, pp. 537–541); ~16 cases | Strong | Strengthened (EFSA and courts on bee method; BPA limit based on an academic study). Refinement: choice of indicator species can flip verdicts (honeybee; TBT whelks) |
| Silos and remits: knowledge sits in another discipline or agency | MTBE air/water split (LL1-11, p. 114); BSE told to the health department after 17 months (LL1-15, pp. 159–160); drug regulators without environmental expertise (LL2-13, p. 284); pipe designers never consulted toxicologists (LL2-04, pp. 82–84); ~13 cases | Moderate–strong | MTBE groundwater risk flagged internally and by US EPA in 1984–88: institutional, not societal, ignorance (hindsight LL1-11) |
| Monitoring catches what models and self-referential indicators miss | Cod assessments tuned to offshore landings, inshore data excluded as “messy and often anecdotal” (LL2-17, pp. 411–414); software flagged low ozone values as “suspect” (LL1-07, p. 82); long records found ozone loss and acidification (LL1-07, p. 82; LL1-10, p. 102) | Strong | Strengthened: retrospective overestimation persists in North Sea cod; CFC-11 and HFC-23 caught by atmospheric monitoring. Northern cod reached “Healthy” status partly through a lowered reference point, “not an increase in the quantity of cod” (DFO; hindsight LL1-02). Counter: model-based rules rebuilt many stocks |
| Measurement capability sets the horizon; convenient proxies become safety claims | TBT imposex cause unknown for a decade (LL1-13, p. 136); Gaucho 10 ppb detection floor imposed on public researchers (LL2-16, p. 373); DBCP smell (1.7 ppm) accepted as warning above the 1 ppm limit (LL2-09, p. 205); optical microscopy pegged asbestos limits (LL1-05, pp. 56–57); ~13 cases | Strong | Asbestos limits cut 10–50-fold with electron microscopy; EU mandated effect-based oestrogen monitoring. Better measurement can also change status without new harm evidence (DES feed use, hindsight LL1-14) |
| Latency: early nulls are uninformative; exposure becomes universal before evidence matures | Mesothelioma 50–60 years after peak imports (LL1-05, p. 52); fewer than 10% of Interphone cases had 10+ years of use (LL2-21, pp. 512, 517); “largely unknown, yet already widespread” (LL2-00, p. 10); 12+ cases | Strong | UK male mesothelioma peaked 2016 (timing right, height overstated); DES harms kept appearing. Latency discounts early nulls, not well-followed later ones |
| Surprise recurs and is found by systems not built to find it | PCBs found while analysing DDT (LL1-06, p. 64); DES cluster a “fortuitous accident” (LL1-08, p. 86); BPA traced from labware (LL2-10, p. 217); Irgarol found in a herbicide survey (LL2-12, p. 267); ~9 cases | Strong (recurrence); moderate (property screening as response); suggestive (diversity) | Several post-2001 surprises came from remedies: HFOs degrade to persistent TFA; SO2 cuts unmasked warming; disaster-related deaths among Fukushima evacuees (a combined-disaster count); exclusion of pregnant women from research (hindsight LL1-07, LL1-10, LL2-18, LL1-08) |
| Distinctive (“signature”) outcomes get noticed; diffuse increments to common disease, and harm to things nobody values commercially, do not | 4–7 cases of very rare cancers or sperm loss triggered prompt action on DES, vinyl chloride, DBCP (LL2-27, p. 645); angiosarcoma’s rarity meant the causal connection with vinyl chloride was “undisputed” (LL2-08, p. 189); a pest snail’s loss would have prompted “little if any action” (LL1-13, p. 136) | Strong (signature effect); moderate (wildlife sentinels) | Honeybee colonies proved a poor sentinel; wild bees bore the harm (hindsight LL2-16) |
| Ignorance is partly produced: decisive studies not done, unanswerable questions posed, noise generated | Research as tobacco’s “antidote” (LL2-07, p. 154); vinyl chloride research refused so industry could act as if the cause were “unknown” (LL2-08, p. 184); “more information as a substitute for action” (LL2-22, p. 547); Swann: “the cry for more research should not be allowed to hold up our recommendations” (LL1-16, p. 181) | Strong (documented cases); moderate (research inertia) | Strengthened by later document disclosures (PFAS, fossil fuels) |
| Certainty language: a conditional scientific judgement becomes an unconditional public claim | BSE: “no risk” could not be stated categorically; a month later beef was “perfectly safe” (LL1-15, p. 161); nuclear “language of certainty” (LL2-18, p. 448) | Strong (BSE); moderate (general) | Claims of collapsing trust in scientists weakened (hindsight LL1-00, LL2-00) |
Counter-evidence. “Surprise” and “ignored warning” are coded inconsistently: the editors call DES next-generation effects “a complete surprise” (LL1-16, p. 170) while the chapter says warnings were ignored (LL1-08, pp. 88, 90); MTBE’s threat “was never considered” (LL1-11, p. 117) yet was flagged in 1984–88. The reports apply the absence-of-evidence argument asymmetrically: LL2’s evidence scale illustrates, with approval, regimes that act on “weak” (10–33%) or “moderate” evidence (Table 27.2, p. 658), while a false positive requires “high confidence” (67–95%) of no harm (LL2-02, p. 18). The claim that research is biased towards false negatives (LL2-26, Table 26.4) is too one-directional: low power and publication bias also produce false positives in published findings, as the replication crisis and the reports’ own mobile-phone warning show (hindsight LL2-26, LL2-27). The two-sided restatement keeps the precautionary point: under low power and high uncertainty both errors become likely, and which is costlier depends on irreversibility and scale (hindsight LL2-26).
Weight for the lens. High for the search-quality, framing, measurement and latency patterns (using both halves of the absence-of-evidence point); high for monitoring, but not as a general case against models; low for the knowledge-to-ignorance ratio and for frequency claims.
4.2 Early warnings and why they were missed (epistemic and institutional layers; T02)#
In brief. Warnings came early, from the edges of expert systems and just as often from inside the producing firms. Some never reached those able to act; others arrived and were discounted. The evidence threshold governed timing in at least twelve cases, and the lag figures, though real in direction, are not a consistent measure.
Where warnings came from. Front-line officials and affected people in at least eight cases: women factory inspectors (LL1-05, p. 53), DBCP workers comparing notes at lunch (LL2-09, p. 204), a Minamata mother whose observation convinced Harada in 1961, when medical opinion held the placenta protective (Kitamura had raised placental transfer as a possibility in 1959; LL2-05, p. 105), inshore fishers (LL1-02, p. 21), beekeepers (LL2-16, pp. 372–373). Dissenting scientists in at least ten. Inside or commissioned by the producing industry in at least eight: Dow’s toxicologist on vinyl chloride in 1959 (LL2-08, pp. 182–183), the DBCP consultant in 1958 (LL2-09, pp. 204–205), the American Petroleum Institute calling zero “the only absolutely safe level” of benzene in 1948 (LL1-04, p. 39), Chisso’s own doctor’s cat experiment (LL2-05, p. 101). Chance or monitoring built for other purposes in at least seven. Strong for the cases; moderate as a generalisation, since the corpus cannot show how many peripheral warnings proved wrong. Analysis: where the best-informed warner sat inside the firm, the gap was disclosure, not detection.
How warnings were lost. - Not delivered: BSE to the health department after 17 months (LL1-15, pp. 159–160); EE2 reports in water missed by drug regulators (LL2-13, p. 284); DBCP makers’ knowledge not passed to user firms (LL2-09, p. 211). - Delivered and discounted: the 1953 DES trial (LL1-08, p. 86); Canada’s own 1988 call to halve the cod quota (LL2-17, p. 413); a 1990 MTBE warning dismissed because petrol components were “rarely found in groundwater”, though nobody monitored for MTBE (LL1-11, p. 114); a 2001 paper on a roughly 1,000-year tsunami recurrence that never reached plant design (LL2-18, p. 438). - Contested through a recurring repertoire: calls for more research, alternative causes, replication demanded of the inconvenient finding, shifting rationales (growth-promoter reassurances each overturned in turn, LL1-09, pp. 94–95; beryllium’s defence moving from overexposure to the position that “not enough was known” to prevent the disease, LL2-06, pp. 137–138). - Trimmed inside advisory processes: the Southwood committee judged a brain ban not “politically feasible” (LL1-16, p. 179); a SEAC draft had its “most potentially inflammatory” wording edited out (LL1-15, p. 161).
Rating. Both modes occur: strong (at least twelve cases). Hindsight strengthened the discounting strand (PFAS producers knew of toxicity “forty years before the public health community”; MTBE flagged 1984–88), while the BSE inquiry found over-reassurance rather than producer bias (hindsight LL1-15, LL1-16).
The lags. Table A2.1’s “years of substantial inaction” run from 5–30 (TBT) to about 100 or more (asbestos 101, PCBs c. 100), median about 40 excluding fisheries (LL2-A2, p. 702). The dating rules are inconsistent: start dates mix direct observations with related-substance signals (the “PCB” warning of 1899 predates PCB production), and end dates mix bans, voluntary withdrawals and admittedly ineffective management. Counted from the first specific, credible warning, lags shrink to months for vivid, attributable harms and stay at decades for chronic, diffuse ones (DES: 7 months from the cancer link, 18 years from the no-benefit trial; benzene: 10 years from the 1977 cohort study). “Effective action” kept arriving long after the table’s dates: EU asbestos limit cut in 2023, US chrysotile ban 2024, EU benzene limit 0.2 ppm from April 2026, EU EE2 standard 2026 with a 2039 target (hindsight LL2-A2, LL1-04, LL2-13). Strong as description; weak to moderate as a measure. Analysis: separate three intervals: the lag in knowing, the lag in responding, and the lag from the first binding rule to a measurable fall in harm.
When response was fast. At least ten fast responses (DES in the US, vinyl chloride, DBCP within about two months, Danish avoparcin, French TBT, the US aerosol ban, Caulerpa in California 17 days after detection). What they shared: a legible endpoint, an affected group with a voice, independent public expertise, a concentrated industry or cheap fix, low commercial stakes (sunflower seed-dressing suspended in 1999, maize only in 2004, LL2-16, p. 382), or harm to something with market value. Moderate: consistent but confounded, since several were unusually easy cases. Counter-cases: the 1952 London smog drew only “modest remedies”; Minamata’s identified route still met twelve years of inaction.
Standard of proof. At least twelve cases where the proof demanded set the timing: “decisively settled” (fisheries, 1883–85; LL1-02, p. 18); “clear evidence that all fish and all shellfish are poisoned” (Minamata, 1957; LL2-05, p. 99), although Shizuoka Prefecture had used the same Act for a shellfish-poisoning episode in 1950 (p. 98); a threshold finding of “significant risk” (US Supreme Court, benzene, 1980; LL1-04, p. 40); the question whether Gaucho was “solely responsible, at national level, for all” losses (LL2-16, p. 379). Lower standards brought action: the US aerosol ban on a “reasonable expectation” of harm; the vinyl chloride rule upheld “on the frontiers of scientific knowledge” (LL2-08, p. 187). Strong that the standard governed timing; moderate that lower standards would have produced better outcomes. Analysis: the demanded standard was often universal (unmeetable in multicausal systems), rose with the cost of the remedy, and was asymmetric, high for harm and low for safety (DBCP’s safety rested on “authoritative assertion but without evidence”, LL2-09, p. 211).
Status quo as default. Six mechanisms: grandfathering (MTBE predated the new-substance cut-off, LL1-11, p. 116); provisional numbers hardening (the 1948 beryllium limit, reportedly chosen in a taxi, adopted “tentatively” and then made permanent, LL2-06, p. 133); conditional approvals whose conditions lapsed (leaded petrol cleared in 1925 “provided that” it was properly regulated, with a long-term public study urged; neither happened, LL2-03, pp. 53, 56); committees and research in place of action; feasibility-based limits (“what the industry felt was achievable”, LL2-08, p. 182); precautionary relabelling (a “precautionary gloss”, LL1-02, p. 24). Strong for the mechanisms; moderate as a general tendency.
Knowing is not acting. “Uncertainty favours the side of inaction” (LL2-04, p. 86); proven causation did not produce Great Lakes remediation (LL1-12, p. 130); Minamata’s failure was not using existing powers (LL2-05, pp. 99, 114). Hindsight adds the chrysotile listing blocked under the Rotterdam Convention’s consensus rule through 2025, and the 2021 German floods, where forecasts showed the rain two days ahead yet 29–35% of surveyed residents got no warning (hindsight LL1-00, LL2-15). Analysis: the gap has four layers, each with its own remedy: not delivered; delivered but contested; accepted but blocked by the distribution of costs; adopted but not implemented. Treating it as one “information problem” repeats LL1’s mismatch between diagnosis and remedy.
Counter-evidence. The reports’ own forward warnings have a mixed record (section 5.4). Swine flu shows a warning over-weighted because it fitted prevailing theory: “Perhaps too much faith was placed on the ability of science to foresee” (LL2-02, p. 31). Genuine ignorance limited foresight in ozone, mesothelioma, DES and BSE. Delay was not always bad faith (Phillips on BSE; Guidotti’s “cognitive dissonance and denial rather than cupidity” on beryllium, LL2-06, p. 145). Acting on warnings created new hazards (MTBE, tall stacks, HCFCs, booster biocides), and labels and bans also persist after concern fades (saccharin, cyclamate, irradiation). The reports set a low bar for a warning to count as “credible” and a high bar for a false positive.
4.3 Interests, power and the political economy of knowledge (political-economic layer; T03)#
In brief. The best-evidenced lessons are about mechanisms, not motives or frequencies. Seven cases rest on contemporaneous internal documents or official findings (tobacco, vinyl chloride, beryllium, PCBs, asbestos, Minamata, lead). Most other cases show incentive effects or sincere error, not misconduct, and the state is often the interested party.
Three kinds of explanation (analysis). Documented misconduct: records or official findings show concealment, falsification, covert sponsorship, stated intent to create doubt, or suppression. Incentive effects: conduct that follows from who pays and who gains, without evidence of deception (feasibility-based limits, catches above advice, indifference). Sincere but mistaken belief: a reassuring model genuinely held (threshold doses, the placental barrier, dilution, “remote” BSE risk). The categories overlap; self-serving bias can make an incentive feel like sincere belief (LL2-25, p. 614). In several cases the chapters read as bad faith what inquiries read as sincere error: BSE (“covertly subordinated”, LL1-15, p. 164, against the Phillips Inquiry) and beryllium (Guidotti).
| Pattern | Key evidence | Rating |
|---|---|---|
| Producers know first; private knowledge runs ahead of public positions | Vinyl chloride bone disease in 1% of PVC workers and 6% of vat cleaners, shared privately in 1966 with agreement to “use discretion”; a secrecy agreement kept a 250 ppm cancer result from NIOSH in 1973 (LL2-08, pp. 183–186); Monsanto publicly called toxicity claims “simply not true” while its 1969 plan accepted worldwide contamination (LL1-06, p. 65); a beryllium limit co-author privately disowned it in 1989 (LL2-06, p. 136); 10 cases | Strong (documents in 7+); moderate as a generalisation, since tested mainly where litigation opened records |
| Manufactured doubt: keeping questions open; “more research” as delay | Tobacco research as “antidote” and teams to “keep the controversy alive” (LL2-07, p. 154); vinyl chloride report accepted only once it said the cause was “unknown” (LL2-08, p. 184); Chisso’s rival theories (LL2-05, pp. 102–103) | Strong (existence, 6+ cases with intent documented); moderate (causal effect on delay); suggestive (real-time diagnosis) |
| Control of the research pipeline and the funding effect | Tobacco-affiliated reviews: affiliation the only predictor of a “not harmful” conclusion (OR 88.4, 95% CI 16.4–476.5; LL2-07, p. 161); 40 years of industry-funded lead research (LL2-03, p. 56); Gaucho detection floor (LL2-16, p. 373) | Strong (pharmaceuticals, tobacco, lead); moderate (environmental chemicals) |
| Changing the rules (standards of proof, metrics, definitions, questions put to assessors) | “Sound science” campaigns for “unreasonably high standards of proof” (LL2-07, p. 162); a proposal to discard relative risks below 2.0 (p. 164); limit “as measured and calculated by Brush” (LL2-06 notes, p. 137). (Separately, and not evidence of intent: the Commission’s nanomaterial definition lets its 50% threshold be replaced by one between 1 and 50% where warranted by concerns for “environment, health, safety or competitiveness”, LL2-22, p. 540, an example of a cost qualifier written into a definition; suggestive) | Strong on intent; mixed on realised effect (US data-access laws enacted; the EU relative-risk proposal not adopted; LL2-07, pp. 163–164) |
| Capture, dual mandates and the state as interested party | MAFF “responsible first to the industry” (LL1-16, p. 179); beryllium worker safety the “last priority” (LL2-06, p. 132); Japan’s trade ministry: “Never stop it!” (LL2-05, p. 99); Fukushima “regulatory capture” (LL2-18, pp. 441–443); promote-and-oversee nano programme (LL2-22, pp. 546–548); 11 cases | Strong (existence); moderate (causation) |
| Secrecy and litigation as the main window | Tobacco record “would have remained undiscovered” without litigation (LL2-07, p. 169); public bodies withheld findings too (EU hormone committee, LL1-14, p. 150; UK effluent survey held until 1994, LL2-13, p. 284) | Strong; implies observability bias |
| Cost-shifting and liability that deters admission | Monsanto: stopping would mean “admitting guilt by our actions” (primary text; hindsight LL1-06); beryllium limit “fundamental to our product liability defense” (LL2-06, p. 137); Manville’s bankruptcy (LL2-25, p. 612) | Strong (cost-shifting); moderate (deterrence of admission) |
| Trade, export and jurisdictional arbitrage | DBCP exported after the US ban with English-only labels (LL2-09, pp. 207–209); Canada blocked chrysotile listing (LL2-A3, pp. 724–726) | Strong |
| Countervailing interests: action waits for an organised interest that bears the harm or profits from the alternative | Arcachon oyster growers (LL1-13, p. 136); Swedish farmers requested a growth-promoter ban (LL1-09, p. 95); GM wanted lead out to protect catalytic converters (LL2-03, p. 60); responsible behaviour came mostly from firms “selling hazardous products rather than by their manufacturers” (LL2-27, p. 647) | Moderate (12+ instances; causal weight unseparated) |
| Treatment of warners | Keats report dismissed as “biased pseudoscience” (LL1-02, p. 21); Bayer sued three beekeeper leaders and lost (LL2-16, p. 380); a SLAPP ruling (LL2-09, p. 208) | Moderate: often warners’ own accounts, and warners selected for vindication |
| Interests behind restriction and alarm: competitors, makers of substitutes, domestic producers, trade interests and research or advocacy programmes can gain from restriction, and can push it beyond what the evidence warrants | The EU hormones ban, taken against two expert committees and driven “principally” by public concern, with “no good evidence” of health benefit (LL1-14, pp. 150, 153–154), was settled by beef quotas at third-country exporters’ expense, not by science (hindsight LL1-14); Majone on EU aflatoxin standards and African exporters, and on precaution misused for protectionism (critiques §3.3); GM wanted lead out of petrol to protect its catalytic converters (LL2-03, p. 60); some firms favoured binding invasive-species rules over voluntary codes because they felt disadvantaged against competitors who ignored the codes (LL2-20, p. 499); DuPont’s CFC shift was partly commercial positioning (hindsight LL1-07); MTBE was scaled up under a protective mandate (LL1-11, pp. 110–111); the reports’ own institutional stakes (the EEA withdrew from the IARC meeting while its editor co-authored the mobile-phone chapter, LL2-21, p. 520) | Moderate (several cases; the critics’ strongest distributive point; causal weight unmeasured). Not analysed in the reports, which treat these interests only as welcome accelerators of action (see “Countervailing interests”) |
The Part D analysis (LL2-25). Harms enter firms’ decisions only through liability, regulation and reputation, and each channel leaks (pp. 608–612). The chapter’s most useful contribution is the distinction between “business actions” within the rules and “political actions” aimed at “influencing these political and regulatory contexts in the pursuit of profits” (p. 615), which lets an analyst be charitable about the first and strict about the second. Its headline, that continuing was perceived as profitable “in virtually all reviewed cases” (p. 607), is close to built in by selection. Hindsight strengthened its diagnosis (ExxonMobil’s internal climate projections versus its advertorials; fluorochemical toxicity known internally by 1970; an Exxon memo of 1985 advising against MTBE) but found firms differing within sectors: a rival refiner declined MTBE, and the beryllium producer co-drafted with the steelworkers’ union the tenfold-tighter limit OSHA adopted in 2017 (hindsight LL2-25, LL2-06).
Counter-evidence. Public authorities caused or concealed harm in several cases (Minamata, DOE, Japan’s nuclear regulators; after 2013, Flint and Camp Lejeune), which weakens LL2’s “for the most part … irresponsible corporations” (hindsight LL2-00). Some criticism labelled doubt-making was valid (the EPA revised its second-hand smoke assessment “in response to valid criticisms”, LL2-07, p. 153). Industry-funded work also produced protective findings (low-dose benzene risk; skin-route beryllium sensitisation). The reports scrutinise allies far less than industry: the Hardell group’s telecom-operator funding is a footnote (LL2-21, fn 11), and several authors’ expert-witness roles go undisclosed. Organised alarms exist too (MMR). Analysis: the reliable generalisation concerns whoever controls exposure and information, firm or state. The most useful marker of manufactured doubt is asymmetry in the proof demanded, not the existence of dissent (LL2-05, p. 112).
4.4 Innovation, trajectories, lock-in and alternatives (economic and systemic layers; T04)#
In brief. The reports’ robust contributions are about mechanisms of trajectory: the prized property that is also the hazard; substitution within the same principle; several distinct kinds of lock-in. Their optimistic claims (precaution stimulates innovation, diversity insures against surprise, agroecology outperforms) rest on illustration and the editors’ framework, and later evidence supports only a weak “redirects, not stops” version.
| Pattern | Key evidence | Rating | Hindsight |
|---|---|---|---|
| The prized property is the hazardous property | PCB stability (LL1-06, pp. 64, 72); CFC inertness, since short-term safety “appears to demand” persistence (LL1-07, p. 83); DDT persistence praised in the 1948 Nobel speech (LL2-11, p. 241); asbestos durability (LL1-05); MTBE mobility (LL1-11, pp. 110–112); 8 cases | Strong | Strengthened: persistence and mobility became EU hazard classes (2023); HFOs degrade to persistent TFA |
| Enthusiasm and conspicuous benefit displace appraisal; benefits weaker than claimed | Radiation, “caution tended to be thrown away” (LL1-03, p. 31); DES “modern and scientific” (LL1-08, p. 88); TEL an “apparent gift of God” (LL2-03, p. 53); “nano-fever” (LL2-22, pp. 545–546) | Moderate | Mixed: DES, growth promoters confirmed; DDT’s malaria benefit, PCB fire safety and some seed treatments real (French beet yields fell from 851 q/ha in 2019 to 649 q/ha in 2020, in a virus-yellows outbreak two years after the 2018 ban; hindsight LL2-16) |
| Regrettable substitution: substitutes judged against the incumbent reproduce or relocate the problem | Lead → MTBE → ethanol/ETBE; CFCs → HCFCs → HFCs → HFOs; TBT → boosters → third generation; BPA → BPS/BPF; imidacloprid → near-equivalents; DDT → pyrethroids; about 14 chains; LL2-12’s five-step cycle (p. 273) | Strong | Strongly strengthened; regulators moved to group restrictions (2024 EU bisphenols rule; PFAS group proposal) |
| Lock-in takes several forms: capital, price, knowledge, rules, dependence, adaptive treadmills, defensive adoption | Committed technologies reinforced “even if markedly inferior” (LL1-16, p. 177); TEL alternatives “categorically denied” then “forgotten” (LL2-03, pp. 54–55); herbicide “treadmill” and “deskilling” (LL2-19, p. 462); sunk investment (LL2-28, p. 672); 15+ cases | Strong (mechanism); moderate (“late action consolidates monopolies”); asserted (“winners are arbitrary”) | US 2024 asbestos rule found eight chlor-alkali plants, 42–83 years old, still using asbestos diaphragms; 206 EU emergency authorisations for restricted neonicotinoids; dicamba drift led farmers to plant tolerant seed defensively |
| Diversity as insurance | Surprises smaller with several technologies than one “near monopoly” (LL1-16, p. 187); integrated vector management (LL2-11, pp. 251–252) | Suggestive (portfolio); moderate (diversity of tactics against adaptive targets) | Untested as insurance. The monopoly forecast was right for seeds and agrochemicals (2017–18 mergers) and wrong for nanotechnology, which diffused as a fragmented toolkit |
| Who steers direction: appropriability, incumbents, mandates, research funding, dual-mandate bodies, unplanned co-drivers | Innovations that can be “packaged and sold” to the largest markets “largely bypass the poor” (LL2-19, p. 460); lead left US petrol to protect catalytic converters: “Apparently, poisoning a technology was more important than poisoning people” (LL2-03, p. 60) | Moderate | The EHS share of US nanotechnology programme funding fell from about 10% (2016) to about 4% (2020); the broader “responsible development” line was 1.1% of the FY2026 request (not strictly comparable; in 2020 the National Academies said the programme “has performed exceptionally well” on responsible development; hindsight LL2-22, section 3.6) |
| Precaution stimulates innovation | “can help stimulate” (LL1-00, p. 4); “increasing evidence” (LL2-28, p. 670); vinyl chloride compliance cost USD 278m against forecasts of up to USD 90bn (LL2-08, p. 187) | Weak form moderate; strong form asserted/contested | Meta-analysis of 103 studies: “the most likely scenario is statistical insignificance” (Cohen and Tubb 2018); vinyl chloride like-for-like overestimate about fourfold, not 300-fold |
| Narratives of progress, essentiality and “problem solved” | TEL “the only material available” (LL2-03, p. 54); asbestos “irreplaceable” (LL1-05, p. 58); DBCP “essential” (LL2-09, p. 211); “today’s technology is now safe” (LL2-28, p. 672) | Moderate | “No alternative” claims recur and sometimes win; US exemptions in 2025–26 accepted that compliance technology “is not available” |
| Scale and speed of deployment outran appraisal | MTBE the third most produced organic chemical in the US by 1995 (LL1-11, p. 110); BPA at 3.8 Mt a year (LL2-10, p. 216) | Strong (historical cases); moderate (general) | Ethanol scaled by mandate before its multi-media assessment, after the lesson had been written |
GM crops and agroecology (LL2-19). The reports’ fullest innovation-pathway case. Hindsight vindicated the political economy: the glyphosate resistance treadmill (62 resistant species, 34 first recorded since 2013), narrow delivery (still essentially two traits; the same five countries about 89% of GM area), consolidation, and the institutional critique of developer-controlled evidence. It weakened the health “indications” (the Séralini study was retracted; an EU-funded two-year replication found no adverse effects) and the agroecology yield claims (average organic yield gap about 19–25%). The chapter is most useful as an account of how innovation systems select problems, not as an evaluation of a technique (hindsight LL2-19).
Counter-evidence and complications. Substitution often did reduce harm (most asbestos substitutes; hydrocarbon refrigerants; biocide-free foul-release coatings). Some lock-in was not irrational (beryllium’s performance; alcohol fuel’s cost in 1921; halons with no alternative for some uses). Exits proved fragile while lock-in proved sticky (derogation cycles; reversed nuclear phase-outs). The reports rarely plan for transition costs, which fell hardest on the most vulnerable part of a system (weaner pigs after the growth-promoter ban; sugar beet after the neonicotinoid ban), and LL2’s own DDT chapter warns that withdrawing an incumbent before a substitute is proven “probably increased the threshold of expectation of proof” for alternatives (LL2-11, p. 250). Analysis: induced innovation is likeliest when a binding, dated requirement meets an available engineering or substitute pathway in a concentrated industry; weakest when targets are soft, incumbents much cheaper, or substitutes share the old principle.
4.5 Costs, benefits and justice (economic layer; T05)#
In brief. Economics is where the reports are most openly incomplete and where they hold some of their most transferable structural insights. Their numbers are the weakest layer: nearly every headline figure checked in hindsight was overstated, understated, misattributed or not like-for-like.
| Pattern | Key evidence | Rating |
|---|---|---|
| The founding asymmetry: costs of acting concentrated, visible, near-term; costs of not acting diffuse and deferred | LL1-00, pp. 3–4; lead as an “unequal contest” (LL2-03, pp. 52–53); cod limit set at 190,000 t, not the ~125,000 t the target required, to avoid “drastic” repercussions (LL1-02, pp. 21–22); EU catch limits averaged 47% above advice after 2003 (LL2-17, pp. 421–422); ~10 cases | Strong (description); moderate (cause), since vivid harm plus a cheap fix overrode it (vinyl chloride, DBCP, DES) |
| Appraisal boundaries decide the answer: estimates count only what is already quantified | Lead cardiovascular effects omitted (LL2-23, p. 568); acid-rain appraisal ignored emitters’ own damage (LL1-10, pp. 103–104) | Strong (mechanism). Hindsight: global lead-attributable death estimates rose from about 0.9m (GBD 2019) to 3.5m (GBD 2023) as exposure models changed to cumulative bone-lead exposure, and a separate 2023 estimate put lead-attributable cardiovascular deaths at 5.5m, six times GBD 2019 (hindsight LL2-23); the decisive acid-rain benefit was avoided fine-particle deaths, which the 2001 chapter never counted |
| Ex ante overestimation of compliance costs | Vinyl chloride; lead (“one million barrels” a day against the EPA’s 30,000, LL2-03, p. 60); beryllium’s fear that regulation would leave it “no longer … a viable industry” (Brush Wellman 1977, quoted at LL2-06, p. 135); ~8 cases | Moderate: direction supported, magnitudes unreliable; wider literature finds only a slight tendency to overestimate |
| Valuation conventions move results several-fold and carry ethics | Stern’s costs of inaction fall from 14.7% to 4.2% of GDP as the discount rate rises from 1.3% to 2.8% (LL2-23, Table 23.1, p. 574); test whether the conservative bound still justifies action (pp. 571, 573) | Strong (sensitivity); moderate (conservative-bound rule, now in EU air-quality impact assessment); politically reversible (US 2023 then 2025) |
| The level of proof allocates the cost of error | “risk-maker or the risk-taker?” (LL1-09, p. 96); Justice Marshall on “the burden of medical uncertainty” (LL2-08, p. 187); tort rules “asymmetrically hamper plaintiffs” (LL2-24, p. 588) | Strong |
| Distribution: consent and benefit decoupled; harm falls on workers, the poor, other countries, the unborn; evidence follows power | Second-hand smoke; DES daughters; DDT spray residents “the largest non-occupationally exposed community in the world” (LL2-11, p. 248); tall stacks exporting harm (LL1-10); Greenland’s mercury damage with “hardly any local emissions” (LL2-23, p. 569); 15+ cases | Strong (descriptive); suggestive (quantified) |
| Distribution shapes political will | Acid-rain positions followed perceived costs (LL1-10, p. 107); TBT harm tolerated until the oyster crop failed (LL1-13, p. 136) | Moderate |
| Prices that exclude harm confer advantage and lock incumbents in | “an unjustifiable advantage in the marketplace” (LL1-16, pp. 176–177); asbestos cartels (LL1-05, p. 58) | Strong (lock-in); moderate (price mechanism); suggestive (“smarter substitutes”) |
| Cheap early action against expensive late remediation | ~1,200 clinical BSE cases removable for ~£1.5m against a £4.2bn bill (LL1-15, pp. 158, 164); weed eradication costs rising “at least 40 times” with delay (LL2-20, p. 487) | Moderate: direction supported (Italian ban avoided an estimated 8,000–22,000 mesothelioma deaths), counterfactuals weak and often not like-for-like |
| The intervention point decides who pays | EE2: end-of-pipe treatment costed at EUR 32–37bn for England and Wales rather than redesigning the drug (LL2-13, pp. 290–296) | Strong. Hindsight: the 2024 EU wastewater recast puts at least 80% of new treatment costs on producers of medicines and cosmetics |
| Compensation late, partial and decided by procedure | Tort “a poor legal model” (LL2-24, p. 589); DBCP settlements averaging USD 1,500 per worker (LL2-09, p. 209); liability caps against Fukushima costs (LL2-18, pp. 445–446) | Strong. Hindsight: the Manville Trust pays 5.6% of scheduled claim value; pre-funded bonds never adopted; pooled asbestos funding diluted employer accountability (French Senate 2005) |
| Who counts victims controls apparent harm (Minamata) | Passive, claim-based recognition; strict 1977 criteria after claims surged; prefecture co-financing the polluter; “relief money (not compensation)” (LL2-05, pp. 107–110) | Strong within the case, with a 13-year out-of-sample record: recognition frozen, 55,000 people given relief off-register, the statutory survey only a 32-person pilot by 2026 (hindsight LL2-05) |
| Legacy costs and intergenerational commitment | CFC-12 above 37% of its 2001 level in 2100 (LL1-07, p. 77); 213 US Superfund sites list DDT (LL2-11, pp. 249–250) | Strong (physical); suggestive (ethics analysed) |
Counter-evidence. The reports document the costs of precaution and then underweight them: hormone sanctions (a ceiling of US$116.8m plus C$11.3m a year, not the chapter’s EUR 160m), swine flu (about USD 124m plus more than 4,100 lawsuits, with Guillain-Barré cases and deaths), South Africa’s DDT withdrawal, Fukushima’s disaster-related deaths among evacuees (a count covering the combined earthquake, tsunami and nuclear disaster, and a cost of emergency protective action after an accident rather than of precaution before deployment; hindsight LL2-18), Germany’s nuclear phase-out (about €3–8bn a year, mostly air-pollution mortality). Critics’ strongest economic point, that precautionary costs can be regressive (DDT and malaria; EU aflatoxin standards and African exporters), is answered by classifying these as “real risks”, which does not engage it (LL2-02, pp. 35–36; critiques §3). The benefits of the hazardous technologies are rarely weighed. Analysis: the durable lesson is not that numbers win; it is that whoever controls the accounting conventions decides what counts (hindsight LL2-23).
4.6 Governance, institutions, law and participation (institutional layer; T06)#
In brief. The most durable governance insight is not specific to precaution: the evidential threshold is a device for allocating the cost of error, and since 2013 it has become openly political in both directions. The best-documented institutional mechanism is the reassurance trap. Reforms about information advanced; reforms that would move money or power did not.
| Pattern | Rating | Main complications |
|---|---|---|
| “Precaution” names very different commitments; labels and practice diverge (Table 1.2, LL1-00, p. 14; “precautionary gloss”, LL1-02, p. 24; Rio’s “cost effective” wording as precaution’s “Achilles heel”, LL2-13, p. 296) | Strong | The reports relabel too (“precautionary prevention” enrols known-harm successes) |
| Evidence thresholds and burden of proof are allocative, political choices | Strong (12+ instances) | Two-way weighing remains rare; thresholds politicised both ways since 2013 (EU graded hazard classes; US Executive Order 14303, 2025) |
| Cost and proportionality arguments tilt towards delay, but precaution has costs and is hard to reverse | Moderate | Hormones, saccharin, irradiation; BSE measures relaxed through open, costed review |
| Framing and scope set by those commissioning assessment decide the answer; committees diverge on shared evidence (29 TCE assessments, four conclusion types, LL2-04, pp. 84–85; BPA guidance values spanning ~250,000-fold) | Strong | Separating assessment from management was neither necessary (UK FSA kept trust) nor sufficient (EFSA independence controversies) |
| Sponsor-regulators and dependence on applicant data subordinate protection | Strong within cases; moderate to weak as a comparative law | Phillips: the health department, with no sponsorship role, was “as eager as MAFF” to avoid alarm |
| Categorical reassurance blocks graded precaution and erodes enforcement (BSE: ~48% of abattoirs visited in 1995 failed the offal rules; “a bit of window dressing”, LL1-15, p. 162) | Strong | Premise of “very low” trust in scientists was wrong |
| Lay and frontline observers see harm first; participation’s value is conditional | Moderate (detection); suggestive (participation improves outcomes) | GM Nation? flawed; legitimacy rises mainly when recommendations are honoured |
| Adopting a rule is not reducing a risk (two asbestos prosecutions in 1931–68, LL1-05, p. 56; Swann “gradually diluted”, LL1-09, p. 94) | Strong (12+ cases) | Some rules worked fast once enforced (all-species feed ban; global TBT ban) |
| Mobile, transboundary hazards need institutions of matching reach; unilateral action leaks (UK meat-and-bone-meal exports doubled after the domestic ban, LL1-15, p. 163) | Strong | Small jurisdictions sometimes lead (Bermuda on booster biocides) |
| Monitoring is a precondition; triggers, review and exit rules are thin | Strong (monitoring); asserted (pre-agreed triggers); moderate (exit rules, a hindsight lesson) | Vigilance holds where independent institutions have legal mandates |
| Courts cut both ways; the legal standard decides | Strong (15+ episodes) | Pfizer requires a risk “adequately backed up by the scientific data”, not “purely hypothetical”: “reasonable grounds” is workable, suspicion alone is not |
| Remedies partly adopted; effects largely untested | Moderate | Reforms reversible; innovation-principle counter-current |
Key evidence and hindsight. The reports’ key governance move is that framing is a management decision disguised as a scientific one (LL1-14, p. 154; LL1-15, p. 165; LL2-28, p. 677). Later evidence supports that, but not the institutional fix most associated with it: what seems to matter more is who writes the question, whether scope and evidence rules are published, and whether divergence is explained. Hindsight adds a lesson the reports did not draw: openness about costs served proportionality in both directions, including relaxing measures (the UK’s Over Thirty Months rule was replaced by testing after a review put its cost at about £2bn per death prevented; hindsight LL1-15). Implementation failure modes recur: unfunded conditions, exemptions that become permanent (leaded aviation fuel, “temporary” since 1996 and still permitted; EU authorisation of TEL to 2032), voluntary codes, process targets (the Floods Directive’s objectives “generally not quantified or time-bound”, European Court of Auditors 2018).
Counter-evidence. The hormones chapter is the reports’ own internal counterpoint: an EU ban taken against two expert committees, driven “principally” by public concern, with expert advice left unpublished and trade sanctions without demonstrated health benefit (LL1-14, pp. 150, 153–154). Openness can be weaponised: tobacco lobbied for data-access laws applying only to publicly funded studies (LL2-07, p. 163), and later a US “transparency” rule (2018–21, vacated) limited the use of studies whose data were not public (a court held that it “determined outcomes rather than process”; hindsight LL2-07), while Executive Order 14303 (2025) restricted reliance on “overly precautionary assumptions”, both in the name of rigour. The White House science adviser defended the order under the title “Sound policy demands sound science”; critics, including Michaels (an LL2 author), called it “Fool’s gold”; Science’s editor argued that the scientific community’s own “sluggishness and defensiveness” had enabled it (hindsight LL2-27). Whether such measures improve evidence or discount it is a live dispute. Many governance chapters were written by protagonists (Michaels, Bingham, the invasive-species authors, a Commission litigator on hormones, Cranor as an undisclosed plaintiffs’ expert in Milward).
4.7 Complexity, systems and scale (systemic layer; T07)#
In brief. The robust content is a set of mechanisms, not complexity theory: persistent agents at scale create stocks that outlast control; dispersal relocates harm; acute, high-dose, adult or average endpoints miss chronic, developmental and system-level effects; product-by-product regulation produces substitution treadmills. “Complexity” itself is a rhetorical resource on both sides.
| Pattern | Key evidence | Rating |
|---|---|---|
| Deployment outruns knowledge | CFC-12 releases rose from 25 kt cumulative (1930–48) to 300 kt a year in 1970 (CFC-11: 5 kt to 207 kt; LL1-07, p. 82); MTBE; BPA; DES with 2–10 million exposed in the womb (LL1-08, pp. 87–88) | Strong (historical persistent chemicals); moderate (emerging technologies, whose forward warnings have mixed outcomes) |
| Scale turns small effects into large harm; growth swamps per-unit gains | An average ~5 IQ point loss dismissed as “small” (LL2-03, p. 61); aerosol cuts offset by foam growth (LL1-07, p. 80); Minamata by-product per unit rose while output rose (LL2-05, pp. 95, 102) | Strong (lead, SO2, ozone); moderate (general). Swine flu shows interventions scale too: 107 Guillain-Barré cases and 6 deaths across 40 million inoculations (LL2-02, p. 28) |
| Persistence and stocks: stopping production does not stop harm | Installed PCBs (LL1-06, p. 72); CFC banks; TBT sediments; DBCP in 254 of 1,312 Californian wells in 2010 (LL2-09, p. 210); 12+ sections | Strong. Hindsight: decline is fast then slow; floors come from exemptions and by-products (PCB-11); stocks can be remobilised (mussels in Lake Ontario) or become resources (the halon bank) |
| Irreversibility needs splitting into kinds | Latency “pipelines”; persistence; ecological state change; social and institutional lock-in | Strong (latency, persistence); moderate (ecological: northern cod reopened in 2024, western Baltic cod in “a novel and likely irreversible low productivity state”). “Irreversible” often means “not on policy timescales” |
| Masked decline | Catch rates “might continue to increase even as the stock was collapsing” (LL2-17, p. 413); multispecies model “a gigantic random number generator” (LL1-02, p. 25) | Strong (fisheries); moderate beyond |
| Two kinds of threshold | Dose thresholds recede (“harm expansion”, LL2-28, p. 672; radiation 700 → 20 mSv; “safe” blood lead 60 → 10 µg/dl); system thresholds exist but cannot be located in advance (generic tipping-point models “an exercise in futility”, LL2-17, p. 417; critical loads made acid-rain action tractable, LL1-10, pp. 106–107) | Strong (named agents); moderate (general prior; selection effect). Governance reference points get moved |
| Acute, high-dose and average-based tests mislead; timing matters | TBT targets set from acute data while whelks were sterilised at 3–5 ng/l (LL1-13, pp. 136–141); “the time makes the poison” (LL2-10, p. 219) | Strong (acute endpoints); moderate (developmental timing); suggestive and contested (non-monotonic responses at environmental doses) |
| Mixtures, co-causes and sole-cause framing | Asbestos plus smoking raises lung-cancer risk more than 50-fold (LL1-05, p. 55); oestrogen mixtures (LL2-13, p. 290); “solely responsible, at national level, for all” (LL2-16, p. 379) | Strong (single-agent assessment understates; sole-cause demands are unanswerable); moderate (relaxing causal criteria, which can shield a hazard claim from refutation) |
| Self-propagating and adaptive agents | Invasive species lag phases defeat liability (LL2-20, p. 497); no saturation despite 42+ treaties (p. 493); resistance treadmills (LL1-09; LL2-11; LL2-19) | Strong. Hindsight: invasion rates “often even accelerating”; the ionophore narasin, kept because “not used in humans”, co-selects for vancomycin resistance |
| Fixes relocate harm | Tall stacks: local air improved while European SO2 emissions more than doubled to ~57 Mt (LL1-10, pp. 101–103) | Strong |
| Global commons need institutions of matching reach | TBT and the IMO; ozone’s review ratchet and >USD 1bn fund (LL1-07, pp. 78–81); climate framework before effect (LL2-14) | Strong (reach); moderate (conditions of success: concentrated producers, substitutes, finance, ratchet, monitoring) |
| Warning chains break at interfaces; vigilance decays | Vaison-la-Romaine and the Odra (LL2-15, pp. 353, 360); “hydro-illogical cycle” (pp. 360–361) | Moderate overall; strong on floods after hindsight (Ahr 2021, Valencia 2024) |
Interactions between problems (analysis, from hindsight). Several of the most consequential system effects run between chapters: sulphate aerosols masked warming, so SO2 control unmasked it while preventing about 80,000 premature deaths a year in Europe; ozone substitutes were greenhouse gases; invasive mussels remobilised legacy PCBs. Both benefits and costs of intervening can arrive through channels outside the frame of the decision.
Counter-evidence. Complexity-based warnings in the reports were not uniformly reliable (northern cod’s irreversibility; pesticide–pathogen synergy; forest decline from SO2; MTBE as “everlasting”). The Great Lakes author argues that supposed complexity and uncertainty “has not been inconvenient” to those reluctant to pay for remedies (LL1-12, p. 129), while LL2’s editors use complexity to justify earlier action; both have case support. Much large-scale improvement came from structural change (Eastern Europe’s economic collapse cut SO2; DDT’s exit came through resistance and new tools). Several systems claims have no worked case in Chapter 28; the moving-target claim (LL2-28, p. 672) is asserted without one, although asbestos disease being repeatedly attributed to superseded working conditions fits it (LL1-16, p. 173; T04 P9).
4.8 Actors, mindsets, framing and narratives (cultural and cognitive layer; T08)#
In brief. The reports hold two unreconciled theories of failure: a cognitive one (misplaced certainty, blind spots, hubris) and an interest-based one (product defence, manufactured doubt). The best bridge is LL2-25 and LL2-28: interest shapes perception, often without bad faith. Sincere belief was at least as common a source of delay as bad faith, and did serious damage without any deception; the relative size of the two was never measured, and documented bad faith lies behind some of the largest harms (lead, tobacco, asbestos).
| Pattern | Key evidence | Rating |
|---|---|---|
| Enthusiasm and the virtue that is also a hazard | “magic mineral” (LL1-05, p. 53); “gift of God” (LL2-03, p. 53); “there seemed no limit” to oestrogen uses (LL2-13, p. 280); ~13 cases | Moderate (benefit salience crowds out slow harm); strong (prized property as hazard) |
| Mental models that fixed what counted as harm (acute threshold harm; protective barriers; dilution as disposal; systems perform to specification; loyalty to the model; stationarity) | Radiation limits with “no realisation” of latent cancer (LL1-03, p. 33); Kehoe’s school: poisoning only “at high doses with obvious signs” (LL2-03, p. 58); the placenta (LL2-05, p. 105); “controlled use”; scientists “lulled by false data signals” (LL2-17, p. 413); 17+ cases | Strong. But paradigm-based scepticism was sometimes right (mobile phones, food irradiation): what distinguishes harmful cases is never testing a prior against an independent baseline, treating the edge of knowledge as the edge of risk, and refusing to say what would change the view |
| Confidence built on absence, and the reassurance trap | BSE (LL1-15, pp. 161–162); “The standard is safe” (LL2-06, p. 137); odour proxies (LL2-09, p. 205; LL2-08, p. 184) | Strong (fallacy; BSE trap); moderate (trap as general dynamic). The health department’s equal keenness to reassure shows the trap works without a sponsorship conflict or lying |
| Seeing the public as prone to panic | “hysterical demands” (LL1-15, p. 159); “mob hysteria” (LL1-06, p. 64); lay reasoning “the fancy of an amateur” (LL2-05, p. 105) | Moderate. Flint (2014–15) repeated the dismissal of independent testers |
| Who counts as an expert | Curated BSE advisers (LL1-15, p. 162); borrowed credibility (“to be fully acceptable and credible”, LL2-06, p. 136); same evidence, different verdicts (LL2-04, pp. 84–85; LL2-10, pp. 221–223) | Strong (institutional choice of expertise moves verdicts by orders of magnitude). CLARITY-BPA, publicly funded in both arms, reproduced the guideline-versus-academic split: paradigm as well as funder |
| Commitment, liability and escalation | A “policy edifice” (LL1-15, p. 164); stakes of admitting error rising “perhaps exponentially” as uncertainty fell; “there must be room for them to turn around” (LL2-06, pp. 149–150) | Moderate–strong. Organisations did reverse where they had less sunk commitment (downstream users, Danish farmers) |
| Framing contests (who names the problem, sets the question, defines “safe”) | UK asked whether lead did “obvious harm” (LL2-03, p. 68); beryllium as a “public relations problem” (LL2-06, p. 133); “relief money (not compensation)” (LL2-05, p. 110); “survive among the nations” (LL2-03, p. 53) | Strong (question-setting decides verdict); moderate (rhetorical frames’ causal weight) |
| Sincere belief, motivated reasoning and bad faith | ~7 cases of documented private–public divergence or concealment; ~10 of sincere or paradigm-bound error (DES, radiation, CFCs, TBT, antimicrobials, cod, Fukushima, swine flu) | Strong (both occur); moderate (motivated reasoning as the common middle). Where bad faith was alleged on documents, later records corroborated it; where inferred from outcome, hindsight usually weakened it |
| The reports’ own mindsets | Asymmetric scrutiny in the mobile-phone, GM and neonicotinoid chapters; “fear or imagine” (LL1-00, p. 4) | Moderate. Protagonist conviction and self-citation appear both in chapters that held (lead, benzene, BPA, carbon nanotubes, ozone) and in chapters that failed; the failures share a narrower feature, key claims resting on one group’s positive or unpublished findings later contradicted by larger independent studies (section 5.5, item 4) |
Analysis. The most reliable marker of bad faith in the corpus is a documented gap between private and public positions, but it is observable only where litigation or archives opened the record, so its absence proves nothing. Shifting rationales and asymmetric scepticism also appear in sincere cases and among warners. The more useful question for a lens is not “are they lying?” but “what is their reasoning insulated from?”: feedback from harm, independent baselines, dissent, and costs borne by others. Most safeguards (independent baselines, pre-set triggers, open dissent, separating promotion from protection) work whether the problem is self-deception or strategy.
4.9 False positives and the limits of the project (T09)#
Treated in section 5. In brief: the false-alarm review is a good rebuttal of critics’ lists and a poor estimate of precaution’s error rate; the method decides the count; after thirteen years the ledger ran both ways; the asymmetry argument is sound as a conditional and weak on its premises; both volumes select on outcome and are largely written by protagonists; and mechanisms held up in hindsight while numbers and forecasts often did not. T09 also lists the counterweights the reports contain but underuse: the hormones chapter’s critique of EU precaution (LL1-14, pp. 153–154); the asbestos authors’ concession that rebalancing would sometimes restrict things later shown safe (LL1-05, p. 60); the editors’ “in no way precautionary” and “genuinely reveals” passages (LL1-16, p. 173); the floods chapter’s distinction between a real risk that did not materialise and a false alarm (LL2-15, p. 354); the EE2 authors’ question about “the price of being precautionary” (LL2-13, pp. 294–296); and the invasive-species chapter’s point that misclassification cuts both ways (LL2-20, p. 488) (T09 §9).
4.10 The canonical lessons (T10)#
Treated in section 3. In brief: the twelve lessons are best read as a checklist of failure modes, framed by a pre-existing appraisal framework (ESTO) and distilled from the case authors’ own lessons, with no reported coding method (section 3.2); they are unevenly supported; the 2013 volume kept them unchanged and surrounded them with new tools and a more accusatory tone; the reports diagnose power but prescribe information; and uptake followed a gradient from low-cost to redistributive lessons. T10’s six cross-cutting patterns are: P1, the reports diagnose power but prescribe information (analysis; moderate); P2, the evidence threshold is the fulcrum and became openly political (strong); P3, uptake followed a gradient (analysis; moderate); P4, warnings are more reliable about direction than magnitude (strong); P5, “effective action” is a process, and adopting a rule is not reducing a risk (strong); P6, the move from hazard control to innovation governance invited an organised counter-frame (moderate).
5. How much weight to give#
5.1 The structural limits#
- Selection on the outcome. Every LL1 case was chosen because harm occurred, “where sufficient is now known” (LL1-00, p. 11), and so were LL2’s nine Part A cases. The corpus can show how warnings were mishandled. It cannot show how often heeding warnings of comparable strength would have been right, because it has no denominator of warnings, including those that proved false (critiques §4, §9.1; Marchant 2003). Mazur’s (2004) design, which judged a whole period’s alarms true or false, would answer this; LL2 used Mazur only as a source of alleged false positives. Strong as a limit, and disclosed by the reports themselves.
- Protagonist authorship. Authors were chosen for “substantial involvement” (LL2-00, pp. 9–10). This gives archival depth and specialist knowledge, and a tilt. Four of LL1’s seven editors wrote cases and then distilled the lessons; the false-alarm chapter was led by an editorial-team member. No Part A contribution comes from a company whose conduct is at issue or a regulator defending itself. The only company voice in LL2 is Bayer’s dissent on neonicotinoids, in Part B (Panel 16.1, pp. 401–402, with the authors’ reply, pp. 403–406). Within Part A the nearest counterweights are Guidotti’s reading of beryllium conduct as “denial rather than cupidity” (LL2-06, p. 145) and Castaño’s caution against exaggerating risk (LL2-05, p. 130); neither speaks for a company or regulator (section 2.7).
- Uneven hindsight. The reports ask to be judged by “the spirit of the times” (LL1-00, p. 11). They apply this to excuse two of the four false positives (swine flu and saccharin were reasonable ex ante; LL2-02, pp. 31–32), but not symmetrically to false negatives, several of which are dated from warnings whose actionability is disputed: asbestos before 1930 (the historian the chapter cites, Bartrip, argues the opposite), PCBs from a class-level 1899 report, MTBE on an undocumented foreseeability argument (LL1-11, p. 115), TBT’s “nothing precautionary” despite France acting in 1982 on the “best information available” (LL1-13, p. 136). Moderate. Hindsight bias is limited where the evidence is contemporaneous internal intent (tobacco, vinyl chloride, beryllium, PCBs).
- Compression strips caveats. Each summary layer drops qualifications from the layer below: Chapter 17 turns “illustrative, rather than definitive” into cases that “both support and illustrate” the lessons, and drops the proportionality caveats (LL1-16, p. 169; LL1-17, p. 193); Chapter 28 restates “4 of 88” without Chapter 2’s subjectivity caveat, its one-third “the jury is still out” category or its critics’-list denominator; the EEA’s launch release called precaution “nearly always beneficial” (critiques §5.3).
- Frequency words are uncounted. “Most”, “many”, “virtually all” and “for the most part” appear without tallies.
- Prevention failures dominate the evidence. Many LL1 cases, and most of Part A, are failures to act on known harm (benzene, asbestos after the 1960s, vinyl chloride, tobacco, beryllium, Minamata, lead), not failures of precaution under genuine uncertainty (LL1-17, Table 17.1, p. 192; LL1-04, p. 46; T09 §12.4). The false-positive debate, and the emerging technologies a lens is meant for, bear mainly on the smaller set of genuine uncertainty cases, where the reports’ only prospective test (their own forward warnings) has a mixed record (section 5.5, item 6). Marchant’s point applies: a precautionary principle cannot prevent what is genuinely unanticipated, and the stronger charge is slow response once evidence emerged (critiques §4). Strong as a limit.
- The counterweight can be overdone (T09 §12.3). Selection undermines claims about frequency, not the mechanisms documented case by case (suppression of dissent, producer control of research, manufactured doubt, externalised costs, lock-in), and document-based evidence for doubt-manufacturing has grown since 2013. The critics’ own lists of “scares” were showcases too. And hindsight confirmed most of the harms: most Part A false negatives are now mainstream public-health history.
5.2 False positives: what the review showed and what survives#
Reports say. A regulatory false positive is a case where authorities acted on a suspected risk and later evidence gives at least “high confidence” (67–95%, on the IPCC scale) that the activity did not pose it; only government regulation counts (LL2-02, pp. 18–19). Of 88 cases drawn mainly from critics’ lists, four were genuine (p. 25). False positives are “few and far between as compared to false negatives” (pp. 10, 35). The authors concede that “interpreting scientific literature includes some level of subjectivity” (p. 33).
Seven design choices keep the count low (T09; critiques §5.3): 1. Asymmetric bar. A false positive needs high confidence of no harm; “real risk” has no stated threshold. LL2’s evidence scale illustrates, with approval, regimes that act on “weak” (10–33%) or “moderate” evidence (LL2-27, Table 27.2, p. 658), while a false positive requires “high confidence” (67–95%) of no harm (LL2-02, p. 18). (The table describes existing regimes; the EEA’s working definition itself asks only for “an appropriate strength of scientific evidence”, p. 649.) 2. “Jury still out” as a holding category. Proving a negative is rare. 3. Regulation-only scope. Alarms acting through markets, liability or rhetoric cannot count (MMR is filed as an “unregulated alarm”, p. 22). 4. Trade-offs defined out. Risk-risk trade-offs are classed as mistaken false-positive claims, so the critics’ main concern cannot register. 5. Proportionality untested. Any documented harm rules out a false positive, whatever the cost of the response (aflatoxin and DDT scored “real risk”). 6. No denominator. The 88 are a showcase: Lieberman and Kwon alone supply 28. 7. The report’s own candidates untested. LL1’s two (North Sea sludge dumping, Y2K) are not among the 88.
Evidence and hindsight. - Of about 18 checked cases in the category “the jury is still out”, about 12 moved towards harm or regulation (BPA, phthalates, PFOA, perchloroethylene, endocrine disruptors) and about 3 towards reassurance (GM food safety, mobile phones, Bt pollen and monarch butterflies). The check was selective (hindsight LL2-02). - The nitrite analysis, where lower nitrite plus ascorbate and monitoring made bacon nearly nitrosamine-free within a year (p. 25), is the chapter’s best worked case and was vindicated (processed meat IARC Group 1, 2015). - False positives were not short-lived. Saccharin labelling lasted 23 years; irradiation approvals stalled about 15–20 years. Cyclamate, which the chapter classes “the jury is still out” rather than as a false positive, is still banned in the US after 55 years. MMR, excluded by design, aged worst. - No independent re-analysis of “4 of 88” exists; it circulated in policy documents uncorrected.
Rating. - “Alleged false alarms in critics’ showcase lists mostly proved real or unresolved”: moderate–strong (a selective check: of about 18 cases in the category “the jury is still out”, about 12 moved towards harm, about 3 towards reassurance; T09 §5). This is a finding in the reports’ favour. - “Claimed false alarms deserve the same scrutiny as claimed harms”: a procedural norm that follows from both halves of the record. - “Definitions and thresholds decide how many errors of each kind are found”: strong, and cuts both ways. - “False positives are rare relative to false negatives”: unmeasured, neither established nor overturned. Hindsight’s verdict is that the underlying point “has not been overturned, and many alarms have since been confirmed”, while “4 of 88” is fragile and unreplicated (hindsight LL2-28). Movement since 2013 leans the reports’ way on a selective sample. - “False positives are brief and narrow”: weakened.
The asymmetry argument. LL2-28 argues that under irreversibility a precautionary measure paired with research can be reversed while missed harm cannot, so policy should tip “towards avoiding harm, even at the cost of more false alarms” (p. 673). Moderate as a conditional. Its premises fail in documented cases: precautionary measures persisted for decades; the reports’ own “homo-illogical cycle” undercuts sustained research (p. 680); and precaution itself caused irreversible harm. The clean ex ante case is swine flu: a precautionary mass immunisation produced 107 Guillain-Barré cases and six deaths across 40 million inoculations (LL2-02, p. 28). Fukushima Prefecture counts 2,351 disaster-related deaths from stress and ill-health among evacuees, and UNSCEAR documents no radiation-attributable disease among residents; but the count covers the combined earthquake, tsunami and nuclear disaster, with no official split, and these are costs of emergency protective action after an accident, not of precaution before deployment (hindsight LL2-18). They still show that protective measures can cause irreversible harm. Analysis: state it as a conditional. A missed harm probably costs more than an unnecessary restriction when the agent is persistent, latent or irreversible, exposure is widespread, the restriction is reversible, and the benefit forgone is modest or substitutable. Elsewhere it is an empirical question.
Methods biased towards false negatives. Table 26.4 lists ten design features biased towards false negatives against three towards false positives (LL2-26, p. 635). Strong for regulatory defaults and low-powered hazard studies (for data-poor chemicals, inaction is a false negative by construction). Weak as a general law: the replication crisis, the “decline effect” in ocean-acidification studies of fish behaviour, and a 2024 bias simulation that reproduced Interphone’s heavy-user excess with no true effect show errors running both ways (hindsight LL2-26, LL2-27). The sound restatement: under low power and high uncertainty both false alarms and false reassurance become likely, and which is costlier depends on irreversibility and scale (hindsight LL2-26).
5.3 External critiques: which are strong#
| Critique | Access (critiques file) | Assessment |
|---|---|---|
| Case selection and missing base rates (Marchant 2003; Hammitt et al. 2005; Mazur’s design) | Marchant [full]; Hammitt [abstract]; Mazur [meta] | Strong against any frequency or expected-value reading; much weaker against mechanism claims, which Marchant accepts |
| The false-positive method (Cox 2007; definitional points above) | Cox [abstract]; the authors’ reply (Hansen et al. 2007b) [meta] | Strong against “4 of 88” as a rate. The rating rests mainly on this document’s own reading of LL2-02 (pp. 18–19, 33) and critiques §5.3, not on Cox, whose paper was seen only in abstract and whose reply was not read. The review remains a fair rebuttal of critics’ lists |
| Risk-risk trade-offs and distribution (Graham and Wiener; Goldstein, who uses MTBE, an LL1 case; Majone on aflatoxins; Sunstein on DDT) | Graham and Wiener [known]; the 2008 exchange [meta]; Goldstein and Majone [abstract]; Sunstein [full] | Moderately strong. The reports document such trade-offs but keep them out of the error ledger. Unread reply: Hansen and Tickner (2008) argue, judging from titles and LL2’s summary, that trade-offs are often overstated and avoidable through alternatives assessment (LL2-02, pp. 24–25) |
| Advocacy in the contested chapters (mobile phones; the GM health claim; nuclear casualty figures) | This document’s own reading and hindsight files | Moderately strong, and exactly where hindsight has been least kind |
| Legal vagueness (“appropriate strength of evidence”, “reasonable grounds”) (Marchant and Mossman) | Marchant [full]; Marchant and Mossman [meta] | Strong in practice. The EEA definition moves hard choices into placeholders |
| “Paralysis” and incoherence (Sunstein; Peterson) | Sunstein [full]; Peterson [summary] | Decisive against strong versions. Met in the definition’s wording, which requires weighing “pros and cons of action and inaction” (LL2-27, p. 649), not in the synthesis chapters’ practice: LL2-27 argues only for more precaution (section 5.6), LL2-02 keeps trade-offs out of the error ledger (section 5.2), and LL2-28 tilts policy by default (p. 673). Residual force: once both sides must be weighed, the weighing does the principle’s work, and the definition gives no method for it or for who does it (critiques §3.1) |
| Fear, trust and the social costs of precaution (Durodié 2003) | [abstract] | Suggestive. Heavily precautionary regimes can carry unrealistic resource demands, and a “right to know” can leave people feeling less safe rather than more (critiques §3.5). The reports do not engage it |
| How alarms are handled and communicated (Löfstedt, on the Swedish acrylamide alarm) | [meta] | Moderate as a gap. LL2 classes acrylamide “the jury is still out”, which later hazard evidence supports; but Löfstedt’s point concerned how the alarm was communicated, which the 88-case framework does not assess (critiques §3.3) |
| Precaution is effectively irreversible because investment stops (European Risk Forum 2015, which coordinated the chief executives’ 2013 innovation-principle letter) | [full] | Suggestive. Bears directly on LL2’s claim that over-regulation “can be quickly caught” (LL2-02, p. 34). Neither side offers systematic evidence on reversal rates; hindsight on saccharin, irradiation and cyclamate leans towards persistence (section 5.2; lens entries T3, W8) |
| Selective precaution (Wiener, Rogers, Hammitt and colleagues) | [meta]/[abstract] | Strong as a reframing: precaution is applied unevenly by institution and by risk, which LL1 itself concedes (p. 168); which risks get precaution is a political outcome needing explanation (critiques §3.4, §9.4) |
| Blanket “anti-science” or “anti-innovation” | Various | Weak: both volumes argue for more and different science and for redirecting innovation |
| Ad hominem objections to authors’ expertise (the Risk-Monger blog) | [full] | Weak as argument; useful as a record of reception |
Defenders. Besides Stirling, Wynne and Gee (below), philosophers have answered the standard charges: Sandin and colleagues (2002) [meta/known] argue that the charges of being ill-defined, absolutist, risk-increasing and unscientific can be met; Steel (2015) [known] builds a version designed to meet the incoherence objection through proportionality and consistency. These defend a principle, not the EEA’s case evidence (critiques §8).
Standpoints. This document discloses report authors’ standpoints throughout (section 2.7; Appendix A). Critics’ standpoints were not examined to the same standard. The critiques file records only that the European Risk Forum coordinated chief executives’ lobbying for an “innovation principle” (described by a critical NGO as a lobby group drawn from heavily regulated sectors), and that the Risk-Monger is the openly polemical blog of a Brussels risk-communication commentator (critiques §5.2, §7). Readers should apply the symmetry check in section 6.1 (rule 2) to critics too.
Critics concede ground: Marchant that false negatives are generally more serious and responses were often too slow once evidence existed; Majone that precaution has a role where irreversible damage is imminent; Sunstein the value of not demanding proof and of protecting the vulnerable (critiques §9.3). Defenders’ strongest reply (Stirling, Wynne, Gee) is that precaution is a framework for broadening appraisal, not a decision rule, and that risk assessment is no less value-laden. This answers incoherence; it is weaker on operationalisation and on who sets the threshold.
5.4 Hindsight verdicts across the sections#
Verdicts summarise each section’s hindsight file (evidence to September 2026). “Core” means the section’s central diagnosis or mechanism.
| Id | Case | Verdict since publication | One-line note |
|---|---|---|---|
| LL1-00 | Preface and Introduction | Mixed | Latency “pipelines” and label variation strengthened; Peto range loose; Table 1.1 errors; the claim that precaution would avoid trade disputes did not hold; low trust in scientists not supported |
| LL1-02 | Fisheries | Core held and strengthened | Assessment bias and catches above advice persist (2026 North Sea cod limit against zero-catch advice); sardine collapse misdated; pessimism about model-based rules too general; northern cod reopened 2024 partly via a lowered reference point |
| LL1-03 | Radiation | Mostly held and strengthened | Low-dose cancer risk confirmed in worker and CT cohorts; surveillance call vindicated; power-line analogy weakened; threshold lobbies moved to political venues (2025–26) |
| LL1-04 | Benzene | Core held; specifics overstated | Limits fell far below 1 ppm outside US federal rules (EU 0.2 ppm, 2026); gasoline IARC Group 1 (2025); disease spectrum, 54/1,000 risk and “>200 deaths” are protagonist upper bounds |
| LL1-05 | Asbestos | Core held and strengthened | All forms carcinogenic, no threshold; ban effects shown; US ban 2024; UK peak overstated 20–35%; several cost figures unreliable; compensation-to-prevention link unsupported |
| LL1-06 | PCBs | Core held; health advocacy weakened | Legacy stock and private–public divergence confirmed from primary documents; state settlements; paediatric attributions not borne out; “100 years” inflated by ~40 |
| LL1-07 | Halocarbons and ozone | Mostly held and strengthened | Persistence forecasts right; HCFC/HFC critique adopted (2007, Kigali); CFC-11 cheating detected; recovery dates slipped; feedstock exemptions leak; “not precautionary” contested |
| LL1-08 | DES | Held and strengthened | Common reproductive harms quantified; 1971 efficacy review still “possibly effective”; daughters’ breast cancer contested; third generation unresolved |
| LL1-09 | Growth promoters | Direction vindicated; flagship weakened | Animal resistance fell after bans; Pfizer upheld; bans spread (EU 2006, US 2017, imports 2026); VRE weakest human-harm link; human benefit evidence rated low quality; transition costs omitted |
| LL1-10 | Sulphur dioxide | Core held; numbers weak | Dispersion story and critical loads vindicated (exceedance 3.5% by 2024); “tenfold” contradicted by own source; London toll understated; forest vitality forecast wrong; biggest benefit and cost outside the frame |
| LL1-11 | MTBE | Core held; history corrected | US exit by 2006–07; EU persistent-mobile classes; IARC 2B (2025); warnings existed 1984–88, so “never considered” was wrong; “everlasting” overstated; substitution chain continued |
| LL1-12 | Great Lakes | Mixed | Legacy tail and neurodevelopmental direction held; “proven” and “irreversible” overstated; waning-support forecast wrong; recovery non-monotonic |
| LL1-13 | TBT | Held and strengthened | Global convention worked (imposex exceedance 81% → ~21%); shipping confirmed as main source; persistence understated; mechanism superseded; “none precautionary” too sweeping |
| LL1-14 | Hormones | Evidence lessons held; science contested | Low-baseline children and assessment-scope points strengthened; genotoxic-carcinogen verdict still disputed; sanctions overstated; settled by beef quota, not science |
| LL1-15 | BSE | Narrative held; motive contested | Feed leakage and poor enforcement confirmed; “covertly subordinated” rejected by the inquiry; active testing found hidden disease; measures later wound back through costed review |
| LL1-16 | Twelve lessons | Mechanisms held; optimism thin | No-evidence, applicant-data, institutional-variation and substitution claims strengthened; innovation, diversity and public-understanding claims thin; small factual slips |
| LL1-17 | Conclusions | Diagnosis held; prescriptions contested | Level of proof as political choice strengthened; screening and monitoring strengthened; innovation contested; lessons as a package untested |
| LL2-00 | Preface and Introduction | Mixed | Persistence and vulnerable-window warnings strengthened (PFAS); emerging warnings mixed; “irresponsible corporations” partly held up (the legal-remedy half borne out strongly; the generalisation weakened by harms caused by public authorities); trust claim weakened; “4 of 88” unreplicated |
| LL2-02 | False alarms | Rebuttal held; rate claim not established | Most checked cases classed “the jury is still out” moved towards harm; false positives proved long-lived; MMR aged badly; not an error-rate estimate |
| LL2-03 | Leaded petrol | Core strengthened; specifics wrong | No threshold; CDC 3.5 µg/dL; WHO attributes 3.5m deaths to lead; CDC level already outdated in 2013; IQ gain misquoted; alcohol oversold; aviation lead still permitted |
| LL2-04 | PCE in water mains | Core held | Harm later documented in exposed cohorts; assessors still diverge; “on the cusp” of confirmed carcinogen wrong; action came via a US statute on neurotoxicity (2024), then reconsidered |
| LL2-05 | Minamata | Mechanisms held (13-year record) | Recognition frozen; 1977 criteria unchanged; survey only a pilot; litigation split; legal wording needs correcting; Grandjean’s limit claim contested |
| LL2-06 | Beryllium | Core strengthened; prescription weakened | Tenfold-lower limits (US 2017, EU 2019); “end most use” reversed as beryllium became a critical mineral; discount-versus-audit half right; exit-route thesis partly |
| LL2-07 | Tobacco and research | Strengthened | US fraud findings (2006, 2009); sponsorship bias corroborated; cross-sector playbook documented; breast-cancer claim contested; OR 88.4 an outlier |
| LL2-08 | Vinyl chloride | Core strengthened; extras weakened | Concealment archive public; liver cancer and cirrhosis strengthened; multi-site cancer list weakened; cost overestimate ~4×, not 300× |
| LL2-09 | DBCP | Core held; details wrong | Neglect confirmed by primary record; groundwater exceedances projected to ~2080; regulatory and exposure details wrong; litigation account one-sided |
| LL2-10 | Bisphenol A | Vindicated in EU; dispute widened | EFSA intake limit cut 20,000-fold on an academic study; EU ban 2024; other assessors dissent; jointly designed study reproduced the split; mechanistic claims weak |
| LL2-11 | DDT | Mechanisms held; pace and health claims weak | Resistance, substitute uncertainty and leakage confirmed; use fell to 370 t (2023) faster than forecast; several health findings not replicated; single-cause South African story |
| LL2-12 | Booster biocides | Strengthened | EU non-approval (2016) and IMO ban (2023) of cybutryne; next substitutes flagged (medetomidine endocrine finding 2024); “policy proven effective” unsupported |
| LL2-13 | Ethinyl oestradiol | Held; regulation late but stricter | EU standard of 0.017 ng/L (2026) with 2039 target; producers pay ≥80% of treatment; measurement limits confirmed; cost projections optimistic; populations hedged sensibly |
| LL2-14 | Climate | Descriptive history held | Emissions record 54.1 Gt (2025); Kyoto “hot air”; science confidence strengthened; targets overtaken; “precaution redundant” contested |
| LL2-15 | Floods | Mechanisms strengthened; numbers weak | Weakest-link failures recurred (Ahr 2021, Valencia 2024); memory decay supported; flood projections and Floods Directive claims unverified |
| LL2-16 | Neonicotinoids | Method critique vindicated; some science weakened | EFSA, courts and auditors confirmed the method was unfit, yet new guidance still not in force (2026); restrictions became law; synergy and honeybee-sentinel claims weakened; real crop losses; derogation cycles |
| LL2-17 | Ecosystems and fisheries | Mixed | Canadian override story held; “irreversible demise” of cod overturned; Norway exemplar factually flawed and later overshot; EU override persists; Baltic cod collapsed |
| LL2-18 | Chernobyl and Fukushima | Institutional held; health weakened | “Safety myth” and capture confirmed; costs ~100× liability caps; overruns; no documented radiation-caused disease at Fukushima; evacuation harms unforeseen; phase-outs reversed |
| LL2-19 | GM crops and agroecology | Political economy strengthened; health and yield claims weakened | Treadmill, narrow traits and concentration borne out; Séralini retracted; agroecology yield gap ~19–25% |
| LL2-20 | Invasive species | Diagnosis held; forecasts late | No saturation; costs quadrupling each decade; EU instrument came 2015; ruddy duck not eradicated; USD 1.4tn figure misattributed |
| LL2-21 | Mobile phones | Core epidemiology largely weakened | Large independent cohorts and national incidence data find no increased risk, as does a WHO-commissioned review (assessed from its abstract; several of its authors held ICNIRP roles or co-authored studies the chapter disputes); isolated signals persist (CERENAT; a bias-adjusted Canadian Interphone reanalysis; IARC 2024 “mixed”); institutional observations hold; the reports’ clearest not-borne-out warning, unresolved rather than refuted |
| LL2-22 | Nanotechnology | Architecture diagnosis held; outcome untested | Protagonist update of the authors’ 2008 article (section 1.5); voluntary reporting superseded; REACH nano rules 2020; definition settled 2022; MWCNT carcinogen classification (2026); TiO2 classification annulled; nanosilver risk weaker; governance recommendations largely not adopted |
| LL2-23 | Costs of inaction | Mechanism strengthened; numbers low weight | Undercounting confirmed (lead-attributable death estimates rose several-fold as exposure models changed; the omitted cardiovascular pathway dominates later cost estimates); conservative-bound rule in EU air law; valuation conventions reversed in US (2025) |
| LL2-24 | Early warners and victims | Diagnosis held; proposals not adopted | Proof rules and tort delays confirmed; whistleblower law covers breaches only; France’s alert commission abolished 2026; no bonds; arithmetic errors; undisclosed expert role |
| LL2-25 | Business | Diagnosis strengthened | Private knowledge versus public doubt documented afresh; cost-shifting confirmed; “virtually all” built into selection; firms differed; success example double-edged |
| LL2-26 | Science | Mixed | PFAS and BPA vindicated in the EU; research neglect held but inertia overstated; one-directional error claim most weakened; exposure-limit ratchet not universal |
| LL2-27 | More or less precaution? | Diagnosis and tools held; prescription contested | Barriers and product defence confirmed; emerging hazards diverged; innovation claim weak form only; policy climate turned against it |
| LL2-28 | In conclusion | Mechanisms held; statistics fragile | Harm expansion strengthened for named agents; committee divergence persists; “4 of 88” unreplicated, the 1% figure unsourced (plausible range 1–2%) and “half of all articles” overstated about fourfold; GM health sentence weakened; transparency adopted, redistributive tools not |
| LL2-A2 | Annex 2 | Qualitative story held; lag measure weak | Long lags and slow recovery vindicated; “effective action” was a decades-long process; several figures imprecise; hormones contested |
| LL2-A3 | Annex 3 | Direction held; magnitude and mechanism weak | Gasoline, asbestos, BPA, growth promoters and ozone moved as predicted; claims resting on contributors’ own unpublished work not confirmed |
5.5 Patterns in the verdicts#
- Mechanisms and institutional diagnoses held in essentially every chapter. Strong (hindsight files, mostly independent sources).
- Specific numbers are the weakest layer, and errors ran both ways. Overstatements: the Peto range restated in 2013 as “some 400 000” mesothelioma deaths; benzene’s “>200 deaths”; the EUR 160m hormone sanction; vinyl chloride’s 300-fold cost contrast; “half of all articles” (about fourfold); the 1% research-funding figure (unsourced; plausible range 1–2%). Understatements: US asbestos settlements given as “USD 2 billion” against USD 70 billion by 2002 (T05 §4.4); the London 1952 death toll (hindsight LL1-10); TBT persistence (hindsight LL1-13); lead-attributable deaths, where later estimates rose several-fold (hindsight LL2-23). Analysis: costs of inaction tended to be lower bounds, while protagonists’ own health estimates tended to be upper bounds.
- Direction outperformed magnitude and mechanism. Annex 3’s warnings moved the predicted way; its claims resting on single laboratories or unpublished work mostly did not.
- What distinguishes the failures is narrower than conviction. Protagonist authorship and self-citation are common both in chapters that held and in chapters that failed: lead (Needleman’s own “seminal” work), benzene (Infante’s own cohort), BPA (Soto co-authored many sources), PFAS (Grandjean’s own study in his own journal), ethinyl oestradiol (the authors’ own studies), multi-walled carbon nanotubes (the authors’ own warning) and ozone (Farman) all held or were vindicated (digests LL2-03, LL1-04, LL2-10, LL2-26, LL2-13, LL2-22, LL1-07). The failures share something narrower: key claims rested on one group’s positive findings, or on unpublished work, and were later contradicted by larger independent studies (mobile phones, the GM health sentence, the Chernobyl mortality figures, the PCB paediatric attributions, Annex 3’s laboratory claims). Where protagonists’ findings were independently replicated, they held. Moderate.
- Several “vindications” rest on mechanism or concentrations, not measured outcomes: growth promoters, booster biocides, neonicotinoid bans.
- The emerging-issue warnings split. Vindicated or moving the reports’ way: BPA, neonicotinoids, endocrine disruptors, PFAS, invasive species, one carbon-nanotube type. Not borne out or reassuring: mobile phones, GM food health, Fukushima radiation health, broad nanomaterial harm. The reports’ own emerging set therefore contains candidate false positives, which a lens built from them should count.
- Uptake followed a gradient from low-cost to redistributive lessons (section 3.6), and protective reforms proved politically reversible while incumbent capital persisted for decades.
5.6 Where the reports are advocacy rather than analysis#
- The synthesis chapters (LL1-16, LL1-17, LL2-27, LL2-28) are the editors’ programme. Analysis: the ESTO framework “provided the initial framing” (LL1-16, p. 168) and the lessons were “distilled” by the editors from the case authors’ lessons (LL1-00, p. 3), with no reported coding or counter-case search, so the framework shaped what the cases were used to show. LL2-27 asks “more or less precaution?” but argues only for more. Its principal critics (Sunstein, Graham and Hsia, Wiener, the European Risk Forum) appear only in the bibliography, although many supportive works are also uncited, so the trimming was general, and Gee does rebut the critics’ reading of the North Sea Declaration (p. 657) (notes LL2-27).
- The prefaces: critics who “fear or imagine” (LL1-00, p. 4); “There is something profoundly wrong” and harms “for the most part” from “irresponsible corporations” (LL2-00, pp. 6, 11).
- The innovation and false-positive balance claims, which firmed up in 2013 on evidence from the same network.
- Motive attributions beyond the documents: BSE “covertly subordinated” (LL1-15, p. 164); DES “economic interests predominated” (LL1-08, p. 90); PCE “artificially and purposefully creating doubt” (LL2-04, p. 88); radiation “politics entered the scene” (LL1-03, p. 34); a mobile-phone “spinning machine” (LL2-21, p. 521).
- Protagonist chapters defending their own work or positions: mobile phones (Hardell’s own studies, with the rival study’s industry money scrutinised and his group’s telecom funding in a footnote); GM crops (forensic standards for GM, face-value acceptance of agroecology syntheses); nuclear health figures (Greenpeace-published and renewables-commissioned sources flagged only in references); Annex 3 claims from contributors’ own laboratories; undisclosed expert-witness or litigation roles (Cranor in Milward; Ozonoff in PCE cases); invasive-species authors running the institutions they describe; nanotechnology (LL2-22), a protagonist update of the authors’ own 2008 article, with about a quarter of its references the authors’ own work, a key early warning co-authored by Maynard (Poland et al. 2008), no dissenting panel, and hazard language that escalates from “preliminary” (p. 536) to “rapidly increasing evidence of risks” (p. 539); its self-cited warning on long multi-walled carbon nanotubes was later vindicated (digest and hindsight LL2-22). Protagonist authorship is not itself a mark of failure (section 5.5, item 4).
- Asymmetric scrutiny: latency used to discount null studies while short-latency positives are accepted (LL2-21); national-scale framing faulted in regulators but used against farmers (LL2-16); public intuition credited only where it proved right (LL1-16, pp. 178, 188).
- A risk of unfalsifiability: the GM chapter treats “the persistence of the same institutional patterns” as itself the emerging late lesson (LL2-19, p. 470).
What is analysis-grade. Chapters built on contemporaneous records: tobacco (internal documents and court findings), vinyl chloride (secrecy agreement), BSE (ministry minutes and official inquiry), beryllium (litigation documents, with Guidotti’s counter-reading), the Minamata ministry reply, the fisheries reviews, the TBT monitoring record, and the ozone chapter’s physical forecasts. The reports are also fairer than their reputation in places: LL1-16 rejects blanket opposition to innovation (p. 169), concedes that research can increase uncertainty and that restricting the wrong agent is “in no way precautionary” (p. 173); the asbestos authors concede that rebalancing would sometimes restrict things later shown safe (LL1-05, p. 60); the EE2 authors ask whether “the price of being precautionary” is “simply too high” (LL2-13, pp. 294–296); the floods chapter separates a real risk that did not materialise from a false alarm (LL2-15, p. 354).
5.7 What the reports cannot support#
- No base rate for how often warnings of a given strength proved right.
- No prospective test for telling true warnings from false ones; the factors for choosing a threshold are named but never weighted (LL1-17, p. 193; LL2-28, p. 676).
- No systematic accounting of the costs of precaution (admitted “beyond the scope”, LL1-16, p. 168).
- No exit or de-escalation criteria.
- No integrated treatment of precaution-induced trade-offs.
- No evidence that the twelve lessons work as a package.
- No robust claim that precaution stimulates net innovation.
- No comparative test of “more precautionary” regimes.
- No analysis of power, declared out of scope.
- Proxies for ignorance (persistence, bioaccumulation) that are chemical-specific; novelty alone proved a weak signal (hindsight LL2-27).
- No analysis of the interests on the side of alarms and restrictions (competitors, makers of substitutes, domestic producers, advocacy and research programmes); every interest analysed is on the side of producers or promoting states (section 4.3).
5.8 Net weighting guide#
| Type of claim in the reports | Weight for the lens |
|---|---|
| Documented mechanisms (search-produced “no evidence”, framing, measurement limits, latency, producer knowledge, rule-changing, lock-in, regrettable substitution, persistence, displacement, reassurance trap, implementation gap) | High |
| Evidence threshold as allocation of the cost of error | High |
| Governance diagnoses (dual mandates, assessor divergence, reach mismatch) | High for existence; moderate for causal weight |
| Lay and frontline detection | Moderate as detection; low as validation |
| Innovation, diversity and trust claims | Low; weak form of the innovation claim only |
| Frequency claims (false alarms rare; errors one-directional; “virtually all”) | Low |
| Specific numbers and counterfactual costings | Low unless corrected against the hindsight files |
| Emerging-issue forecasts | Case by case; treat as a mixed prospective record |
“High” means high as a question to ask. It is not evidence that the mechanism is operating in a given case. For emerging technologies, weight each lens entry by its support from genuinely uncertain cases and forward warnings (tags [U] and [F] in section 6), not only by its support from failures to act on known harm ([K]).
6. The lens: a technology-neutral toolkit#
This section distils the patterns above into diagnostic tools that can be applied to any emerging technology and to those who develop, finance, promote, oversee, warn about, campaign against or restrict it. It is designed to stand alone. Each entry gives the pattern; the questions to ask (Ask); a Mirror question that turns the entry on those raising a concern or proposing a restriction; its evidence base in the reports (section ids and pages); its strength, overall and by case type; and its known limits, including, where the files show it, whether the pattern also appeared where the warning proved wrong. Each entry is tagged by layer and by the stage of a technology’s life at which it mainly applies.
The lens is built from a corpus of failures. Most of its entries therefore describe how harm is missed, discounted or hidden. Entries W7, W8, T3, T4, I9, C7 and S4 describe how warnings, alarms and restrictions go wrong, and the Mirror lines apply the same scrutiny to warners throughout. Section 6.12 lists responses that worked.
6.1 Rules for using the lens#
- Run the symmetry checks first, and again before concluding. - Would the same scrutiny catch an unfounded alarm promoted by an interested advocate? (MMR, excluded from the false-alarm review as an “unregulated alarm”, aged worst; hindsight LL2-02. The mobile-phone warning was written largely by the authors of the studies it relied on; hindsight LL2-21.) - Are critics’ and advocates’ funding, legal roles and stakes disclosed to the same standard as the developer’s? (The reports put their own mobile-phone authors’ telecom-operator funding in a footnote while scrutinising the rival study’s industry money, LL2-21, fn 11; several authors’ expert-witness roles went undisclosed; section 5.6.) - Is the evidence of interested distortion documented (internal records, official findings), or inferred from timing and outcome? Where bad faith was alleged on documents, later records corroborated it; where it was inferred from outcome, hindsight usually weakened it (section 4.8). - Are the examples used to argue for or against caution a sample or a showcase, and what is the denominator? (LL2-02, p. 19; LL1-00, pp. 11–13.) - Is the warning about direction, or about magnitude and mechanism, and is it weighted accordingly? (Hindsight LL2-A3.) - Do summaries of the evidence carry forward the caveats of the underlying analysis? (Chapter 28 restated “4 of 88” without Chapter 2’s subjectivity caveat; LL2-28, p. 673 against LL2-02, p. 33.) - Has the full range of graduated, provisional and reversible responses been considered, or only allow-or-ban? (Section 6.12; LL2-02, p. 35.)
- Use it for mechanisms, not frequencies. The reports show how things go wrong, not how often. A pattern’s presence is a reason to look harder, not a prediction of harm, and a count of patterns present is not a verdict.
- Apply it symmetrically. Ask every question of proponents and of critics, of the technology and of any proposed restriction, substitute or alternative. Each entry’s Mirror line is the minimum. The reports’ weakest chapters are those that did not (section 5.6).
- Judge ex ante, with consistent dating. Ask what was knowable, by whom and at what strength of evidence at the time. Distinguish “a warning existed that later proved right” from “the warning was actionable at acceptable cost”.
- Separate prevention from precaution. Many historical failures were failures to act on strong evidence (asbestos after the 1960s, benzene, vinyl chloride, Minamata). These are different problems from acting under genuine uncertainty, and need different remedies. Use the case-type tags (section 6.2) to see which kind of evidence supports each entry.
- Assign knowledge states to sub-questions. One technology can sit in “risk” for one pathway, “uncertainty” for another, “ambiguity” where values are contested, “variability” where effects differ across people and places, “indeterminacy” where future uses cannot be predicted, and “ignorance” for unknown failure modes, all at once (LL2-27, Table 27.1, p. 656).
- Weigh direction above magnitude. The reports’ warnings were more reliable about which way things would move than about how large effects would be or by what mechanism.
- Look for comparators. Who, facing similar evidence, acted differently, and what happened to them? Treat heterogeneity among firms and jurisdictions as evidence: it is the best check on claims that action is unaffordable or inaction inevitable (T05 Q15). Examples: Shizuoka Prefecture used food law for shellfish poisoning in 1950 while the national ministry refused in 1957 (LL2-05, pp. 98–99); Sweden and Denmark acted on growth promoters before the EU (LL1-09, pp. 95–96); California eradicated Caulerpa where France did not (LL2-20, p. 498); the US acted on DES years before Europe (LL1-08, pp. 86, 89); Bermuda acted on booster biocides before the EU (LL2-12, p. 271); a rival refiner declined MTBE, and the beryllium producer co-drafted a tighter limit (hindsight LL2-25, LL2-06). Comparators are themselves selected, so use them as checks, not proofs.
- Pair every entry with the critics’ countervailing questions (critiques §9.4). Of any proposed protective response, ask whether it creates substitute or countervailing risks; forgoes benefits, especially for the least advantaged; can be captured to protect incumbents or markets; and is reversible in practice. And treat selective precaution, applied to some risks and not to comparable ones, as something to explain (critiques §3.4).
- Weight by case type. A strength earned mainly from failures to act on known harm ([K]) transfers less well to emerging technologies than one supported by genuinely uncertain cases ([U]) or by the reports’ own forward warnings ([F]). Each entry’s Strength line gives both.
- Record, don’t add up. For each entry applied, record: present / absent / unknown; the evidence; its source and whether it is documented or inferred; confidence; and the Mirror result. Do not sum entries into a verdict.
6.2 How to apply it: tags, case types and a first pass#
Layer tags. Epistemic; Political-economic; Economic; Institutional; Systemic; Cultural (cultural or cognitive), as in section 1.1.
Stage tags. Pre-deployment (design, appraisal, approval); scaling (adoption, mandates, growth); first signals (early warnings); contested (disputed evidence and proof); after restriction (implementation, substitution, review, exit); legacy (stocks, liability, remediation). Neither report names the Collingridge dilemma, but both analyse it through lock-in (section 2.6): the governance window narrows as commitment grows, so entries tagged pre-deployment and scaling matter most for emerging technologies. LL2-22 argues for intervening at design, before lock-in, and notes that reform windows are scarce (pp. 539–540, 547, 550–551; asserted).
Case types (analysis; the boundaries are contestable, see section 5.1, item 3): - [K] Known harm, prevention failure. The harm and its cause were established, or known inside the producer, well before action: asbestos after the 1960s; benzene; vinyl chloride; second-hand smoke; beryllium’s chronic disease below the limit; Minamata after 1956; lead after the 1960s; PCBs after 1966; DBCP after the 1958 rat data; PCE in water mains; TBT after documentation; northern cod; Great Lakes remediation; sulphur dioxide after source–receptor attribution; DES after the 1953 no-benefit trial. - [U] Genuinely uncertain or unknown at the time. Early radiation; CFCs before 1974; DES before the cancer link; BSE; growth promoters; MTBE before the 1984–88 warnings; hormones; asbestos before 1930; the four false positives and the cases classed “the jury is still out” (LL2-02); flood extremes; the Fukushima design basis. - [F] Forward warnings unresolved in 2013, checked by hindsight. BPA; booster biocides; ethinyl oestradiol; climate; neonicotinoids; nuclear health; GM crops; invasive species; mobile phones; nanotechnology; Annex 3’s forecasts. Their record is mixed (section 5.5, item 6).
A first pass. For a quick application, start with the entries that are strongest and supported beyond [K] cases: K1 (search quality), K2 (the question decides the answer), K9 (real-world conditions), K10 (sensitive groups and windows), W2 (not delivered or discounted), W7 (warning quality), T1 (the threshold allocates error), I1 (private–public gap), I5 (promotion and oversight), L3 (regrettable substitution), G2 (rules against reductions) and C7 (costs of precaution). Then work through the rest by stage.
Overlaps. Some entries look at one mechanism from different sides and should be read together: K2, G4 and M2 (framing, assessor divergence and the model of harm); W3, W8 and M3 (reassurance, alarm and commitment); C1 and W4 (who pays and why knowing is not acting); L3, S2 and S4 (substitution, relocation and intervention side-effects); K4, K7 and K11 (latency, screening and harm expansion); I7 and I9 (countervailing interests for and against restriction).
6.3 Knowledge and evidence#
K1. Absence of evidence is a property of the search. [Epistemic · first signals, contested] “No evidence of harm” often means nobody looked, the study was too small or short, the detection limit was too high, or the endpoint was wrong. Ask: Was the harm actually searched for? With what power, follow-up relative to plausible latency, and detection limits? How large an effect could the evidence have missed (use the upper confidence bound)? Mirror: Is “no evidence of safety” being used as if it were evidence of harm? When several independent, well-powered studies followed long enough find nothing, is that allowed to count? Evidence: LL1-15, pp. 163–164; LL1-16, p. 172; LL1-05, p. 55; LL2-09, p. 205; LL2-06, pp. 139–140; LL2-26, pp. 631–635; hindsight LL1-16 (BSE testing). Strength: Strong. By case type: [K] strong; [U] strong (EU active BSE testing found hidden disease); [F] two-sided (mobile phones). Limits: The counterpart matters. Several independent, well-powered null lines followed long enough can cap large risks (hindsight LL2-21). Latency discounts early nulls, not later adequate ones. Diagnosticity: the same reasoning was used in the mobile-phone chapter to discount null studies while early positive results were accepted without asking why risk would appear so soon (LL2-21, pp. 512, 514; digest LL2-21).
K2. The question decides the answer. [Epistemic, Institutional · pre-deployment, contested] What assessors are asked, which endpoints and populations they use, which studies they admit and which legal categories apply determine what can be found. Ask: Who wrote the question? What did it exclude (intended use only, single agents, sponsor data, averages, one endpoint)? Is it answerable (whether a product was “solely responsible, at national level, for all” losses, LL2-16, p. 379)? Would alternative evidence-admission rules move the answer? Do legacy identifiers or thresholds make new variants invisible? Are screens built around the last hazard reassuring about the next? Are newer, more sensitive methods discounted because they are not yet validated? Are signals from test systems and surrogates dismissed as irrelevant to people? Mirror: Is a warning’s question framed so that it cannot fail (unfalsifiable multicausal claims; “persistence of the same institutional patterns” as itself the lesson, LL2-19, p. 470)? Evidence: LL1-14, p. 150; LL2-16, p. 379; LL2-05, p. 99; LL2-03, p. 68; LL2-10, pp. 220–223; LL2-22, pp. 537–541; LL1-11, p. 116; LL2-26, Table 26.3, p. 630; hindsight LL2-12, lesson 3 (an oestrogen screen passed agents that acted through other endocrine routes); LL2-10, pp. 222, 229 (validation lag); T02 §1.1 (animal data for PCBs, DBCP, vinyl chloride and DES were early warnings that preceded action by years or decades). Strength: Strong. By case type: [K] and [U] strong; [F] strong (the bee-assessment method and the BPA endpoint were later accepted by regulators and courts). Limits: Framing can also over-weight a warning that fits prevailing theory (swine flu, LL2-02, p. 31).
K3. Measurement sets the horizon. [Epistemic · pre-deployment, first signals] What cannot be measured cannot be warned about, and convenient proxies quietly become safety claims. Ask: What are the detection limits and who set them? Are proxies (smell, visible effects, per-unit metrics) standing in for the harm? What would better measurement reveal? Mirror: Is a new, more sensitive measurement being read as new harm when it only reveals existing exposure? Evidence: LL1-13, p. 136; LL2-16, p. 373; LL2-09, p. 205; LL2-08, p. 184; LL1-05, pp. 56–57; LL2-13, pp. 284, 295. Strength: Strong. By case type: [K] strong (asbestos microscopy; DBCP odour); [U] strong (TBT); [F] strong (EE2 measurement limits confirmed; hindsight LL2-13). Limits: Better measurement can also change status without new evidence of harm, and apparent “harm expansion” partly follows where detection goes.
K4. Latency and deployment speed. [Epistemic, Systemic · scaling] Where harm is slow, early reassurance is weak and exposure becomes universal before evidence matures. Ask: How does the adoption curve compare with the time needed to detect the slowest plausible harm? How much exposure will accumulate before an adequately long study could report? Could deployment be staged or reversible while evidence accrues? Mirror: Is “not enough time has passed” being used to keep a warning alive indefinitely, whatever later studies show? Evidence: LL1-05, pp. 52, 55; LL2-21, pp. 512, 517; LL2-00, p. 10; LL1-07, p. 82; LL1-08, pp. 87–88. Strength: Strong (historical persistent agents); moderate (general). By case type: [K] and [U] strong; [F] mixed. Limits: The reports’ own forward warnings on this basis have a mixed record. Diagnosticity: latency reasoning appears in both vindicated warnings (asbestos) and one not borne out (mobile phones).
K5. Self-referential indicators and moveable yardsticks. [Epistemic, Institutional · scaling, after restriction] Indicators generated by the activity itself can stay reassuring during decline; reference points can be revised so status improves without any change in the world. Ask: Are the indicators of safety or success independent of the activity? Are key parameters held constant, or heterogeneous units pooled? Who can revise the yardstick, and has it moved? Mirror: Are indicators used by those raising concern (sentinel species, selected sites) representative, or chosen because they show harm? Evidence: LL1-02, pp. 20–24; LL2-17, pp. 411–414; LL1-07, p. 82; hindsight LL1-02 and LL2-17 (northern cod reached “Healthy” status partly through a downward revision of the limit reference point, “not an increase in the quantity of cod”; the size of the cut is inconsistent across DFO documents, roughly 30–60%). Strength: Strong. By case type: [K] strong (cod); [U] strong (ozone data flagged “suspect”); [F] moderate. Limits: Not a case against models: model-based rules rebuilt many fish stocks. A revised reference point can be a genuine scientific improvement; the test is whether it was set independently and in advance.
K6. Knowledge sits elsewhere. [Epistemic, Institutional · pre-deployment, first signals] Relevant knowledge often exists in another discipline, agency, supplier or user, or inside the producer, and does not reach the decision. Ask: Which discipline owns the appraisal, and which endpoints, media or populations fall outside it? Is upstream hazard knowledge reaching downstream integrators? Who must be consulted? Does control achieved by the lead producer travel down a dispersed supply chain, and does concentrated production mean global exposure through supply chains? Mirror: Is a critic’s discipline claiming ownership of a question it is not equipped to answer? Evidence: LL1-16, p. 174; LL1-11, p. 114; LL1-15, pp. 159–160; LL2-13, p. 284; LL2-04, pp. 82–84; LL2-09, p. 211; hindsight LL2-06, lesson 4 (harm surfaced among secondary users and recyclers); LL2-19, p. 468. Strength: Moderate–strong. By case type: [K] strong (PCE, DBCP); [U] strong (MTBE, BSE); [F] moderate. Limits: Silos and interests are hard to separate; a silo is often where an interest sits.
K7. Surprise needs broad, independent, sustained observation. [Epistemic, Systemic · scaling, legacy] Surprises were usually found by systems not built to find them. Ask: What long-running, independent observation could register the unexpected? What is its power to detect a large change in time? How is it funded through quiet periods? Are the properties that make being wrong expensive (persistence, accumulation, mobility, irreversibility, scale, self-propagation) used as triggers even without a named harm? (LL2’s twelve criteria for action, Box 27.4, are listed in section 3.4.) Mirror: Is novelty alone being treated as a trigger? Evidence: LL1-07, p. 82; LL1-10, p. 102; LL1-03, p. 36; LL1-16, pp. 170–172; LL1-17, Table 17.1, p. 192; LL2-27, Box 27.4, p. 653; LL2-26, p. 634; hindsight LL1-17 (CFC-11, PFOS). Strength: Strong (monitoring); moderate (property screening, strong only for persistent chemicals); suggestive (technological diversity as insurance). By case type: [U] strong for monitoring; [F] weak for novelty as a trigger. Limits: Novelty alone predicted poorly; the proxies are chemical-specific. For adaptive or self-propagating agents, track record elsewhere predicted better than intrinsic properties (LL2-20, pp. 490, 500–501; W9). Observation systems are fragile (units closed in quiet periods; geopolitical rupture).
K8. Distinctive harms get noticed; diffuse ones do not. [Epistemic · first signals] Rare, signature outcomes trigger action; increments to common conditions, and harm to things nobody values commercially, stay invisible. Ask: Would the plausible harms be distinctive enough to notice, or would they disappear into common conditions? Is the chosen sentinel informative, or merely visible? Mirror: Is a visible but uninformative sentinel being used to claim harm (or its absence)? Evidence: LL1-08, pp. 84–87; LL2-08, p. 189; LL2-27, p. 645; LL1-13, p. 136; hindsight LL2-16 (honeybee a poor sentinel). Strength: Strong (signature effect); moderate (sentinels). By case type: [K] strong; [F] moderate (the honeybee sentinel weakened, both ways). Limits: Evidence that diffuse harms went unnoticed comes mostly from cases where they were eventually noticed.
K9. Designed conditions against real use. [Epistemic, Institutional · pre-deployment, scaling] Appraisals assume containment, maintenance, compliance, intended use and the product as sold. In practice systems leak and degrade, rules go unenforced, products transform, exposure arrives by unregulated routes, and uses spread beyond those where any benefit was shown. This carries forward lesson 5, the lesson with the widest case support (section 3.2). Ask: What does the appraisal assume about containment, maintenance, dose, compliance and purpose? Who, other than the operator, would detect leakage, misuse, unappraised uses or non-compliance? What does the product become in use and at end of life? Does the regulated metric capture every exposure route and peak? Are uses spreading into routine, prophylactic or trivial applications with no demonstrated benefit? Mirror: Are claims that controls will fail in practice documented, or assumed? Evidence: LL1-16, pp. 174–175 (leaking tanks and “closed systems”; unenforced controls; hospital doses varying up to a hundredfold); LL1-05, p. 57 (WTO: “controlled use” cannot be relied on); LL1-15, pp. 160–162 (offal controls designed around commercial convenience; about 48% of abattoirs visited in 1995 failing); LL1-11, p. 115 (double-walled tanks leaking through improper installation; containment depends on enforcement); LL1-06, p. 67 (the tested product differs from the transformed exposure); LL2-27, Table 27.1, p. 656 (“indeterminacy”: unpredictable uses such as shoe-shop X-rays, answered by pre-market benefit assessment); LL1-03, p. 34 (shoe-shop fluoroscopes under recommendation-only rules); LL1-08, p. 86 (DES advertised for “routine prophylaxis in all pregnancies”); LL2-16, p. 384 (seed dressings used preventively “regardless of the presence and abundance of pests”); LL2-22, pp. 544–546 (controlled-use assumptions; “solutions looking for a problem”); LL2-09, pp. 206, 211 (air monitoring missed skin uptake); hindsight LL2-06, lesson 2 (a full-shift average did not control peaks or skin contact); LL2-A3, p. 737 (assess real-world misuse); hindsight LL1-17 (illegal CFC-11 production detected by atmospheric monitoring). Strength: Strong (about ten cases). By case type: [K] and [U] strong; [F] suggestive (LL2-22’s controlled-use claims are asserted rather than documented). Limits: Some rules worked quickly once enforced (the all-species feed ban; the global TBT ban). Real-use data are usually gathered only after deployment.
K10. Who is most sensitive, and when? [Epistemic · pre-deployment, first signals] Reference subjects, average exposures and adult or acute endpoints hide the most sensitive groups and life stages, and the timing of exposure can matter as much as its size. Ask: Which groups, life stages or parts of the system are most sensitive, and are they represented in tests, reference subjects and averages? Is the timing of exposure considered as well as its size? Where is exposure highest and evidence thinnest? Do risk estimates come from one atypical, high-exposure group? Mirror: Is a claimed sensitive-window effect independently replicated, with a plausible dose–response, or does it rest on one group’s findings? Evidence: LL1-14, pp. 150, 152–153 (low-baseline prepubertal children missed; hindsight LL1-14: their hormone levels had been overestimated, and EU law later named them “the group of greatest concern”); LL2-26, Table 26.3, p. 630 (the adult male as reference subject; averages); LL2-26, pp. 638–639 (averages hide concentrated harm); LL2-27, p. 650 (“more the timing of the dose, rather than the dose itself”); LL2-28, pp. 674, 677 (variable susceptibility; “tipping point exposures” differ between groups; timing made the dose harmful for TBT and DES); LL2-10, p. 219 (“the time makes the poison”); LL2-05, p. 105 (the placenta assumed protective); LL1-08, pp. 84–88; LL2-11, pp. 247–248 (evidence thinnest where exposure highest); digest LL1-03 (radiation risk estimates from harmed, atypical populations); hindsight LL2-00 (the persistence and vulnerable-window warning is LL2’s best-vindicated introductory claim); hindsight LL2-26 (child vaccine-response data behind PFAS limits). Strength: Strong. By case type: [K] and [U] strong (reference subjects and averages hiding sensitive subgroups); [F] strengthened (developmental windows; PFAS, BPA). Limits: Non-monotonic dose–response at environmental doses did not hold up (hindsight LL2-10). The evidence is densest for endocrine and neurodevelopmental agents.
K11. The first harm is rarely the last. [Epistemic, Systemic · first signals, after restriction, legacy] Confirmed hazards often prove harmful in more ways, at lower doses and to more groups than first recognised (“harm expansion”). Controlling the first, most visible harm breeds confidence about slower or different ones. And observed harms get attributed to superseded versions of the technology (the moving-target problem). Ask: Is oversight calibrated to the first, most visible harm? Has controlling it created a sense that the hazard is handled? What other endpoints, lower exposures or populations could the same agent or failure mode affect? Are claims that observed harms belong to superseded versions being tested rather than assumed? Mirror: Is apparent expansion real, or does it follow where detection and research attention went? Evidence: LL2-28, p. 672 (harm expansion; by the time harm is confirmed “the technology has often changed”); LL2-A3, p. 717 (harm “expands over time”); LL1-16, p. 171 (readily identified acute effects preceded less obvious chronic problems, sometimes by decades, for sulphur dioxide, radiation, benzene, asbestos, TBT and PCBs, though the editors warn this is no general rule); LL1-03, p. 33 (1925 tolerance dose about 700 mSv a year against 20 mSv now); LL2-06, pp. 133–134 (acute beryllium disease controlled while chronic disease appeared below the limit); digest LL1-05 (the 1969 hygiene standard covered asbestosis only, pp. 56, 61); LL1-16, p. 173 and T04 P9 (asbestos disease repeatedly attributed to superseded conditions); LL2-24, pp. 590–593 (responsibility can attach to a class of harm when the actor was on notice of a lesser one); hindsight LL2-28 (limits cut after 2013 for lead, asbestos, PM2.5, PFAS and BPA). Strength: Strong for confirmed hazards ([K]); moderate as a prior for suspected ones ([F]). Limits: Selection and detection effects: cases were chosen because harm occurred, and continued study finds more endpoints (hindsight LL2-A3). Counter-examples exist: EFSA raised its nickel intake limit in 2020, and a proposed US perchlorate goal (2026) is above the 2008 level (hindsight LL2-26); DES daughters’ breast cancer is now contested (hindsight LL1-08).
6.4 Warnings and their fate#
W1. Warnings come early, from the edges and from inside. [Epistemic, Institutional · first signals] Front-line workers, users, neighbours and insiders’ own scientists often see harm first. Ask: Who is positioned to notice harm first? Is there a channel that treats their reports as data and turns anecdote into structured inquiry, while checking their own fallacies? What does the developer know internally that overseers do not? Mirror: Are peripheral warnings being accepted because of who raises them, rather than tested? Evidence: LL1-05, p. 53; LL2-09, p. 204; LL2-05, pp. 101, 105–106; LL2-08, pp. 182–186; LL1-04, p. 39; LL1-02, p. 21; LL2-17, p. 414. Strength: Strong (cases); moderate (general). By case type: [K] strong; [F] moderate (beekeepers vindicated on method). Limits: Warners were selected because they were vindicated; lay knowledge can be positional or wrong (“pensioners’ party”, LL1-05, p. 60). Diagnosticity: peripheral warners also drove MMR, which proved unfounded (hindsight LL2-02).
W2. Not delivered, or delivered and discounted. [Institutional · first signals, contested] These are different failures with different remedies. Ask: Did the signal reach someone with authority to act? If it did, how was it handled: calls for more research, alternative causes, replication demanded only of the inconvenient finding, rationales that shift while the conclusion stays fixed? Mirror: When a warning is discounted, is the discounting reasoned and published, so it can be checked, or merely assumed to be bad faith? Evidence: LL1-16, p. 168; LL1-15, pp. 159–161; LL1-11, p. 114 and hindsight; LL1-09, pp. 94–95; LL2-06, pp. 137–138; LL1-03, p. 34. Strength: Strong. By case type: [K] strong; [U] strong (BSE, growth promoters, MTBE’s 1984–88 warnings). Limits: Some discounted warnings were rightly discounted; the reports rarely record them.
W3. The reassurance trap. [Cultural, Institutional · first signals, contested] An early categorical safety claim makes every later protective step look like an admission of error, collapses graded options, and tells enforcers the rules do not matter. Ask: Have categorical reassurances been given? Are private caveats stronger than public statements? Is residual risk stated openly? Is concern being treated as a communications problem? How much of any late bill would go on buying back credibility and market access rather than reducing risk? Mirror: See W8, the alarm trap. Evidence: LL1-15, pp. 161–162; LL2-06, pp. 133, 137; LL2-18, p. 448; hindsight LL1-15 (Phillips: the aim was “sedation”); LL1-15, p. 164 and digest LL1-15 (strategies that depend on controlling information fail abruptly); T05 §3.9 (the cost of delay). Strength: Strong (BSE, contemporaneous minutes); moderate (general). By case type: [U] strong; [F] strong (the Fukushima “safety myth”). Limits: It operates without lying and without a sponsorship conflict; open candour also enabled de-escalation later.
W4. Knowing is not acting. [Institutional, Political-economic · contested, after restriction] Accepted knowledge often failed to produce action because costs were concentrated, harm was elsewhere, or rules went unenforced. Ask: At which layer is action stuck: not delivered, contested, accepted but blocked by who pays, or adopted but unimplemented? Were the criteria that would trigger action agreed in advance, and are they protected from later revision? Does the body that must declare an emergency also bear its cost? Mirror: Is inaction sometimes a reasoned judgement that the proposed action would do more harm than good? Evidence: LL1-00, p. 4; LL2-04, pp. 76, 86; LL1-12, p. 130; LL2-05, pp. 99, 114; LL2-17, p. 423; LL2-12, p. 274; hindsight LL1-00 (Rotterdam deadlock), LL2-15 (2021 floods; the German district that must declare an emergency also pays for it). Strength: Strong (description); moderate (explanation). By case type: mainly [K]. Limits: Pre-agreed triggers get re-specified downwards (hindsight LL2-17); knowing and acting are separated by legitimate disagreement as well as by interest.
W5. What made response fast. [Institutional · first signals] A legible endpoint, an affected group with a voice, independent public expertise, a concentrated industry or cheap fix, low commercial stakes, harm to something with market value. Ask: Which of these conditions are present or absent? Which harms fall on parties with no standing, market value or political weight? Mirror: Would the same conditions speed an unfounded restriction? Evidence: LL2-27, p. 645; LL2-08, pp. 186–189; LL2-09, p. 206; LL1-08, pp. 84, 86; LL2-16, p. 382; LL1-13, p. 136; LL2-20, p. 498. Strength: Moderate (confounded; several were easy cases). By case type: mixed [K] and [U]. Limits: Counter-cases: the 1952 London smog drew only “modest remedies”; Minamata’s identified route still met twelve years of inaction (section 4.2).
W6. Protect warners before vindication. [Institutional · first signals, contested] Ask: How would someone inside or outside raise a concern about a lawful but possibly hazardous activity? What protects them before they are proved right? Mirror: How are good-faith warnings that prove wrong handled, without deterring future warners? Evidence: LL2-24, pp. 582–585; LL1-16, p. 179; LL2-16, pp. 378, 380; LL2-09, p. 208; hindsight LL2-03 (Flint), LL2-24. Strength: Moderate. By case type: [K] and [F]. Limits: Protection on good faith means accepting some false alarms; existing whistleblower law mostly covers breaches of law, not warnings about lawful products. Warners’ accounts of retaliation are often their own.
W7. Warning quality. [Epistemic · first signals, contested] Warnings differ in quality. In the hindsight record, those that held had independent replication, dose–response and consistency with population trends, and claimed a direction rather than a precise magnitude or mechanism. Those that failed rested on one group’s positive findings or on unpublished work, and were contradicted by larger independent studies. Ask: Has the signal been replicated by independent groups? Is there a dose–response? Is it consistent with population trends? Does it rely on one group’s work, or on unpublished data? Is it a claim about direction or about magnitude and mechanism? Does it fit prevailing theory suspiciously well? Mirror: Are reassurances held to the same tests: independent replication, adequate power and follow-up, published data? Evidence: section 5.5, items 3–4; hindsight LL2-21 (large independent null cohorts and national incidence data); hindsight LL2-19 (the Séralini study retracted; an EU-funded two-year study found no adverse effects); hindsight LL2-A3 (contributors’ unpublished claims not confirmed); LL2-02, p. 31 (swine flu over-weighted because it fitted theory); hindsight LL2-26 (low power and publication bias produce false positives); LL2-27, Box 27.3, p. 652 (Bradford Hill’s features). Strength: Suggestive to moderate: a pattern in the hindsight verdicts, not tested prospectively. By case type: mainly [F]. Limits: Replication takes time, and demanding it before any interim step is itself a delay tactic when harm is latent (K4, I2). Several vindicated warnings began as one group’s findings (the Antarctic ozone losses; long carbon nanotubes).
W8. The alarm trap. [Cultural, Institutional · after restriction, legacy] The mirror of W3. An early categorical alarm or restriction makes later de-escalation look like an admission of error, so alarms and restrictions harden just as reassurances do. Ask: Have categorical alarms been raised, or restrictions imposed, without stated conditions for lifting them? Would de-escalation be read as an admission of error by the warners or the regulator? Is there an open, costed review route? When independent null results accumulate, is there a way for the warning to be downgraded? Mirror: This entry is itself the mirror of W3; apply both. Evidence: hindsight LL2-02 (saccharin label 23 years; irradiation approvals stalled about 15–20 years; cyclamate still banned in the US after 55 years; MMR); LL1-16, pp. 173, 181 (lifting a restriction needs research that “genuinely reveals” a concern unfounded, while keeping it needs only uncertainty); LL2-02, p. 34 (the chapter’s claim that over-regulation “can be quickly caught”); hindsight LL2-21 (a small organised dissent continues after the large null studies); the European Risk Forum’s irreversibility argument (critiques §3.3). Contrast: the BSE measures were wound back through open, costed review (hindsight LL1-15). Strength: Moderate (persistence documented in several cases; the mechanism inferred). By case type: [U] and [F]. Limits: Persistence can also reflect continuing uncertainty or a low cost of keeping the measure. Some measures were lifted quickly once reviewed.
W9. Evidence from elsewhere. [Epistemic, Institutional · first signals, contested] Warnings are discounted because harm appeared in another place, population or country; and “no harm elsewhere” is relied on where conditions differ. Ask: Is harm seen in another place, population or setting being discounted because it has not appeared locally? Is “no harm elsewhere” being relied on where conditions differ? What analogous track record exists, and who would have to confirm it for it to count here? Mirror: Are differences in conditions that would make foreign evidence irrelevant being examined, rather than dismissed? Evidence: LL1-12, p. 126 (Florida bald-eagle declines published in 1952–58; Great Lakes research began only in the mid-1960s, when most of the population was gone); LL2-05, pp. 102, 105 (“no harm elsewhere” misleads when site conditions differ; Minamata poisoning recurred at Niigata in 1965); LL1-16, p. 180 (Norway accepted acid-rain research in 1976, the UK only in 1985); LL1-10, p. 105 (outsiders’ evidence counted once the sceptic’s own institutions confirmed it); LL1-05, p. 54 (German authorities accepted the asbestos–lung cancer link in 1938 and made it compensable in 1943); LL2-20, pp. 490, 500–501 (invasiveness elsewhere is the best predictor, degrading as conditions change); LL2-27, Box 27.4, p. 653 (analogy as a criterion); hindsight LL1-00 (countries ban asbestos once mesothelioma appears in their own data; odds 14.1 times higher). Strength: Moderate. By case type: [K], [U] and [F]. Limits: Conditions do differ (site-specific exposure; different species), and track record degrades as conditions change (LL2-20).
6.5 Thresholds, burden of proof and error#
T1. The evidential threshold allocates the cost of error. [Institutional, Economic · pre-deployment, contested] Choosing the level of proof decides who bears the cost of being wrong while uncertainty lasts, and latent harm keeps uncertainty going for decades. Ask: What standard of proof must be met before any protective step, and before any claim of safety? Who set it, openly or by default? Is it universal, sole-cause or “satisfy everyone”? Does it rise with the cost of the remedy? Who bears the error at that threshold: “risk takers or risk makers”? Mirror: Is the threshold for acting set so low, and the threshold for lifting so high, that no measure could ever be shown unnecessary? Evidence: LL1-17, p. 193; LL1-16, Table 16.1, p. 184; LL2-27, pp. 656–658; LL1-02, p. 18; LL2-05, pp. 99, 112; LL1-04, p. 40; LL2-09, p. 211; hindsight LL1-17 (Pfizer), LL2-27 (Executive Order 14303). Strength: Strong, across [K], [U] and [F]. Limits: The reports give no method for weighing the factors or deciding who sets the threshold.
T2. Who must produce the evidence. [Institutional · pre-deployment] Ask: Can overseers require data without first proving risk? Are incumbent versions exempt from scrutiny that newcomers face? Must all commissioned studies be registered before results are known, raw data opened, and independent verification funded? Mirror: Are those making claims of harm expected to register studies, share data and allow verification too? Evidence: LL2-22, p. 537; LL1-11, p. 116; LL1-16, p. 179; hindsight LL1-16 (Transparency Regulation 2019/1381; Blaise). Strength: Strong (structural). By case type: [K], [U] and [F]. Limits: Reversing the burden needs a well-defined regulated object (digest LL2-22, suggestive); the EU kept applicant-generated data and added verification rather than replacing it (section 3.2).
T3. Both kinds of error, and exits in both directions. [Institutional · after restriction] Ask: What evidence would show this warning to be false, and is that bar set in advance at a level comparable to the bar for acting? How would a false alarm be recognised and reversed? What forces review of a restriction, and of an approval? Which ledger is being counted: regulatory decisions only, or also alarms and reassurances acting through markets and rhetoric? Mirror: Built in: the entry is two-sided. Evidence: LL2-02, pp. 18–19, 34–35; LL1-16, pp. 173, 181; hindsight LL2-02 (saccharin, irradiation, MMR), LL1-15 (costed de-escalation). Strength: Strong (logic); frequency contested. By case type: [U] (the false positives). Limits: Precautionary measures and public alarms both persist for decades; re-evaluation design matters as much as the first call.
T4. Irreversibility as a conditional, not a trump. [Systemic, Economic · pre-deployment] Ask: Is the potential harm persistent, latent or irreversible, and exposure wide? Is the proposed measure genuinely reversible, paired with funded research, and free of irreversible harms of its own? Is the benefit forgone modest or substitutable? Where the precautionary step is cheap, is a lower evidence threshold proportionate? Mirror: Is the irreversibility of the harm being compared with the irreversibility of the response’s own effects? Evidence: LL2-28, p. 673; LL1-00, p. 13; LL2-27, p. 649; LL2-02, p. 28 (swine flu); hindsight LL2-18 (disaster-related deaths among evacuees, with the caveats in section 5.2), LL2-02; LL2-21, pp. 515, 518, 520 and digest LL2-21 (cheap steps justified on lower evidence, a point accepted across the divide in the mobile-phone case). Strength: Moderate. By case type: [U] and [F]. Limits: The premises fail in documented cases (section 5.2): measures persisted for decades, and research was not sustained.
6.6 Interests and the production of evidence#
I1. Producers know first; watch the private–public gap. [Political-economic · scaling, first signals] Ask: Is there a gap between what developers say privately (internal research, communications with investors or regulators) and publicly? What would surface it before litigation does? Mirror: Is there a gap between what those raising the concern say publicly and what their own data show? Evidence: LL2-08, pp. 183–186; LL1-06, p. 65; LL2-06, pp. 134–137; LL2-07, pp. 153–158; LL2-25, p. 610; hindsight LL2-25 (climate, fluorochemicals, MTBE memo). Strength: Strong (documented cases). By case type: [K] strong; [U] and [F] weak, because the gap is observable mainly after litigation. Limits: Observable mainly where litigation opened records, so its absence proves little.
I2. Manufactured doubt: look for asymmetry. [Political-economic, Epistemic · contested] Ask: Is the same evidentiary bar applied to evidence of safety as to evidence of harm? Does ground shift as objections are answered? Is “more research” offered in place of interim action, and are its question, timeline, funder and independence stated? Mirror: Do those raising the concern apply the same bar to evidence against their claim, and does their ground shift as objections are answered? Evidence: LL2-07, p. 154; LL2-08, p. 184; LL2-05, p. 112; LL2-06, p. 138; LL1-06, p. 65; LL1-16, pp. 173, 181 (Swann procedure). Strength: Strong (existence); moderate (causal effect); suggestive (diagnosis in real time). By case type: mainly [K]. Limits: Some contested criticism was valid (the EPA revised its second-hand smoke assessment “in response to valid criticisms”, LL2-07, p. 153). Diagnosticity: shifting rationales and asymmetric scepticism also appear in sincere cases and among warners (section 4.8).
I3. Which studies exist. [Political-economic, Epistemic · pre-deployment, contested] Control of the research agenda shifts the apparent weight of evidence without any falsification. Ask: Who funds, designs and controls the studies behind the safety claims, and the studies behind the harm claims? Which questions are not being studied at all? What share of public research goes to understanding harms rather than developing products? Mirror: Built into the Ask: funding and control of harm-side studies get the same scrutiny. Evidence: LL2-07, pp. 155–161; LL2-03, p. 56; LL2-16, p. 373; LL2-19, pp. 468–470; LL2-26, pp. 626–629; LL2-27, p. 646. Strength: Strong (pharmaceuticals, tobacco, lead); moderate (environmental chemicals). By case type: [K] strong; [F] moderate. Limits: A publicly funded joint study reproduced the BPA split, so paradigm and evidence rules matter as well as funder (hindsight LL2-10). The reports rarely scrutinise critics’ funding.
I4. Changing the rules (“political actions”). [Political-economic, Institutional · contested] Interested parties move from contesting evidence to reshaping standards of proof, metrics, definitions and assessment procedures. Ask: Is anyone trying to change the rules rather than contest the evidence? Would the proposed rule apply symmetrically? Does it remove discretion to act on weight of evidence? Are such efforts disclosed? Mirror: Are advocates of restriction also seeking to change evidence standards, definitions or procedures, and is that disclosed? Evidence: LL2-25, pp. 615–617; LL2-07, pp. 162–165; LL2-06, p. 137; LL2-05, pp. 108–110. Strength: Strong (intent); mixed on realised effect (US data-access laws enacted; the proposed EU rule discarding relative risks below 2.0 not adopted; LL2-07, pp. 163–164). By case type: [K]. Limits: Who promoted a procedure does not settle whether it is good governance.
I5. Promotion and oversight in one body; the state as an interested party. [Institutional, Political-economic · pre-deployment, scaling] Ask: Does any body both promote the technology and oversee its risks, through mandate, budget, careers or national strategy? Who else, beyond the promoter, has reasons to reassure? Is independence won after a crisis drifting back? Has the technology been designated strategic or critical, turning policy from reducing use to securing supply? Mirror: Does any body both campaign on the hazard and fund, conduct or assess the research on it? Evidence: LL1-15, pp. 157–165; LL1-16, p. 179; LL2-06, p. 132; LL2-18, pp. 441–443; LL2-22, pp. 546–548; LL2-05, p. 99; hindsight LL1-15, LL2-18, LL2-22; hindsight LL2-06, lesson 9 (strategic designation); LL2-21, p. 520 (the EEA withdrew from the IARC meeting while its editor co-authored the chapter). Strength: Strong (existence); moderate (as cause). By case type: [U] strong (BSE); [F] strong (the Fukushima regulatory capture findings). Limits: Bodies without a sponsorship role also rushed to reassure; separation is necessary but not sufficient.
I6. Liability that rewards not knowing. [Political-economic, Economic · first signals, legacy] Ask: Does liability exposure give the developer a reason to avoid learning about or admitting harm? Is there a route to change course without ruinous admission? Mirror: Do those raising the concern have litigation, funding, reputational or institutional stakes in its being true? Evidence: LL1-06, p. 65 (and hindsight); LL2-06, pp. 137, 148–150; LL2-25, p. 612. Mirror evidence: Cranor’s undisclosed role as plaintiffs’ expert in Milward (hindsight LL2-24); Ozonoff’s possible litigation role (hindsight LL2-04); the Hardell group’s telecom-operator funding (LL2-21, fn 11). Strength: Moderate; suggestive for exit routes as a remedy. By case type: [K]. Limits: The exit-route thesis is equally explained by interest alignment (hindsight LL2-06, lesson 6).
I7. Countervailing interests. [Political-economic · first signals, contested] Action often waited less for proof than for an organised interest that bore the harm, held standing, or profited from the alternative. Ask: Which parties bear the harm, and do they have standing, data and voice? Which harmed parties have none? Mirror: See I9: the same interests that accelerate justified action can push restriction beyond the evidence. Evidence: LL2-25, p. 609; LL1-13, p. 136; LL1-09, pp. 95–96; LL2-03, p. 60; LL2-27, p. 647. Strength: Moderate. By case type: [K] and [U]. Limits: An interest in the alternative can capture precaution (I9); causal weight is unseparated from the evidence.
I8. Displacement across borders. [Political-economic · after restriction] Ask: If restricted in one jurisdiction, where does the activity go? Who can block information-sharing or trade measures? Mirror: Would a unilateral restriction push the activity to places with weaker oversight and raise total harm? Evidence: LL2-09, pp. 207–209; LL2-A3, pp. 724–726; LL1-15, p. 163; LL1-04, p. 39. Strength: Strong. By case type: [K]. Limits: Displacement is often inferred from coincidence rather than shown (digest LL2-A3: strong for exporter obstruction, moderate for displacement).
I9. Whose interests does restriction serve? [Political-economic · contested, after restriction] Competitors, makers of substitutes, domestic producers, trade interests and advocacy or research programmes can gain from restriction, and can push it beyond what the evidence warrants. The reports treat such interests only as welcome accelerators of action (I7). Ask: Who gains from restriction, and is that interest shaping the evidence or the threshold? Is the measure applied to this risk but not to comparable ones, and why? Would it look the same if applied equally to domestic and foreign, incumbent and new sources? Would it survive the scrutiny applied to the technology? Mirror: See I7: who bears the harm if restriction does not come? Evidence: LL1-14, pp. 150, 153–154 and hindsight LL1-14 (the hormones ban, taken against two expert committees, settled by beef quotas at third-country exporters’ expense); critiques §3.3 (Majone on aflatoxin standards and African exporters, protectionism, double standards and regressive effects) and §9.4 (ask whether a response “can be captured to protect incumbents or markets”); LL2-03, p. 60 (catalytic converters); LL2-20, p. 499 (firms favouring binding rules over codes that competitors ignored); hindsight LL1-07 (DuPont’s CFC shift partly commercial positioning); LL1-11, pp. 110–111 (MTBE scaled by mandate); critiques §3.4 and LL1-16, p. 168 (selective precaution). Strength: Moderate (several cases; the critics’ strongest distributive point; unanalysed in the reports). By case type: [U] (hormones) and [F]. Limits: A commercial interest in restriction does not make the restriction wrong (GM’s interest in removing lead coincided with a real hazard). Evidence of protectionism is mostly alleged, not documented.
I10. Who decides, and who frames the problem? [Political-economic, Institutional · pre-deployment] Ask: How many people take the pathway decision, and who is absent? Who defines the problem and what counts as “innovation” or “safe”? Were alternatives on the agenda at all? How economically central is the activity to the jurisdiction deciding on it? Mirror: When a restriction is proposed, who frames the problem, and are those who would bear its costs present? Evidence: LL2-28, p. 671 (key decisions on innovation pathways “made by a few people on behalf of many”); LL2-28, p. 672 (unequal power “well beyond the scope of this report”); LL2-05, p. 92 (a “democratic deficit”); LL2-03, p. 52 (at the 1925 conference, “No ‘innovation’ other than TEL was discussed”, despite a declared intention to discuss alternatives); LL2-19, p. 461 and digest LL2-19 (defining “innovation” is a distributive choice); LL2-17, p. 419 (knowledge institutions survive their failures while communities bear the collapse; suggestive); LL2-05, pp. 96, 99 (economic centrality bends regulatory judgement; digest LL2-05). Strength: Moderate (vivid cases, no comparison set). T10 P1 notes that the reports diagnose power but prescribe information. Limits: The reports name power but do not analyse it (section 5.7); the claim that broader participation improves outcomes is suggestive (G6).
6.7 Trajectories, lock-in and substitution#
L1. The prized property may be the hazardous property. [Economic, Systemic · pre-deployment] Ask: Is what makes the technology valuable (durability, stability, potency, reach, self-propagation, inertness) also what could make harm persistent, mobile or hard to reverse? Has that property itself triggered scrutiny proportionate to scale? Mirror: Is a property being condemned as hazardous without evidence that it causes harm in this use? Evidence: LL1-07, p. 83; LL1-06, pp. 64, 72; LL2-11, p. 241; LL1-05, pp. 52–53; LL1-11, pp. 110–112; LL2-16, p. 376. Strength: Strong. By case type: [U] strong; [F] strengthened (persistence and mobility became EU hazard classes). Limits: The virtue is often real (fire safety, non-toxicity at the point of use); the lesson concerns trade-offs, not rejection.
L2. Benefits need the same scrutiny as risks. [Economic · pre-deployment] Ask: What benefit is claimed, who has tested it independently, and is it specific to this option or to the wider system it rides on? Who receives it? Are claims for the preferred alternative tested as hard? Mirror: Built into the Ask: the benefits claimed for alternatives and for restriction get the same test. Evidence: LL1-08, pp. 86, 90; LL1-11, p. 111; LL1-16, pp. 175–177; LL2-04, pp. 80, 83; LL2-A3, pp. 732–733. Strength: Moderate (strong where benefit was tested and absent, as with DES). By case type: [K] strong (DES); [F] mixed (agroecology’s claimed benefits weakened, hindsight LL2-19). Limits: Benefits were real and large in several cases (DDT’s malaria benefit; PCB fire safety; some seed treatments; T04 P2).
L3. Regrettable substitution. [Economic, Systemic · after restriction] Substitutes judged only against a worse incumbent, within the same operating principle, chosen by incumbents and scaled by mandate, tend to move harm rather than remove it. Ask: If this were restricted, what would fill the gap, and has it been assessed on its own terms? Does it share the hazard-conferring property? Would a class- or function-based approach work better? Mirror: Is a substitute being condemned by association with the incumbent without its own assessment? Evidence: LL1-16, pp. 173–177; LL2-12, pp. 265, 273–276; LL1-11, pp. 110–117; LL1-07, p. 81; LL1-13, p. 141; hindsight LL2-10, LL2-12, LL2-16. Strength: Strong. By case type: [U] strong; [F] strongly strengthened. Limits: Substitution often did reduce harm (most asbestos substitutes; hydrocarbon refrigerants).
L4. Lock-in comes in forms that unlock differently. [Economic, Systemic · scaling, legacy] Ask: What long-lived capital, installed stock, standards, contracts, skills and exemptions does deployment create? Is the technology cheap partly because others bear its costs? Is it sold as an integrated proprietary system whose use by some compels adoption by others? Is there a planned exit with sunset dates? Mirror: Are claims of lock-in being used to dismiss genuine performance advantages? Evidence: LL1-16, p. 177; LL2-28, pp. 672–673; LL2-03, pp. 54–55; LL2-19, pp. 462, 472; LL2-16, pp. 383–385; LL1-05, p. 58; hindsight LL2-27 (chlor-alkali plants), LL2-19 (defensive adoption). Strength: Strong (mechanism); moderate (“smarter substitutes kept out”); asserted (“arbitrary winners”). By case type: [K] and [F]. Limits: Some incumbents persisted because alternatives were genuinely worse; exits proved politically fragile.
L5. Single-tactic control of adaptive systems breeds treadmills. [Systemic · scaling] Ask: Does control rely on a single tactic against something that adapts? What happens when it adapts, and do linked traits let resistance travel? Mirror: Do the proposed alternatives avoid the treadmill, or face their own? Evidence: LL2-19, p. 462; LL2-11, pp. 241, 243, 251; LL1-09, pp. 93–97; hindsight LL2-19, LL2-11, LL1-09 (co-selection). Strength: Strong. By case type: [U] and [F] strengthened. Limits: Alternatives face resistance too: pyrethroid-resistant vectors followed South Africa’s switch from DDT (LL2-11, p. 243).
L6. Direction is steered, and claims about innovation need checking. [Economic, Political-economic · pre-deployment, after restriction] Ask: What can be owned, who holds the capital, what is mandated or funded, and which alternatives cannot attract investment because their benefits flow to users rather than providers? Are claims that restriction will stifle, or spur, innovation checked against comparable ex post outcomes? Are “no alternative”, “essential” and compliance-cost claims tested against what happened in past cases? What unrelated developments (co-technologies, obsolescence, market shifts, resistance) would change the trajectory anyway, and how durable would an exit be if they reversed? When harm falls, how much is due to the measure? Mirror: Built into the Ask: claims that restriction will spur innovation get the same check as claims that it will stifle it. Evidence: LL2-19, pp. 460, 465–466, 476; LL2-03, pp. 52–55, 60; LL2-08, pp. 187, 192 and hindsight (about fourfold overestimate); LL1-17, p. 194; LL2-28, p. 670. Co-drivers: LL2-03, pp. 60, 63–65 (catalytic converters and “pure chance”; final elimination “often needs an independent co-driver, which makes it fragile”, digest LL2-03); LL2-05, p. 105 (acknowledgement came after production stopped as “no longer necessary”); LL1-10, pp. 104–106 and hindsight LL1-10 (structural change did much of the work); hindsight LL2-11 (DDT’s exit through resistance and new tools). Strength: Moderate (steering). “Precaution stimulates innovation”: moderate for the weak claim that it redirects rather than stops innovation; asserted for the strong claim. Overstated cost forecasts: moderate and conditional. Limits: The wider literature finds only a slight tendency to overestimate compliance costs, and a meta-analysis of 103 studies found that “the most likely scenario is statistical insignificance” (Cohen and Tubb 2018; section 4.4). Credit for improvement is hard to assign when co-drivers are present.
6.8 Costs, distribution and justice#
C1. Who carries the costs of acting and of not acting? [Economic, Political-economic · pre-deployment, contested] Ask: Are the costs of inaction dispersed, deferred, foreign or unseen, while the costs of action fall on identifiable parties with lobbying power? If so, look for delay: this configuration often slowed action, but vivid harm combined with a cheap fix overrode it (LL2-08, LL2-09, LL1-08). Mirror: Are the costs of a proposed restriction concentrated on parties without a voice (small producers, poorer countries, users)? Evidence: LL1-00, pp. 3–4; LL2-27, p. 659; LL2-03, pp. 52–53; LL1-02, pp. 21–22; LL2-17, pp. 413, 421. Strength: Strong (description); moderate (cause). By case type: [K]. Limits: Fast action despite concentrated costs (vinyl chloride, DBCP, DES; T05 §3.1).
C2. The boundaries and conventions of appraisal. [Economic · pre-deployment] Ask: What does the appraisal leave out (pathways, populations, places, periods), and is the omission systematic in one direction? Which valuation choices (discount rate, value of life, what is monetised, whether unquantified effects enter as zero) drive the result, and who sets them? Does the decision survive the most conservative credible bound? Mirror: Are the harms counted in a case for restriction upper bounds, and are the restriction’s own costs left out? Evidence: LL2-23, pp. 564–577; LL1-10, pp. 103–104; LL1-04, p. 41; hindsight LL2-23 (lead; US valuation reversals). Strength: Strong (mechanism); low weight for specific figures. By case type: [K] and [F]. Limits: Estimates can also be too high (MTBE’s upper-end estimate; the Dutch asbestos counterfactual; T05 §3.2).
C3. Consent, benefit and who studies the harm. [Economic · scaling] Ask: Do those exposed consent to or benefit from the exposure? Where is exposure highest and evidence thinnest? Who will study harm that is displaced downstream, abroad or to later users? Mirror: Who bears the costs of the precautionary response, and did they consent? Evidence: LL2-04, pp. 80, 83; LL2-11, pp. 247–248; LL2-09, pp. 207–209; LL1-10, pp. 101–103; LL2-26, pp. 638–639. Strength: Strong (descriptive); suggestive (quantified). By case type: [K] and [U]. Limits: Where the protected and the exposed are the same people, the trade-off is internal to one group (DDT spraying against malaria; LL2-11, pp. 246–249).
C4. Who defines and counts victims, and who pays. [Economic, Institutional · legacy] Ask: Who will define and count those harmed, and does that body also pay? Is counting active or passive? Are the exposure records that later claimants will need being kept? Does relief come with or without recognition? When effects fall below what epidemiology can detect, how will “the number of victims” be decided, and are advocacy and mainstream estimates kept apart? Mirror: Are victim counts produced by interested parties on either side? Evidence: LL2-05, pp. 104–110; LL1-05, pp. 60–61; hindsight LL2-05; hindsight LL2-18, lesson 4 (below the detection limit of epidemiology, victim counts become a choice of method). Strength: Strong within Minamata; moderate as a generalisation. By case type: [K]; [F] for the nuclear counts. Limits: Courts are split on the Minamata criteria; in 2026 an appeal court upheld prefectural rejections (hindsight LL2-05).
C5. Tail risk and time. [Economic, Systemic · legacy] Ask: If harm appears after decades, will the responsible party exist and be solvent? Do caps, limitation periods, development-risk defences or state backstops shift tail costs to the public? Does compensation require a history of prior victims that a novel hazard lacks? How persistent is the footprint, and is the decision horizon as long? Does system inertia mean that waiting for observed harm locks in more harm? Mirror: Would bonds or pre-funded schemes burden new entrants disproportionately, and do they depend on a state able to monitor them (LL2-24, pp. 600–601)? Evidence: LL2-24, pp. 586–603; LL2-18, pp. 445–446; LL2-25, p. 612; LL2-20, p. 497; LL1-07, p. 77; hindsight LL2-18, LL2-25; LL2-14, pp. 314, 337 (system inertia; digest LL2-14). Strength: Strong. By case type: [K] and [F]. Limits: Deepwater Horizon is a weak test of the cap argument, since the firm was solvent and the cap fell away; pre-emptive compensation tables would have been premature for at least one hazard (hindsight LL2-24).
C6. The intervention point allocates the bill. [Economic · after restriction] Ask: Where along the causal chain will control be applied, and does that place costs on the producer, on intermediaries or on the public? Mirror: Does moving the bill to producers shift the contest to cost attribution rather than risk reduction? Evidence: LL2-13, pp. 290–291, 296; LL2-20, p. 492; hindsight LL2-13 (producer-funded treatment). Strength: Strong. By case type: [F]. Limits: Producer-pays rules triggered litigation over proportionality and over how contributions are apportioned (hindsight LL2-13, lesson 3).
C7. The costs of precaution itself. [Economic, Systemic · after restriction] Ask: What would the protective response cost, and who would bear it: countervailing risks, forgone benefits for the least advantaged, transition costs for the most vulnerable part of the system? Is there a graduated or reversible option? Mirror: Are claimed costs of precaution documented, or asserted by those who would bear them? Evidence: LL1-14, pp. 153–154 (the hormones ban as “in reality, a political risk assessment” with “no good evidence” of benefit, conceded by an author who advised the EU); LL2-02, pp. 25, 28–29 (swine flu: Guillain-Barré cases and deaths, about USD 124m and more than 4,100 lawsuits); LL2-11, pp. 243, 250 (South Africa’s DDT withdrawal); hindsight LL1-09 (transition costs; a rise in therapeutic antibiotic use), LL2-16 (beet yields in a virus-yellows outbreak after the ban), LL2-02 (Jarvis et al. 2022: €3–8bn a year for Germany’s nuclear phase-out), LL2-18; critiques §3; T05 §4.2. Strength: Strong that precautionary responses carry material costs, sometimes irreversible and sometimes regressive; moderate on their size relative to benefits. Under-weighted in the reports. By case type: [U] and [F]. Limits: Several costs are ceilings or estimates, not measured losses (the hormone sanctions); the Fukushima deaths are costs of emergency protective action after an accident, not of precaution before deployment, and the count covers the combined disaster (section 5.2).
C8. Delay has its own bill. [Economic · first signals, legacy] Ask: Does the cost of delay include unwinding lock-in, legacy clean-up, and repairing credibility and market access, not only physical harm? Does early action remain cheap only while the window is open? Mirror: Is the cost of acting early on a warning that proves wrong counted too? Evidence: LL1-15, pp. 158, 164 (about 1,200 clinical BSE cases removable for about £1.5m against a £4.2bn bill); LL2-20, p. 487 (eradication costs rising “at least 40 times” with delay); hindsight LL1-15 (much of the late bill went on restoring market access); T05 §3.9. Strength: Moderate: direction supported; counterfactuals weak and often not like-for-like (section 4.5). By case type: [U] and [F]. Limits: Early-action estimates are made after the fact, with knowledge of which warning proved right.
6.9 Institutions, law and implementation#
G1. Label against practice. [Institutional, Cultural · after restriction] Ask: Which version of “precaution”, “responsible” or “safe” is actually in force: its trigger, its evidence strength, its cost qualifiers? Is precautionary or safety vocabulary (“deliberately conservative”, “controlled use”, “closed systems”, numerical “residual risk”) describing practice that has not changed? Mirror: Is “precaution” being claimed for measures that are really prevention of known harm, enlarging precaution’s apparent record? Evidence: LL1-00, pp. 13–14; LL1-02, pp. 20, 24; LL1-16, pp. 174–175; LL2-13, p. 296; LL2-18, pp. 447–448. Strength: Strong. By case type: [K], [U] and [F]. Limits: The reports relabel too (“precautionary prevention” enrols known-harm successes; LL1-00, pp. 14–15).
G2. Adopting a rule is not reducing a risk. [Institutional · after restriction] Ask: Are protective commitments backed by enforcement, measurement, funding and deadlines, or by voluntary codes, conditional approvals, open-ended “temporary” exemptions and process targets? Is “action” a planned sequence with verified reductions in harm? Can offsets, windfalls and flexibility mechanisms make formal compliance diverge from real reduction? Do early controls hit the tractable segment (small users, cheap uses, low commercial stakes) rather than the largest source? Can the same agent continue under another stated purpose or label? Is a statutory duty being met in form while deferred in substance? Mirror: Are claims that a rule has failed based on measured outcomes, or on the absence of data? Evidence: LL1-05, p. 56; LL1-09, p. 94; LL2-03, pp. 53, 56; LL2-11, p. 252; LL2-20, p. 498; LL2-A2, p. 702; hindsight LL2-03 (aviation lead), LL2-15, LL2-16; LL2-14, pp. 324–326 (formal compliance against real reduction; digest LL2-14); LL1-13, pp. 136, 138–139 (small boats before large ships); LL1-06, p. 72 (cheap uses before costly ones); LL2-16, p. 382 (lowest commercial stakes first); LL1-09, pp. 93, 95 (rules keyed to stated purpose); hindsight LL2-05, lesson 3 (a duty met in form, deferred in substance); hindsight LL2-13, lesson 9 (a flagship case’s early choices become templates). Strength: Strong. By case type: [K], [U] and [F]. Limits: Some rules worked fast once enforced (BSE cohort cases fell sharply after the feed ban; the global TBT ban; SO2; T06 §8).
G3. Provisional numbers harden. [Institutional · pre-deployment, after restriction] Ask: Which limits, definitions or classifications are provisional? What forces their review, and whose interests attach to keeping them? Mirror: Are provisional restrictions and precautionary classifications hardening in the same way? Evidence: LL2-06, pp. 133, 137, 150; LL2-08, p. 182; LL1-13, pp. 137–138; hindsight LL2-06 (“sticky” standards). Strength: Strong. By case type: [K]. Limits: Replacing an anchor creates the next anchor: other institutions converged on the new beryllium number rather than deriving their own (hindsight LL2-06, lesson 1).
G4. Divergence on shared evidence. [Institutional, Epistemic · contested] Ask: Where assessors reach different verdicts on the same evidence, do they publish their evidence rules, weights and handling of uncertainty and explain the difference? Mirror: Do the assessors that advocates prefer publish their evidence rules and weights too? Evidence: LL2-04, pp. 84–85; LL2-10, pp. 221–223; LL1-11, p. 113; LL2-28, p. 677; hindsight LL2-10, LL2-28; hindsight LL2-05, lesson 8 (Castaño and Grandjean read the same exposure data through different thresholds). Strength: Strong. By case type: [K] and [F]. Limits: Harmonised measurement narrows factual disputes but not normative ones (hindsight LL2-05, lesson 8); a jointly designed BPA study reproduced the split (hindsight LL2-10).
G5. Reach must match the hazard. [Institutional, Systemic · scaling, after restriction] Ask: Does the governing institution’s reach match the scale and mobility of the effects? Can activity move to less regulated places, and can a single party veto coordinated action? Are the conditions for collective action present: concentrated producers, substitutes, finance for late adopters, a ratchet, independent verification? Mirror: Is waiting for higher-level coordination being used as a reason to do nothing locally (LL2-20, Box 20.4, p. 501)? Evidence: LL1-13, p. 142; LL1-10, pp. 103–107; LL1-07, pp. 78–81; LL2-14, pp. 321–337; hindsight LL1-05 and LL2-A3 (Rotterdam). Strength: Strong (reach); moderate (conditions of success). By case type: [K] and [F]. Limits: Small jurisdictions sometimes lead (Bermuda on booster biocides; LL2-12, p. 271).
G6. Participation: detection or legitimacy? [Institutional, Cultural · pre-deployment] Ask: Do participation processes influence framing and outcomes, or only communication? Is there evidence participants’ recommendations were acted on? Mirror: Are participants representative, or self-selected advocates on either side? Evidence: LL1-16, pp. 186–188; LL2-27, pp. 659–660; hindsight LL1-17 (legitimacy rises mainly when recommendations are honoured). Strength: Moderate (detection); suggestive (better outcomes). Limits: Value-driven outcomes can rest on factual error: the Brent Spar decision rested partly on a withdrawn oil estimate (hindsight LL1-17).
G7. Vigilance decays unless institutionalised. [Institutional, Cultural · legacy] Ask: What keeps attention alive in quiet periods? Is vigilance lodged in institutions with legal mandates? Where would a warning chain break between those who know and those with authority to act? Mirror: Does institutionalised vigilance outlive the hazard, keeping resources on a concern that has faded? Evidence: LL2-15, pp. 353, 359–361; LL2-28, p. 680; hindsight LL2-15, LL2-28. Strength: Moderate (strong for floods after hindsight). By case type: [U] and [F]. Limits: The “homo-illogical cycle” is extrapolated from floods (T06 §10).
G8. The legal standard decides. [Institutional · contested, legacy] Courts and trade tribunals cut both ways. Which standard of proof and causation governs, and how much deference reviewers give a reasoned regulator, often decide the outcome. Ask: What standard of proof and causation will courts and trade tribunals apply: a precautionary statute with reasoned discretion, a quantified “significant risk” test, individual foreseeability, or sole-cause causation? How much deference do they give a reasoned regulator? Can responsibility attach to a class of harm when a lesser harm was known? Is litigation the only route by which internal knowledge will surface? Mirror: Would the same legal standard also let an unfounded restriction stand, or strike down a justified one? Evidence: LL1-04, p. 40 (the 1980 benzene ruling’s “significant risk” threshold); LL2-08, p. 187 (the vinyl chloride rule upheld “on the frontiers of scientific knowledge”); LL2-03, p. 60 (the appeal court: regulation under “this precautionary statute” should “precede, and hopefully prevent” harm); LL1-05, p. 57 (WTO on asbestos); LL1-14, p. 153 and LL2-A3, pp. 736–737 (WTO on hormones: burden, deference and independence); LL2-16, pp. 374, 380–382 (the Conseil d’État on Gaucho; Bayer’s defamation suits lost); LL2-17, p. 420 (a court would not “become an academy of science”); LL2-24, pp. 586–593 (the burden and standard of proof decide who absorbs uncertainty; liability for a class of harm); LL2-07, p. 169 (litigation as the main window); hindsight LL1-09 and LL1-17 (Pfizer), LL2-16 (EU courts upheld the 2013 restrictions in 2018 and 2021), LL2-18 (legal accountability runs on a narrower foreseeability test than inquiries use; acquittals final in 2025), LL2-24 (Milward; the US expert-evidence rule tightened in 2023). Strength: Strong (courts’ two-way role; 15 or more episodes, T06 §11); moderate (deterrence). By case type: [K], [U] and [F]. Limits: Courts’ precaution is narrower than the reports’: in Pfizer a risk must be “adequately backed up by the scientific data”, and a measure cannot rest on a “purely hypothetical approach to the risk”.
G9. Protective reforms are reversible; incumbent capital is not. [Institutional, Political-economic · after restriction, legacy] Ask: How durable is the coalition behind a reform? Can it be deferred, derogated or re-specified? Is delay being tracked separately from dilution? Would a change of government or a different crisis reverse it? Mirror: Are evidence-led relaxations being mislabelled as dilution? Evidence: LL1-16, p. 180 (1979 rendering standards withdrawn as “an unnecessary burden on industry”; Californian sardine conservation reversed with a change of government); LL1-12, pp. 129–132 (the “virtually eliminated” pledge “not properly implemented”); hindsight LL2-18, lessons 2 and 8 (reforms diluted or reversed when priorities shift; policy after a focusing event only as durable as its coalition); hindsight LL2-24 (France abolished its alert commission in 2026); hindsight LL2-13, lesson 1 (deferral instruments moved a 2021 horizon to 2039 while the standard became stricter: delay and dilution are separable); hindsight LL2-27 (chlor-alkali plants still using asbestos diaphragms after 42–83 years); section 5.5, item 7. Strength: Moderate, strengthened in hindsight. By case type: [K] and [F]. Limits: Some relaxations followed costed evidence (BSE); reversibility also protects against locking in mistaken restrictions.
6.10 Systems and scale#
S1. What persists. [Systemic · legacy] Ask: If use stopped tomorrow, what stocks (products in service, infrastructure, environmental reservoirs, bodies, institutional commitments) would keep releasing effects, for how long, and who would manage them? Mirror: Are claims of a permanent legacy tested against recovery data? Evidence: LL1-06, pp. 66–72; LL1-07, p. 77; LL1-13, p. 141; LL2-09, p. 210; LL2-04, p. 76; hindsight LL1-12 (remobilisation), LL1-07 (bank became a resource). Strength: Strong. By case type: [K] and [U]. Limits: Stocks can become resources, and some recovery was faster than feared (the halon bank; Great Lakes delistings; MTBE attenuation; T05 §3.13).
S2. Fixes that relocate harm, and totals that outgrow per-unit gains. [Systemic · after restriction] Ask: Does a proposed fix reduce harm, or move it to other places, media, populations or times? Is performance judged per unit while totals grow? Who tracks aggregate volume and population-level shifts? Mirror: Would the proposed restriction itself relocate harm? Evidence: LL1-10, pp. 101–103; LL1-11, p. 114; LL1-07, p. 80; LL2-05, pp. 95, 100; LL2-03, p. 61; hindsight LL1-03 (CT collective dose). Strength: Strong. By case type: [K] and [U]. Limits: Much large-scale improvement came from structural change, not governance (T07 §5, item 4).
S3. Unit of assessment. [Systemic, Epistemic · pre-deployment] Ask: Is assessment by single product, or by combined and cumulative exposure, class and function? Could a “sole cause” framing guarantee an inconclusive answer? And, symmetrically, what evidence would count against a multicausal concern? Mirror: Built into the Ask. Evidence: LL1-05, p. 55; LL2-13, p. 290; LL2-16, p. 379; LL2-27, pp. 652–654; LL2-28, p. 674; LL1-12, p. 129. Strength: Strong (single-agent understatement; sole-cause framing); moderate (relaxing causal criteria). By case type: [K], [U] and [F]. Limits: Relaxed causal criteria can shield a hazard claim from refutation; “inconsistency is expected”, applied loosely, protects weak hypotheses (notes LL2-28).
S4. Interventions have system effects too. [Systemic · after restriction] Ask: What would the corrective or precautionary intervention do at scale, including rare side-effects and effects on linked systems? Could benefits or costs arrive through channels outside the decision’s frame? Mirror: Built in: this entry applies the lens to interventions. Evidence: LL2-02, pp. 28, 35; LL2-11, p. 243; LL2-20, pp. 496–497 (the signal crayfish, a fix that became a hazard); LL1-11, pp. 110–111 (MTBE scaled up under a protective mandate); hindsight LL1-10 (SO2 cuts unmasked warming), LL2-18 (evacuation), LL1-09; T07 §5, item 3. Strength: Strong (existence); moderate (predictability). By case type: [U] and [F]. L3 (regrettable substitution), a subset of the same phenomenon, is rated Strong on comparable evidence. Limits: Most such effects were identified after the fact, as were most of the harms in the corpus.
S5. Claims of irreversibility and thresholds. [Systemic · contested] Ask: When harm is called irreversible, or exposure safely below a threshold, on what timescale and against what yardstick, set by whom? What evidence would count against the claim? Mirror: Built into the Ask: it applies to claims of irreversible harm as well as claims of safety. Evidence: LL2-17, pp. 409, 417; LL2-28, p. 672; LL1-10, pp. 106–107; hindsight LL2-17 (cod reopened; Baltic cod not). Strength: Moderate. By case type: [K] and [F]. Limits: “Irreversible” often means “not on policy timescales” (section 4.7); northern cod’s “irreversible demise” was overturned.
S6. Shared resources and loss of use. [Systemic, Economic · scaling, legacy] Where a resource is shared and depletable (antibiotic efficacy, groundwater, fish stocks, common assets), each local use can be a system-wide cost, and loss of use is harm even without toxicity. Ask: Does the activity draw down a shared resource, or select for adaptations that erode it? Does contamination or depletion in one use foreclose options elsewhere? Who is accountable for the resource as a whole? Mirror: Is a claimed shared-resource loss measured, or projected from worst-case assumptions? Evidence: LL1-09, pp. 94, 96–97 (antibiotic efficacy; digest LL1-09); LL2-A3, pp. 731–732 (harms pooling in a shared resource make each local use a system-wide cost); LL1-11, pp. 112, 114, 119 (groundwater; Santa Monica lost 71% of its local supply; loss of use as harm; digest LL1-11); LL1-02, pp. 19–26 (fish stocks); LL2-24, p. 602 (liability caps plus a burden of proof on the public encourage excessive risk-taking with shared assets). Strength: Moderate–strong. By case type: [K] and [U]. Limits: Some resources recovered faster than feared (MTBE attenuation; northern cod’s partial return).
S7. Tightly coupled systems and extremes. [Systemic, Institutional · pre-deployment, legacy] The corpus’s cases of acute catastrophic failure (nuclear accidents, floods) show safety cases built on scenario lists and independence assumptions; published estimates of rare extremes that never reached design bases; confidence built on “no accident yet”; monitoring that failed in the extreme it existed to observe; design codes built on short records; and emergency responses that caused harm themselves. Ask: What cascades or common-cause failures lie outside the scenario list? Does the design basis use short records, and have published estimates of rare extremes reached it? Is confidence resting on the absence of accidents so far? Will monitoring and warning survive the event? Who has the legal authority, and the budget, to act at the decisive moment? What would the emergency response itself cost? What does the review’s remit exclude? Mirror: Are worst-case scenarios being presented as likely without their probability basis? Evidence: LL2-18, pp. 432, 439, 447–448 (probability estimates depend on listed scenarios and independence assumptions); p. 438 (a 2001 paper on a roughly 1,000-year tsunami recurrence never reached plant design); pp. 445, 447 (“no accident yet”); p. 444 (security excluded from stress tests); LL2-15, pp. 353, 355, 360 (warning chains fail at the weakest link; design codes assume “the past is the key to the future” on short records; the flood information office itself flooded); hindsight LL2-18, lessons 1, 3 and 10; hindsight LL2-15 (Ahr 2021; Valencia 2024; unprecedented events defeat systems built for precedented ones); T07 §3.14. Strength: Moderate–strong, resting on official inquiries; the nuclear chapter’s own probability arithmetic is unreliable. By case type: [U] and [F]. Limits: Two case families only; the health tolls in the nuclear chapter were overstated (hindsight LL2-18).
6.11 Mindsets, culture and framing#
M1. Sincere belief can do serious harm without bad faith. [Cultural · all stages] Ask: If everyone involved is sincere, what would still produce harm: weak feedback from harm to decision-maker, long lags, costs borne by others, commitment to earlier positions? What is the reasoning insulated from? Mirror: Are warners’ sincere beliefs also insulated from feedback, independent baselines and dissent? Evidence: LL1-08, p. 88; LL1-03, p. 31; LL2-02, p. 28; LL2-25, pp. 613–615; LL2-28, p. 678; hindsight LL1-15. Strength: Strong that sincere error was common and harmful; the relative size of harm from sincere error and from bad faith was never measured. By case type: [K], [U] and [F]. Limits: Documented bad faith lies behind some of the largest harms (lead, tobacco, asbestos); sincerity is not a defence to be assumed.
M2. The model of harm behind the confidence. [Cultural, Epistemic · pre-deployment] Ask: What model of harm underlies the confidence (endpoint, dose metric, reference population, timescale, assumed barriers, assumed performance to specification)? What would we expect to see if it were wrong, and has anyone said what evidence would change the view? Mirror: Has the warner said what evidence would change their view? Evidence: LL1-03, p. 33; LL2-03, p. 58; LL2-06, pp. 133–134; LL1-13, p. 141; LL2-05, p. 105; LL1-16, pp. 174–175; LL2-15, p. 355. Strength: Strong. By case type: [K] and [U]. Limits: Holding a prior is not error: paradigm-based scepticism was right about mobile phones and food irradiation.
M3. Commitment escalates. [Cultural, Institutional · contested, after restriction] Ask: What would admitting a problem cost this organisation (liability, reputation, identity, past statements), and how does that cost grow as evidence accumulates? Mirror: What would admitting error cost the warners or the regulator that restricted? Evidence: LL1-15, pp. 161, 164; LL2-06, pp. 148–150; LL2-17, pp. 413–415; LL2-05, p. 105; LL2-18, p. 445. Strength: Moderate–strong. By case type: [K] and [U]. Limits: Organisations did reverse where they had less sunk commitment (downstream users; Danish farmers; section 4.8).
M4. Language and narratives. [Cultural · all stages] Ask: How are publics, frontline observers and critics described (“hysteria”, “misinformation”, “amateur”, “anecdotal”)? What claims of “essential”, “no alternative”, “progress” or national interest are being made, and by whom? What words (“natural”, “normal”, “safe”) turn contested judgements into apparent facts? Mirror: How are developers and their scientists described (the mobile-phone chapter’s “spinning machine”, LL2-21, p. 521)? Evidence: LL1-15, p. 159; LL1-06, p. 64; LL2-05, pp. 99, 105; LL2-17, p. 414; LL2-03, pp. 53–58; LL1-05, p. 58; LL2-06, p. 136. Strength: Moderate (quotations verified; causal weight inferred). Limits: Language is evidence of framing, not of its effect on decisions.
M5. Enthusiasm and the premium on novelty. [Cultural · pre-deployment, scaling] Conspicuous benefit and the prestige of the modern displace appraisal of slow harm. Ask: Is the technology presented as modern, scientific or progressive in ways that substitute for evidence of benefit? Are the benefits conspicuous and the harms slow? Is anyone asking whether it should be used, not only whether it could? Mirror: Is aversion to novelty (“unnatural”, “untested”) substituting for evidence of harm? Evidence: LL1-03, p. 31 (“caution tended to be thrown away”); LL1-08, p. 88 (DES “modern and scientific”); LL2-03, p. 53 (TEL an “apparent gift of God”); LL2-13, p. 280 (“there seemed no limit” to oestrogen uses); LL1-05, p. 53 (the “magic mineral”); LL2-22, pp. 545–546 (“nano-fever”; where nanotechnology “could be used, it may be questionable whether it should”); LL1-16, p. 176 (prior justification of uses, a rare response developed for radiation). Strength: Moderate (benefit salience crowds out slow harm; section 4.8). By case type: [K] and [U]; [F] suggestive. Limits: Benefits were often real (section 4.4); enthusiasm is read from language, not measured.
M6. Who counts as an expert. [Cultural, Institutional · pre-deployment, contested] The composition of advisory bodies, the disciplines admitted and borrowed credibility move verdicts. Ask: Who sits on assessment bodies, which disciplines and evidence streams are admitted, and do differently constituted bodies reach different verdicts on the same evidence? Is credibility being borrowed from academic or official auspices? Is value-laden advice presented as purely scientific? Does a professional culture fix what counts as harm? Mirror: Are the experts that advocates rely on drawn from one network, and is their credibility borrowed too? Evidence: LL1-15, pp. 162, 165 (advisers “carefully selected”; advice presented “as if it was purely scientific”); LL2-06, p. 136 (a textbook under academic auspices “to be fully acceptable and credible”); LL2-05, pp. 103, 113–114 (scientists from the “centre” trusted over those from “hick” universities); LL1-16, p. 174 (clinicians’ acute focus); LL2-22, p. 543 (a regulator “rooted in chemistry”); LL2-04, pp. 84–85 and LL2-10, pp. 221–223 (same evidence, different verdicts); LL1-09, p. 98 (committee composition shapes which harms count; asserted); hindsight LL2-10 (CLARITY-BPA). Strength: Strong (institutional choice of expertise moves verdicts). By case type: [K], [U] and [F]. Limits: Paradigm matters as well as affiliation: the publicly funded CLARITY-BPA study reproduced the split.
M7. Organisational and national cultures. [Cultural, Political-economic · scaling, contested] Cultures of denial built by “good people”, ideologies that treat profit or national standing as self-evidently serving society, strategic designation and institutional “safety myths” shape what is seen. Ask: Does the organisation’s culture treat profit, growth, national standing or supply security as self-evidently serving society? Would staff who raised a problem be heard? Is there an institutional “safety myth”? Has the activity become central to a place or nation’s identity or economy? Mirror: Do advocacy organisations have cultures that reward alarm or penalise retreat? Evidence: LL2-25, pp. 613–616 (self-serving bias; “ethical blindness”; good people building cultures of denial); LL2-28, p. 678; LL2-03, p. 53 (“survive among the nations”); LL2-05, pp. 96, 99 (a company town; “Never stop it!”); hindsight LL2-06, lesson 9 (strategic designation); LL2-18, p. 448 and hindsight LL2-18 (the “safety myth”). Strength: Moderate (vivid cases; largely secondary or inferred). Limits: Culture cannot be separated from interest (T08 §14).
M8. Salience: media, focusing events and campaigns. [Cultural, Political-economic · first signals, contested] What becomes salient, and when, shapes action as much as evidence does. Ask: What would make the harm salient: a focusing event, a campaign, an election, media coverage? Is apparent controversy being sustained by news practice after the evidence has converged? Do affected people judge the hazard by different criteria from experts? How durable is a policy shift made in response to a focusing event? Mirror: Is salience driving restriction beyond the evidence? Evidence: LL2-07, p. 166 (news practice can sustain apparent controversy after consensus forms); LL1-05, pp. 56–57 (television documentaries, an Ombudsman report and victims’ advocates drove later tightening); LL1-10, pp. 102–103, 105–106 (vivid communication set the agenda; visible harms carried public understanding; digest LL1-10); LL2-03, p. 63 (the UK government endorsed unleaded petrol “within half an hour” of the report’s publication because of a campaign and an imminent election); hindsight LL2-18, lesson 8 (post-crisis shifts only as durable as their coalition); LL2-20, p. 500 (stakeholders judge hazards on different criteria from experts). Strength: Moderate (several cases; causal weight inferred). Limits: Salience cuts both ways: the hormones ban was driven “principally” by public concern (LL1-14, p. 154), and MMR shows salience without substance.
6.12 Response repertoire#
The entries above diagnose failure. The reports and the hindsight files also document responses that worked, partly worked, or failed instructively. Precaution in the reports’ own framing is a way of broadening responses, not a binary ban (critiques §8; LL2-02, p. 35).
| Instrument | What it does | Where it worked | Where it failed or was diluted | Strength |
|---|---|---|---|---|
| Graduated, exposure-reducing measures | Reduce exposure without a ban | Nitrites: lower nitrite plus ascorbate made bacon nearly nitrosamine-free within a year (LL2-02, p. 25; vindicated, hindsight LL2-02); DDT “centrist” exposure reduction (LL2-11, p. 248) | Rarely tested elsewhere | Moderate (nitrites); suggestive otherwise |
| Provisional action plus committed research | Acts while funding the research that could lift the measure | The “double reaction” (LL2-28, p. 673); the Swann procedure (LL1-16, pp. 173, 181); “reasonable grounds” held workable in law (Pfizer; hindsight LL1-17) | Swann “gradually diluted” (LL1-09, p. 94); research not sustained (LL2-28, p. 680) | Moderate |
| Emergency or interim powers | Fast protective standard pending full rulemaking | DBCP emergency standard in about two months (LL2-09, pp. 206–207) | Depends on a legible endpoint (W5) | Moderate |
| Measurable intermediate thresholds | Makes action tractable without full causal certainty | Critical loads for acid rain (LL1-10, pp. 106–107); exceedance down to 3.5% of mapped ecosystems by 2024 (hindsight LL1-10) | Simplification and compromise (“60 % gap closure”) | Moderate–strong |
| Jointly produced fact base | Shared source–receptor knowledge as a basis for allocating obligations | EMEP and the joint UK–Scandinavian programme (LL1-10, pp. 103–107) | Necessary, not sufficient: resistance continued for years after attribution | Moderate |
| Review ratchet plus transition finance | Tightens commitments as evidence grows; pays late adopters | Montreal Protocol (LL1-07, pp. 78–81); later adaptations (hindsight LL1-07) | Feedstock exemptions leak; recovery dates slipped (hindsight LL1-07) | Strong (for ozone) |
| Pre-agreed triggers | Criteria that elicit action, agreed in advance | Recommended (LL2-17, p. 423; LL2-12, p. 274) | Triggers get re-specified downwards (hindsight LL2-17) | Asserted in the reports; weak in practice |
| Supply choke-point controls | Controls the few points of supply | Booster biocides (LL2-12, p. 273; hindsight LL2-12, lesson 5) | Legacy stocks keep releasing long after supply stops | Moderate |
| Class- or function-based restriction | Prevents substitution within the same hazardous principle | Non-release options preferred over “chemical for chemical” substitution (LL1-13, pp. 141–142); the 2024 EU bisphenols rule (hindsight LL2-10); reframing around a class (hindsight LL2-13, lesson 2) | Needs a well-defined class | Moderate, strengthening |
| Prior justification plus optimisation | Requires each use to be justified before exposure | Radiation protection (LL1-03, pp. 34–35) | A “rare example” (LL1-16, p. 176); medical collective dose still rose with CT (hindsight LL1-03) | Moderate |
| Independent outside re-analysis | Tests the assessment against outsiders’ data and models | Outsider re-analyses of northern cod (LL2-17, pp. 412–413); the Keats report (LL1-02, p. 21) | Both were overridden at the time | Moderate (as detection) |
| Open, costed review for de-escalation | Lifts or replaces measures when their cost per unit of protection is known | The UK Over Thirty Months rule replaced by testing at about £2bn per death prevented (hindsight LL1-15) | Rarely used for approvals | Moderate |
| Producer pays at source | Places the cost of control on those who put the agent on the market | EU wastewater recast: at least 80% of new treatment costs on producers (hindsight LL2-13) | The contest moves to cost attribution (hindsight LL2-13, lesson 3) | Moderate |
| Surveillance built alongside restriction | Generates the evidence that later judges the restriction | DANMAP and Svarm tracked resistance after the growth-promoter bans (hindsight LL1-09) | The surveillance institutions were the chapter authors’ own | Moderate |
| Acting while the window is open | Eradication or containment before spread | California eradicated Caulerpa 17 days after detection; France did not (LL2-20, p. 498) | Windows close fast; lag phases hide spread | Moderate |
| Small jurisdictions funding their own evidence | Local studies justify local action | Bermuda banned Irgarol and diuron paints in 2005 after funding coral studies (LL2-12, p. 271) | Limited reach (G5) | Suggestive |
6.13 Crosswalk to the twelve lessons and the theme questions#
The twelve lessons (section 3.2) in the lens. 1 Ignorance: K7, K11, rule 5. 2 Monitoring: K1, K7, W4. 3 Blind spots: K2, K6, M2, M6. 4 Interdisciplinary obstacles: K6, M6. 5 Real-world conditions: K9, G1. 6 Benefits: L2. 7 Alternatives and diversity: L3, L6, K7, section 6.12. 8 Lay knowledge: W1, G6. 9 Values: G6, I10, M4. 10 Independence: T2, I3, I5. 11 Institutional obstacles: W4, G2, G7, G9. 12 Paralysis by analysis: I2, T1, T4.
The 149 theme questions (T01–T10, each file’s closing list; T07 has fourteen). Q-numbers map to entries as follows:
| Theme | Mapping |
|---|---|
| T01 | Q1 rule 5; Q2–3 K1; Q4–6 K2; Q7 K10; Q8 K6; Q9 K5; Q10 K7; Q11 W1; Q12 K7; Q13 K8; Q14 W3; Q15 rule 2 |
| T02 | Q1 W7; Q2 W1; Q3 I1; Q4 K1; Q5 K11; Q6 T1; Q7 T2; Q8 G3; Q9 I5; Q10 M3, I6; Q11 I2, W4; Q12 T4; Q13 C1; Q14 W9; Q15 T3 |
| T03 | Q1 I1; Q2 I3; Q3 I2; Q4 I4; Q5 I5; Q6 W3; Q7 I4; Q8 I6, C5; Q9 W6; Q10 I7; Q11 I8; Q12 L6; Q13 G3; Q14 rule 0; Q15 rule 0, T3 |
| T04 | Q1 L1; Q2 L2; Q3–4 L3; Q5 K4; Q6 L4; Q7 L4, C2; Q8 L5; Q9 L4; Q10 I5, L6; Q11 L6; Q12 L6, M4; Q13 C7; Q14 rule 2; Q15 L6, G9 |
| T05 | Q1 C1; Q2 C2; Q3 L6; Q4 C2; Q5 T1; Q6 C3; Q7 L4; Q8 C5; Q9 I6; Q10 C4; Q11 C6; Q12 C5, S1; Q13 C7; Q14 L2; Q15 rule 7 |
| T06 | Q1 G1; Q2 T1; Q3 K2; Q4 G4; Q5 I5; Q6 T2; Q7 W3; Q8 W1; Q9 G6; Q10 G2; Q11 G5; Q12 K7, W4; Q13 T3; Q14 C5; Q15 C7, S4 |
| T07 | Q1 S1; Q2 K4; Q3 K4, L4; Q4 K5; Q5 S2; Q6 K10; Q7 S3; Q8 S6, L5; Q9 S2; Q10 G5; Q11 K7; Q12 G7, S7; Q13 S4; Q14 S5 |
| T08 | Q1 L1, M5; Q2 M2; Q3 K1; Q4 W3; Q5 M4; Q6 M6; Q7 I1; Q8 I2; Q9 M3; Q10 K2; Q11 G1; Q12 I5; Q13 W1, W6; Q14 M1; Q15 rule 0 |
| T09 | Q1 T3; Q2 rule 0; Q3 T3; Q4 L3, C7; Q5 T3, W8; Q6 T1; Q7 W7; Q8 rule 3; Q9 W7, rule 0; Q10 rule 6; Q11 L2; Q12 K7; Q13 rule 0; Q14 W7, W8; Q15 section 6.12 |
| T10 | Q1 rule 5; Q2 K7; Q3 K1; Q4 K7; Q5 K6; Q6 K9; Q7 L2; Q8 L3; Q9 T2; Q10 T1; Q11 I5, W3; Q12 W1; Q13 G6; Q14 T3, C7; Q15 G2 |
Previously dropped, now covered. A completeness review found that the first version of this lens dropped T01 Q7, T02 Q5 and Q14, T04 Q15, T05 Q15, T07 Q6 and Q8, T08 Q6 and T10 Q6, and carried T06 Q14, T07 Q12 and T09 Q7, Q14 and Q15 only in part. They now map as follows: T01 Q7 and T07 Q6 to K10; T02 Q5 to K11; T02 Q14 to W9; T04 Q15 to L6 and G9; T05 Q15 to rule 7; T07 Q8 to S6; T08 Q6 to M6; T10 Q6 to K9; T06 Q14 to C5; T07 Q12 to G7 and S7; T09 Q7 to W7; T09 Q14 to W7 and W8; T09 Q15 to section 6.12. No theme question is now left without a home, though several are merged.
Appendix A. Case-by-case summaries#
Each paragraph gives the story, the main lesson, key pages, the authors’ standpoint (role, self-citation where known, and whether there is a dissenting panel) and the hindsight verdict. Fuller treatment is in the digest, notes and hindsight file for each id.
The 2001 volume (LL1)#
LL1-00 Preface and Introduction (pp. 1–16). Sets the template: an 1898 factory inspector’s asbestos warning against a UK ban on white asbestos only in 1998 (p. 11). Defines precaution as acting before strong proof against serious or irreversible threats, weighing the costs of action and inaction, and recalls the German Vorsorgeprinzip as a wider programme including monitoring, clean production, innovation and proportionality (p. 13). Table 1.2 shows legal formulations ranging from action “even where there is no scientific evidence to prove a causal link” (North Sea, 1990) to Rio’s negatively framed rule (p. 14). John Snow’s pump handle is recast as “precautionary prevention” (pp. 14–15). All cases are false negatives; no usable false positives were found (pp. 12–13). The Preface asserts that political will “seems to be an even more important factor” than information (p. 4). Standpoint: Preface by the EEA Executive Director; Chapter 1 unsigned. The report discloses that case authors were mostly “active participants” in their histories (p. 12); four of the seven editors also wrote cases and then distilled the lessons. No panels. Hindsight: mixed. Latency “pipelines” and the variation in what “precaution” means held; the Peto mortality range and Table 1.1’s dates are loose; the claim that precaution would avoid transatlantic trade disputes did not hold; “very low” trust in scientists was not supported even by 2001 survey data.
LL1-02 Fisheries (MacGarvin; pp. 17–30). Scottish herring, Californian sardine and above all northern cod show “history repeating itself” (p. 17). Canada’s “deliberately conservative” regime failed because assessments converging only with hindsight overestimated the stock (p. 21); the inshore fishers’ Keats report was dismissed as “biased pseudoscience”; Harris recommended 190,000 t rather than the ~125,000 t the target required, to avoid “drastic” social consequences (pp. 21–22); the stock collapsed in 1992. EU reference points were a “precautionary gloss” (p. 24), and the author asks whether model-based precaution can work, since Canada’s regime “still crashed” (p. 25). Lessons: capability masks decline; hindsight-convergent estimates mislead most during decline; proof standards count the costs of action but not inaction. Standpoint: The author is the report’s executive editor and cites his own WWF-UK work for key figures; no panels. Hindsight: core diagnosis held and strengthened (North Sea retrospective bias persisted; 2026 cod limit set against zero-catch advice). The sardine collapse is misdated; the pessimism about model-based rules was too general; northern cod reopened in 2024 partly through a lowered reference point.
LL1-03 Radiation (Lambert; pp. 31–37). Harm was visible from 1896, but excitement and real medical value meant “caution tended to be thrown away” (p. 31). Individuals warned before institutions; early limits were calibrated to acute effects with “no realisation” of latent cancer (1925 tolerance dose roughly 700 mSv a year against 20 mSv now; p. 33); recommendation-only rules left shoe-shop fluoroscopes unchecked (p. 34). Stewart’s pelvimetry finding was “disbelieved” until replicated (p. 34). The one explicit recommendation is to fund long-term epidemiological databases “even when an immediate need is not perceived” (p. 36). Claims that “politics entered the scene” in limit-setting are unsourced. Standpoint: An independent radiation biologist and consultant to environmental groups, the nuclear industry and government (p. 197); no panels. Hindsight: mostly held and strengthened. Worker and CT cohorts show cancer risk below 100 mGy at least as high as bomb-survivor estimates; surveillance was vindicated; medical collective dose rose with CT. The power-line analogy weakened. What Lambert called “substantial lobbies” for thresholds and hormesis (p. 35) had their petitions denied by the US nuclear regulator in 2021 and then gained ground through political routes (2025 US executive order; 2026 proposal to drop ALARA). The ICRP’s 2025 memorandum reaffirmed the linear model as prudent while conceding that optimisation means “the appropriate level of protection, not simply the lowest dose” (hindsight LL1-03).
LL1-04 Benzene (Infante; pp. 38–51). Known as a marrow poison from 1897 and a leukaemia cause from 1928, benzene stayed in use with limits set by what was “easily achievable” (p. 43); the American Petroleum Institute in 1948 called zero “the only absolutely safe level” yet recommended 50 ppm (p. 39). Infante’s own 1977 cohort study found 5–10-fold leukaemia risk at permitted levels (p. 40); the 1980 Supreme Court required a “significant risk” finding, which Infante calls a “straightjacket” (pp. 40–41); a 1 ppm limit came only in 1987. Lessons: knowing is not acting; feasibility-bound limits; the burden placed on the regulator; diffuse exposure through petrol outlasts workplace controls. Standpoint: A protagonist author (OSHA; he led the first benzene cohort study) whose own estimates supply key numbers; opponents appear only through his rebuttals; no panels. Hindsight: institutional lessons held. Limits outside US federal rules moved well below 1 ppm (EU 0.2 ppm from 2026); gasoline became IARC Group 1 (2025). The broad disease spectrum, 54-per-1,000 risk and “>200 deaths” from delay are protagonist upper bounds.
LL1-05 Asbestos (Gee, Greenberg; pp. 52–63). From the “magic mineral” to a projected 250,000–400,000 western European cancer deaths (p. 52). Warnings came from women factory inspectors (1898), insurers refusing cover (1918) and a 1930 survey finding asbestosis in 66% of long-serving workers; the first regulations (1931) produced two prosecutions in 37 years (pp. 53–56). Doll’s 1955 lung-cancer finding faced attempted suppression; mesothelioma needed only months of exposure (pp. 54–55). The WTO accepted that “controlled use” could not be relied on (p. 57). Lessons: latency and the “pensioners’ party” fallacy produce false reassurance; short-follow-up studies are uninformative; externalised costs and cartels slowed substitutes. Pre-1930 actionability is disputed by the historian the chapter cites. Standpoint: Gee (EEA editor, former NGO director) and Greenberg (former UK Medical Inspector of Factories); advocacy by participants, relying on secondary histories and self-citation; no panels. Hindsight: core held and strengthened: all fibre types carcinogenic with no threshold; bans demonstrably avoided deaths; Canada (2018) and the US (2024) banned it. The UK peak was overstated by 20–35%; several cost figures are unreliable; the claim that compensation improves prevention is unsupported.
LL1-06 PCBs (Koppe, Keys; pp. 64–75). Adopted from 1929 as “thought to be safer”, PCBs were found in the environment by chance in 1966 during DDT analysis (p. 64). A 1937 industry-commissioned study was presented to producers at a meeting that closed with a plea to avoid “mob hysteria” among workers (p. 64). Monsanto publicly called toxicity claims “simply not true” while its 1969 plan accepted worldwide contamination and ruled out stopping production (p. 65). Governments acted from cheap to costly uses, “only when there was a high level of scientific proof” (p. 72), leaving installed equipment as the long-term source. Standpoint: Koppe’s own PCB and dioxin research feeds the chapter, and Keys was one of the report’s editors; no panels. Hindsight: structural argument held: legacy stocks persist (the Stockholm 2025 goal off track), primary documents confirm the private–public divergence, and US states have settled with Monsanto. The paediatric respiratory and behavioural attributions were not borne out; “100 years” is inflated by about 40 years; the 1930s counterfactual is weak.
LL1-07 Halocarbons and ozone (Farman; pp. 76–83). Written by the scientist whose 1985 paper reported the Antarctic losses. CFCs were adopted as efficient and non-toxic; short-term safety “appears to demand” inertness, which means persistence (p. 83). A 1965 assessment would have found no known grounds for concern (p. 82). The only unequivocally precautionary acts were the 1977–80 aerosol bans, offset by foam growth; Farman reads Montreal as “overtaken by events” (p. 80) and calls the open-ended HCFC/HFC transition “deeply flawed” (p. 81). Discovery came from long-term monitoring; software had flagged low values as “suspect” (p. 82). Standpoint: A participant with strong views, writing a brief, lightly sourced chapter (p. 12); no panels. Hindsight: persistence forecasts held (CFC-12 ~44% of its 2001 level in 2100); the substitution critique was adopted (2007 HCFC acceleration; Kigali 2016); illegal CFC-11 production was caught by monitoring. Recovery dates slipped; feedstock exemptions leak; whether Montreal was precautionary remains a definitional dispute.
LL1-08 DES (Ibarreta, Swan; pp. 84–92). A cheap, unpatented synthetic oestrogen prescribed from the 1940s to prevent miscarriage on a reversed causal theory. Trials in 1953 showed it did not work; prescribing continued for about two decades (p. 86). A “fortuitous accident”, a cluster of a rare vaginal cancer in young women (7 of 8 cases against 0 of 32 controls), ended use in pregnancy within about seven months in the US; Europe lagged by years (pp. 84, 86, 89). The common reproductive harms were found only because the cancer triggered follow-up (pp. 86–87). Strongest lesson: once benefit was disproved there was no justification for any risk (p. 90). Standpoint: Ibarreta (a Commission Joint Research Centre scientific officer) and Swan; no panels or dissent. Hindsight: held and strengthened: causation settled, reproductive harms quantified; the 1971 US efficacy review still rated DES “possibly effective” 18 years after the negative trial. Daughters’ breast cancer is now contested and third-generation effects unresolved. An unforeseen consequence: caution became exclusion of pregnant women from research.
LL1-09 Antimicrobial growth promoters (Edqvist, Pedersen; pp. 93–100). Low-dose feed antibiotics were “readily adopted” from 1949; the Swann Committee (1969) judged the evidence “a sufficiently sound basis for action”, but its recommendations were “gradually diluted” (p. 94). Reassurances rested on models later overturned (pp. 94–95). Sweden banned growth promoters from 1986 at farmers’ request; Danish farmers halted avoparcin voluntarily in 1995; the EU followed despite its scientific committee’s doubts (pp. 95–96). A Swedish commission noted proof would need a 17-step causal chain per gene and substance, so inaction “is not a neutral position” (pp. 95–96). Standpoint: The key sources are the authors’ own commission and institution, disclosed only in the author annex; no panels. Hindsight: direction vindicated: animal resistance fell after bans; the Pfizer challenge failed (2002); bans spread (EU 2006, US 2017, EU imports 2026); colistin strengthened the general claim. Hospital VRE proved the weakest human-harm link; WHO rates human-benefit evidence low quality; transition costs the chapter omitted were real.
LL1-10 Sulphur dioxide (Semb; pp. 101–109). After the 1952 London smog, Britain built tall stacks; ground-level air improved while European emissions more than doubled and harm moved to Scandinavian lakes (pp. 101–103). A precipitation network built to study plant nutrients detected acidification; resistance continued years after source–receptor attribution (pp. 102–105). Critical loads made action tractable without causal certainty, though only “60 % gap closure” seemed achievable (pp. 106–107). Positions followed perceived costs; change came “only when the issue was taken to the international level” (pp. 106–107). Standpoint: A receptor-country insider (NILU; EMEP); UK counter-arguments are not presented; no panels. Hindsight: core held: dispersion as the textbook failed fix; critical-load exceedance down to 3.5% of Europe’s mapped ecosystems by 2024. The “tenfold” Eastern European rise is contradicted by the chapter’s own source; the London toll is badly understated; the forest-vitality forecast went the wrong way. The largest benefit (fewer fine-particle deaths) and largest unintended cost (unmasked warming) both lay outside the chapter’s frame.
LL1-11 MTBE (Krayer von Krauss, Harremoës; pp. 110–125). Chosen as a lead substitute because it was cheap and moved through existing pipelines; scaled by a US oxygenate mandate to the third most produced US organic chemical by 1995 (pp. 110–111). Highly soluble and mobile, it contaminated groundwater (Santa Monica lost 71% of its local supply, p. 114); the Danish EPA dismissed a 1990 warning while nobody monitored for MTBE (p. 114); it predated EU new-substance rules (p. 116). The same data yielded divergent carcinogenicity verdicts (p. 113). Lesson: evaluate substitutes on their own terms; scale should trigger scrutiny. Standpoint: Co-written by the chair of the report’s editorial team; no panels. Hindsight: central argument held (US exit by 2006–07; EU vPvM hazard classes 2023; IARC 2B 2025). Warnings were flagged by an oil-company engineer, a state paper and US EPA in 1984–88, so the threat was not “never considered” but discounted. “Everlasting” risk was overstated; asthma links unsupported; the substitution chain continued (ETBE, ethanol).
LL1-12 Great Lakes (Gilbertson; pp. 126–134). Wildlife gave the first signals (soft-shelled cormorant eggs, ranch mink, gulls), and research began late (p. 126). Litigation and a new EPA broke the USDA’s alignment with manufacturers (p. 128). Concentrations fell and then flattened at toxicologically significant levels; the 1978 “virtually eliminated” pledge was “not properly implemented” (pp. 129–132). The author argues that supposed complexity and uncertainty “has not been inconvenient” to those reluctant to pay for remedies, and that proven causation still did not produce remediation (pp. 129–131). Standpoint: A participant-advocate (International Joint Commission) who cites his own work and gives opponents one-line treatment; no panels. Hindsight: mixed. The legacy tail held (PCBs still drive fish advisories) and the neurodevelopmental direction was replicated, but “proven” and “irreversible” overstated the evidence; the congener claim is contested. Support did not wane: large restoration programmes followed. Recovery was non-monotonic (invasive mussels remobilised PCBs). What unlocked remediation was bounded local targets and an economic-benefits case.
LL1-13 TBT antifoulants (Santillo, Johnston, Langston; pp. 135–148). Imposex appeared in 1970–71; its cause stayed unknown for a decade (p. 136). A pest snail’s loss would have prompted “little if any action”; the oyster crop’s collapse at Arcachon did, and France acted in 1982 on the “best information available” (p. 136). The UK’s first target (20 ng/l) rested on acute tests while dogwhelks were sterilised at 3–5 ng/l (pp. 136–137). Large ships were exempted on an “open seas” assumption (p. 139); “It would seem” only global restrictions can work (p. 142). The authors judge no action precautionary, because each followed documented harm (p. 142). Standpoint: Two Greenpeace scientists and a TBT researcher who co-authored several cited UK studies, none of it disclosed in the chapter; no panels. Hindsight: aged well: the IMO convention entered force in 2008; imposex exceedance fell from 81% to about 21% of OSPAR sites; shipping was confirmed as the main source; persistence proved longer. The steroid mechanism was superseded; the Japan example is weak; “none precautionary” is too sweeping.
LL1-14 Hormones as growth promoters (Bridges, Bridges; pp. 149–156). The EU banned six hormones against its own Lamming Committee and JECFA, disbanded the committee and did not publish its interim conclusions (p. 150). The committees assessed only authorised use, single substances and manufacturers’ data, and never characterised uncertainty, so the ban was “in reality, a political risk assessment”, driven “principally” by public concern (p. 154). Low-baseline prepubertal children were missed (pp. 150, 152–153). There is “no good evidence” the ban protected health, yet later research “probably justifies” it (pp. 153–154). Standpoint: The lead author advised the EU at the WTO, which the chapter does not say; no panels. It is nonetheless the reports’ sharpest internal critique of EU precaution. Hindsight: the evidence lessons strengthened (children’s hormone levels overestimated; assessment scope; neither side generated decisive evidence). The genotoxic-carcinogen verdict remains contested; sanctions were overstated; the dispute was managed by beef quotas, not science. It is the reports’ own internal counterpoint to precaution.
LL1-15 BSE (van Zwanenberg, Millstone; pp. 157–167). One ministry promoted agriculture and protected consumers. Fear for exports and spending dominated its first 20 months; the health department learned 17 months late (pp. 159–160). About 1,200 clinical cases could have been removed for about £1.5m (p. 158). Controls followed commercial convenience; in May 1990 advisers said “no risk” could not be stated categorically, and a month later the minister called beef “perfectly safe” (p. 161). Cheap measures were then refused lest they imply the reassurance was false; about 48% of abattoirs visited in 1995 failed the offal rules (pp. 161–162). Standpoint: No panels; the authors accept the Phillips Inquiry’s main criticism and dispute two of its conclusions. Hindsight: narrative held; feed leakage and enforcement failure confirmed; EU active testing found hidden disease. The Phillips Inquiry found officials sincerely believed the risk remote and the health department equally keen to reassure, so “covertly subordinated” is contested. Measures were later wound back through open, costed review.
LL1-16 Twelve late lessons (editorial team; pp. 168–191). The synthesis: long gaps between warning and action; information not delivered or discounted; institutional versus societal ignorance; the twelve lessons (section 3.2); plus sections on science (Type I/II error bias; Table 16.1’s ladder of proof), innovation (lock-in, diversity as insurance) and governance that go beyond the cases. ESTO “provided the initial framing” and gave an opportunity to “test or elaborate” its points against the cases (p. 168); the Preface says the lessons were “distilled” from the case authors’ own lessons (LL1-00, p. 3). Analysis: with no coding method or counter-case search reported, the cases work more as illustration than as a test. The chapter is fairer than its reputation: it rejects blanket opposition to innovation, concedes research can increase uncertainty, and hedges that not all cases show distortion from non-independent information. Standpoint: The editorial team, four of whom wrote case chapters; its section on science and governance draws heavily on the editors’ own work. Hindsight: mechanism claims held (active testing confirmed “no evidence” produced by not looking; EU reforms acknowledged dependence on applicant data; institution-by-institution variation in precaution confirmed). Innovation, diversity and public-understanding claims rest on thin evidence. Several small factual slips (Swann’s date; “PCB chloracne” in 1899).
LL1-17 Conclusions (pp. 192–194). Compresses Chapter 16 into a definition (precaution as “an overarching framework of thinking”), Table 17.1 (risk/prevention, uncertainty/precautionary prevention, ignorance/precaution) and the level-of-proof argument (p. 193), and closes with innovation as “ultimately a matter of political discourse” (p. 194). Drops Chapter 16’s caveats and does not use the hormones chapter. Standpoint: Unsigned; most plausibly the editorial team. Hindsight: diagnosis held; level of proof as a political choice strengthened as analysis; property screening and monitoring strengthened as policy (Stockholm Convention growth; EU persistent-mobile classes); removing antibiotics from feed vindicated. The innovation claim is contested; the lessons as a package untested.
The 2013 volume (LL2)#
LL2-00 Preface, Introduction and Part A introduction (pp. 1–16). McGlade’s Preface makes “the relationship between knowledge and power” the thesis and calls for “the power structures of knowledge” to change (pp. 7–8). The Introduction summarises: the nine Part A cases show “more than sufficient evidence for much earlier action”, obstructive business and the value of independent science (p. 10); harms were “for the most part” caused by “irresponsible corporations” (p. 11); false positives are “few and far between” (p. 10); the twelve lessons “remain highly pertinent” (p. 11). Authors were chosen for “substantial involvement” (pp. 9–10). Standpoint: Preface by the EEA Executive Director. Case advice included the Collegium Ramazzini; authors were chosen for “substantial involvement”; four commentaries are left off the panel list (p. 16). Hindsight: mixed. The persistence and developmental-window warning is the best-vindicated claim (PFAS). Emerging-technology warnings have a mixed record. “Irresponsible corporations” is weakened by harms driven by public authorities (Flint, Camp Lejeune, Minamata state liability); the trust claim by a 68-country survey; “4 of 88” was never independently replicated.
LL2-02 False alarms (Hansen, Tickner; pp. 17–45). Tests critics’ lists of over-regulation: of 88 alleged cases, four genuine false positives (swine-flu immunisation, saccharin labelling, Southern corn leaf blight, food irradiation; p. 25). Swine flu shows a warning over-weighted because it fitted theory, with a stockpiling option never really discussed and 107 Guillain-Barré cases across 40 million inoculations (pp. 26–31). Nitrites show graduated measures working (p. 25). Lessons include openness about disagreement, alternatives, care with large-scale introductions, research as supplement not substitute, built-in re-evaluation (pp. 34–35). Standpoint: Hansen (LL2 editorial team) and Tickner (a long-standing advocate of precaution; an assessment, not stated in the report); no panels. Hindsight: a strong rebuttal of critics’ lists (most checked cases classed “the jury is still out” moved towards harm) and a strong lesson that definitions decide counts, but not an error-rate estimate: false positives proved long-lived, trade-offs were defined out, and MMR, excluded as an “unregulated alarm”, aged worst.
LL2-03 Leaded petrol (Needleman, Gee; pp. 46–75). Warned against before sale (1922) and after worker deaths (1924), TEL was approved in 1925 “provided that” it was properly regulated, with a public study urged; neither followed, and for 40 years research was industry-funded (pp. 50–56). Kehoe treated contaminated “controls” as “natural” (pp. 56–57); Patterson broke the paradigm (pp. 57–58). Phase-out came when lead threatened catalytic converters, and in Europe by “pure chance” alignment with forest concerns (pp. 60, 64). Benefits: blood lead down more than 90%; IQ gains valued at USD 100–300bn per US birth cohort (p. 62). Standpoint: Needleman, whose own lead research is part of the story and who praises his “seminal” work (p. 60), and Gee (EEA editor, former Director of Friends of the Earth UK). Four supporting panels bring out the contingency the lessons omit (section 2.7). Hindsight: core science strengthened (no safe level; WHO attributes 3.5m deaths a year to lead; new natural-experiment studies). Specifics wrong (CDC level already replaced in 2012; IQ gain misquoted); the alcohol alternative oversold. Leaded aviation fuel, exempted as “temporary” in 1996, remains the largest US source of airborne lead.
LL2-04 PCE in water mains (Ozonoff; pp. 76–91). A pipe lining applied in solvent leached PCE into drinking water across some 700 miles of New England mains; an early odour anomaly was explained away as incomplete “curing” and routine tests could not see organics (p. 77). Toxicological knowledge existed but “never figured in the water mains product design”; the author finds indifference, not concealment: “nobody made them care” (pp. 84, 86). Rudén’s panel shows 29 TCE assessments reaching four conclusion types by institution (pp. 84–85). Lessons: acceptable risk belongs to a use and its beneficiaries; uncertainty favours inaction; liability as the “acid test”. Standpoint: A single author whose possible litigation role is undisclosed; panels by Rudén (supportive) and Onasch (thin substitution economics) (section 2.7). Hindsight: core held; harm later documented in exposed cohorts; assessors still diverge five ways. “On the cusp” of confirmed carcinogenicity was wrong. Action came via a 2024 US rule on neurotoxicity, now under reconsideration. The author’s litigation role was undisclosed.
LL2-05 Minamata (Yorifuji, Tsuda, Harada; pp. 92–130). Chisso’s methylmercury poisoned fishing families from the 1950s. Epidemiology identified the route by 1956, but the health ministry refused to apply food law without “clear evidence that all fish and all shellfish are poisoned” (p. 99), although Shizuoka Prefecture had used the same Act for a shellfish-poisoning episode in 1950 (p. 98). Chisso suppressed its doctor’s cat experiment, installed an ineffective purifier and promoted rival theories; the trade ministry insisted “Never stop it!” (pp. 99–104). Government acceptance came in 1968, after production stopped as “no longer necessary” (p. 105). A mother’s observation convinced Harada in 1961 that the disease passed to the foetus, when medical opinion held the placenta protective; Kitamura had raised placental transfer as a possibility in 1959 (p. 105). Poisoning recurred at Niigata in 1965 (p. 105). Strict 1977 criteria, set by a prefecture that co-financed the polluter, excluded tens of thousands (pp. 107–110). Verdict: a “democratic deficit”. Standpoint: Protagonist authors relying on their own studies; panels by Grandjean (declared interest), Selin and Castaño, whose caution about low-dose harm is a partial internal dissent (section 2.7). Hindsight: mechanisms held with a 13-year out-of-sample record: recognition frozen, criteria unchanged, the statutory survey only a 32-person pilot by 2026, litigation split. Legal wording needs correcting; Grandjean’s lower-limit call remains contested.
LL2-06 Beryllium (Michaels, Monforton; Guidotti panel; pp. 131–150). A 2 µg/m³ limit chosen in 1948 “in the absence of an epidemiological basis”, reportedly in a taxi, was adopted “tentatively” and made permanent (p. 133). It controlled acute disease while chronic disease appeared below the limit (pp. 133–134). The producer planned a textbook under academic auspices “to be fully acceptable and credible” and called the standard “fundamental to our product liability defense” (pp. 136–137). The state was sponsor, customer and regulator. Guidotti reads the conduct as “cognitive dissonance and denial rather than cupidity” and argues firms need “room … to turn around” (pp. 145–150). Standpoint: Michaels is both protagonist and historian; the evidence of intent rests on litigation documents, many “available from authors”; the company’s own account is absent. Guidotti’s panel is the counter-reading. Hindsight: empirical core strengthened (OSHA 0.2 µg/m³ in 2017; EU 2019); the prescription to end most use weakened as beryllium became a critical mineral. The tighter US limit was co-drafted by the producer and the steelworkers’ union, which partly vindicates Guidotti’s auditing model over blanket discounting.
LL2-07 Tobacco industry manipulation of research (Bero; pp. 151–178). Internal documents show research treated as the “antidote” to the passive-smoking issue and teams formed to “keep the controversy alive” (p. 154). Eight strategies (Box 7.1, p. 155): fund, hide, publish, suppress, criticise, change standards, press, policymakers. Among 106 reviews, industry affiliation was the only predictor of concluding second-hand smoke harmless (OR 88.4; p. 161). “Sound science” campaigns sought “unreasonably high standards of proof” (p. 162). Lesson: disclosure is necessary but not sufficient. Standpoint: Largely a synthesis of the author’s own work; Panel 7.1 is complementary; no industry panel. Hindsight: strengthened: US federal courts found manufacturers conspired to deny health effects (2006, affirmed 2009); sponsorship bias corroborated independently; the playbook documented across sugar, fluorochemicals and fossil fuels. Breast cancer from second-hand smoke remains contested; OR 88.4 is an imprecise outlier; the WHO tobacco treaty’s Article 5.3 is omitted.
LL2-08 Vinyl chloride (Soffritti et al.; pp. 179–202). A 500 ppm limit rested on one 1930s guinea-pig study and reflected “what the industry felt was achievable” (p. 182). Companies learned privately of bone disease in 1966 and agreed to “use discretion”; a report was accepted only once it said the cause was “unknown”; a secrecy agreement kept a 250 ppm cancer result from NIOSH in 1973 (pp. 183–186). Once angiosarcoma deaths became public in 1974, limits fell to 1 ppm within months, upheld “on the frontiers of scientific knowledge” (pp. 186–187). Standpoint: Allied advocates (the Ramazzini Institute, NRDC, a public-interest consultant and the EEA editor); no industry or regulator voice; Panel 8.2 presents contested bioassay claims without the counter-view. Hindsight: concealment history strengthened (archives public since 2018); liver cancer and cirrhosis confirmed. The multi-site cancer list weakened; the cost contrast is about fourfold like-for-like, not 300-fold. Infeasibility claims recur (2025–26 US exemptions citing technology “not available”).
LL2-09 DBCP (Bingham, Monforton; pp. 203–214). Rat data in 1958 showed testicular damage; a consultant’s advice for sub-1 ppm exposure and protective clothing was called “impractical”, and the 1 ppm limit sat below the lowest dose tested (pp. 204–205). Workers found their own sterility by comparing notes at lunch in 1977; an emergency standard followed in about two months (pp. 204–206). Exports continued with English-only labels; compensation was small and late (pp. 207–210). Safety had rested on “authoritative assertion but without evidence” (p. 211). Standpoint: Bingham headed OSHA during the rulemaking she describes; Monforton co-authored; no panels. Hindsight: core held; the primary record confirms regulatory neglect; groundwater exceedances projected to about 2080; DBCP never listed under the Rotterdam Convention. Regulatory and exposure details are wrong in places, and the litigation account omitted facts against plaintiffs.
LL2-10 Bisphenol A (Gies, Soto; pp. 215–239). BPA’s oestrogenic activity, known in the 1930s, did not follow it into plastics; it was rediscovered by accident in 1993 (pp. 216–217). Academic low-dose studies were excluded by assessors relying on guideline studies, producing tolerable intakes orders of magnitude apart on shared evidence (pp. 220–223). Markets withdrew BPA while agencies still said “safe” (p. 225). Standpoint: Gies (German Federal Environment Agency) and Soto (Tufts), who co-authored many of the sources; no panels. Much of the later literature “vindicating” the chapter comes from the same scientific network (hindsight LL2-10). Hindsight: vindicated in the EU: EFSA cut its tolerable intake 20,000-fold in 2023, on an academic immune-endpoint study of the kind the chapter said was excluded, and the EU banned BPA in food-contact materials (2024). The dispute widened (other agencies dissent by up to 1,000-fold; a jointly designed study reproduced the split). Non-monotonic dose responses and high free-BPA serum values did not hold; substitution by BPS and BPF followed.
LL2-11 DDT (Bouwman et al.; pp. 240–260). A fiftieth-anniversary tribute to Silent Spring. The 1948 Nobel speech counted persistence as a virtue and read resistance as a prompt for new chemicals (p. 241). South Africa’s switch away from DDT was followed by pyrethroid-resistant reinvasion, which “probably increased the threshold of expectation of proof” for alternatives (pp. 243, 250). Spray residents are “the largest non-occupationally exposed community in the world” (p. 248). The authors propose a “centrist” position: cut use and exposure rather than ban (p. 248). Standpoint: All four authors research or advise on DDT and malaria; about 17 of 112 references are their own, and one author advised the WHO consultation the chapter quotes; no panels. Hindsight: mechanisms held (resistance wears down single tools; substitutes carry their own uncertainties; restrictions leak). Use fell far faster than forecast (to 370 t in 2023; India stopping from 2025), mainly because vectors became resistant and substitutes matured. Several health claims did not replicate; the South African recovery had several causes.
LL2-12 Booster biocide antifoulants (Price, Readman; pp. 261–278). Banning TBT on small boats triggered “booster” biocides, “believed to be less damaging” (p. 265); Irgarol was found by chance at up to 1,700 ng/L in a herbicide survey (p. 267), and the substitutes swapped an endocrine hazard for broad inhibition of photosynthesis at the base of food webs (pp. 273–274). The cycle: assume a replacement is safer, monitor, concern builds, ban the worst, search again (p. 273). Monitoring without predetermined thresholds becomes an “academic pursuit” (p. 274). Standpoint: An insider account: Readman made the first detection, and 13 of 41 references are the authors’ own; no industry or regulator voice. Hindsight: strengthened: EU non-approval of cybutryne (2016) and an IMO ban (2023). The cycle repeated: medetomidine met the EU endocrine-disruptor exclusion criterion in 2024. The chapter’s endocrine reassurance weakened, and its claim that “policy has proven effective” lacks ecological data.
LL2-13 Ethinyl oestradiol (Jobling, Owen; pp. 279–307). The pill’s potent, stable oestrogen passes through sewage works “not designed” to remove it (p. 281). Intersex roach were noticed in 1978; a national survey was kept unpublished until 1994; drug regulators had “limited expertise in environmental issues” (pp. 282–284). The UK chose end-of-pipe treatment, costed at EUR 32–37bn for England and Wales, over drug redesign (pp. 290–293). The authors ask whether “the price of being precautionary” is “simply too high” and call Rio’s “cost effective” wording precaution’s “Achilles heel” (pp. 294–296). Standpoint: Participant authorship: the authors’ own studies and commentary supply much of the evidence and the cost figure; no dissenting panel. Hindsight: delay worse than feared, but regulation arrived stricter: Directive 2026/805 sets 0.017 ng/L with a 2039 target, and the 2024 wastewater recast makes producers fund at least 80% of new treatment. Measurement limits confirmed; Swiss cost projections optimistic; English roach populations self-sustaining; a Canadian lake population collapsed and recovered.
LL2-14 Climate change (Grassl, Metz; pp. 308–346). Framework action came fast (the UNFCCC before human influence was detected), effective action never: emissions rose from ~38 to ~50 Gt CO2-eq between 1990 and 2010 (pp. 321–325). Kyoto compliance rode on windfalls (p. 324). Doubt-making was one cause, “not the only one” (p. 330). Precaution is said to have applied mostly where implementers were also beneficiaries (p. 337) and to be redundant now the science is settled. A panel notes that expert groups underestimated structural uncertainty (p. 333). Standpoint: Written by insiders (IPCC and WCRP), not disclosed in the chapter; Panel 14.1 (MacGarvin) partly dissents on structural uncertainty (section 2.7). Hindsight: descriptive history held (record 54.1 Gt in 2025; Kyoto over-compliance mostly “hot air”); science confidence strengthened; quantitative targets overtaken; the claim that precaution no longer matters contested (tipping-point framing; ICJ advisory opinion 2025).
LL2-15 Floods (Kundzewicz; pp. 347–368). Floods cannot be prevented; the aim is “living with floods” (pp. 356, 362). Warning chains fail at their weakest link: accurate forecasts with no local warning at Vaison-la-Romaine; on the Odra, local authorities lacked legal power to raise alerts and the flood information office itself flooded (pp. 353, 360). Design codes assume “the past is the key to the future” on short records (p. 355); memory fades in a “hydro-illogical cycle” (pp. 360–361). Standpoint: A single author, a hydrologist and IPCC author; five named reviewers; three complementary panels. Hindsight: mechanisms strengthened: the 2021 German floods (forecasts two days ahead; 29–35% of surveyed residents unwarned; peaks matching unrecorded floods of 1804 and 1910) and Valencia 2024 (“paralysis at the decisive moments”, in a judge’s words) reproduced the patterns. Quantitative projections and the Floods Directive’s promised risk reduction remain unverified.
LL2-16 Neonicotinoid seed dressings and bees (Maxim, van der Sluijs; Bayer panel; pp. 369–406). Beekeepers reported losses from 1994. Assessment tools built for sprays were applied to systemic seed dressings; public researchers were told not to measure below the manufacturer’s 10 ppb detection limit (pp. 373–377). The official committee answered whether the product was “solely responsible, at national level, for all” losses, “a question that had never been asked” (p. 379). Sunflower use was suspended in 1999; maize, with larger stakes, only in 2004 after court rulings (pp. 380–382). Bayer’s dissent (Panel 16.1, pp. 401–402, by a co-author of the disputed studies) argues that colony losses are multifactorial and that large-scale monitoring found no correlation with seed dressings; the authors’ reply (pp. 403–406) does not engage the monitoring studies. Standpoint: The authors’ reply to Bayer is printed; Bayer’s panel author co-authored the disputed studies (section 2.7). Hindsight: method critique confirmed by EFSA, EU courts and auditors, yet revised bee guidance was still awaiting a vote in September 2026; restrictions became law (outdoor ban 2018). Pesticide–pathogen synergy and the honeybee as sentinel weakened; Bayer’s multifactorial framing, and its narrower claim that honeybee colonies often show no measurable field harm, held up, while its “no correlation” claim was undermined at national scale (hindsight LL2-16, Claim 9); wild bees bore the harm; beet yields fell in a 2020 virus-yellows outbreak after the 2018 ban; derogations and near-equivalent substitutes cycled.
LL2-17 Ecosystems and managing change (McGlade, van den Hove; pp. 407–428). Written partly as the EEA Executive Director’s first-person account of her former agency. Warnings about northern cod (catch rates can rise as a stock collapses; outsider re-analyses; the agency’s own 1988 call to halve the quota) were overridden; ministers said “the scientists had been wrong before” (pp. 411–414). The model excluded inshore data as “messy and often anecdotal” (p. 414). Norway’s prompt cuts are the contrast (p. 414). The chapter recommends agreeing in advance “which diagnostic criteria and metrics will be used to elicit action” (p. 423). Standpoint: The EEA’s then Executive Director, a former DFO scientist, writing partly in the first person; Panel 17.2 sits uneasily with the main text on the authority of science (section 2.7). Hindsight: Canadian narrative held; “irreversible demise” overturned (reopened 2024, though partly through a downward revision of the limit reference point, “not an increase in the quantity of cod”; the size of the cut is inconsistent across DFO documents, roughly 30–60%; hindsight LL1-02, LL2-17); the Norway exemplar contains factual errors and later overshot advice; EU override persists; Baltic cod collapsed. Pre-agreed triggers became common but get re-specified downwards.
LL2-18 Chernobyl and Fukushima (Dorfman, Fucic, Thomas; pp. 429–457). Uses the two accidents as warnings for new nuclear build: health tolls uncertain and probably undercounted; probabilistic assessment blind to cascading common-cause failures; regulation speaking a “language of certainty” (p. 448); liability caps far below accident costs; new build late and over budget. The Diet commission’s “profoundly manmade” and “regulatory capture” findings are cited (pp. 441–443). Standpoint: The authors are known critics of nuclear power; no panels or rejoinders; contested and advocacy-commissioned sources are flagged only in the references. Hindsight: institutional and economic diagnoses held or strengthened (IAEA “safety myth”; costs ~100 times the European cap; Olkiluoto and Flamanville years late). Health forecasts weakened: UNSCEAR documents no radiation-attributable disease among Fukushima residents, while the prefecture counts 2,351 disaster-related deaths from stress and ill-health among evacuees (a count covering the combined earthquake, tsunami and nuclear disaster, with no official split). The chapter’s most transferable content was borne out: probabilistic assessment bounded by listed scenarios misses cascading common-cause failures, and a review remit that excluded security limited what the stress tests could find (p. 444; digest LL2-18, insights 1 and 12; hindsight LL2-18, lessons 1 and 10). The caesium release figure was too high; the phase-out trajectory reversed outside Germany.
LL2-19 GM crops and agroecology (Quist et al.; pp. 458–485). Contrasts “top-down” technology transfer with “bottom-up” agroecology. Innovation policy built on competitiveness and IP rewards what can be “packaged and sold” and “largely bypass[es] the poor” (p. 460). Herbicide tolerance creates a “treadmill” and “deskilling” (p. 462); developer-controlled, confidential, underpowered studies tilt towards “no evidence of harm” (pp. 468–470); the late lesson “may be” institutional (p. 470). Agroecology results “speak for themselves” (p. 474). Standpoint: Biosafety scientists from one network, with heavy self-citation; editorial and advisory-board ties undisclosed; no adversarial voice. Hindsight: political economy strengthened (62 glyphosate-resistant weeds; dicamba drift and vacatur; 2017–18 mergers; EU law excludes herbicide-tolerant plants from its lighter gene-editing regime). The health “indications” collapsed (Séralini retracted; no effects in an EU-funded two-year study); agroecology yield claims weakened; the chapter held GM and its preferred alternative to different evidential standards.
LL2-20 Invasive alien species (Brunel et al.; pp. 486–508). Invasions grow with trade and travel, “with no indication yet of any saturation effect” despite 42+ treaties (p. 493). Lag phases of decades defeat traceability and liability (p. 497); eradication windows close fast (California eradicated Caulerpa 17 days after detection, France did not, p. 498); governments used EU coordination as an excuse for inaction (Box 20.4, p. 501); fixes became hazards (signal crayfish, p. 497). Standpoint: The six authors run the institutions they describe, which the chapter does not mention; about 30% of references are their own; no panels. Hindsight: diagnosis held and mainstreamed (rates “often even accelerating”; IPBES costs above USD 423bn a year; a global target to halve introductions). Institutional forecasts were late (EU regulation 2015); the ruddy duck was not eradicated; the USD 1.4 trillion global cost was misattributed.
LL2-21 Mobile phones and brain tumours (Hardell, Carlberg, Gee; pp. 509–529). Tells how IARC classified radiofrequency fields as “possibly” carcinogenic (2B) in 2011, largely on the authors’ own case-control studies and Interphone. Argues that null studies were misread as “negative”, that latency defeats early studies (fewer than 10% of Interphone cases had 10+ years of use), and that a divided consortium produced an “elegant and oracular” conclusion each side captured (pp. 511–518). Standpoint: Protagonist authorship: Hardell’s own studies are central; the group’s telecom-operator funding is in a footnote (fn 11); the EEA had withdrawn from the IARC meeting while its editor co-authored the chapter (p. 520); no panels. Hindsight: core epidemiological conclusions substantially weakened: large independent cohorts and national incidence trends show no increased risk, as does a WHO-commissioned review (2024; moderate certainty). The review was assessed from its abstract, and several of its authors held roles in ICNIRP or in studies the chapter disputes; isolated signals persist (CERENAT, OR 2.89 in the heaviest users; a bias-adjusted Canadian Interphone reanalysis, OR about 2; IARC 2024 calling the human evidence “mixed”); some rat findings keep plausibility open (hindsight LL2-21). Institutional and communication observations hold. The reports’ clearest early warning that has, so far, largely not been borne out.
LL2-22 Nanotechnology (Hansen, Maynard, Baun, Tickner, Bowman; pp. 530–560). A prospective audit of a young technology against the twelve lessons. Early hazard signals (ultrafine TiO2; long multi-walled carbon nanotubes behaving like asbestos; nanosilver) are presented as “preliminary” (p. 536), though the language escalates to “rapidly increasing evidence of risks” (p. 539). Chemical identifiers made nano forms legally invisible; voluntary reporting failed; the US regulator had to show risk before demanding data, “a classic regulatory paradox” (p. 537). Twenty years after the first signals, “many governments still call for more information as a substitute for action” (p. 547); the promoting programme also oversaw risk research (pp. 546–548). Table 22.1 found knowledge lessons widely noted and alternatives never (p. 548). Standpoint: A protagonist update of the authors’ 2008 article, co-authored by the project lead (section 1.5). About a quarter of references are the authors’ own, including a key early warning co-authored by Maynard (Poland et al. 2008) and the benchmark research agenda (Maynard et al. 2006); no dissenting panel; false positives not considered. Hindsight: architecture diagnosis aged best (mandatory registries; REACH nano rules from 2020; definition settled 2022). The long-MWCNT warning was vindicated (EU carcinogen classification applying 2026); the TiO2 classification was annulled; nanosilver risk looks lower. Governance recommendations largely not adopted; no realised harm exists to test outcomes.
LL2-23 Costs of inaction (Andersen, Clubb; pp. 561–580). Accepts that policymakers wait for monetised costs of inaction and argues these can justify precaution if built on evidence, low discount rates and ranges (pp. 564, 577). Cases: lead, mercury, nitrate, air pollution, ozone. Costs of inaction are lower bounds because whole pathways are omitted (p. 568); valuation conventions move results several-fold (Table 23.1, p. 574); the conservative bound already justified SO2 abatement (EUR 5–9 damage per kg against abatement from below EUR 1; pp. 571, 573). Weighs costs of action only where small. Standpoint: Several headline numbers come from Andersen’s own work; no panels. Hindsight: undercounting strongly vindicated (global lead-attributable death estimates rose from about 0.9m in GBD 2019 to 3.5m in GBD 2023 as exposure models changed to cumulative bone-lead exposure; a separate 2023 estimate put lead-attributable cardiovascular deaths at 5.5m, six times GBD 2019, with 77% of a USD 6.0 trillion cost in cardiovascular mortality); the conservative-bound practice entered EU air-quality law; nitrate evidence moved its way without a changed standard. Valuation conventions proved politically contingent (US reversals in 2025). The chapter’s own numbers carry little weight.
LL2-24 Early warners and late victims (Cranor; pp. 581–606). A normative legal essay: protect warners on reasonable belief, not vindication (pp. 582–584); tort is “a poor legal model” (p. 589), with proof rules that “asymmetrically hamper plaintiffs” (p. 588); alternatives include no-fault schemes and worst-case assurance bonds (pp. 594–603), though compensation tables need a history of prior victims and deterrence feedback is “modest” (pp. 599, 603). UK asbestos case law relaxed causation (Panel 24.2). Standpoint: A single author with three supporting panels; no industry, insurer or regulator voice; the author’s role as plaintiffs’ expert in Milward is undisclosed. Hindsight: the structural diagnosis was borne out (Milward lost after nine years; Camp Lejeune compensation legislated only in 2022; a UK levy scheme for untraceable defendants). Proposals mostly not adopted: whistleblower law covers breaches of law only; France abolished its alert commission in 2026; no bonds anywhere. Arithmetic errors, and the author’s undisclosed role as plaintiffs’ expert in Milward.
LL2-25 Why business did not act (Le Menestrel, Rode; pp. 607–620). In “virtually all reviewed cases” continuing was perceived as profitable (p. 607). Harms reach firms only through liability, regulation and reputation, each leaky; uncertainty becomes a “welcome ‘excuse’” (p. 614); good people build cultures of denial. The key distinction: “business actions” within the rules versus “political actions” that change rules and evidence (p. 615); secrecy about the latter “can be seen as a signal” of bad faith (p. 617). Warns against blame “with hindsight” (p. 616). Standpoint: Business-ethics and behavioural-economics researchers relying on second-hand evidence from mixed sources; no panels. Hindsight: diagnosis strengthened (internal climate projections against public doubt; fluorochemical toxicity known by 1970; an Exxon memo of 1985 against MTBE; asbestos trust paying 5.6% of claim value). “Virtually all” is built into a failure sample; firms differed within sectors; remedies partly adopted, none for uncertain hazards; the fiberglass “success” was itself a false positive.
LL2-26 Science for precautionary decisions (Grandjean; pp. 621–642). An insider’s essay on how environmental-health science delays prevention: research concentrates on known substances (top-20 substances take 12% of chemical links; data-poor priority chemicals attract almost none; pp. 626–629); nine default assumptions later proved wrong (Table 26.3, p. 630); non-significant results are called “negative” (p. 635); the upper confidence limit should be treated as a plausible worst case (p. 633); research lacks independence. Proposes a “PATIO” research ethos (p. 638). The author calls himself “part of the inertia” (p. 628). Standpoint: Single-author advocacy by an LL2 editorial-team member, built on his own study published in his own journal; no dissent. Hindsight: PFAS and BPA examples vindicated in the EU (and PFAS in the US); the research-neglect description held but inertia was overstated (attention shifted after controversy); the statistics critique was endorsed by the ASA while practice changed little; the one-directional error claim is the most weakened; exposure limits kept falling for flagship toxicants, with counterexamples.
LL2-27 More or less precaution? (Gee; pp. 643–669). The project originator’s case. Seven barriers explain delay (p. 645). Offers an EEA working definition (p. 649), a knowledge-state typology adding ambiguity (Table 27.1), Bradford Hill reappraised for multicausality (pp. 651–654), twelve criteria for action (Box 27.4), a strength-of-evidence scale (Table 27.2, p. 658) and a participatory cycle (p. 660). “Not established” rarely says who bears the error, “risk takers or risk makers” (p. 658); late action “consolidated technological monopolies … at unrealistically low prices” (p. 659). Argues only for more precaution. Standpoint: The project originator and editor of both volumes; no panels; Box 27.5 is by a Commission official writing in a personal capacity. Hindsight: diagnosis and tools held; the fight over evidence standards became explicit policy in both directions; emerging hazards diverged (BPA, neonicotinoids and PFAS towards the chapter; GM food and mobile phones away); innovation claim holds only in the weak form; the policy climate turned.
LL2-28 In conclusion (unsigned; pp. 670–684). Technology adoption accelerated while governance stayed static (p. 670). Shared features: a few deciding for many, no mechanisms to respond, misleading prices, poor accounting (p. 671). Delay worsened when the technology has changed by the time harm is confirmed (the moving-target problem), by sunk-investment lock-in and by scale (p. 672); “harm expansion” (p. 672); tip policy towards avoiding harm “even at the cost of more false alarms” (p. 673); a “homo-illogical cycle” of fading vigilance (p. 680). Proposes pollution taxes, natural-capital accounting, pre-funded compensation, liability bonds and a place for value conflicts; power is “well beyond the scope” (p. 672). Standpoint: Unsigned editorial synthesis: advocacy in the institution’s voice, with no panels or dissent. Hindsight: harm expansion strengthened for the named agents; committee divergence persists; “4 of 88” is unreplicated and restated without its caveats, the 1% research-funding figure unsourced (plausible range 1–2%), and “half of all articles” overstated about fourfold; the GM human-health sentence is unsupported. Transparency was adopted; tax shifts reversed and bonds never appeared.
LL2-A2 Annex 2: overview of LL1 (pp. 701–716). Recaps the fourteen 2001 cases with chronologies frozen at 2001 and Table A2.1 (from Gee 2009) giving “years of substantial inaction” (p. 702). Separates delays in knowing from delays in responding and records that rules often failed to reduce risk. Standpoint: Unsigned; parts date from different years without saying so; no panels. Hindsight: the qualitative story held (long lags, slow recovery, regrettable substitutes, rules without reduction), but the lag table uses inconsistent dating rules and “effective action” proved a decades-long process (asbestos, benzene and PCB measures kept arriving after 2013). Several figures repeated from 2001 are imprecise; the hormones case remains contested.
LL2-A3 Annex 3: updates of nine LL1 cases (pp. 717–737). Short 2012–13 updates, mostly by authors revisiting their own cases, under the editors’ thesis that harm “expands over time” (p. 717): fish, benzene, asbestos (the fullest political-economy account, including Canada’s obstruction of the Rotterdam Convention), PCBs, ozone, DES, growth promoters, MTBE and a Commission lawyer’s summary of the 2008 WTO hormones ruling. Standpoint: Mostly authors revisiting their own cases or promoting their own laboratory’s work; no panels, no industry or dissenting voices, no declarations of interest; the hormones piece is by the Commission’s own lawyer. Hindsight: the direction held (gasoline IARC Group 1; asbestos limits cut 10–50-fold; BPA restricted; growth promoters ended; ozone on its recovery path). Claims resting on contributors’ own, unpublished or uncited work (farmed-fish pollutants “abolishing” benefits, PCB–diabetes epigenetics, MTBE as a “probable” human carcinogen, benzene risk underestimated 3–9-fold) were not confirmed. A good guide to which way things moved; a weak guide to how far or why.
Appendix B. Supporting material#
The source reports and the working files behind this document are listed below. Paths are relative to the folder that contains this document.
| Location | Contents |
|---|---|
Resources/Late lessons from early warnings II - Full report (05-2013).pdf |
LL2 source (report page = PDF page − 2) |
Resources/Issue_Report_No_22.pdf |
LL1 source (report page = PDF page) |
working/text/LL1-2001.txt, working/text/LL2-2013.txt, working/text/chunks/ |
Text extracts and chunks used for reading and quotation checks |
working/late-lessons/notes/<id>.md (47 files) |
Full audited reading notes for each section: standpoint, argument, evidence, mechanisms, lessons, insights with ratings, caveats, audit logs (some with a second audit) |
working/late-lessons/digests/<id>.md (47 files) |
Condensed digests: core story, key evidence, authors’ lessons, mechanisms, transferable insights, caveats |
working/late-lessons/hindsight/<id>.md (47 files) |
Post-publication checks to September 2026: overview, how LL2 revisited LL1 cases, claim-by-claim verdicts with sources, implications for weight, access limits |
working/late-lessons/themes/T01-knowledge-uncertainty-ignorance.md |
Epistemic theme (section 4.1) |
working/late-lessons/themes/T02-early-warnings-and-response.md |
Warnings, lags, proof, inertia (section 4.2) |
working/late-lessons/themes/T03-interests-power-political-economy-of-knowledge.md |
Interests and power (section 4.3) |
working/late-lessons/themes/T04-innovation-trajectories-lock-in.md |
Innovation, lock-in, substitution (section 4.4) |
working/late-lessons/themes/T05-costs-benefits-justice.md |
Economics and justice (section 4.5) |
working/late-lessons/themes/T06-governance-institutions-participation.md |
Governance, law, participation (section 4.6) |
working/late-lessons/themes/T07-complexity-systems-scale.md |
Complexity, systems, scale (section 4.7) |
working/late-lessons/themes/T08-actors-mindsets-framing.md |
Actors, mindsets, framing (section 4.8) |
working/late-lessons/themes/T09-false-positives-limits-and-critiques.md |
False positives and the project’s limits (section 5) |
working/late-lessons/themes/T10-the-canonical-lessons.md |
The twelve lessons and their evolution (section 3) |
working/late-lessons/external/context.md |
Institutional setting, intellectual traditions, afterlife |
working/late-lessons/external/critiques.md |
Reception, critiques, the false-positives debate, the innovation principle |
working/late-lessons/review/ (fidelity.md, balance.md, completeness.md, revision-log.md) |
Fidelity, balance and completeness reviews of this document’s first version, and the log of changes made in response |
Each theme file ends with a list of technology-neutral diagnostic questions tied to its evidence (fifteen each, fourteen for T07); section 6 consolidates them, and section 6.13 maps each question to a lens entry.