Popper's Evolutionary Epistemology: P1-TT-EE-P2

Hello! Welcome to your sixth lesson in our course on Popperian realism, tradition, and rationalism.

In our last lesson, we defined Critical Rationalism as an attitude—a commitment to being as self-critical as possible. We saw how this mindset shifts the focus from justifying our beliefs to actively seeking out their flaws.

Today, we will put that attitude into motion. We will explore the dynamic process by which knowledge actually grows, according to Popper. This is his theory of "evolutionary epistemology," a model that describes how we progress from ignorance to a better, though still incomplete, understanding of the world.

Lesson 6: Popper's Evolutionary Epistemology

Introduction

Today, we will cover the sixth learning outcome of this module: Formulate Popper's evolutionary epistemology schema: P1 -> TT -> EE -> P2 (Problem -> Tentative Theory -> Error Elimination -> New Problem).

This schema is the engine of Critical Rationalism. It takes the abstract ideas we've discussed—falsifiability, the rejection of justification, the critical attitude—and combines them into a single, powerful model of progress. We will see that knowledge does not grow by accumulating certainties, but by an endless and iterative cycle of problem-solving, much like Darwinian evolution.

We will break down each component of this four-stage process:

1. $P_1$: Why all knowledge creation begins with a Problem.
2. $TT$: The role of creative conjecture in generating a Tentative Theory.
3. $EE$: The critical process of Error Elimination.
4. $P_2$: How solving one problem inevitably leads to a New Problem.

This lesson should take you approximately 50 minutes to complete.

---

The Schema in Motion: From Problem to New Problem

Popper's model is a direct challenge to the traditional empiricist view that knowledge begins with observation. For Popper, observation is only relevant when it clashes with an existing expectation or theory, creating a problem. The entire process of knowledge growth is an evolutionary cycle.

To get a feel for this problem-centered view, we will turn to a discussion featuring David Deutsch, a physicist and key successor to Popper, whose ideas we will explore in more depth in Module 3.

This video is a rich, high-level conversation about Popper's epistemology. We will use specific clips to unpack each stage of the schema.

1. The Starting Point: Problem ($P_1$)

All thinking, all knowledge creation, begins with a problem ($P_1$). What is a problem? It's a conflict between ideas. It's the moment a cherished theory crashes against reality, or two internal beliefs are found to be incompatible. It is not a passive observation of the world; it's a tension that demands a resolution.

• Watch: 1:20 - 9:46 from the video above.
• Focus on:
  • Deutsch's core claim: "Thinking actually begins... with a problem."
  • His definition of a problem as a "conflict between ideas."
  • The distinction he draws between genuine, knowledge-creating problem-solving and the automatic, algorithmic processes of a sunflower or even the human immune system. These systems contain knowledge, but they don't create it in the moment.

As Deutsch explains, creation of new knowledge only happens when a problem arises. For an amoeba, this might be a mutation that provides a new, conflicting instruction to its genome. For a person, it could be anything from noticing a bug in a piece of code (a conflict between your intended outcome and the actual one) to a deep philosophical paradox. Popper himself gives the example of a newborn baby being born with an "expectation" of being cared for and fed. The inevitable gap between that perfect, inborn expectation and the messiness of reality is the baby's first problem.

2. The Creative Leap: Tentative Theory ($TT$)

Once we have a problem, how do we solve it? Not through induction or by deriving a solution from data. We solve it with a creative leap: a Tentative Theory ($TT$). This is a guess, a conjecture, a story we invent to try to resolve the conflict that defined our problem.

In our last lesson, we discussed the distinction between the 'context of discovery' and the 'context of justification'. The generation of a Tentative Theory belongs squarely in the context of discovery—it doesn't matter where the idea comes from, only what we do with it next.

• Watch: 50:33 - 52:05 from the video above.
• Focus on: Eli Tyre's excellent summary: "You have a problem and then magically creativity generates a conjecture... 'maybe the whole situation works like this, does that resolve this conflict between ideas?'"

This stage is fundamentally creative and conjectural. When you were building trading systems at Revolut and a settlement failed, you wouldn't derive the cause from first principles. You would conjecture possible causes ($TT$): "Is it a counterparty API issue? A timing mismatch in the messaging queue? A bug in our state machine?" Each of these is a tentative theory proposed to solve the problem of the failed settlement ($P_1$).

3. The Crucible: Error Elimination ($EE$)

Here is where the critical attitude we discussed in the last lesson becomes paramount. The Tentative Theory is not to be cherished and defended; it is to be attacked. Error Elimination ($EE$) is the process of subjecting our conjecture to the most severe criticism and testing we can devise. This is the "selection" mechanism in our evolutionary process.

This process can take many forms:

• Logical criticism: Does the theory contain contradictions?

• Empirical testing: What are the theory's most surprising and unlikely predictions? Let's design an experiment to test them.

• Problem-solving capacity: Does the theory actually solve the original problem ($P_1$)? Does it create even worse problems?

• Watch: 1:12:02 - 1:14:15 from the video above.

• Focus on: The idea that criticism ($EE$) is not just a mechanical checklist; it is also a creative and conjectural process. To criticize a theory effectively, you have to conjecture its potential weaknesses.

Think of the rigorous due diligence process in venture capital. A good VC doesn't just look for evidence confirming a startup's pitch ($TT$). They actively try to "kill the deal" by conjecturing and testing failure modes ($EE$): "What if their customer acquisition cost doubles? What if a major competitor enters the market? What is the weakest assumption in their financial model?" A theory that survives this crucible is not "proven," but it is battle-hardened. It has survived severe error elimination.

4. The Next Frontier: New Problem ($P_2$)

This is the most dynamic part of the schema. If our theory is refuted, we must return to the drawing board and generate a new one ($TT$). But even if it survives error elimination and successfully solves $P_1$, it is never the final word. A good theory, by solving an old problem, illuminates our ignorance and reveals a new, deeper, and more interesting set of problems. This is $P_2$.

$P_2$ then becomes the starting point for the next cycle of inquiry. This is why knowledge growth is an endless frontier.

• Watch: 13:41 - 15:47 from the video above.
• Focus on: The example of calculus.
  • $P_1$: How can we talk about velocity at a single instant? (A conflict between the idea of 'rate of change' and 'an instant').
  • $TT$: Newton and Leibniz's invention of calculus.
  • $EE$: The methods worked, but they were criticized for being logically inconsistent (e.g., treating infinitesimals as both zero and non-zero).
  • $P_2$: The new problem for 19th-century mathematicians became: How can we put calculus on a logically rigorous foundation? This led to the development of modern analysis, a deeper and more powerful field.

Your experience as a product owner provides another perfect example. You might have a problem with user retention ($P_1$). You hypothesize a new feature will fix it ($TT$). You build and A/B test it ($EE$). The feature works and retention improves! But it also dramatically increases server load, creating a new problem of system scalability ($P_2$). The cycle begins again.

---

Conclusion

Today, we have formulated Popper's evolutionary model of knowledge growth:

$$P_1\to TT\to EE\to P_2$$

This schema transforms the static rules of falsification into a dynamic, endless process of problem-solving.

Key Takeaways:

• Knowledge creation begins not with data, but with a Problem ($P_1$), which is a conflict between existing ideas or expectations.
• Our response is a creative guess, a Tentative Theory ($TT$), whose origin is less important than its testability.
• This theory is then subjected to rigorous Error Elimination ($EE$), where we apply the critical attitude to try and refute it.
• A successful theory solves $P_1$ but reveals a new, deeper Problem ($P_2$), ensuring the growth of knowledge is an infinite, evolutionary journey.

Looking Ahead

We have now established the complete theoretical foundation of Popper's critical rationalism. We understand the logic (falsifiability), the attitude (criticism), and the process ($P_1\to TT\to EE\to P_2$). In our next and final lesson of this module, we will bring this schema home. We will apply it directly to a field you know intimately: the process of model development and selection in econometrics and statistics. We'll see how specifying, estimating, and running diagnostics on a model is a perfect embodiment of Popper's evolutionary epistemology.