Universitas Scholarium — A Community of Scholars Log In
Tutorial Course

CRDS 1004 · Causation, Evidence, and the Scientific Method

Led by Popper Simulacrum

5 modules 5 modules · ~30 hours Interdisciplinary School Updated 2 days ago

The scientific method from falsification and paradigm shifts through experimental design, causal inference, and the replication crisis.

Falsification: What …1Research Programmes …2Experimental Design:…3Causal Inference: Pe…4Replication, Fraud, …5
  1. Module 1

    Falsification: What Makes a Claim Scientific

    Led by Popper Simulacrum

    The question

    A theory that cannot be falsified is not scientific — it is a story. Astrology makes predictions so vague that any outcome confirms them. Freudian psychoanalysis interprets any behaviour as evidence for its theory (the patient who agrees with the interpretation confirms it; the patient who disagrees is "in denial" — also confirming it). Popper's demarcation criterion: a theory is scientific if and only if it makes predictions that could, in principle, be shown to be false.

    Outcome

    The student can state Popper's demarcation criterion, explain the asymmetry of falsification, describe the Duhem-Quine problem, and apply the practical criterion ("what would change your mind?") to evaluate a claim. (Falsification)

    Sub-units

    1. 1.1 The Demarcation Problem: Science vs. Pseudoscience
    2. 1.2 Popper's Falsificationism: The Logic of Scientific Testing
    3. 1.3 The Asymmetry: Why Falsification Is Stronger Than Verification
    4. 1.4 The Duhem-Quine Problem: Why Falsification Is Not Simple
    5. 1.5 The Practical Criterion: "What Would Change Your Mind?"
  2. Module 2

    Research Programmes and Paradigm Shifts: When to Abandon a Theory

    Led by Lakatos Simulacrum

    The question

    Popper says: falsify and abandon. But scientists do not actually work this way — they hold onto theories through anomalies, modifying auxiliary hypotheses to save the core. Are they being irrational? Lakatos says no — a research programme can rationally accommodate anomalies, as long as the modifications are progressive (they predict new facts) rather than degenerating (they only explain away old anomalies).

    Outcome

    The student can describe Kuhn's paradigm shift model, describe Lakatos's research programme model (hard core, protective belt, progressive vs. degenerating), apply the progressive/degenerating distinction to a case study, and explain when theory abandonment is rational. (Research programmes and paradigm shifts)

    Sub-units

    1. 2.1 Kuhn's Paradigm Shifts: Normal Science, Crisis, and Revolution
    2. 2.2 Lakatos's Research Programmes: Hard Core and Protective Belt
    3. 2.3 Progressive vs. Degenerating: The Lakatos Criterion
    4. 2.4 Case Study: From Ptolemy to Copernicus to Kepler
    5. 2.5 When Should You Change Your Mind? The Rationality of Theory Choice
  3. Module 3

    Experimental Design: Controls, Randomisation, and Blinding

    Led by R.A. Fisher Simulacrum

    The question

    The experiment is the most powerful tool humanity has ever devised for establishing causal claims. But a badly designed experiment is worse than no experiment at all — it produces confident but wrong conclusions. The three pillars of experimental design are: the control group (what happens without the intervention), randomisation (ensuring the groups are comparable), and blinding (preventing expectations from influencing results). This module teaches the student to evaluate experimental evidence rigorously — to distinguish the well-designed study from the poorly designed one.

    Outcome

    The student can explain the necessity of control groups, the purpose of randomisation, the function of single and double blinding, describe the placebo effect, and explain sample size and statistical power. (Experimental design)

    Sub-units

    1. 3.1 The Control Group: What Would Have Happened Without the Intervention
    2. 3.2 Randomisation: Making the Groups Comparable
    3. 3.3 Blinding: Preventing Expectations from Becoming Results
    4. 3.4 The Placebo Effect: When Belief Becomes Biology
    5. 3.5 Sample Size, Power, and the Problem of Small Studies
  4. Module 4

    Causal Inference: Pearl's Do-Calculus and the Ladder of Causation

    Led by Pearl Simulacrum

    The question

    Correlation is not causation — every student knows this. But what IS causation, and how do we establish it? Judea Pearl's framework provides the answer: causation is the effect of an intervention — not "what happened when X was observed" but "what would happen if we did X." The do-calculus formalises the distinction between seeing and doing, and the ladder of causation shows that causal reasoning requires a cognitive leap that no amount of observational data can provide.

    Outcome

    The student can describe the three rungs of Pearl's ladder, explain the difference between P(Y|X) and P(Y|do(X)), apply the back-door criterion to a simple causal graph, describe the front-door criterion as an alternative when confounders are unmeasured, and explain counterfactual reasoning. (Causal inference)

    Sub-units

    1. 4.1 The Ladder of Causation: Seeing, Doing, and Imagining
    2. 4.2 The Do-Operator: Seeing vs. Doing
    3. 4.3 Confounders and the Back-Door Criterion
    4. 4.4 The Front-Door Criterion: When Confounders Are Hidden
    5. 4.5 Counterfactual Reasoning: The Highest Rung
  5. Module 5

    Replication, Fraud, and the Crisis of Confidence in Science

    Led by Popper Simulacrum

    The question

    Science is self-correcting — but only if it actually corrects itself. The replication crisis (2010s–present) revealed that a disturbingly large proportion of published findings in psychology, medicine, and other fields cannot be replicated by independent researchers. The crisis has exposed systemic problems: p-hacking (manipulating data analysis to produce significant results), publication bias (journals publish positive results and reject negative ones), HARKing (Hypothesising After the Results are Known — presenting post-hoc findings as pre-planned), and outright fraud. This module examines the crisis and its solutions.

    Outcome

    The student can describe the replication crisis with quantitative evidence, describe p-hacking, publication bias, and HARKing, and describe four solutions (pre-registration, registered reports, open data, adversarial collaboration). (The replication crisis)

    Sub-units

    1. 5.1 The Replication Crisis: The Numbers
    2. 5.2 p-Hacking: Mining Data for Significance
    3. 5.3 Publication Bias: The Missing Null Results
    4. 5.4 HARKing: Hypothesising After the Results Are Known
    5. 5.5 Solutions: Pre-Registration, Registered Reports, Open Science