Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality:...
Transcript of Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality:...
![Page 1: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/1.jpg)
MT Causality Counterfactuals Randomized Experiments
Causality:Explanation versus Prediction
Department of GovernmentLondon School of Economics and Political Science
![Page 2: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/2.jpg)
MT Causality Counterfactuals Randomized Experiments
1 Brief Review of MT Material
2 Causality
3 Fundamental Problem of Causal Inference
4 Randomized Experiments
![Page 3: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/3.jpg)
MT Causality Counterfactuals Randomized Experiments
1 Brief Review of MT Material
2 Causality
3 Fundamental Problem of Causal Inference
4 Randomized Experiments
![Page 4: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/4.jpg)
MT Causality Counterfactuals Randomized Experiments
What did we learnabout during MT?
![Page 5: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/5.jpg)
MT Causality Counterfactuals Randomized Experiments
New territory. . .
By the end of today you should be able to:Identify what makes for a causalrelationshipDistinguish causation fromcorrelation/associationBegin to analyse research problemsusing counterfactual thinking
![Page 6: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/6.jpg)
MT Causality Counterfactuals Randomized Experiments
The broad story arc for LTCausal inference!
Generating causal theories andexpectationsMaking comparisonsStatistical methods useful for causalinference(Quasi-)Experimentation
Developing your research proposalsOne-on-ones w/ ThomasLiterature review (Reading Week)
![Page 7: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/7.jpg)
MT Causality Counterfactuals Randomized Experiments
The broad story arc for LTCausal inference!
Generating causal theories andexpectationsMaking comparisonsStatistical methods useful for causalinference(Quasi-)Experimentation
Developing your research proposalsOne-on-ones w/ ThomasLiterature review (Reading Week)
![Page 8: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/8.jpg)
MT Causality Counterfactuals Randomized Experiments
1 Brief Review of MT Material
2 Causality
3 Fundamental Problem of Causal Inference
4 Randomized Experiments
![Page 9: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/9.jpg)
MT Causality Counterfactuals Randomized Experiments
Pre-Post Change HeuristicOur intuition about causation relies tooheavily on simple comparisons ofpre-post change in outcomes before andafter something happens
No change: no causationIncrease in outcome: positive effectDecrease in outcome: negative effect
Several reasons why this is inadequate!
![Page 10: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/10.jpg)
MT Causality Counterfactuals Randomized Experiments
Flaws in causal inferencefrom pre-post comparisons
1 Maturation or trends2 Regression to the mean3 Selection4 Simultaneous historical changes5 Instrumentation changes6 Monitoring changes behaviour
![Page 11: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/11.jpg)
MT Causality Counterfactuals Randomized Experiments
Directed Acyclic Graphs
Causal graphs (DAGs) provide a visualrepresentation of (possible) causal relationships
Causality flows between variables, which arerepresented as “nodes”
Variables are causally linked by arrowsCausality only flows forward in time
Nodes opening a “backdoor path” fromX → Y are confounds
“Selection bias” or “Confounding”
![Page 12: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/12.jpg)
MT Causality Counterfactuals Randomized Experiments
Directed Acyclic Graphs
Causal graphs (DAGs) provide a visualrepresentation of (possible) causal relationships
Causality flows between variables, which arerepresented as “nodes”
Variables are causally linked by arrowsCausality only flows forward in time
Nodes opening a “backdoor path” fromX → Y are confounds
“Selection bias” or “Confounding”
![Page 13: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/13.jpg)
MT Causality Counterfactuals Randomized Experiments
Directed Acyclic Graphs
Causal graphs (DAGs) provide a visualrepresentation of (possible) causal relationships
Causality flows between variables, which arerepresented as “nodes”
Variables are causally linked by arrowsCausality only flows forward in time
Nodes opening a “backdoor path” fromX → Y are confounds
“Selection bias” or “Confounding”
![Page 14: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/14.jpg)
MT Causality Counterfactuals Randomized Experiments
Smoking Cancer
![Page 15: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/15.jpg)
MT Causality Counterfactuals Randomized Experiments
Smoking Cancer
Age
Environment
GeneticPredisposition
ParentalSmoking
![Page 16: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/16.jpg)
MT Causality Counterfactuals Randomized Experiments
Smoking Cancer
Age
Environment
GeneticPredisposition
ParentalSmoking
![Page 17: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/17.jpg)
MT Causality Counterfactuals Randomized Experiments
Smoking Cancer
Age
Environment
GeneticPredisposition
ParentalSmoking
![Page 18: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/18.jpg)
MT Causality Counterfactuals Randomized Experiments
Smoking Cancer
Age
Environment
GeneticPredisposition
ParentalSmoking
CoinFlip
![Page 19: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/19.jpg)
MT Causality Counterfactuals Randomized Experiments
The 3 or 4 or 5 principles
1 Correlation
2 Nonconfounding
3 Direction (“temporal precedence”)
4 Mechanism
5 (Appropriate level of analysis)
![Page 20: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/20.jpg)
MT Causality Counterfactuals Randomized Experiments
The 3 or 4 or 5 principles
1 Correlation
2 Nonconfounding
3 Direction (“temporal precedence”)
4 Mechanism
5 (Appropriate level of analysis)
![Page 21: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/21.jpg)
MT Causality Counterfactuals Randomized Experiments
Smoking Cancer
Age
Environment
GeneticPredisposition
ParentalSmoking
![Page 22: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/22.jpg)
MT Causality Counterfactuals Randomized Experiments
The 3 or 4 or 5 principles
1 Correlation
2 Nonconfounding
3 Direction (“temporal precedence”)
4 Mechanism
5 (Appropriate level of analysis)
![Page 23: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/23.jpg)
MT Causality Counterfactuals Randomized Experiments
The 3 or 4 or 5 principles
1 Correlation
2 Nonconfounding
3 Direction (“temporal precedence”)
4 Mechanism
5 (Appropriate level of analysis)
![Page 24: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/24.jpg)
MT Causality Counterfactuals Randomized Experiments
Smoking Cancer
Age
Environment
GeneticPredisposition
ParentalSmoking
![Page 25: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/25.jpg)
MT Causality Counterfactuals Randomized Experiments
Smoking Cancer
Age
Environment
GeneticPredisposition
ParentalSmoking
![Page 26: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/26.jpg)
MT Causality Counterfactuals Randomized Experiments
Smoking Cancer
Age
Environment
GeneticPredisposition
ParentalSmoking
![Page 27: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/27.jpg)
MT Causality Counterfactuals Randomized Experiments
The 3 or 4 or 5 principles
1 Correlation
2 Nonconfounding
3 Direction (“temporal precedence”)
4 Mechanism
5 (Appropriate level of analysis)
![Page 28: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/28.jpg)
MT Causality Counterfactuals Randomized Experiments
The 3 or 4 or 5 principles
1 Correlation
2 Nonconfounding
3 Direction (“temporal precedence”)
4 Mechanism
5 (Appropriate level of analysis)
![Page 29: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/29.jpg)
MT Causality Counterfactuals Randomized Experiments
Smoking Cancer
Age
Environment
GeneticPredisposition
ParentalSmoking
![Page 30: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/30.jpg)
MT Causality Counterfactuals Randomized Experiments
The 3 or 4 or 5 principles
1 Correlation
2 Nonconfounding
3 Direction (“temporal precedence”)
4 Mechanism
5 (Appropriate level of analysis)
![Page 31: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/31.jpg)
MT Causality Counterfactuals Randomized Experiments
The 3 or 4 or 5 principles
1 Correlation
2 Nonconfounding
3 Direction (“temporal precedence”)
4 Mechanism
5 (Appropriate level of analysis)
![Page 32: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/32.jpg)
MT Causality Counterfactuals Randomized Experiments
The 3 or 4 or 5 principles
1 Correlation
2 Nonconfounding
3 Direction (“temporal precedence”)
4 Mechanism
5 (Appropriate level of analysis)
![Page 33: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/33.jpg)
MT Causality Counterfactuals Randomized Experiments
Source: The Telegraph. 27 June 2016. http://www.telegraph.co.uk/news/2016/06/24/eu-referendum-how-the-results-compare-to-the-uks-educated-old-an/
![Page 34: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/34.jpg)
MT Causality Counterfactuals Randomized Experiments
Questions?
![Page 35: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/35.jpg)
MT Causality Counterfactuals Randomized Experiments
1 Brief Review of MT Material
2 Causality
3 Fundamental Problem of Causal Inference
4 Randomized Experiments
![Page 36: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/36.jpg)
MT Causality Counterfactuals Randomized Experiments
Causal InferenceCausal inference (typically) involves
gathering data in a systematic fashion inorder to assess the size and form of
correlation between nodes X and Y in such away that there are no backdoor paths
between X and Y by controlling for (i.e.,conditioning on, holding constant) any
confounding variables, Z.
![Page 37: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/37.jpg)
MT Causality Counterfactuals Randomized Experiments
In essence, this means finding orcreating counterfactuals.
![Page 38: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/38.jpg)
MT Causality Counterfactuals Randomized Experiments
Counterfactual Thinking
Causal inference involves inferring whatwould have happened in acounterfactual reality where thepotential cause took on a different value
Counterfactual : relating to what hasnot happened or is not the case
![Page 39: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/39.jpg)
MT Causality Counterfactuals Randomized Experiments
“A Christmas Carol”
1843 novel by Charles Dickens
Ebenezer Scrooge is shown his own future bythe “Ghost of Christmas Yet to Come”
Has the choice to either:1 stay on current path (one counterfactual), or2 change his ways (take a different counterfactual)
![Page 40: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/40.jpg)
MT Causality Counterfactuals Randomized Experiments
Dickensian Causal Inference
Causal effect: The difference betweentwo “potential outcomes”
The outcome that occurs if X = x1The outcome that occurs if X = x2
The causal effect of Scrooge’s lifestyle isseen in the difference(s) between twopotential futures
![Page 41: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/41.jpg)
MT Causality Counterfactuals Randomized Experiments
Other Counterfactualsin TV & Film
Groundhog DayRun Lola RunMinority ReportSource CodeX-Men: Days of Future Past
![Page 42: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/42.jpg)
MT Causality Counterfactuals Randomized Experiments
Fundamental problem ofcausal inference!
We can only observe any given unitin one reality! So any counterfactual
for a given unit is unobservable!!!
![Page 43: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/43.jpg)
MT Causality Counterfactuals Randomized Experiments
Fundamental problem ofcausal inference!
We can only observe any given unitin one reality! So any counterfactual
for a given unit is unobservable!!!
OH NO!
![Page 44: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/44.jpg)
MT Causality Counterfactuals Randomized Experiments
Two solutions!1 “Scientific” Solution1
(Assume) units are all identicalEach can provide a perfect counterfactualCommon in, e.g., agriculture, biology
2 “Statistical” SolutionUnits are not identicalRandom exposure to a potential causeEffects measured on average across unitsKnown as the “Experimental ideal”
1From Holland
![Page 45: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/45.jpg)
MT Causality Counterfactuals Randomized Experiments
Two solutions!1 “Scientific” Solution1
(Assume) units are all identicalEach can provide a perfect counterfactualCommon in, e.g., agriculture, biology
2 “Statistical” SolutionUnits are not identicalRandom exposure to a potential causeEffects measured on average across unitsKnown as the “Experimental ideal”
1From Holland
![Page 46: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/46.jpg)
MT Causality Counterfactuals Randomized Experiments
Mill’s methods2
AgreementDifferenceAgreement and DifferenceResidueConcomitant variations
2Discussed in Holland
![Page 47: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/47.jpg)
MT Causality Counterfactuals Randomized Experiments
Mill’s Method of Difference
“If an instance in which the phenomenonunder investigation occurs, and an instancein which it does not occur, have everycircumstance save one in common, that oneoccurring only in the former; thecircumstance in which alone the twoinstances differ, is the effect, or cause, or annecessary part of the cause, of thephenomenon.”
![Page 48: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/48.jpg)
MT Causality Counterfactuals Randomized Experiments
“Rerum cognoscere causas”Causal inference is meant to help“explain” the social world
Other notions of explainConcept generation and labellingDescriptive typologies
Explanation may or may not involvemechanistic claims (see LT Week 5)
Causation is deterministic at the unitlevel!Counterfactual approaches to causalinference are “forward” in nature
![Page 49: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/49.jpg)
MT Causality Counterfactuals Randomized Experiments
“Rerum cognoscere causas”Causal inference is meant to help“explain” the social world
Other notions of explainConcept generation and labellingDescriptive typologies
Explanation may or may not involvemechanistic claims (see LT Week 5)
Causation is deterministic at the unitlevel!Counterfactual approaches to causalinference are “forward” in nature
![Page 50: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/50.jpg)
MT Causality Counterfactuals Randomized Experiments
“Rerum cognoscere causas”Causal inference is meant to help“explain” the social world
Other notions of explainConcept generation and labellingDescriptive typologies
Explanation may or may not involvemechanistic claims (see LT Week 5)
Causation is deterministic at the unitlevel!Counterfactual approaches to causalinference are “forward” in nature
![Page 51: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/51.jpg)
MT Causality Counterfactuals Randomized Experiments
“Rerum cognoscere causas”Causal inference is meant to help“explain” the social world
Other notions of explainConcept generation and labellingDescriptive typologies
Explanation may or may not involvemechanistic claims (see LT Week 5)
Causation is deterministic at the unitlevel!
Counterfactual approaches to causalinference are “forward” in nature
![Page 52: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/52.jpg)
MT Causality Counterfactuals Randomized Experiments
“Rerum cognoscere causas”Causal inference is meant to help“explain” the social world
Other notions of explainConcept generation and labellingDescriptive typologies
Explanation may or may not involvemechanistic claims (see LT Week 5)
Causation is deterministic at the unitlevel!Counterfactual approaches to causalinference are “forward” in nature
![Page 53: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/53.jpg)
MT Causality Counterfactuals Randomized Experiments
Prediction is not causation.Causation is not prediction.
![Page 54: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/54.jpg)
MT Causality Counterfactuals Randomized Experiments
Prediction is not causation.Causation is not prediction.
Why are these distinct?
![Page 55: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/55.jpg)
MT Causality Counterfactuals Randomized Experiments
1 Brief Review of MT Material
2 Causality
3 Fundamental Problem of Causal Inference
4 Randomized Experiments
![Page 56: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/56.jpg)
MT Causality Counterfactuals Randomized Experiments
The Experimental IdealA randomized experiment, or randomized controltrial is:
The observation of units after, andpossibly before, a randomly assignedintervention in a controlled setting, whichtests one or more precise causalexpectations
This is Holland’s “statistical solution” to thefundamental problem of causal inference
![Page 57: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/57.jpg)
MT Causality Counterfactuals Randomized Experiments
Random AssignmentA physical process of randomization
Breaks the “selection process”Units only take value of X = x becauseof assignment
This means:Treatment groups, on average, provide insight into counterfactual “potential”outcomesRandomization means potentialoutcomes are balanced between groups,so no confounding
![Page 58: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/58.jpg)
MT Causality Counterfactuals Randomized Experiments
Random AssignmentA physical process of randomization
Breaks the “selection process”Units only take value of X = x becauseof assignment
This means:Treatment groups, on average, provide insight into counterfactual “potential”outcomesRandomization means potentialoutcomes are balanced between groups,so no confounding
![Page 59: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/59.jpg)
MT Causality Counterfactuals Randomized Experiments
Smoking Cancer
Age
Environment
GeneticPredisposition
ParentalSmoking
CoinFlip
![Page 60: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/60.jpg)
MT Causality Counterfactuals Randomized Experiments
Experimental Inference ICausal inference is a comparison of twopotential outcomes
A potential outcome is the value of theoutcome (Y ) for a given unit (i) after receivinga particular version of the treatment (X )
Each unit has multiple potential outcomes(y0i , y1i), but we only observe one of them
A causal effect is the difference between these(e.g., yx=1 − yx=0), all else constant
![Page 61: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/61.jpg)
MT Causality Counterfactuals Randomized Experiments
Experimental Inference ICausal inference is a comparison of twopotential outcomes
A potential outcome is the value of theoutcome (Y ) for a given unit (i) after receivinga particular version of the treatment (X )
Each unit has multiple potential outcomes(y0i , y1i), but we only observe one of them
A causal effect is the difference between these(e.g., yx=1 − yx=0), all else constant
![Page 62: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/62.jpg)
MT Causality Counterfactuals Randomized Experiments
Experimental Inference ICausal inference is a comparison of twopotential outcomes
A potential outcome is the value of theoutcome (Y ) for a given unit (i) after receivinga particular version of the treatment (X )
Each unit has multiple potential outcomes(y0i , y1i), but we only observe one of them
A causal effect is the difference between these(e.g., yx=1 − yx=0), all else constant
![Page 63: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/63.jpg)
MT Causality Counterfactuals Randomized Experiments
Experimental Inference ICausal inference is a comparison of twopotential outcomes
A potential outcome is the value of theoutcome (Y ) for a given unit (i) after receivinga particular version of the treatment (X )
Each unit has multiple potential outcomes(y0i , y1i), but we only observe one of them
A causal effect is the difference between these(e.g., yx=1 − yx=0), all else constant
![Page 64: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/64.jpg)
MT Causality Counterfactuals Randomized Experiments
Experimental Inference IIWe cannot see individual-level causal effects
We want to know: TEi = y1i − y0i
We can see average causal effects
Ex.: Average difference in cancerbetween those who do and do not smokeATEnaive = E [y1i |xi = 1]− E [y0i |xi = 0]
Is this what we want to know?
Yes, if X randomizedYes, if all confounds controlled
![Page 65: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/65.jpg)
MT Causality Counterfactuals Randomized Experiments
Experimental Inference IIWe cannot see individual-level causal effects
We want to know: TEi = y1i − y0i
We can see average causal effectsEx.: Average difference in cancerbetween those who do and do not smokeATEnaive = E [y1i |xi = 1]− E [y0i |xi = 0]
Is this what we want to know?
Yes, if X randomizedYes, if all confounds controlled
![Page 66: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/66.jpg)
MT Causality Counterfactuals Randomized Experiments
Experimental Inference IIWe cannot see individual-level causal effects
We want to know: TEi = y1i − y0i
We can see average causal effectsEx.: Average difference in cancerbetween those who do and do not smokeATEnaive = E [y1i |xi = 1]− E [y0i |xi = 0]
Is this what we want to know?
Yes, if X randomizedYes, if all confounds controlled
![Page 67: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/67.jpg)
MT Causality Counterfactuals Randomized Experiments
Experimental Inference IIWe cannot see individual-level causal effects
We want to know: TEi = y1i − y0i
We can see average causal effectsEx.: Average difference in cancerbetween those who do and do not smokeATEnaive = E [y1i |xi = 1]− E [y0i |xi = 0]
Is this what we want to know?Yes, if X randomized
Yes, if all confounds controlled
![Page 68: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/68.jpg)
MT Causality Counterfactuals Randomized Experiments
Experimental Inference IIWe cannot see individual-level causal effects
We want to know: TEi = y1i − y0i
We can see average causal effectsEx.: Average difference in cancerbetween those who do and do not smokeATEnaive = E [y1i |xi = 1]− E [y0i |xi = 0]
Is this what we want to know?Yes, if X randomizedYes, if all confounds controlled
![Page 69: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/69.jpg)
MT Causality Counterfactuals Randomized Experiments
![Page 70: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/70.jpg)
MT Causality Counterfactuals Randomized Experiments
Preview of next week
What is a “scientific literature”?
How do we accumulate scientificevidence?
![Page 71: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/71.jpg)
![Page 72: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/72.jpg)
Mill’s Methods
![Page 73: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/73.jpg)
Agreement
If two or more instances of the phenomenonunder investigation have only onecircumstance in common, the circumstancein which alone all the instances agree, is thecause (or effect) of the given phenomenon.
![Page 74: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/74.jpg)
DifferenceIf an instance in which the phenomenonunder investigation occurs, and an instancein which it does not occur, have everycircumstance save one in common, that oneoccurring only in the former; thecircumstance in which alone the twoinstances differ, is the effect, or cause, or annecessary part of the cause, of thephenomenon.
![Page 75: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/75.jpg)
Agreement and DifferenceIf two or more instances in which thephenomenon occurs have only onecircumstance in common, while two or moreinstances in which it does not occur havenothing in common save the absence of thatcircumstance; the circumstance in whichalone the two sets of instances differ, is theeffect, or cause, or a necessary part of thecause, of the phenomenon.
![Page 76: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/76.jpg)
Residue
Subduct from any phenomenon such part asis known by previous inductions to be theeffect of certain antecedents, and the residueof the phenomenon is the effect of theremaining antecedents.
![Page 77: Causality: Explanation versus PredictionMTCausalityCounterfactualsRandomized Experiments Causality: Explanation versus Prediction Department of Government London School of Economics](https://reader036.fdocuments.us/reader036/viewer/2022062416/60f73680aeaa1a559a2f7088/html5/thumbnails/77.jpg)
Concomitant variations
Whatever phenomenon varies in any mannerwhenever another phenomenon varies in someparticular manner, is either a cause or aneffect of that phenomenon, or is connectedwith it through some fact of causation.