Topic 04
How to watch and judge an economic documentary
An economic documentary often rests on research that experts disagree about. Scholars assess the effect of imports from China on American manufacturing differently. The version of the study by Autor, Dorn and Hanson published in the American Economic Review links imports to about one quarter of the decline in employment between 1990 and 2007, while an earlier working paper spoke of about one third. If experts disagree about the scale, how do you judge a film that shows only one version of events? This text suggests which questions to ask of any such film.
What to check in a documentary about the economy
A documentary about the economy talks about numbers but shows them through people, images and editing. While watching, it is worth noting four things: where the data come from, which period they cover, who is speaking and from what perspective, and whether voices from different sides are heard. Each of these is simple to establish, and together they show what the whole narrative rests on.
Also check whether the makers give their data sources on screen, in the end credits or on the film's page. If the sources are easy to check, you can verify each number yourself. If they are missing, treat the figures with caution. In our view this is the first step of critical viewing for any documentary about the economy.
One person's story and the scale of a phenomenon
A single story about one person illustrates a phenomenon but does not prove its scale. The tale of one closed factory can be true and moving, yet it will not tell you how many people lost their jobs across the country. Scale is shown only by statistical data, for example from the BLS or the Census Bureau.
In a good economic documentary, story and statistics complement each other. When a film relies on emotion alone, or numbers appear without context, that is a sign the picture may be incomplete. So look for both elements in the film at once.
Correlation and cause: are they the same thing?
No. Correlation does not mean causation. If employment fell at the same time a trade agreement came into force, that does not yet prove the agreement was the only cause of the fall. Other factors may have been at work in the same period, and their effect has to be estimated separately.
The research on imports from China shows that even professional researchers can assess the impact of such a factor differently. When a film presents a single cause as obvious, ask whether the authors considered other explanations.
Facts, interpretations and opinions
A good documentary separates facts, interpretations and opinions, and its sources are given or easy to check. A fact is a number drawn from official statistics. An interpretation is an explanation of why that number changed. An opinion is a judgment on whether the change was good or bad. If during a screening these three blur into one, pause the film and try to pull them apart.
Critical viewing does not mean distrust of every film. It means the habit of asking the same questions every time, whether or not you agree with the authors' thesis.
From watching to checking
The best way to learn this is to work with actual numbers. Take the data the film mentions, find the source and compare the period and the method of calculation with what you heard on screen. At Freight & Floor we invite you to practice using the BLS data and to watch future economic documentaries with more confidence.