All Episodes
Previous Next
Plain Text
Nov. 7, 2017 - Skeptoid
17:43
Skeptoid #596: How to Assess a Documentary

Some tips to assess whether a documentary is good science or just propaganda. Learn about your ad choices: dovetail.prx.org/ad-choices

Transcriber: nvidia/parakeet-tdt-0.6b-v2, sat-12l-sm, and large-v3-turbo
|

Time Text
How to Spot Fake Documentaries 00:07:36
Besides making this podcast, we also make educational and documentary films here at Skeptoid Media.
And when we do, a very reasonable question people ask me is, why should I trust your documentary?
How do we know it's more accurate than any other?
So today, I'm going to share my best list of tips and tricks for helping you assess the quality of any documentary film.
And that's coming up right now on Skeptoid.
Hi, I'm Alex Goldman.
You may know me as the host of Reply All, but I'm done with that.
I'm doing something else now.
I've started a new podcast called Hyperfixed.
On every episode of HyperFixed, listeners write in with their problems and I try to solve them.
Some massive and life-altering, and some so minuscule it'll boggle your mind.
No matter the problem, no matter the size, I'm here for you.
That's HyperFixed, the new podcast from Radiotopia.
Find it wherever you listen to podcasts or at hyperfixedpod.com.
You're listening to Skeptoid.
I'm Brian Dunning from Skeptoid.com.
How to assess a documentary.
It's no secret that a lot of the documentaries that studios throw our way, both on the television and in the cinema, are bloated with misinformation.
Most of them are either propaganda or just pop sensationalism.
Many of us enjoy watching these for the entertainment value.
It's fun, just as it was intended.
But there are those of us who hope to actually be enlightened and informed.
But unless we happen to have actual expertise on the subject being presented, we have no practical way to know whether what we're watching is good education or just propaganda.
Today we're going to cover some tips that will help you acquire this elusive superpower.
I've just read many articles from filmmakers talking about how they make a good documentary film, and there are a number of universal rules they all follow.
Don't forget that a movie is art.
A movie tells a compelling story.
Don't make a documentary, make a movie.
Grab your audience emotionally.
No matter the subject at its core, it's really about people.
Tell a story, don't give a lecture.
Don't tell the facts, tell the truth.
Movies are art.
Now there probably are filmmakers out there who are more interested in the material and in helping people than in the art and craft of commercial storytelling.
But most of them are not the ones successful enough to be interviewed for these articles.
Chances are that if you're watching a documentary, it was made with commercialism as its main goal.
The others weren't commercial enough to get onto your screen.
I found one of these directors' notes particularly telling.
Michael Moore gives one of his 13 rules for making documentaries as, film only the people who disagree with you.
It's a simple insight, and it's been crucial to his tremendous success.
Create conflict and drama on the screen.
And it's as far as you can possibly get from present good information.
That's simply not a priority for a commercial filmmaker.
The chilling truth is that what we can infer from Michael Moore and all these other filmmakers trying to make as good a movie as possible is that they have your entertainment in mind, not your enlightenment.
So, in reality, we need to be gravely skeptical of every documentary, even those that pass all of the assessments I'm about to discuss.
And on that note, here they are.
The tricks you can use to gauge the validity of a documentary.
Is the film emotionally powerful?
Beware of documentaries that tug at your heartstrings.
Appealing to emotions is a powerful way to persuade people to a point of view.
A great science can be fascinating and engaging without being emotional.
But an emotional presentation is a cheap way to buy the audience's fascination and engagement.
This doesn't prove the movie's science is wrong, but it is a red flag that suggests the filmmakers are trying to persuade you without necessarily having the content to do so.
Gasland, the 2010 anti-fracking film, was a great example of this.
Even though I agree completely that we urgently need to get off of all fossil fuels, and filmmaker Josh Fox is releasing a new film making that point, Gasland was wrong from beginning to end.
But it told emotional stories about people with mystery diseases and showed random pictures of dead wildlife with no context.
All to get you emotionally engaged.
It worked, and people left the theaters loaded with false information about fracking and hating it for all the wrong reasons.
Beware of emotional content.
How are the contrarians portrayed?
Here's an easy tip that can often give you some great insight into a film's reliability.
Most documentaries include experts from the other side who disagree with the filmmaker's premise in an effort to make it appear balanced.
Do those experts say something stupid?
Because if they did, I can virtually guarantee you that the editors sifted through three hours of tape to find that one stupid sentence.
A stupid comment or goofy behavior or anything ludicrous from the alternative viewpoint experts is a big red flag that deceptive editing played a significant role in this film's development.
A great example of this was the way the Christian producers of the film Expelled introduced the atheist Richard Dawkins.
They showed him having makeup applied before the interview and being fussy about it.
It was a blatant poisoning of the well to make him appear ridiculous even before he opened his mouth.
In fact, everyone wears makeup on camera.
You have to.
With the harsh lighting and staging, you look weird if you don't.
Here's what always happens to me.
While I'm sitting there on camera, the director asks me tons of questions about some urban legend, about its history, about what the people who support the woo-woo version believe.
And then I explain what actually happened and how we know that.
Then, when you watch the edited show, you see me telling about the origin of the legend, and I'll say something like, oh, there's people who believe that X happened, and some people even believe something as crazy as Y or even Z.
Then, everything I said after that, where I give the facts of what really happened, never makes it onto the show.
The viewer gets the impression that the extent of my knowledge on the subject is that I looked it up on Wikipedia, saw a few really strange potential explanations, and then looked no further, believing it to be a mystery without a rational solution.
If I was actually clueless, they wouldn't have chased me down to have me on the show.
So always pay special attention to how the opposing viewpoint people are presented.
The Skeptoid Files Mystery 00:02:48
Is the film's protagonist controversial?
By protagonist, I don't mean who the movie is about necessarily.
I mean the main person who is trying to make the point.
Maybe this is the filmmaker.
Maybe this is the main expert who's featured on camera and making most of the film's points.
Responsible and objective scientists, historians, journalists, whomever, are rarely controversial figures.
As an example, take the movie Blackfish, which was an expose about killer whales in theme parks.
It was highly successful and had a significant impact on the industry.
It's also become iconic for being perhaps the most dishonest film documentary ever made, with virtually all of its claims either misrepresented or wholly fabricated.
And the film has been savaged by virtually every marine science publication.
But audiences never knew this.
They accepted it wholeheartedly, and it won awards and critical acclaim.
In a world that can feel overwhelming, spreading thoughtful, evidence-based content is one of the best ways to make a positive impact.
Ask your local public radio station to air the Skeptoid Files, a 30-minute radio-friendly version of Skeptoid that pairs two related episodes promoting real science, true history, and critical thinking.
And in these challenging times for public media, we're offering these broadcasts for free to radio stations, available on the PRX Exchange or directly from Skeptoid Media.
It's an easy ask.
Just send a quick message to your station's programming director.
By helping to bring the Skeptoid files to the airwaves, you'll help promote the essential skills we all need to tell fact from fiction.
Just go to your local station's website, find the programming director's email address, or just their general email address.
You can even use the telephone.
I know that might sound crazy.
It's an old legacy device that allows real-time voice communication.
I know that's weird, but hey, it's an option.
The world can feel chaotic, but you're not powerless.
When you promote critical thinking, you can help your community tell fact from fiction.
And that's how we shape a better future.
In uncertain times, spreading good ideas can make you feel helpful, not helpless.
Let's stand up for reason, truth, and understanding together.
Get them to air the Skeptoid files from Skeptoid Media, available on the PRX Exchange, and they'll know what that is.
The protagonists in Blackfish are the experts it presents who make what appears to be a science-based case against SeaWorld.
Western Audiences and Guilt 00:05:06
Its three most prominent are Howard Garrett, Laurie Marino, and Ken Balcombe.
Although they're all legitimate cetacean scientists or researchers, they're also best known as controversial animal rights activists with some pretty far-out views.
A responsible science film would have steered well clear of them because their presence fatally taints the film's reputation.
So that's one thing you can do.
Google to see if the protagonists are controversial.
If they are, it adds a bit of weight to tip the scales toward the film being unreliable.
Does the film stroke Western luxury guilt?
I would like to call out one specific genre as being a huge red flag, and it's what I call Western luxury guilt.
Those of us who live in Western industrialized nations enjoy an extraordinary standard of living.
We have comfortable homes filled with gadgets.
We drive amazing cars.
We eat at restaurants and buy food at grocery stores that have more choices than were available in the entire world a century ago.
We make a lot of money and buy whatever we want.
We have 75-inch 4K televisions and iPhones.
Although most comfortable people in Western nations don't feel any conscious guilt about it, it's still common for some to compensate for it.
They tend to project the outward appearance of disdain for such luxuries.
It becomes politically correct to show contempt for those things that separate their own wealthy culture from the world's poorest cultures.
Thus, themes like anti-corporatism, anti-globalization, anti-materialism, the rejection of biotech and the embrace of esoterica such as alternative medicine, yoga, raw and organic foods, all become badges of enlightenment and social responsibility.
Now, to be clear, I'm not bagging on people who enjoy these things.
I'm pointing out that the phenomenon of Western luxury guilt is not lost on the producers of documentaries.
And they often choose these themes as they're virtually guaranteed to be successful.
Generally, Western audiences will love movies that claim the food industry is corrupt, or chain restaurants will poison you, or big pharma is corrupt, and organic diet cures all disease, or we're all cruel to animals or to each other, or humans are destroying the planet with greenhouse gases and plastic.
You get the idea.
I'm not saying those ideas are wrong.
If you listen to Skeptoid, you know that I'm a huge proponent of climate science.
I'm just pointing out what kinds of themes film producers know their audience wants.
Generally speaking, if the theme of the documentary is one that strokes Western luxury guilt and talks about why we horrible Westerners should hate ourselves, then the chances are very high that the film is not a good science documentary.
Even if its basic claim is one that's generally true, it's likely to be absurdly exaggerated and misrepresented because it's trying to appeal to the audience's Western luxury guilt much more than it's trying to educate.
I repeat, generally, this is not an absolute rule, but when it comes to assessing a documentary, this is a rule of thumb that will steer you right more often than it will steer you wrong.
Don't worry about a lack of alternative viewpoints.
Here's something that I often hear described as a way to gauge a documentary, but I don't agree.
Does it present alternative viewpoints?
Does it give a fair shake to opposing views?
In most cases, I don't miss it, depending on the type of documentary.
If it's about a historical event, or a biography, or something factual, then introducing opposing viewpoints is harmful, just like math classes don't bring in someone to make the case that 2 plus 2 equals 5.
The process of finding a conclusion can be like a scientific investigation.
Focus on what we know and how we know it.
If a documentary is about a controversial topic for which there is popular misinformation, then you have to present that misinformation in order to address it.
But a good documentary that informs its audience with good information will always be clear about what it's telling you and why.
If it's just bringing in alternate viewpoints and saying, now you decide what's true, then that's a disservice to the facts.
A well-done documentary should never allow its audience to leave the theater thinking that some unsupported unscientific view should remain worthy of their consideration.
So, there we have it.
A few rules of thumb, which may help some of us emerge from the theaters a bit less misinformed.
Premium Support for Truth 00:02:08
But even these will not help you solve the greatest movie mystery of all.
What the heck is that yellow fluid they pour over our popcorn?
Speaking of documentary films, I often give hosted screenings of Skeptoid Media's latest Principles of Curiosity, a 40-minute film shot in some amazing locations that gives three simple steps anyone can follow to learn to tell what's real from what's not.
I have an accompanying talk to give after the screening.
Check my public appearance calendar at skeptoid.com to see if it's coming to a town near you soon.
Or, if you like, drop me an email at brian at skeptoid.com and let's arrange one for your group, school, or company.
You're listening to Skeptoid, a listener-supported program.
I'm Brian Dunning from Skeptoid.com.
Hello, everyone.
This is Adrienne Hill from Skookum Studios in Calgary, Canada, the land of maple syrup and mousse.
And I'm here to ask you to consider becoming a premium member of Skeptoid for as little as $5 per month.
And that's only the cost of a couple of Tim Horton's double-doubles.
And that's Canadian for coffee with double cream and sugar.
Why support Skeptoid?
If you are like me and don't like ads, but like extended versions of each episode, Premium is for you.
If you want to support a worthwhile nonprofit that combats pseudoscience, promotes critical thinking, and provides free access to teachers to use the podcast in the classroom via the Teacher's Toolkit, then sign up today.
Remember that skepticism is the best medicine.
Next to giggling, of course.
Until next time, this is Adrienne Hill.
From PRX
Export Selection