Decoding Academia 33: The Great Müller-Lyer Debate from Fish Tanks to Eye Operations *Patreon Preview*
Welcome to another enlightening episode of Decoding Academia. In this bonus preview of our highly secretive Patreon content, we are discussing a controversial paper by Dorsa Amir and Chaz Firestone that challenges the established notion of the Müller-Lyer illusion being a product of cultural environments. Prepare yourself for some high-level discussions of the visual processes of guppy fish and bearded lizards, as well as the remarkable lengths that psychologists will go to in order to get people to complete their tests. Will our seasoned scholars unravel the illusion, or is this debate another eye-catching mirage? <wink, wink>Sources(forthcoming) Amir, D., & Firestone, C. Is visual perception WEIRD? The Müller-Lyer illusion and the Cultural Byproduct Hypothesis. Psychological Review.Dorsa's summary thread on the paperJoe Henrich's critical thread on the paperChaz's response to the Joe Henrich threadPaul Bloom's Substack articles on Nature vs. Nurture debates and clever experiments
Hello and welcome to Decoding the Gurus, Decoding Academia with the psychologist Matthew Brown.
And today I'm going to be a psychologist too.
I'm a psychologist.
I'm a psychologist and I'm Chris Kevner.
I can appoint you an honorary psychologist for the purposes of this.
I'm an associate professor of psychology.
I might be a food professor if you just give me a little while and then you'll have to.
That's how it works.
That's how it works.
If someone from another software discipline hangs around for long enough, eventually we anoint you.
I'm not like Sam Harris saying I'm a neuroscientist or I'm actually in a department teaching your undergraduates about your subject.
So there we go.
My undergraduates.
I like the sound of that.
All over the world.
You are Mr. Psychology.
All of the failures are at your feet.
And all of the wins too, Chris.
All of the wins too, which will include the paper that we're reviewing today.
Yeah.
All your wins, all your pee under 0.05.
I know how you guys roll.
Everyone a win.
That's right.
Yeah.
So Matt, before we talk about the paper, I just want to, you know, we're having a lot of amount of banter and I have a question.
You know, there's like things that you do that you think work, but they might just be superstitions, but they're like technological.
Like, so for example, I plugged in this laptop here.
I set it up all nice, but then I was like, Oh, I should plug the power in because that will make the recording better.
But I'm like, is that?
I've encountered your magical approach to technology before, Chris.
This is great.
But I think in this occasion, it must work, right?
At least you're not picking the screen and turning around twice.
No, but it's because like when it's on the...
So some programs run slower, like the script outputs slower when I use it.
Oh, couldn't it be, man?
But I was like plugging it in.
Well, look, in the case of these recordings, Chris, we're not limited by processing power, which is the thing that your little Apple Mac is saving by doing that.
We're mainly limited by your shitty domestic internet connection.
That's right.
God knows how you found one in Japan where they're all amazing.
You must have the only bad internet connection in Tokyo.
Yeah.
I mean, you're in Bundaberg and you've got a great one.
So, you know, that's right.
You're fair.
Now, that's three minutes.
That's the end of that.
We're not allowed that.
Banter done.
Mischief managed.
So, Matt, I'm going to test you here.
Do you know the title of the paper that we're looking at today?
I have it if you don't.
No.
How prepared are you?
I'd be glad to read it out.
The paper is Is Visual Perception Weird?
The Muller-Layer Illusion and the Cultural Byproduct Hypothesis by Dorsa Aneer and Chas Firestone.
Dorsa's at Duke University and Chas is at Johns Hopkins.
Good universities.
Yeah, forthcoming as well.
It's not published yet, right?
We're ahead of the presses.
Coming out in psychological review, but it's only improvement for him at the minute.
Yeah, well, that's it.
We're at the bleeding edge of research, aren't we?
So weird, of course, in this title refers to Western...
Oh, my God.
My undergrad is better than you.
Educated.
What does the E stand for?
Am I going to have to Elucidate?
Or, you know, I need to prompt you.
Okay, so Western educated.
What's the IMAP?
Oh, God.
Industrialized?
Okay.
I was going to say industrialized, but then I thought...
Rich.
Rich, Matt.
Rich.
Rich.
Very good.
D doesn't stand for democratic, does it?
It does.
It does indeed.
Like, you might say, Matt, that they chose those words to make the acronym weird rather than, you know, them being the normal way to refer to those things.
But who can say?
Who can say?
Yeah, yeah, yeah.
Psychologists never do that.
Never, never choose words just to make a collection of words.
That's a collection of words.
Western educated, industrialized, rich, democratic.
But why does that matter?
What is the point there?
Well, the point there is, you know, it's a topic dear to all anthropologists'hearts, which is the question of whether or not research in psychology is actually Is it actually revealing universal truths about human nature, which is what we would like to think?
Or rather, is it really just reflecting a particular milieu, shall we say?
Yeah, so it's a thing that psychologists fret about.
With good reason.
With good reason.
So, yeah, so it's generally a good thing to check for cultural...
You want to check that an effect or a measure works with men and women, if you think it works for all people, for instance.
Oh, very good.
Including women in your psychology.
Even the women.
We should even include women, Chris.
Okay.
Very progressive.
The little ladies are important too.
I've often said this.
Now, but the question is, I mean, that doesn't really mean that it is actually that we do necessarily see a lot of variability with every single thing that we study.
And there would be certain things, you know, everyone's got a hippocampus, Chris, for instance.
Most people, yes.
Yeah.
Yeah.
Most people don't want to exclude the hippo.
But, you know, so, you know, some maybe biological basic things are maybe less culturally determined, I think, in general.
And stuff that is more complex, you know, comes about through learning and environmental influences and so on.
You generally expect to be more culturally determined.
Now, the topic here is the Moeller-Lyer illusion, which is a very classic, well-studied visual illusion.
Yeah, among many, right?
So there are hundreds, if not thousands of visual illusions.
They're really fun.
And, you know, I think we understand the biological, you know, neural substrates about some of them, but not others.
The Molalai illusion, Chris, would you want to take us through that?
What does it look like?
Well, if people only know one single visual illusion that they've come across in their lives, it's likely this one.
The one where there's two lines.
And there are arrows at the end of the lines, and they're either pointing inwards or pointing outwards.
And then the question is, which line is longer?
But as it happens, both lines are the same length, but the one with the arrows pointing inwards appears longer, right?
I knew this illusion long before I knew anything about psychology, right?
So I think if my description was coherent enough, almost everybody will have come across this illusion, you know, at least in some...
So, yeah, that's it.
Perceiving two lines that are the same length to be different because of kind of contextual visual information, perhaps, right?
Perhaps.
Just repeat this because it's really central to the paper, right?
In case you've been living under a rock and you haven't come across this illusion, just to reiterate, imagine two horizontal lines.
Those are the lines you're comparing.
The top line has got two shorter lines.
Coming in to each of the points on each end at 45 degrees, right?
And they're coming in, right?
God, it's hard to describe.
Oh no, go ahead.
You're trying to get a better, first description looks better.
Listeners should vote.
Was Matt's 45-degree angle description better?
Look, we'll just post a picture.
Look it up.
Look it up, people.
You can Google it in five seconds.
We're not going to explain it to you.
You've all seen it.
People will have seen it.
Trust me, Matt.
This is not a rare illusion.
Yeah.
So there's concern, judging from the title of this paper, that this might be an illusion associated with weird populations, right?
And that would be the second part of the title, the cultural byproduct hypothesis, that this is not a visual illusion that is innate to our visual system, but is one that develops because of features of the environment that you're in, perhaps features that are more common or only available in developed modern architecture societies, right?
Yeah, in the paper, and I presume in the literature, it's referred to as carpentered spaces, which is an odd way to describe them.
But the idea is carpentered spaces.
It's not a phrase I've ever come across before.
because I'm Ria's Christian, whenever I hear carpentry, I imagine like Jesus and, you know, like the cross.
So like whenever people are talking about carpeted spaces, Yeah, with a lathe.
In biblical times.
Yeah.
Now, but, you know, what they're referring to is, you know, in artificial environments that humans tend to build, you often end up with a lot of straight lines or even straight-ish lines and, you know, nice, neat corners.
And, you know, there's a bunch of explanations.
Especially if you live in a communist society, Mark.
Right.
Yes.
Sure.
Yeah, that's what you're referring to?
Yeah, yeah, yeah.
Yeah, brutalism.
We get it.
We get it.
Thanks, Chris.
Now, what was my train of thought?
That's right.
So, I mean, there's a bunch of explanations for why this illusion occurs.
But the one I think it's probably the most well accepted or it's the most popular is that it reflects the kind of tuning.
Of our visual system to basically the effects of perspective.
So when you're looking at a visual scene, a natural visual scene, or an artificial one, then you're going to tend to see that optical effect of convergence, where lines tend to come together in the distance, just due to geometry, basically.
So the idea with the cultural On the other hand, as they point out in the paper, it could well be the case that, well, I think it is now demonstrated, that that is the case that you tend to see that convergence of perspective, even in natural scenes where there might not be such nice, neat.
So this explanation, I think, is commensurate with both the idea that it's really biological and it's not amenable to environmental change, like it's a hardwired thing, because, you know, you're going to get that effect in natural scenes and also in artificial scenes.
On the other hand, it could fit the idea that there could be cultural impacts on it because if there's more of those scenes in your experience, there's going to be some learning involved in your visual system for this effect to be heightened.
So that's the idea, basically.
If you're looking at one of these horizontal straight lines and it's got a couple of converging So you're kind of, it's further away, right?
So it's going to appear smaller, but you're kind of compensating for that effect by presuming that it's bigger, that it actually appears, right?
And the opposite is true for when the angles are coming in the other direction because it's implying that the object is closer towards you and therefore you're sort of, So I think that's a reasonable explanation for the effect.
I know there are other ones, but we probably don't have time to go through them all.
Yeah.
Yeah.
So part of the issue around this or the kind of discussion that has come around it is because whenever they looked at some cross-cultural data, if that were the explanation, what Matt described, right, it's a feature of the way that we...
It should be a universal feature.
Every culture, every person in the world has the optical blind spot.
It's not culturally specific.
There just is a blind spot in human visual processing because of the way it works.
And in the same way, visual illusions are interesting in this respect because you might anticipate that they are But in this case, the specific illusion, an early claim was that it is culturally variable.
And like we talked about, it is related or proposed to be related to carpeted spaces, like societies that have more street edges and this kind of thing.
And I was aware of this.
I've read this in books.
I may have referenced it to students, although I haven't.
Actually thought about this in great detail, but it's, you know, it's part of one of the things that people argue when they're saying, look, culture is powerful.
It's so powerful.
It can actually influence the way that you perceive visual illusions, right?
And these illusions, which you see, people in other cultures might not perceive them because of, you know, features in their environment.
So it's part of the evidence that's been offered for showing the power of culture.
To influence cognition, right?
Yeah.
I think it's a great example of a very deep sort of philosophical even issue in psychology, which is just a perennial question.
It's like whatever psychological property you observe, to what degree is it something that is hardwired?
That's a bad term, but I can't think of a better one off the top of my head.
You know, biologically determined versus something that is learned, that sort of blank slate sort of approach.
And, you know, it's definitely like a bit of both.
On one hand, human brains are incredibly nalatable, incredibly flexible in the way in which we can approach things and find solutions to problems and find ways to satisfy our various desires.
On the other hand, it's also incontrovertible to say that It is incredibly modular.
There are a lot of specialized processes as well that don't really change fundamentally in ontogenesis and throughout the lifespan.
So it's a complicated question.
the answer is going to be different depending on the topic that you're looking at so the question Yeah, yeah.
And there are plenty of things which are culturally variable.
I'm interested in cross-cultural psychology, and I agree, like, just off the top of my head, the way in which self-promotion is received in different cultures.
It's different.
Me and Matt talk about this all the time on the podcast because there's an allergy.
To self-promotion in, you know, Northern Irish culture, Japanese culture, very strongly Australian culture, but not so much in American culture.
There is in certain aspects, right?
But this is just, so the thing that can be adaptive socially can vary.
But even with that, I'd say it's nuanced, right?
Like, while the ways in which people can express or pursue self-promotion and achieve social cachet.
Would vary hugely between cultures.
I'd say almost every culture, people generally would like to increase their social status.
Yes, yeah.
Yeah.
So that's a good example that like there's nuance to it because like maybe the way to self-promote is to self-denigrate, right, in a given society.
Like, you know, there's just, it is an interesting thing, but I don't think you or I Now, I mention this because this paper is saying, okay, this illusion has been in previous research touted as a powerful example of the power of culture to shape cognition and visual perception.
And just reading from the abstract here, the cultural byproduct hypothesis bears on foundational issues in the science, philosophy, and sociology.
of psychology and remains popular today.
Yet, here we argue that it is almost certainly false.
They're coming out of the gate, shooting.
You know, this is an often cited result that it's variable.
And basically the previous finding or the claim is that in societies where there is less carpentry or less...
Then the illusion is less effective and people don't see it as much because there's not as much street edges in their environment.
But they're going to argue that is wrong and they're going to supply five separate lines of evidence for that.
Yes.
Let's work through them, shall we?
Yeah.
We won't read them out.
They made a helpful diagram.
They did.
So let's start with number one.
This is probably one of the best.
You shouldn't lead with the best.
You should put number one.
Yeah, but they like some of the other ones.
I mean, they're all good.
They're all good.
You could pick one of these.
All right, number one.
It is pretty strong.
It is pretty strong.
The illusion is not limited to humans appearing in non-humans from diverse ecologies.
Right, so let's Guppy fish.
It's guppy fish.
I mean, there's other ones as well, but they essentially trained guppies that if they approach a line that is longer, they'll get more rewards, right?
So you train the fish, you go towards the stimulus, and you get a reward, right?
Then you put into its fish tank the lines, right, with the different arrows.
And it goes towards the one which suggests it is making, you know, the mistake, the error.
Beautiful.
It's such a nice, neat experiment.
And it's a very big blow to the carpentered hypothesis.
It is a significant blow.
And it's been shown in other fish species as well as guppies, parakeets, pigeons, horses, capuchins.
Bearded dragons.
Bearded dragons.
It's a species of lizard.
I think they're Australian, right?
Yeah.
And even they claim the foraging patterns of ants.
I find that surprising, but I didn't check that particular citation.
Neither did I, but I was in a lab that was doing studies, comparative studies on ants and humans foraging behavior.
So I was sometimes amazed at the ants foraging collective.
Patterns is often very intelligent, even though the individual aren't so much.
But I am curious about how you can demonstrate that for 4G patterns, but I didn't read the paper.
Anyway, so it's also, it's been shown that like, because these are like repeated measures experiments where they get the same guppy again and again and again.
So they can even test if the effect is statistically significant in each individual fish.
Or each individual animal as well as the group and for the large majority of them.
It is, in fact, except every parakeet, every pigeon, every capuchin, and all but one bearded dragon and guppy.
Is that for a dragon?
No, it's not.
There's something wrong with that particular bearded dragon.
Well, I also noticed it mentioned that it can also be detected in the gaze pattern of flies.
Right now, one point to note here is that these things all have different eyes, right?
Human eyes.
And fly eyes, quite different, right?
Quite different in the structure and visual processing.
But this would imply it is a very fundamental illusion.
And the reason why I'm sympathetic to that is that I know from other topics in visual cognition.
And in particular, I'm thinking of computational studies where they do things like show a neural network model or a statistical model, a whole bunch of images from natural scenes, right?
and they sort of let them learn their own retinal coverage and things like that.
And you tend to see response patterns that fit things like the complex cells in the primary visual field
That would apply to all animals with any kind of eye.
So that's interesting.
So that is a strong finding.
It's a good start.
There are some counters to that, like, oh, what about the fish that have been raised in an aquarium?
Maybe they'll have seen the corners, but they point out, well, hang on, they've only seen, like, imagine a fish in an aquarium.
They're going to see some corners at the edges of their tank, but they're never going to see angles going in, like converging ones, but they're never going to see the opposite one, right?
You know, the counters for this don't work.
I think it is basically just a very strong argument in favor of this position.
Okay.
So they're starting off well.
Now the second line of evidence.
And I like this one as well, though it took me a little bit to get my head around it.
It doesn't surprise me, but that means I should explain it so that the listeners could understand.
Part of this argument is that there's a significant difference in the layouts of natural and artificial environments.
Like, obviously there is in the fact that, you know, a cityscape looks different than a jungle.
But the question is, in the...
Are those aspects less common in natural images?
And a bunch of researchers did a rather, I guess, like processing heavy, not the kind of thing that you could do without a computer, right?
Where they analyze the pixels in natural images, a large repository of natural images.
And Weller, like the kind of spatial distribution of the menth.
That you wouldn't come across this illusion in natural images.
And they found, no, first of all, that they are present in natural environments just from the layouts of scenes.
And then they did the thing which you should do, which tested, ah, but when you take a bunch of artificial city environments, you know, kind of highly carpentered spaces, as you might put it, is there more?
representation of the kind of angles and distribution of shapes that you would want to detect the Müller-Leyer illusion.
And they say, no.
So it doesn't seem that there is additional stimulus in highly carbonated environments that would actually help, right?
This is what they're saying.
Is that right, Matt?
No, you can correct me anything I got wrong there.
Yeah, that's basically right.
I mean, the basic premise is that, yes, the illusion...
and also the opposite, holds true.
This makes sense to me, right?
Because it's like a geometric optical property.
Yeah.
So it's going to be something that you're going to see even in natural scenes with grasses, trees, and gentle slopes.
And I think this point becomes stronger when you move briskly onto the third one.
Hey, Chris, because they're kind of counterintuitive.
Yes, this one is pretty good.
Right.
So, in other words, remember the argument for it being culturally determined is that those of us growing up in...
architectural regimes, right?
Surrounded by...
Nature that's very, the most, right?
Surrounded by this modernistic hellscape.
Full of all of these straight lines and angles, right?
That's why we're seeing this illusion.
But 4.3, the third argument is saying the illusion is not limited to straight lines or arrowheads.
And I've got a great diagram here, Figure 5, which compares it with one involving curved lines.
And you can look at it, right?
And it's working on me.
You can see it involving where there's even no lines at all, just a couple of points.
Surrounded by curly lines.
One D, where there's not even any curly lines, right?
They're just different colored points arranged in these patterns.
And then the real kicker is number E, where you've just got four points.
So, you know, two sets of red dots.
I presume they're equally spaced from each other.
And on one of them, they've got like a human's face sort of pointed.
On the inside of each dot so they've got like a little red nose and on the other version they've got human faces on the outside of those dots so there's just empty space in between the dots and the visual illusion is just as strong.
So this seems to be a very clear demonstration that actually the illusion does not depend on straight lines at all or angles and therefore it seems to completely eliminate The rationale for there being a weird cultural bias there.
Yes, yes.
And like you said, the diagrams are quite neatly presented in this.
It's like the people have a red nose in the last image.
You really should look out the paper because it's good in that respect.
I don't know, Matt.
I feel like image C. It's a little bit of a Rorschach.
Tell me what you see in that image.
Maybe that's just me.
In any case, with the three lines of evidence that we have already, you've got a pretty strong case.
I think this is a pretty good case.
The fourth piece of evidence, though, is also good.
All five of them are good, but This one is that people who are blind can also observe or it's not observed, but also experience this illusion through touching.
Yeah, exactly.
Experience it through touch.
So actually, that's interesting, Matt, because it's also then not just an optical illusion.
It's a geometric illusion, which, you know, you kind of talked about.
Yeah.
And to be honest, I mean, actually, the fun thing about this paper is that I learned a lot more about the illusion than I knew before, which after that wasn't a great deal.
But yeah, like I did not know this and I'm super surprised.
So basically they created like a braille version of the illusion, you know, the lines and the angles.
So people feeling it with their fingers are getting the same effect, which actually completely...
right, Chris?
Or perhaps is it the case that people who, like we know that people who are blind from birth do sort of recapitalize and like a lot of interesting things happen in terms of them.
Developing like an intuitive sense of vision that doesn't depend on vision, if you know what I mean.
And maybe something like that is happening.
I don't know.
It's a bit beyond my kin.
Yeah, yeah.
It's an interesting result in any case.
And like, again, it's just one of the four lines of evidence that they're offering, which is, you know, very impressive.
Five.
Five Lads.
Yeah, I remember...
one of the four lines that we've looked at so far.
The fifth one that is the last one to mention is...
They're all pretty impressive.
This one, however, feels like it's sort of the icing on the cake.
I think it's like that Simpsons clip where they're kicking Krusty.
Stop, stop, he's already dead.
Yeah, the zombie is down and you've already double-tapped him, but you're going to just pump a couple more rounds to be sure.
So, the fifth line of evidence.
which is quite amazing, is that the cultural byproduct hypothesis relies on that this is an aspect that you learn from interacting with the environment, in particularly through the visual field.
We've already seen some issues about that interpretation, but setting them all aside, this would mean that if you had an individual who was not able to experience visual stimulus in any significant capacity,
They shouldn't experience it, right?
Because they haven't had the visual input.
Now, you might think that psychologists would not go to such extreme lengths in order to test their theories, but you would be wrong.
Because Gandhi et al.
in 2015 recruited nine blind children with dense bilateral congenital cataracts.
They had lens replacement surgery.
They wore an eyepatch for 48 hours.
Then they took off their eyepatch and straight away, before they even got a chance to wonder at the wonderful world, The psychologists were there with their model eye illusion to test them.
And guess what?
Guess what?
Can you guess, Chris?
Yes, they all observed it.
And amazingly, it was nine participants, right?
Because obviously, this is a very rare situation where you have people that are having sight restored after being blind and then getting a psychology test.
Like you said, it's a rare situation.
But they did it, and they were all able to observe.
And they did, you know.
Multiple tests of the individuals.
So it's a well-conducted test.
And the fact that there are nine participants is perfectly understandable given the circumstance.
And it actually isn't an unreasonable sample because of the methodology they employed to increase their power.
Yeah, yeah, yeah, yeah.
It's perfectly fine in this context, of course, to have a very low sample size when you have an effect size apart from anything else.
This is incredibly strong.
They've got, I think, tongue-in-cheek little figure there, figure 7b, Chris, where they've got a graph.
Now, this graph breaks all of the rules of the visual presentation of data because, you know, most people would say, oh, this is overkill.
You don't need to do the graph.
But it's basically on the y-axis there is percentage of illusion consistent choices.
And then there's two bars, one for controls and one for newly sighted.
And both bars are of exactly equal length.
And they both go up to 100.
They're both exactly the same.
Well, the illustration before that as well is like showing a cataract surgery, right?
Like it's showing a kind of side slice of an eye and what happens when it's removed.
And then showing the Muller-Lauer.
I really like these illustrations.
It's a very clear demonstration of what Gandhi et al did and what they find.
Yeah, rhetorically very effective, I think, in a good way.
So, look, obviously the paper goes into a lot more detail than we've given here.
We've just scratched the surface.
Overall, the tone of the whole thing, Chris, is very, very careful.
Are these guys actually philosophers?
Because it has that...
They're in the Department of Psychology and Brain Sciences.
I read that in the beginning.
That's right.
I forgot.
No, they are psychologists.
Well, good job.
See, psychologists, we don't need philosophers, Chris.
We can do it ourselves.
Psychologists going their own way.
I approve.
I was also going to mention that they outlined these five lines of evidence, which caused some issue for the predominant.
Interpretation of the Müller-Leyer illusion and its cultural variability.
But there is an issue that there is a body of evidence that suggests it is culturally variable to a significant degree and that that aligns with the degree to which the societies that are being sampled from, you know, have modern environments and this kind of modern architecture and carpentered spaces like we've talked about.
So they then Go to basically do a critical review of not all of the literature, but kind of the most commonly cited studies and historically the studies that kind of set off this topic.
And they make a strong case that there's significant issues there.
They're not claiming that it means all the data is false, but just that given discrepancies, like they're pointing out, for example, how do you quantify the degree of carpentry in an environment, right?
And they go back to the original descriptions given and point out that in lots of these environments, there are descriptions of rectangular structures.
So their argument is actually the secondary literature is more guilty.
of like reifying this distinction between, you know, like a binary, natural, non-carpentry environment versus the modern environment.
But essentially they look critically at the studies and they argue that for various reasons, which revolve around like data collection, translation issues, researcher degrees of freedom, like people excluding participants that, you know, give research And the kind of environments, features that are in environments.
There's just a lot of reason to be skeptical of the previous literature.
And when you combine that with what they are talking about, the five lines of evidence they present, it means that we really, at best, should be highly Ambivalent about the state of evidence at the minute for this illusion being culturally variable.
Yeah, that's right.
The kind of cross-cultural research that was done, like you said, is vulnerable.
It's just a bit messy.
There's some messy constructs involved having to differentiate between these environments and subjectivity there.
And there's also some researcher degrees of freedom involved in terms of rejecting, in scare quotes, bad data.
And so on.
You know, the usual stuff that we've kind of observed with the replication crisis type stuff.
And so, yeah, I think it's kind of a matter of comparing the weight of evidence on both sides.
Like we went through those five things, which, you know, is incredibly strong.
Whereas the evidence on the other side of the ledger is much, much, much weaker.
So, yeah, I think we have to agree 100% with the...
is almost certainly false.
And I would have to agree.
So, yeah.
What do you think, Chris?
Did you enjoy this paper?
It's great.
This is like you described it, Matt, that this is kind of catnip for me because it's a paper which is, you know, it is providing like a critical evaluation of existing literature in a very convincing and well-argued way.
And it actually also makes reference to, you know, as you said, things that we've learned about.
From the replication crisis, about researchers' degrees of freedom.
Not to say we should dismiss all this previous research, but just that now that we're looking critically at it and there are these issues, that we could now construct much better tests of this.
And that's what they suggest at the end.
Like, you know, they're saying, we don't think, you know, their cards are on the table.
They don't think that this is a culturally variable phenomenon for all the reasons that they stated.
You know, you could pre-register design.
You could do an adversarial collaboration with people who are arguing that it is.
You could have very tightly controlled methods, include different kinds of stimulus like they presented, you know, the sideways face and the curvilinear examples and stuff.
And you could do a really neat test of it.
So this to me is like a really good contribution, especially because it's taking the target at a thing which is Cited so much, which is such an appealing example for all sorts of reasons.
It's an easy thing to teach the undergraduates.
It's kind of good to illustrate that culture is an important variable to take into consideration.
But all of that can be true, and this illusion may well turn out to be not so culturally dependent, right?
Yeah.
Yeah, that's right.
Yeah, like there's...
We know that there are a bunch of, I guess, zombie ideas, findings in psychology that kind of persist because they get included in undergraduate textbooks and they get taught.
And people like me don't really think about them much.
We just read it in the textbook and we repeat it, you know, if it's not in our special area of focus and therefore sort of persists.
And so this kind of work is really valuable.
What I appreciated about it is...
It's basically drawing together.
And it's not a philosophical argument, although they do do some very careful reasoning there.
It is referring to and drawing together a whole bunch of empirical evidence.
But it's just set out and argued in such a clear and compelling way.
It was just enjoyable to read, which is rare.
And I learned a bit more about that.
Like, I'm more mystified by...
Like before, at least I had a tentative explanation for what's going on.
But the stuff where even people are, like it's tactile, people that are congenitally blind.
Yeah, so that means we, you know, further research still required.
I just like putting aside the whole cultural variability thing.
What's going on with this illusion?
This might speak to something that I find.
Interesting and sort of variable in academia.
I think I've maybe mentioned this, but I've certainly talked about, you know, culture being able to influence things.
And I'm aware that like some of the results about analytical versus holistic thinking or like these things which are often used to show, you know, Japanese visual perception is different than North American visual perception.
They haven't fared so well in replication.
So I was already like kind of interested in this topic.
But in my case.
And this might be because I'm not invested theoretically to that extent.
When I read a paper like this, I'm like, oh, wow, this is interesting.
I had this understanding from the literature, but this makes a very strong case that my understanding is wrong.
And I'm actually like kind of excited, might be overstating it, but this is the kind of thing I would want to teach undergraduates about, right?
And like maybe...
put them papers advocating for, you know, the kind of classic studies showing the cross-cultural variation.
Then this paper, I'm not saying, okay, now you have to completely dismiss, you know, or take sides, but more like this is a good example of like a very critical paper, which ignites, you know, a discussion and may very well overturn like a longstanding part of a And so that to me is like exciting.
But I do see that in some respects, people respond with like anger that there are this kind of people exist, you know, they don't like it and they consider it kind of, you know, impolite or I don't know.
I don't know, like just kind of that it's besmirching a whole bunch of researchers because a lot of people have talked about this effect.
Yeah, well, I don't approve of that kind of thing.
I think your instinctive reaction to something like this should be curiosity and just interest about finding out, you know, it shouldn't be an unpleasurable experience to find out that something that you thought was true probably isn't, right?
That's a jumping off point for learning more stuff about the world, having a better understanding of what's going on.
And I, like you said, you know, we're not...
But, you know, that is the correct attitude, and it is a jumping-off point for more interesting things rather than just repeating the stuff that we think we already knew.
I mean, they mention that in the discussion areas a bit more, and they sort of point to the broader issues about the degree to which certain visual illusions or certain kind of holistic or gestalt kind of processing can be Affected by culture versus not.
And, you know, they mentioned some interesting ones with these illusory letters phenomenon, right?
So if you're doing an eye test and you're trying to perceive some hazy letters in the distance, right?
You can't quite make them out.
You're probably more likely to fantasize a letter that you're familiar with, right?
So if you're an English speaker, you're probably, you know, imagine a letter from your alphabet.
But, you know, interesting that I mentioned some evidence here that, you know, it doesn't seem to be true at the word level.
So if you take a sentence like she W dot dot T to the doctor for a W dot dot T on her foot, then you might expect, oh, you might fantasize like she went to the doctor for a wart on her foot, right?
Because that makes sense at the sentence level.
But surprisingly, those effects don't seem to occur.
Yeah, it is.
I mean, the more general question is to what degree does learning and experience have these sort of top-down effects on perception is a really open question.
And if it is occurring, like at what level is it occurring and how?
And yeah, it's a very complex topic and yeah, just very interesting.
Now, a sociology of psychology.
Comment on this, Matt, because, you know, we are not invested in this topic very strongly or theoretically, right?
In fact, I find very few things that I am strongly invested in it, including things I've published multiple papers on.
But nonetheless, Joe Henrik, on the other hand, is quite strongly invested.
And he is one of the main people that is cited throughout the paper as the kind of like.
Here is an example of someone making this claim.
Here is evidence why we think this is, you know, categorically wrong.
So, as you would expect, he didn't welcome the way this paper was presented.
Now, to his credit, he did say, like, for example, I'm just reading here.
Thanks again for your paper, Dorso Amir and Charles Firestone.
Disagreement is the lifeblood of science.
I'm replying to this paper in two storm tweets.
See below.
Okay, so that's a good...
That's what you want, right?
All right, let me get my hands dirty.
But in his response, I have to say that there are various like what I would consider fairly snippy retorts.
There's a point and this made me actually reminded me of like, you know, the people who recover the gurus because they said the author set up what they call the cultural byproduct hypothesis.
Which they do mostly by citing papers I co-wrote 15 to 20 years ago, published in 2010 and 2006.
Interestingly, they missed the oldest of these, which was published in 2008, but written first.
A big oversight.
Okay, so is that a big...
Or is that because in the response...
They're quoting it directly from the paper.
So it was called by Joe Henrik, the cultural byproduct hypothesis, right?
But they also mentioned that looking at the 2008 paper, which they didn't cite, you find the same kind of statement.
So it's not a huge oversight as it's presented.
Yeah.
as he presents it.
Well, I did not get that sense from the paper.
At all.
That's not really relevant.
Like a lot of the experiments are forced choice, right?
The guppy can only swim towards like one line or the other line, right?
But to say that that's flattening things into a nature-nurture thing is really no.
There's also, he mentions, you know, they deal with this view by avoiding it rhetorically with their straw man and luring the reader into categorical thinking.
Either you see the Muller-Lyer illusion or you don't.
They don't look at developmental data.
Brackets, which is odd, right?
Now, they do look at the real mental data because the fifth line of evidence was talking about people with congenital.
Is it congenital?
What's the?
Yes.
Like, in essence, that's developmental, a developmental research paper, right?
Because it's, but it's, yeah, it's compared to people.
Yeah, with and without the developmental experience.
Yeah, well, that does sound unfair to me, Chris.
And the other thing that's interesting about that thread, and I'm only just looking at it now, is that Joe Hendrick is sort of citing a whole bunch of other visual illusions.
Oh, yes.
And saying, oh, you know, what about these ones?
You know, you can see them because you're weird, but people in other cultures can't see them.
And, you know, I don't know anything about that research.
But my point is that their paper, Did not make claims about other visual illusions.
It was not like a broad scale thing.
It was about this specific thing.
So it's just a bit...
odd.
It's a bit of whataboutism, right?
It's like...
In the future, I would encourage them and others to share their work with those that they disagree with prior to publication.
Surely this paper could have been improved if they had gotten this feedback.
For example, they might have learned that Herero and Oji Herero are not different dialects.
It's just how you say Herrero in Herrero.
Like saying folks in Munich speak German and Dutch.
Run your paper past those you criticize before running off to the press.
Well, that's an incredibly important thing that they needed to.
Would have improved hugely.
Look, I've got to say, you know, this is understandable because, you know, your work is being criticized.
You get a bit testy and you add in some, like, you know, Shots.
It's understandable.
But I do think, like, you know, we talked about this issue about, like, you know, first you must contact people privately before you issue any criticism.
Like, no, that's not necessary.
And it parallels what we see in the IDW guru's fear, too, which is, you know, how dare you criticize me publicly?
You should have come to me in private.
We could have sorted this out behind closed doors.
How indiscreet.
How impolite.
I don't agree, right?
You put the paper out, you do your best with it.
It's a very strong paper, I think.
And it's a very worthwhile one.
Maybe it does have some little deficiencies.
Maybe it could have cited this extra paper.
Yeah, all papers have deficiencies.
But you do not need to consult with person A or person B about anything before you publish.
And if there is anything serious, maybe you and I are not qualified to judge.
You know, Gat's in the argument.
Maybe we're not aware of some excellent Gat or arguments that Joe Hendrick is aware of, in which case, write your own, baby, right?
That's what the literature is for, for researchers to communicate with each other publicly.
Yeah.
And, you know, Charles Firestone did do a thread.
By the way, you would be interested in MAP.
He makes the point that they weren't making a broader argument about, you know, all visual illusions not being culturally influenced.
But he does, however, question and point to some research that has given alternative potential expeditions for those illusions cited.
Well, I have to say, yeah, people will link to the thread of this thing because Joe Henrich, in one of those tweets, he points to Chris, it's the one starting with, look at sea.
And it is another very classic visual illusion that's very strong.
Where basically a bunch of horizontal lines really look as though they're diagonal, basically.
And they're just not.
It's very, very strong.
Joe Henrik says that you probably see the lines of slanted.
You do.
But he would, I think, argue that he says most him but don't see that.
So, I mean, I don't know, right?
I don't know the research.
I haven't done a cross-cultural study with that.
If I had to bet money on it, in my ignorance, I would kind of suspect that that is pretty culturally constant, that illusion.
It would be interesting to find out.
Oh, okay.
Well, you can do your betting market tick.
We will probably have a chance to speak to the authors of this paper.
So it's a good thing.
We like that.
Yeah.
Now, the other thing here is, again, on the sociology of science kind of thing, that in Charles Firestone's response to this, he does things like he says, we didn't miss sight this, here's a picture, you know, so this is a good chance to clarify this kind of thing.
And at the end of the thread, he mentions, what's next?
We're happy to know that Henrik and colleagues share our concerns about the Seagull's data quality.
Their previous writing had given a different impression.
And he puts up helpfully quotes where they are, you know, saying very positive things about it.
But in the thread, Joe Henrik says that they've been worried about the data collection as well, right?
So he says, we hope our discussions of key pitfalls chart a productive path forward.
By contrast, we're less interested in speculation about who has read what, is aware of what, rushed what off to where.
Not only is it materially irrelevant, best to just focus on the arguments, but it's also false in every case below.
We hope future exchanges leave this out and they point to previous interactions and messages to people.
Again, you know, this happens, right?
Researchers are people, egos are involved.
Things go back and forth.
But I think that it's worth noting that this paper is just, it's a very well-argued paper.
And it can be resolved, the debate around it can be resolved around, you know, high quality.
Yeah, the evidence and the arguments.
Pre-registered, yeah.
Yeah, or evidence and arguments in the literature.
like if there are fundamental issues in the paper we just reviewed that people like you and me can't see.
Aren't they?
Yeah.
Yeah, because we're just...
That would be great.
You know what I mean?
You don't need to get your nose at a joint about it.
And yeah, having now just sort of scanned through Chas Firestone's response, I think it strikes a very appropriate tone, I think I would say.
Yeah, I like the tone.
I might recognize something in the tone.
Well, there was some subtext there, but I think it was more genteel and polite than the threat they were replying to.
Yeah, this is right.
But, you know, the other thing I will say is, like, I came across this paper because of the exchange on Twitter.
Then I read it.
You know, we talked with Mickey a bit about it, and then I read it in detail for this.
And, you know, this is also, like, a little bit the sociology of science, right?
Paul Bloom talked about this on his blog.
Other people have been discussing it and whatnot.
You know, I think that is also something that is good.
It's like, even though there might be, you know, conflicts or whatever, researchers are gossipy bitches too.
So they're like, oh, you know, what's this?
People are unified online.
And, you know, that's also, it's just, we're humans.
It's part of the fun.
It's part of the fun.
It doesn't have to undermine the sort of serious business as underneath it.
Like, I've got the same kind of argy-bargy.
The same kind of ego stuff going on in my field.
We cast a bit of shade at each other and we go pretty hard.
And it's all in good fun, really.
It's good.
At the end of the day as well on this, I like Joe Henrik's work and output in general and this kind of thing.
His research covers a whole bunch of different stuff.
He's got a whole ton of different research lines which are quite influential.
So if it turns out that this illusion isn't as culturally variable and it isn't attached to the features of the environment, that's all right.
It doesn't therefore prove everything else ever claimed is wrong.
He's not going to fall to his knees and go, "I've wasted my life!" I curse you, Chas.
No, that's right.
This is good stuff.
Yeah, it'll probably spark a little bit more work and it might be resolved quickly or there might be some more research.
And that's what it's all about.
Final comment from me, Matt, is I just love comparative psychology research.
always so clever like things that i wouldn't think of every day you know that when we read that book about the octobern I kept thinking, like, I would never have thought of that way to test it.
Comparative psychologist, you get my thumbs up.
I would never have thought to give an octopus a twirly-whirly.
How did they think of that?
Well, the one thing is, I don't like so much where they cut, like, arms off.
No.
Yeah, I don't like that.
No, we do not endorse that.
No, me too.
I like the comparative stuff because I like when we show that some very human thing is something that parakeets do as well.
I'm so doing that.
I really enjoy that sort of little pricking our human-centric, species-centric problem.
Exceptionalism.
Exceptionalism, yeah.
Yeah.
Well, this was an enjoyable one, Mark.
Good according to academia.
It covered all the different aspects that we like, the replication crisis, psychology, cognitive stuff for you.
Gossip on Twitter.
And like I said, after reading the paper, I reached out to Dorsa and Chas if they would be interested to talk about it, because I think it's a really interesting area of research.
So that would probably happen.
Sometime soon.
And there we go.
Yeah, it'd be good to ask them some stuff, like not necessarily rehashing the paper, although we can a bit if we want to, but just ask them more about kind of what they think it implies or what they think it is.
Bigger picture stuff.
That's right.
Now we can just force them to talk about gossip for us.
