Iffy and Waddy Way dissect the "cult-like" fervor surrounding AI at CES, critiquing the Rabbit R1's poor design and comparing Mark Andreessen's anti-slowdown rhetoric to Scientology. They highlight existential threats like voice cloning fraud and algorithmic bias, which NVIDIA counsel Nikki Pope warns undermine consumer trust. The hosts link this accelerationism to Nick Land's far-right techno-capitalism, arguing that creatives are targeted for resisting a future where fiction becomes dystopian reality, ultimately suggesting the industry ignores significant risks in pursuit of inevitable progress. [Automatically generated summary]
Transcriber: nvidia/parakeet-tdt-0.6b-v2, sat-12l-sm, and large-v3-turbo
|
Time
Text
Trust Your Girlfriends00:04:46
This is an iHeart podcast.
Guaranteed human.
When a group of women discover they've all dated the same prolific con artist, they take matters into their own hands.
I vowed I will be his last target.
He is not going to get away with this.
He's going to get what he deserves.
We always say that, trust your girlfriends.
Listen to the girlfriends.
Trust me, babe.
On the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
I got you.
I got you.
Hey, it's Nora Jones, and my podcast, Playing Along, is back with more of my favorite musicians.
Check out my newest episode with Josh Grobin.
You related to the Phantom at that point.
Yeah, I was definitely the Phantom in that.
That's so funny.
Share each day with me each night, each morning.
Listen to Nora Jones is playing along on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
What's up, everyone?
I'm Ego Mode.
My next guest, it's Will Farrell.
My dad gave me the best advice ever.
He goes, just give it a shot.
But if you ever reach a point where you're banging your head against the wall and it doesn't feel fun anymore, it's okay to quit.
If you saw it written down, it would not be an inspiration.
It would not be on a calendar of, you know, the cat just hang in there.
Yeah, it would not be.
Right, it wouldn't be that.
There's a lot of life.
Listen to Thanks Dad on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
Cool Zone Media.
Welcome back to Behind the Bastards.
I don't know why I did that kind of like, almost like I was doing a Halloween opening.
Didn't work at all.
Horrible idea.
But I'm very happy to announce our guest today back after a long hiatus from this show, but not from our hearts.
Iffy and Waddy Way!
Hey!
How's it going?
I'm happy to be back.
Yeah.
Oh, so happy to have you back.
Ify, you are a significant part of the dropout, a wonderful channel on YouTube that is the survivor of college humor, which is kind of like we're kin in the comedy, internet comedy world.
And you guys have been doing some really cool stuff lately, like some of the funnest, like most interesting, like quasi-game show comedy bits.
Like I've watched hours of it.
Yeah.
Yeah.
I was, you know, I was talking to Sam and Dave's, the kind of like higher ups there, which is, you know, which is a testament to how cool the company is because I haven't spoken to the higher ups at ICC or any of the other companies.
But I was like, oh, yeah, this is like where like panel comedy lives.
And now after midnight's back, but I feel like Americans run away from panel comedy shows.
And I like an excuse to riff and goof with friends.
Yes.
And I think that YouTube and the kind of what people get out of a lot of like streaming stuff too, like not like streaming TV, but like, you know, streamers is that goofing with friends thing.
Like I watch red letter media stuff for a lot of the same reason.
And I feel like there's a way to save that stuff.
It's just not putting it on television at 11.30 at night necessarily.
Yeah, yeah.
People should be a little more lucid when they're taking in that kind of media.
But where else are you going to watch, you know, Block?
I was trying to think of the name of the show.
It was the one with the guy.
He has the, it's not a top hat.
It's like a fedora almost.
And he's a detective and all dads love it.
Bosh.
Bosh is Bosh.
Oh, God.
I've never seen Bosch.
My mom loves Bosch.
I don't even use the tools that Bosch makes.
They love Bosch.
Ah, the Bosch heads.
Yeah.
I would laugh, but I just got into Reacher, which is like, it's the stupidest thing on TV, but I love it.
It's like I used to watch a lot of Walker Texas Ranger as a kid.
It's the inheritor of that, but not racist or as racist, I guess.
Yeah, I'm not going to say not at all.
Look, that's why I'm not even going to judge because I remember one time me and M, we were up in the cabin in Wrightwood and we needed to kill time.
And we were like, let's watch this 911 show, whatever, just see.
And we were like seven episodes in, Logged.
We were like, hold on, this is this kind of goes.
Angela Bassett knows what she's doing.
Oh, yeah.
Robots Choosing Pizza00:13:13
No, she's a pro.
And, you know, you can't get work like that or work like you and your colleagues do at the dropout without human beings actually doing things, which is why today we're here to talk about AI.
And particularly, we're going to talk about how a lot of the conversation and a lot of the fandom around AI has turned into more or less a cult.
So that's the premise of this episode, iffy.
I want to start by going back to a place I was about a week ago as we record this, the Consumer Electronics Show.
Every year, they've been holding it for a long time now.
And it's kind of how the tech industry talks about itself and what it has planned for the future.
A lot of its hype.
You know, they're kind of talking up what's coming out that they're hoping we'll get buzzed, we'll make money.
But you also get an idea of like, what do you think we want?
And what are you trying to get us excited about?
And I think the most revealing product that I saw this year was the Rabbit R1.
And it's a little square-shaped gadget.
It's got a screen.
It's got a little camera that can swivel.
And it's an AI that basically, you talk to it like you would an Alexa, but it can use your apps.
And it's supposed to reduce friction in your life by basically routing every move you make online through this machine intelligence.
So you tell it what you want to do and it does it instead of like you using, like physically using your smartphone as much.
You still have to click it sometimes.
And I want to play you a clip of this where this is the CEO Jesse Liu's keynote speech.
Our smartphones has become the best device to kill time instead of saving them.
It's just harder for them to do things.
Many people before us have tried to build a simpler and more intuitive computers with AI a decade ago.
Companies like Apple, Microsoft, and Amazon made Siri, Contana, and Alexa with these smart speakers.
Often, they either don't know what you're talking about or fail to accomplish the tasks we ask for.
Recent achievements in large language models, however, or LLMs, a type of AI technology, have made it much easier for machines to understand you.
The popularity of LLM chatbots over the past years has shown that a natural language-based experience is the path forward.
Now, I don't know that I entirely agree with that because I think the biggest influence that these chatbots have had on me is that whenever I try to deal with like an airline or something, I get stuck on chat GPT and it's a pain in the ass to do anything.
What's so funny about the rise in AI right now is like if we really think about it and you, god damn it, Robert, you threaded the needle right there.
When you really think about it, all AI is, is just the evolution of the shittiest part of calling customer service.
Yes.
The one thing that we do as soon as we call is like, zero, zero, zero, let me get straight to a human.
Let me talk to a human.
And these like eggheads were like, what if we did more of that?
What if we remove your solace from every second of your life?
And it's the kind of thing he seems so off from my experience where he's like, the problem with phones is that it's too hard to do things.
No, it's too easy for me to order a bunch of junk food and have a stranger deliver it.
That's been a problem for me, right?
Oh, yeah.
It's too easy for me to waste six hours on Twitter.
Like, that's what the issue is.
Do you know how much the easiness of everything has made me wake up the next morning with cold food on my porch that I never touched?
Yes.
Because that's too easy.
It was too easy.
Sometimes we need those bumps in the road to keep drunk stone-diffy from ordering a like triple-double burger that I'm hoping gets to me before I fall asleep.
It never does.
I've had so many problems with my phone, but I don't think I've ever had the problem of like, this thing's just too hard to use.
That's just not a problem I know that anyone has.
But Jesse complains that there's too much friction with smartphones.
And his device, the rabbit, is going to let you like, you can just tell it, book me a flight or a hotel on Expedia.
And you don't even have to know, like, it'll just pick a hotel for you a lot of the time or like what flight, you know, it thinks is the most efficient.
Jesse's goal is to basically create AI agents for customers, which like live in this little device you wear and act as you online to handle tasks you normally use your phone to do.
So you can tell your rabbit to book you an Uber.
You can have it book you a flight or you can have it plan your trip to a foreign country.
Ooh, that sounds really bad.
It sounds so fucking bad.
Rabbit's like, hey, how would you like a middle speed CD on T airline?
Middle's efficient as hell.
Spirit's so cheap.
Now you can, you can direct it more, but then that just seems like, well, yeah, that's what I'm already doing on my computer.
Why is it easiest just to like work through a vocal chat bot that might not understand me?
Or at least will be as much friction as like, yeah, when I click, touch my phone and it hits the wrong thing, right?
I just don't see that I'm saving much here.
No one also seems to know how Rabbit's going to integrate with all these apps because that means their device has to have access to them for you.
And that's kind of a big ask for all of these different companies.
That said, and no one knows, by the way, how secure it's going to be, but no one at CES was listening either because the first 10,000 pre-order models that opened at CES sold out instantly.
Wow.
That doesn't mean a lot of normal people are going to buy it.
It means a lot of tech freaks wanted this thing.
You know, that is the thing too.
It's like, yeah, if you're at CES, you're already, you're already drinking the Kool-Aid.
Yes.
You know, and I'm very much, it's so funny because I'm very much that guy, or I was very much that guy who wanted to be on that cusp of technology.
And I feel like, you know, in my early 20s, it seems so cool because you're like, yeah, I want to be Iron Man.
I want to just have full control.
And then you kind of get to the point where you start, if you have enough self-reflection, you notice that you're just kind of, you're using technology to do things that you could just do for much simpler and cheaper.
Like, for example, like when you get these apps and then I'm like sitting in a photo editor for like 50 minutes just to make it look like it was shot on film.
And I was like, I can buy a disposable can.
Like exist.
And what's great is when you now, when you develop them, they put it, they email it to you.
So they can go on Instagram.
It's going to take longer, but arguably you might get some post-flick clarity.
Maybe that pic that didn't look good isn't now on the internet.
Or, you know, you can like spread it out.
But I, yeah, I am getting very you are you are so much more thoughtful in that than like anybody involved in this product has been over the course of their entire life.
Now, a couple of skeptics who have given reviews have already noted problems.
Richard Lawler of the Verbs was like, This thing is not built for left-handed people to use, like, they forgot that left-handed people existed, and so they designed it in a way that's specifically a pain in the ass.
Which, yes, there's also they brag they have this camera that can like move on its own so it can cover stuff in front of it or behind it.
And a commenter on Laudler's article was like, It's a pretty fundamental design principle that you don't add moving parts if you don't need them.
And there's plenty of space in this for a camera in the front and the back, which is one less point of failure, one less thing for shit to get gunked up.
And this is actually bad design.
They're bragging about this, but it's a bad idea.
Yeah.
Yeah, there's a couple of other issues in there.
You know, we'll see.
It looks like it's going to be a lot thicker than a smartphone.
I just don't know the degree to which a regular Google Glass issue, right?
Yeah.
Do you want a second thing that you have to keep on you, like alongside your smartphone?
That's just going to be my question.
So I'm glad we got it.
So is this something that should be replacing your phone, or is this another thing that you are supposed to be holding on to?
I think the goal is for it to eventually replace it, but at this point, you will still need to have both.
So, like, carry another thing, you know, you're now walking around like a drug dealer.
You have two different, it's a big device, and it's not tiny, and it has a big screen.
So, it's just like, well, you just made a different kind of smartphone.
Again, what am I gaining?
Yeah, it's what he's holding in this video, correct?
Yeah, yeah, yeah.
Yeah, okay.
Well, and what more is like that on top of tech person is definitely the person who carries a power bank with them.
So, that is a third-party thing.
And that's me.
So, that's three things you're rocking with.
I know, I have so many power banks and ADHD has blocked every single one of them from being useful because either I forget to charge them or I forget to bring them.
It also just doesn't look comfortable, it's bigger than his hand.
That's why he's not teeny.
We'll get a better look at it in a second because I want to show you when he's talking, he's trying to make the case for this.
And one of like he spends a significant portion of his not very long keynote on him rickrolling himself in the most iffy.
You've got to fucking watch this.
It is so painful.
R1 has an eye, an onboard camera designed for advanced computer vision.
It can analyze surroundings and take actions in real time.
To activate the eye, just double-tap the button.
Oh, funny seeing you here, Rick.
It's a picture of Rick Astley that he points it at.
Let me take a look.
Never gonna give you up.
And now, enjoy what?
Am I getting Rick rolling my own keynote?
Let's move on to the next one.
Okay.
I need every tech keynote speaker to take a improv class.
Yes, one.
You're like, and I don't recommend that to normal people.
Because, like, you're like no-selling your own joke.
Just like, what?
You're not even laughing at it.
Why am I going to laugh?
I will say, this was scripted almost exactly the way Tim Robinson would have written it.
Oh, man.
But I bet Sam Richardson could have delivered that bit better.
100%.
So that is, that is very funny, but I find this next clip more disturbing because it shows this kind of desire that the people that are the early adopters here have, not just for more convenience, but to hand over like the power to choose to a robot that's basically just pulling the first advertised result from Google.
Like it's, it's kind of messed up.
Ooh.
I can also use R1 to order food.
Get me a 12-inch pizza from Pizza Hut deliver to here.
The most ordered option on the app is fine.
Ordering a 12-inch pizza from Pizza Hut.
Since you mentioned that the most ordered option is fine, I will select that for you.
I just created an order for a 12-inch pizza.
It's going to be hand-tossed with a classic marinara sauce and topped with regular cheese.
Please confirm your order.
That sounds pretty good.
I just confirmed an order.
And then he has to click it again, just like on a smartphone.
He has to look at the device and click it.
Here's a freebie for any of even Richard Lawler, who has been in the game for a long time.
But like any of you tech bloggers, just do a side-by-side with this video and physically do everything he's doing in real time because a pizza would have been ordered way faster if you would have just pulled out your phone.
Well, and you could get the pizza you want.
Yeah, I don't want the 12-inch classic marinara most ordered pizza.
I want the shit I actually like.
That's so weird.
Yeah.
Yeah.
Also, who orders a 12-inch pizza from Pizza Hut?
Nobody.
Yeah.
Why?
No way.
Is that the most ordered product from Pizza Hut?
I don't believe it.
That was definitely painful.
Nonsense.
Yes.
Yeah.
It's just like, yeah.
And there's the next clip.
I don't think we'll actually play it, but like it is, it's him saying, hey, plan out like a three-day vacation in London for me.
And as far as I can tell, the AI goes for like the first top 10 list of things to do in London that it finds, which was probably written by an AI and then makes an itinerary based on those.
And it's like, first off, are you that basic?
Second, planning a vacation is fun.
Is that not a thing that you like want to do?
Cults and Machine Learning00:15:00
Yeah.
You're so right.
Why would you?
Because I look, the reason you would go to like a travel agent is because they are experts at it.
They're going to find the most fun thing for you.
But outside of that, yeah, I want to plan the cool stuff I'm going to do, you know?
And what about people with fears, you know, or people without skills, which is definitely going to be a large margin of people who do this.
So you, you're in London now, you're, you're, you're, you're, and then it takes you on a trip to Malta to go scuba diving.
You don't even know how to swim.
And now you're sitting there and they're like, you already paid for it, bro.
Yeah.
You let your fucking thing book this for you.
It's on you.
It's silly, right?
And I, I don't want to be, I'm going to say this is not the most direct parallel to cult shit we'll have, but watching this, I couldn't help but think about a cult that was like the subject of our second episode for this year, The Finders.
And it was one of those things, the guy, Marion Petty, who ran it, was like running games is the way he framed it.
And people would join the cult and give up their agency.
And he'd tell them, go take a job in this city or like go follow this guy and take notes on him for a year or like have a kid and raise it this way.
And this is stuff like this is really common within cults.
One of the appeals of a cult to a lot of people is that you both get a sense of purpose by following the cult and whatever things it says it going to do, and you give up the burden of having to choose a life for yourself.
And this is such a common thing in cult dynamics that psychologist Robert Lifton, who's kind of one of the foundational minds in studying cults, described it as voluntary self-surrender.
And it's a major characteristic of a cult.
Many of the finders were not, you know, these are not dumb people.
These are not like rubes.
These are not hillbillies, as they're often portrayed in our popular media.
A lot of the finders had Ivy League degrees.
One of them owned an oil company.
And these guys still handed their lives over to a cult leader.
Haruki Murakami, writing about Oun Shinriko, which is the cult that set off a bunch of poison gas in the Tokyo subway, noted that many of its members were doctors or engineers who, quote, actively sought to be controlled.
I found a lot of this really information on the fundamental characteristics of what makes something a cult in an article by Zoe Heller published for the New Yorker back in 2021.
At the time, she was kind of looking at QAnon and trying to decide there's not like a clear guy, and that's the cult leader, and there's not like a geographic center to this.
And usually there is with cults in history.
Does this still qualify?
And I think a lot of people would agree that like, yeah, it does.
I think a lot of experts tend to agree that, yeah, it does.
And when she was looking at the QAnon movement as a cult, Heller noted this.
Robert Lifton suggests that people with certain kinds of personal history are more likely to experience such a longing.
Those with, quote, an early sense of confusion or dislocation, or at the opposite extreme, an early experience of unusually intense family milieu control.
But he stresses that the capacity for totalist submission lurks in all of us and is probably rooted in childhood, the prolonged period of dependence during which we have no choice but to attribute to our parents an exaggerated omnipotence.
And I found particularly the bit where he's talking about like, yeah, if you've an early sense of confusion or dislocation makes people crave this kind of, to give up this kind of control and responsibility.
The people running these AI companies, and maybe not necessarily at the very top, because I think those tend to be pretty cynical, realistic human beings, but like a lot of the people who are in them and a lot of the people who are latching on to AI as a fandom online are people whose childhoods and adolescences, like all of ours, were shaped by 9-11, the dislocation and change that that caused.
And their young adulthoods, a lot of these people like us will have come of age around the time of the 2008 crash.
Many of the people who are younger in the AI fan base are, you know, maybe Zoomers and stuff.
And, you know, a lot of them are people who have really ugly ideas about like artists shouldn't charge for shit or whatever.
But also, these are people who, a lot of them came into their careers, went into STEM fields because they were told coming up the tech industry is the safest place to make, you know, a good living for yourself.
And that all fell apart a couple of years ago, right?
It started to at least.
Tech layoffs began.
So again, dislocation, chaos, the sense that like, what else am I going to entrust my life to?
I thought I had a plan and it fell apart.
Yeah.
You know, this is where if he's going to get real philosophical and big brain here, but I just finished All About Love by Bell Hooks.
And, you know, she often talks about like the wandering life with lovelessness and that and that searching for it and not having it having it.
And I feel like that goes hand in hand with what you're saying, right?
Where it's like, I want a sense of belonging and I want to feel like I'm a part of people.
And whether that is running into Target and trampling people for Stanley cups or it's being a part of like what you perceive to be the next big thing.
Like I think that is the biggest kind of selling point for a lot of these AI people who's like, this is the future.
Like that is almost every person who starts a 50 tweet thread with shitty examples of why AI rocks starts it with, this is the future and you just got to get over it.
And there's so many people who just want to be on the ground floor of that.
They want to be the people who were on it.
Because how many times, even I, you know, when you have that like time machine question, you're like, ooh, stock in Starbucks.
Ooh, an apple.
You just want to be there before it gets big.
So when it really, at the end of the day, it all comes down to commerce.
You want to be at the top when it all shifts.
And that is actually the danger in this for me is the commerce.
I think about it often because, you know, like you're saying, it like orders the top Google search.
Google is currently in courts right now fighting against, you know, basically shaking down companies to see who would be the top one.
So like the future of this being actually ace, you know, a useful app kind of lies now in that case, because if Google wins and they can put whoever's on top, that's only going to make it more valuable where they place who's on top because people are using these weird rabbits, you know?
Yeah, exactly.
It's, yeah, it is to, to them, they see the beginning of the future.
And I feel like to me, I'm just looking at all the ways it can be abused because if we just look at everything that has come before us, we have to think of the ways that it has been abused.
And all the ways it'll be a worse future.
You know, and I think I really like that you brought up the panic they try to incite in the rest of us, the like the FOMO, where it's like, this is the future.
Get on board or you're going to get left behind.
Yes.
Right.
That is, that is the cult recruitment tactic.
Right.
And what they're trying to do, I just brought up that a lot of the people who are most vulnerable to this are the folks who like, yeah, they have this sense of like insecurity, dislocation, and they see getting on board with this early.
They feel like a sense of security there.
And by saying, you're going to get left behind.
This is the only way forward.
You won't be competitive if you don't embrace this stuff.
They're trying to induce that sense of fear and dislocation to make people vulnerable.
And I want to read another quote from that New Yorker article.
The less control we feel we have over our circumstances, the more likely we are to entrust our fates to a higher power.
A classic example of this relationship was provided by the anthropologist Bronislaw Malinowski, who found that fishermen in the Trobiand Islands off the coast of New Guinea engaged in more magic rituals the further out to sea they went.
And I think we all feel like we're getting further out to sea these days, right?
Like that's, that's, it's, it's not hard to see why like, yeah, I'm near the shore.
What?
I don't believe in anything but what's right in front of me.
And then like you can't see anything but water and you're like, no, there's a God and I can keep him happy.
Yes, yes, indeed.
It's, it's, it's tough.
Yeah.
Everyone's just kind of grasping at what they can to just bolster themselves.
And sometimes you're grasping at some weird stuff.
Yeah, yeah, yeah.
And it's, it's, you know, it's noted often by, I think, a lot of particularly atheists on the internet that like church attendance is down, people who identify as part of an organized religion, like that, that is at its lowest level basically ever.
And this is true.
These are real trends and they have they have real effects, but I don't think the fact that less people are religious in the traditional sense means they're less superstitious or spiritual than they ever are.
It's just that what they invest with that belief has changed in part because they've seen the world dislocate so far out of what most priests and other sort of like religious heads are capable of sort of explaining or comforting them over, right?
Like religion is less comforting in a world as advanced as ours for most people.
Now, this may seem like a reach still to kind of call what's going on around AI a cult.
And I get that.
I ask you to bear with me here.
And I do want to note there's nothing wrong with the inherent technology that we often call AI, or at least not with all of it.
That's a, because it's used as such a wide banner term for stuff as varied as like a text recognition program that can listen to a human voice and create an on-the-fly transcription.
That's an AI.
That's an example of that kind of technology, right?
Like it gets folded in there.
That's one of the things an AI has to do.
Recognizing language and like facial recognition too, recognizing faces.
If you're ever going to have an actual artificial intelligence, those are two of the baseline capabilities that it needs.
Chatbots obviously are a big part of this, along with like the sundry tools that are being used now to clone voices to generate defakes and fuel our now constant trip into the uncanny valley.
CES featured some real products that actually did harness the promise of machine learning in ways that I thought were cool.
As I noted, I could happen here.
There's like this telescope.
It uses machine learning to like basically clean up images that you take with it at night when there's like a lot of light pollution.
So you can see more clearly.
And I'm like, yeah, that's dope.
That's great.
But that lived alongside a lot of nonsense.
You know, chat GPT for dogs was a real sign I saw.
And like there was an AI-assisted fleshlight to help you not be a premature.
Because of course that's the one that popped on my timeline.
It's like, and it was like, and then they gamified it where you go to different planets.
You defeat the planet.
So I'm like, what you, you keep talking about beating the planets.
So how do I lose?
Is it when I bust?
If I bust, you lost.
Because you're now introducing shame to sex again.
And I thought we finally got out of that.
Yeah, I thought we were moving past that.
Yeah, I can't beat level one.
Those kind of bad ideas.
That's all par for the course for CES.
But what I saw this year and last year, not just at CES, but just over the year in the tech industry from futurist fanboys and titans of industry like Mark Andresen, is a kind of unhinged messianic fervor that compares better to Scientology than it does to the iPhone.
And I mean that literally.
Mark Andreessen is the co-founder of Netscape and the capital firm Andreessen Horowitz.
He is one of the most influential investors in tech history, and he's put more money into AI startups than almost anyone else.
Last year, he published something called the Techno Optimist Manifesto on the Andreessen Horowitz website.
On the surface, it's appean to the promise of AI and an exhortation to embrace the promise of technology and disregard pessimism.
Plenty of people called the piece out for its logical fallacies.
For example, it ignores that a lot of tech pessimism is due to real harm caused by some of the companies Andreessen invested in, like Facebook.
What's attracted less attention is the messianic overtones of everything Andreessen believes.
Quote, we believe artificial intelligence can save lives if we let it.
Medicine, along many with many other fields, is in the stone age compared to what we can achieve with joined human and machine intelligence working on new cures.
There are scores of common causes of death that can be fixed with AI, from plane crashes to pandemics to wartime-friendly fire.
Now, he's right that there's some medical uses for AI.
It's being used right now to help improve the ability to recognize certain kinds of cancer.
I think there's the potential for stuff like in-home devices that let you scan your skin to see if you're developing a melanoma.
And there's debate still over how useful it's going to be in medical research.
I've talked to recently some experts and I've read some stuff that like there are some reasons for caution too.
For some of the same reasons we should have caution with this everywhere.
There's also disinformation that spread medically with AI, even to doctors.
And some of the patterns that using this stuff gets medical professionals into can make them discount certain diagnoses as well.
So I don't say that to like say there's not going to be some significant uses for some of the way this technology works medically.
Some aspects of AI will save lives.
It's just the evidence right now doesn't suggest it's going to completely revolutionize medical science.
It's another advancement that will be good in some ways and there will be some negative aspects of it too, right?
It's also very much not fair to say that like we're going to reduce deaths for human beings as a result of AI because right now the nation of Israel is using an AI program called the Gospel to assist it in aiming its airstrikes, which have been widely condemned for their exceptional, outstanding, in many cases, genocidal level of civilian casualties.
It's just outrageous.
Yeah.
Oh, 100%.
And, you know, you know, that's exactly what's going on is a genocide.
And, you know, the language in a lot of these speeches says that it's fair.
Even more so, yeah, like you're saying, another thing I want to point out, which you might have been about to say, and I'm already jumping ahead, is how I think it was ChatGPT that has quietly switched their terms of service to say that it wouldn't be used for like weapons and to hurt people.
They're going to use this shit for weapons.
That's for sure.
Yeah.
And now it has been quietly scrubbed from those terms of service.
And we do need to talk about that because there's just so many things that we have grown accustomed to with tech that I think is dangerous as we get into things that have more room for error because we're used to updated terms of services on our iPhone, right?
Every time we grab an update, it's like, here's a new terms of service, and you just kind of scroll through it and you go, yeah, because you're like, yeah, you know, this is just a phone.
It's not going to, you know, be used for anything weird yet.
So you're comfortable.
But like when you're doing the same thing with these chat GPT machine learning situations where you're agreeing and you're agreeing, okay, I will help this thing learn.
And now you are just actively helping it learn how to be an assassin.
Like what happens there?
Yeah.
And it's again, it's this back and forth where on one hand, there is some technology like AI-enabled robots that can go run onto a battlefield and pick up an injured soldier.
I have no desire to see some random private bleed to death in a foreign country.
Slowing AI Is Murder00:03:17
Fine with that.
Or anti-missile missiles, right?
Using AI to intercept and stop a missile from blowing up in a civilian area sounds fine.
Like I don't, I don't want random people to die from missiles, but it's also going to be used to target those missiles and to say, like, based on some shit we analyzed on Twitter or whatever, we think wiping out this grid square of apartment buildings will really get a lot of the bad guys.
And based on if he's tweet, we should blow him up.
Exactly, right?
It's just, there's certainly, it's certainly not fair to say there won't be benefits, but it's absolutely unclear in every field of endeavor whether or not they will outweigh the harms, right?
And even if they do, to what extent, you know, because a lot of what I'm saying suggests that even if the benefits outweigh the harms in a lot of fields, it's still not going because of the extent of the harms in part, it's still not going to be a massive sea change, right?
There are a lot of reasons for caution, but Mark has no time for doubters.
In fact, to him, doubting the benefits of AGI, artificial general intelligence, is the only true sin of his religion.
Quote, we believe any deceleration of AI will cost lives.
Deaths that were preventable by the AI that was prevented from existing is a form of murder.
And that's fucked up.
That's really dangerous to start talking like that.
Oh, yeah.
And this is the more direct cult comment here.
I want you to compare the claim Mark made above that slowing down AI is identical to murder.
I want you to compare that to the claims the Church of Scientologies makes, because the Church of Scientology, they have this list of practices and the beliefs that they call tech, right?
And they believe that by taking on tech, by engaging with it, people can become clear of all of their flaws.
And by doing that, you can help, you can fix all of the problems in the world, right?
The Church of Scientology on its websites claims that its followers will, quote, rid the planet of insanity, war, and crime, and in its place, create a civilization in which sanity and peace exist.
How is that in any way different from Mark Andresen saying all of the shit that he's saying, right?
That it's going to like create this, this, this, we're going to revolutionize medicine.
We're going to like end friendly fire.
We're going to cure pandemics.
We're going to stop car crash deaths.
What is what is the difference, right?
And Scientology uses that claim that Scientology tech is so necessary.
It's going to fix all these problems.
So anyone who gets in the way of the Church of Scientology and the deployment of this tech for mankind's benefit is subject to what they call fair game.
A person declared fair game, quote, may be deprived of property or injured by any means by any Scientologist.
And again, Mark Andresen has not said that in his Techno-Optimus manifesto.
In fact, he makes some claims about like none of no people are our enemies, right?
But if you're saying you're a murderer for slowing this down, it's not hard to see how some people might adopt a pro a practice like fair game eventually, right?
That's how where else does this go is my what do we do with murderers?
What is I feel like the general rule across all creeds, across all beliefs, is typically murderers are bad and should die.
That is at least be punished, right?
There's a punishment for murder.
Most people agree.
Yeah.
Speaking of murder, you know who has never committed a murder.
You cannot say that.
Punishment for Murderers00:03:20
Like blatantly all of our ads.
You know who I can't prove were involved in any murders.
Just like I have no evidence that Jamie Loftus had any role with okay.
Okay.
What?
I'm just saying one, she's one, my girl's innocent.
And two, you can't say that about our about the Sponsors.
We don't pick them.
If he, by the way, we're spreading a rumor online that Jamie Loftus was possibly involved in a series of murders in Grand Rapids, Michigan.
It's a bit.
It's a good bit.
It's a bit.
Yeah, yeah.
Everyone loves the bit.
So, you know, who knows?
Who knows?
My girl's innocent.
Uh-huh.
Anyway, here's some ads.
There's two golden rules that any man should live by.
Rule one: never mess with a country girl.
You play stupid games, you get stupid prizes.
And rule two, never mess with her friends either.
We always say, trust your girlfriends.
I'm Anna Sinfield, and in this new season of The Girlfriends, oh my God, this is the same man.
A group of women discover they've all dated the same prolific con artist.
I felt like I got hit by a truck.
I thought, how could this happen to me?
The cops didn't seem to care.
So they take matters into their own hands.
I said, oh, hell no.
I vowed I will be his last target.
He's going to get what he deserves.
Listen to the girlfriends.
Trust me, babe.
On the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
Hey, I'm Nora Jones, and I love playing music with people so much that my podcast called Playing Along is back.
I sit down with musicians from all musical styles to play songs together in an intimate setting.
Every episode's a little different, but it all involves music and conversation with some of my favorite musicians.
Over the past two seasons, I've had special guests like Dave Grohl, Leve, Mavis Staples, Remy Wolf, Jeff Tweedy, really too many to name.
And this season, I've sat down with Alessia Cara, Sarah McLaughlin, John Legend, and more.
Check out my new episode with Josh Grobin.
You related to the Phantom at that point.
Yeah, I was definitely the Phantom in that.
That's so funny.
Share each day with me each night.
Each morning.
Say you love me.
You know I.
So come hang out with us in the studio and listen to Playing Along on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
What's up, everyone?
I'm Ango Moda.
My next guest, you know, from Step Brothers, Anchorman, Saturday Night Live, and the Big Money Players Network.
It's Will Farrell.
My dad gave me the best advice ever.
I went and had lunch with him one day and I was like, and dad, I think I want to really give this a shot.
I don't know what that means, but I just know the groundlings.
I'm working my way up through and I know it's a place to come look for up and coming talent.
He said, if it was based solely on talent, I wouldn't worry about you, which is really sweet.
Selling Vague World Benefits00:15:03
Yeah.
He goes, but there's so much luck involved.
And he's like, just give it a shot.
He goes, but if you ever reach a point where you're banging your head against the wall and it doesn't feel fun anymore, it's okay to quit.
If you saw it written down, it would not be an inspiration.
It would not be on a calendar of, you know, the cat just hang in there.
Yeah, it would not be.
Right, it wouldn't be that.
There's a lot of luck.
Yeah.
Listen to Thanks Dad on the iHeartRadio app, Apple Podcast, or wherever you get your podcasts.
Oh, we're back.
So the more you dig into Anderson's theology, the more it starts to seem like a form of techno-capitalist Christianity.
AI is the savior.
In the cases of devices like the rabbit, it might literally become our own personal Jesus.
And who, you might ask, is God?
Quote, we believe the market economy is a discovery machine, a form of intelligence, an exploratory, evolutionary, adaptive system.
Now, God.
Through this concept of reality, capitalism itself, and capitalize the C there because it's a deity, has chosen to bring artificial general intelligence into being.
All the jobs lost, all the incoherent flots and choking our internet, all the Amazon drop shippers using ChatGPT to write product descriptions.
These are but the market expressing its will.
Artists have to be plagiarized.
Children need to be presented with hours of procedurally generated slop and lies on YouTube so that we one day can reach the promised land of artificial general intelligence.
Iffy, isn't it worth it?
Oh my God, it so isn't.
And it's, I didn't know, you know, one of the biggest criticisms with AI is that it, you know, it is one of the effects of when, you know, creativity and commerce meets, commerce will always try and kill creativity.
Yes.
Because it is commerce is more concerned with the, buck than it is the outcome or what it takes to get said buck.
And that was, that was going to be a whole thing I was going to drop at some point.
And they just said it for me.
They, they just said like like they, I didn't, I thought it was more veiled.
I thought it was more hidden.
But, you know, that is, that is why you can, you, you can try and um say that it is ethical to take from artists because we're making it easier for you.
Your fingies hurt doing all that drawing, but if it learns from you and you know, uh don't ask how you're gonna get paid, but if it learns from you, we can we can give the people what they want without causing you all this labor, you know.
But who gets the money?
It's it's always the dork behind the computer who did the code that is just essentially stealing from all of these people and learning from them and then just producing this amalgamation of everything they've done.
Yeah, yeah, absolutely.
Also, I should note, I'm trying to be consistent about this.
I wrote it down and then I think slipped into it.
It's Andreessen, Mark Andreessen, Andreessen Horowitz.
It's just a weird name that I'm not used to saying.
I wrote this down and then immediately forgot to correct myself at the start of the podcast.
Again, folks, hack and a fraud, but you know who can own?
Well, actually, I won't say only humans can be hacks and frauds like that because the AIs absolutely mispronounce shit and get shit wrong too.
I guess that maybe they are getting conscious.
Can they build an AI that's as much a hack and a fraud as I am?
We'll see.
So.
No.
Thank you, Sophie.
I appreciate it.
AGI is treated as an inevitability by people like Sam Altman of Open AI who need it to be at least perceived as inevitable so their company can have the largest possible IPO, right?
There's a lot of money on the line in the people with money believing all of the promises that Andreessen is making.
This messianic fervor has also been adopted by squadrons of less influential tech executives who simply need AI to be real because it solves a financial problem.
Venture capital funding for big tech collapsed in the months before ChatGPT hit public consciousness.
The reason CES was packed with so many random AI-branded products was that sticking those two letters on a new company is like they treat it like a talisman, right?
It's this ritual to bring back the rainy season.
You know, if you throw AI in your shit, people might buy it.
And it's, you know, there's versions of this, like laptop makers are throwing AI in everything they do now just because like laptop sales soared during the start of the pandemic, but they plummeted because people, for one thing, don't need to buy laptops all the fucking time.
Most people wear them out, right?
Oh my, yes, exactly.
And again, this comes in if you can get people in the cold, if you can get them scared that they're going to fall behind without AI, then maybe they'll buy a new AI and I have a laptop because they're like, well, this is what I got to do to stay competitive.
You know, the terminology that these rich tech executives use around AI is generally more grounded than Andreessen's prophesying, right?
But it's just as irrational.
The most unhinged thing I heard in person at CES was from Bartley Richardson, an AI infrastructure manager at NVIDIA, who opened a panel on deep fakes by announcing, I think everybody has a co-pilot.
Everybody's making a co-pilot.
Everybody wants a co-pilot, right?
There's going to be a Bartley co-pilot, maybe sometime in the future.
That's just a great way to accelerate us as humans, right?
And it's funny.
He's named Bartley.
If you know your old Star Trek and you can remember Barkley, the sad Insign.
He sounds like that guy and resembles him.
Oh, man.
What's funny about that speech is it sounds like he's trying to convince himself to he's like, he's like, it's got to accelerate us, Richard.
Yeah, yeah, yeah.
We're not wasting our time, are we?
Yeah.
Yeah.
Again, later in a separate panel, NVIDIA in-house counsel, Nikki Pope, who's like the only skeptic they let on, cited internal research showing consumer trust in brands fell whenever they used AI.
This gels with research published last December that found around 25% of customers trust decisions made by AI less than those made by people.
No one on stage bothered to ask Bartley.
It was like, okay, you want to use this thing?
We know your own company has data that it makes companies less trustworthy.
Are you worried that if you use it, people won't trust you?
Like, does that is that not in your head?
And that's, that was kind of a pattern at CES.
All of the benefits of AI, with some very, very specific exceptions, most of the benefits of AI were touted in vague terms.
It'll make your company nimble.
It'll make it more efficient.
You know, it'll accelerate you.
Harms, though, while they were discussed less often, they were discussed with a terrible specificity that stood out next to the vagueness.
One of the guys in the deep fake panel was Ben Coleman, and he's the CEO of Reality Defender, which is a company that detects artificially generated media, right?
Their job is to let you know if something's AI generated.
And he claims that his company expects half a trillion dollars in fraud worldwide this year just from voice cloning AI.
Not fraud from AI, just the fake voice AI.
Half a trillion dollars.
Yeah, here's the thing, too, that I think is the scariest part of AI that I don't think we've talked about yet is that everyone can use it.
You know, like it's not, this isn't a thing that is like, oh, it's, it's, you know, these companies is too expensive.
People are priced out and we just got to hope that everyone's good.
You're getting like SpongeBob rapping Kendrick lyrics on TikTok.
You know, we, my buddy Benny, jokingly like promoted his show and made it look like he was having a FaceTime with Obama and it was like pretty good.
The only reason you knew it wasn't, it was fake was because of just the nature of the video.
But I was like, at what point is someone going to stop and go, hey.
We shouldn't have technology where someone can impersonate world leaders.
Yeah.
And, you know, to be honest, that's not even just because like I think everyone is ready for the idea that like, yeah, people are faking Obama or by, because we've done little versions of that for years now.
I think the scariest thing is people aren't ready for their loved ones to be imitated by AI.
And that is a thing that is happening.
In 2023, and this has happened a lot to a lot of people, there was a specific case that kind of went viral of this mother who got a call from what sounded like her kidnapped daughter.
And like the AI generated the voice of her daughter and then a guy was like, give us money or we'll fucking murder her, right?
And her kid was never kidnapped.
She very nearly sent them money because who wouldn't, right?
Like if you don't know that that's a thing that can do, who would not?
Like that's a, that's a, and it's the AI was able to clone her daughter's voice because her daughter has a TikTok, right?
It doesn't take that much, you know?
And this is why, by the way, that people are talking about ways to mitigate this.
I think one of them is like have a family password or something where it's like, all right, if I'm fucking kidnapped, I'm going to say the password, you know, so that, you know, some random person with your TikTok won't know it or at least has to try harder to guess it.
So great.
Thanks to AI.
Now we have to have passwords for our families in real life.
Cool.
Yeah.
If you want to see that Thanksgiving, you got to know the password.
Yeah.
Fucking great.
At CES and at the sub stacks and newsletters of all these AI cultists, there's no time to dwell on problems like these.
Full steam ahead is the only serious suggestion they make.
You should all be excited, Google's VP of engineering, Bashad Bazati, tells us during a panel discussion with a McDonald's executive.
If you're not using AI, Bashad warned, you're missing out.
And I heard versions, variations of the same sentiment over and over again, right?
Not just this stuff is great, but like you're kind of doomed if you don't use it.
And I will give Nikki Pope was the only skeptic really who had a speaking role in CES.
It is not coincidental that she was an academic and a black woman because her background is studying algorithmic bias in the justice system.
And so she had some really good points about like the actual dangers this stuff had.
She was on this, the panel she was on was governing AI risk and kind of her like the partner on the panel, the guy she was talking with was Adobe VP Alexandre Coston.
And she urged the audience, I want you to think about the direct harm algorithmic bias could do to marginalized communities.
Quote, if we create AI that disparately treats one group tremendously in favor of another group, the group that is disadvantaged or disenfranchised, that's an existential threat to that group.
And she was specifically like, people talk about the existential threat of an AI going crazy and killing us all, but like, that's not as realistic as what we know will happen.
Yes.
Oh, yeah.
When you have these banks that like automatically, you know, are using AI to try and approve, you know, loans and Deontay sends his name in and they're like, not approved.
Yeah, exactly.
It's like, nah, I'm good.
And I am glad she was there.
She, again, she still, you know, works for a company that's going to make money off of this.
She's not like a doomer on it, but like at least one person was being like, can we please acknowledge there are dangers?
I know, because here's the thing is, and I truly believe this, and you were basically saying this earlier, that AI as a tool is fine, you know?
Yeah.
I mean, when you, when it is, and a tool is something that is always held and used by a human.
That there's the checks and balances.
It is only as evil as the person who's using it.
And that is just any item, physical or digital, will ever, you know, will always be under.
But the moment you're like, I'm going to give you free reign based on information.
And how many times has an article gone online that was like, it scanned Reddit or it scanned Twitter and it's racist now.
You know, there's, and, and we still like went full steam ahead with producing this and thinking we're right.
And we know, especially when you see a lot of these tech leaders being predominantly white men.
And we know that in general, most white men don't care about protecting marginalized people.
They care about getting their bottom dollar.
They don't see, they see it as a, as a, a rare occurrence because they don't live that existence.
They don't have the data pun intended to build something to defend against it because it's not a real problem to them because they don't see it.
And that is beyond just them being them and more into as humans.
A lot of times, if you don't do the work to see it and understand what happens to other people outside of your perspective, you're just going to believe that it's not real and it's or people are exaggerating or it's this and it's that.
And when you are a gung-ho and you have drunk the Kool-Aid, that is the AI Kool-Aid, and you are telling people that this is the future.
We have to do it.
You're going to push ahead.
But like we've literally have seen a clear-cut example of what happens when you push past safety and you just do what you want to do just because you have a whole bunch of money and a madcat's controller.
Like it gets dangerous.
So as you started talking about like the dangers of certain tools, right?
And how the value of the tools.
I literally looked over at the gun on my table, right?
And we all agree, even people who really like them, there should be regulation.
And I think the vast majority like agree more regulation, but they are like, again, not to say that it's sufficient, but there are a lot of laws about like where you can carry a gun legally, how you can buy a gun, right?
And because people understand that like, yeah, if a tool is that powerful, there should be limitations and things and things that you can do that get them taken away from you forever, right?
Yes.
I don't know how we do that with AI, but I don't think that's a reason not to try, right?
Yes, yes.
You got to do what they did in that movie, Hackers.
And it's like, you're just banned from the internet till you graduated high school or whatever it was.
Yeah.
Yeah.
Now, Kosten claimed that the biggest issue, again, so Nikki, Nikki Pope is like, yeah, I think this stuff could really hurt marginalized communities.
And Alexandria Costen from Adobe responded that like, well, I agree, but the biggest risk of generative AI isn't fraud or plagiarism.
It's not using AI, right?
He claims like this is as big as the internet and we all just have to get on board.
And then I'm going to read verbatim how he ends this particular statement.
I think humanity will find a way to tame it to our best interest.
Hopefully.
Hopefully.
Great.
Cool.
No way.
Accepting the Pain00:02:03
Why?
Awesome.
Awesome.
And the whole week was like that.
Again, these really specific, devastating harms and then vague claims of like, yeah, we're all just going to have to do it.
You know, and I brought up Scientology earlier, but when I think about touting like vague claims of world saving benefits alongside, and it's going to hurt too, and you have to accept the pain.
I think of Keith Ranieri, right?
The Nexium guy.
We all remember Keith, you know, like most cult leaders, Ranieri promised his mostly female followers, you'll get all these benefits.
I'm going to like heal you.
You'll be extra productive.
You'll be super good in your business, super good in your career, but you have to follow my commands because they have to retrain you on some stuff.
And so it's going to be uncomfortable, right?
And the end result of this is a bunch of them branded their flesh and partook in sex trafficking.
You know, these tech tech executives are not Raineri, but I think they see money in aping some of his tactics, right?
The benefits are so good, we just have to accept some pain.
You know, I got to hurt you to rebuild you better.
Now, all of the free money right now is going to AI, and these guys know the best way to chase it is to throw logic to the wind and promise the masses that if we just let this technology run roughshod over every field of human endeavor, it will be worth it in the end.
This is rational for them because they're going to make a lot of money, but it is an irrational thing for us to let them do.
Why would we want to put artists and illustrators who we like out of a job?
Why would we accept a world where it is impossible to talk to a human when you have a problem and you're instead thrown to a churning swarm of chatbots?
Why would we let Sam Altman hoover up the world's knowledge and resell it back to us?
We wouldn't, and we won't, unless he can convince us that doing so is the only way to solve the problems that scare us: climate change, the cure for cancer, and into war, or at least an end to the fear that we will all be victimized by crime or terrorism.
All of these have been touted as benefits of the coming AI age if we can just reach the AI promised land.
And we're going to talk about some of the people who believe in that promised land and what they think it'll be like.
Why We Need Humans00:02:10
But first, iffy, you know what is the real promised land?
The only actual paradise any of us will ever know?
What?
Buying from the sponsors of this show, of course.
It was good.
I was ready.
All right.
Here's an ad.
There's two golden rules that any man should live by.
Rule one: never mess with a country girl.
You play stupid games, you get stupid prizes.
And rule two: never mess with her friends either.
We always say, trust your girlfriends.
I'm Anna Sinfield, and in this new season of The Girlfriends, oh my God, this is the same man.
A group of women discover they've all dated the same prolific con artist.
I felt like I got hit by a truck.
I thought, how could this happen to me?
The cops didn't seem to care.
So they take matters into their own hands.
I said, oh, hell no.
I vowed I will be his last target.
He's going to get what he deserves.
Listen to the girlfriends.
Trust me, babe.
On the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
Hey, I'm Nora Jones, and I love playing music with people so much that my podcast called Playing Along is back.
I sit down with musicians from all musical styles to play songs together in an intimate setting.
Every episode's a little different, but it all involves music and conversation with some of my favorite musicians.
Over the past two seasons, I've had special guests like Dave Grohl, Leve, Mavis Staples, Remy Wolf, Jeff Tweedy, really too many to name.
And this season, I've sat down with Alessia Cara, Sarah McLaughlin, John Legend, and more.
Check out my new episode with Josh Grobin.
You related to the Phantom at that point.
Yeah, I was definitely the Phantom in that.
That's so funny.
Share each day with me each night, each morning.
Say you love me.
Techno-Capitalist Dreams00:14:33
You know.
So come hang out with us in the studio and listen to Playing Along on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
What's up, everyone?
I'm Ago Monum.
Next guest, you know, from Step Brothers, Anchorman, Saturday Night Live, and the Big Money Players Network, it's Will Farrell.
My dad gave me the best advice ever.
I went and had lunch with him one day, and I was like, and dad, I think I want to really give this a shot.
I don't know what that means, but I just know the groundlings.
I'm working my way up through and I know it's a place to come look for up and coming talent.
He said, if it was based solely on talent, I wouldn't worry about you, which is really sweet.
Yeah.
He goes, but there's so much luck involved.
And he's like, just give it a shot.
He goes, but if you ever reach a point where you're banging your head against the wall and it doesn't feel fun anymore, it's okay to quit.
If you saw it written down, it would not be an inspiration.
It would not be on a calendar of, you know, the cat just hang in there.
Yeah, it would not be.
Right, it wouldn't be that.
There's a lot of luck.
Yeah.
Listen to Thanks Dad on the iHeartRadio app, Apple Podcast, or wherever you get your podcasts.
All right, we're back.
So I want to talk about Silicon Valley's latest subculture, emphasis on the cult, effective accelerationism, or E slash ACC, EAC, I think is probably how you could pronounce it.
The gist of this movement fits with Mark Andreessen's manifesto.
AI development must be accelerated without restriction, no matter the cost.
EAC has been covered by a number of journalists, but most of that coverage misses how very spiritual some of it seems.
One of the inaugural documents of the entire belief system opens with the statement, accelerationism is simply the self-awareness of capitalism, which has scarcely begun.
Again, we see a statement that AI has somehow enmeshed itself with capitalism's ability to understand itself.
It is some way intelligent and can know itself.
And I don't know how else you interpret this, but as belief in a god built by atheists who like money a lot.
The argument continues that nothing matters more than extending the, quote, light of consciousness into the stars, a belief Elon Musk himself has championed.
AI is the force the market will use to do this.
And quote, this force cannot be stopped.
This is followed by wild claims that next generation life forms will be created inevitably by AI.
And then a few sentences down, you get the kicker.
Those who are first to usher in and control the hyperparameters of AI/slash techno capital have immense agency over the future of consciousness.
So AI is not just a god.
It's a god we can build and we can use it to shape our future, the future of our reality to our own whims.
And again, some of these guys will acknowledge maybe it'll kill all of us, but as long as it makes a technology that spreads to the stars, that's worth it because we've kept the light of consciousness alive.
Wow.
That's not, I don't think, the mainstream view, but you can definitely find people saying that shit.
And they'll be like, if you attempt to slow this process down, there are risks.
And they're saying the same thing, Andreessen is you stop it from doing all these wonderful things.
But also, I do kind of view that as a veiled threat, right?
Because if AI is the only way to spread the light of consciousness to the void and that is the only thing that matters, what do you do to the people who seek to stop you, right?
Who seek to stop AI?
I actually am fine with extending the light of consciousness into space.
I'm a big fan of Star Trek.
I just don't believe that the intelligent hyper-aware capitalism is the thing to do it.
Again, too much of a Star Trek guy for that.
When I look at the people who want to follow Mark Andreessen's vision, who find what these EAC people are saying is not just compelling but inspiring, I think of another passage from that New Yorker article by Zoe Heller.
Quote, not passive victims, they themselves sought to be controlled.
Haruki Murakami wrote of the members of OM Shinrikyo, the cult whose serenas attack on the Tokyo subway in 1995 killed 13 people.
In his book Underground, Murakami describes most OM members as having deposited all their precious personal holdings of selfhood in the spiritual bank of the cult's leader, Shoko Asahara.
Submitting to a higher authority to someone else's account of reality was, he claims, their aim.
Now, the EAC manifesto newsletter thing used the term techno-capital in conjunction with AI.
This is a word that you can find a few different definitions on because it's a wonky, like weird academia philosophy term.
And there's a number of folks who have, you know, will argue about how it ought to be described.
But this is broadly kind of the same thing that Andreessen is referring to when he talks about the market as this intelligent discovery organism, right?
And while there are a few different ways you'll see this defined, the EAC people and Andreessen himself are thinking about how philosopher Nick Land, who's the guy who's generally credited with like popularizing the term techno-capitalism, defines it.
Land is one of many advocates of the idea of a technological singularity, the point where technological growth driven by improvements in computing becomes irreversible.
The moment at which a super intelligent machine begins inventing more and more of itself and expanding tech in a way that humans can't.
As one of Land's fans summarized in a Medium post, a runaway reaction of self-improvement loops will almost instantaneously create a coherent super intelligent machine.
It is man's last invention.
The most notable of industries, AI, nanotechnology, femtotechnology, and genetic engineering will erupt with rapid advancements, quickly exceeding human intelligence.
Now, obviously, the way Land writes is, again, kind of worth reading, but dense, perhaps too dense for an entertainment podcast.
So I'm going to read again this is from a substat called Regress Studies by a writer named Santi Ruiz, kind of talking about this idea of techno-capitalism that Land has from a more critical standpoint.
Quote, Nick Land, who coined the term, is a misanthrope.
He doesn't like humans much.
So the idea that there could be an entity coming, already being born, drawing itself into existence by hyperstitionally preying on the dreams of humanity, cannibalizing their desires, wearing the invisible hand is an ideological skin.
He's into that.
Techno-economic interactivity crumbles social order in auto-sophisticating machine runway, as he would put it.
And that's good.
You're being colonized by an entity that doesn't care about you, except insofar as you make a good host.
We'll talk about hyperstition in a little bit here.
So Land is the guru of accelerationism.
You might not be surprised to learn that he has a devoted following among the far right.
This is because he is quite racist, anti-democratic, and obsessed with eugenics.
Now, his eugenics are not your grandpappy's eugenics.
For him, it involves gene editing, which will be available to greater extents than ever thanks to AI.
Land claims to dislike white nationalists and conventional racists because they don't see the whole picture.
Quote, and this is me quoting from one of Land's publications.
Racial identarianism envisages a conservation of comparative genetic isolation, generally determined by boundaries corresponding to conspicuous phenotypic variation.
It is race realist in that it admits to seeing what everyone does in fact see, which is to say consistent patterns of striking, correlated, multi-dimensional variety between human populations or subspecies.
Its unrealism lies in its projections.
That's pretty racist.
Land is listed by name in Andreessen's manifesto as someone you should read for a better understanding of the wonderful optimistic future he and his Ilkhaf planned for us.
He cites extensively Gregory Cochran, who posits that space travel spreading to the stars will solve our race problem because it's a natural filter.
Basically saying some races won't make it into space.
So we don't need to be violent.
Like we just have to spread to space and that will do our eugenics part of it for us.
So that's cool.
Yeah, you know, I'm stuck on this like, you know, journey to the stars through evolution thing because I don't know.
Robert, do you play Warhammer 40,000?
Oh, oh, God, iffy, iffy.
Of course I play.
I've been playing Warhammer 40K most of my life.
Okay, because this is sounding very adeptus mechanis.
Yeah, McGeek is right.
Yes, absolutely.
And I'm like, I'm like, what is going on here?
I'm deep and wrong trader.
And now I'm like, no, this is them.
What is fun is that like Warhammer 40,000, the deep fluff envisions a society that it's like a hybrid between the Federation and Star Trek and what these AI EAC people dream of, that it is this utopia for like 10,000 years because they develop thinking machines and then all of the thinking machines turn on them and murder everybody.
And so in the future, we just lobotomize people who commit crimes and turn them into computers for us because we can't have intelligent machines anymore.
So we're just, we're, we're going, we're, that's what it looks like we're marching towards with these folks.
Yeah.
And obviously the, the thing that the Warhammer people are are inspired by is like the book Larry and Jihad and Dune, which is the more artful version of that story with less orcs, which makes it inferior in my mind.
But I do love Dune.
So I know you need more red because the red makes everything faster.
Red makes it go faster.
Yeah.
So Land concludes by imagining both racists and anti-racists binding together in defense of the concept of race, right?
That's what the result of AI is going to be.
The racists need race.
You know, we're going to get so good at gene editing.
The racists will get angry and the anti-racists will get angry because they're so in love with the concept of race.
Well, we're just going to improve people, annihilate racial differences through moving to the stars and the natural filter that that implies.
By the way, the name of the article Land wrote all this in is called Hyper Racism.
So cool guy.
Glad Mark Andreessen cites him in his manifesto.
Glad the biggest venture capital guy in the country is like, yeah, read this dude.
Well, that's the sequel to Flume's Hyper Realism.
So that's, yeah.
It is interesting.
And these guys don't tend to cite it as much.
I think you get in some of the deeper stuff.
They're all talking about these techno-capitalist concepts that Nick Land plays with.
They don't talk about what I think is actually one of his most sort of insightful points, which is about a concept called hyperstition.
And in brief, hyperstition is like creating things in fiction that become real and the process by which that happens.
I think about that a lot when I think about things like the book Larry and Jihad, the war against the intelligent machines in Dune, or, you know, what happened in the Warhammer 40,000 universe.
But I also think about how part of why these people are targeting creators, writers, actors, musicians, artists, like pen and paper, you know, painting artists and stuff, is because the only way out of this future they have envisioned is imagining a better one and then making it real, right?
Like, and that is a thing that creatives have a role in doing.
So if you can kill that ability, hand it over to the machines that you control, maybe you can stop them from this path of resistance.
Motherfuckers.
Yeah, I know.
They're on.
They're on to us.
They're like, you want something better?
We're going to take it away from you.
Yeah.
Fuck you.
So anyway, I think that's going to end it for us in part one.
You know, this whole investigation in much more condensed form, just kind of really focusing specifically on the argument that there's cult dynamics to the fandom is being published in an article on Rolling Stone.
I'll probably edit in like the title or something here so you can find it.
But check that out.
That's kind of the more easily shareable version, more condensed.
Iffy, where should people check out you and your stuff?
Oh, man.
I'm Iffy Wadiway on Twitter and Instagram.
So definitely peep me there.
Listen to our relationship pod with Iffy and Emmy if you want to hear us talk about relationship stuff.
And yeah, yeah, Max Film for movies.
But if you go to Ifiwariway, you'll find all that stuff.
And of course, watch Dropout.
Something is about to be announced next week.
Yes, watch Dropout.
Something cool is coming soon.
And it's also an extremely human endeavor.
Yes.
Yes.
Just like this show is.
So go with, I don't know, whatever god you worship or the machine god you plan to meme into being goodbye behind the bastards is a production of coolzone media for more from coolzone media visit our website coolzone media.com or check us out on the iHeartRadio app, Apple Podcasts, or wherever you get your podcast.
When a group of women discover they've all dated the same prolific con artist, they take matters into their own hands.
I vowed I will be his last target.
He is not going to get away with this.
He's going to get what he deserves.
We always say, trust your girlfriends.
Listen to the girlfriends.
Trust me, babe.
On the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
Hey, it's Nora Jones, and my podcast, Playing Along, is back with more of my favorite musicians.
Check out my newest episode with Josh Groban.
You related to the Phantom at that point.
Yeah, I was definitely the Phantom in that.
That's so funny.
Share each day with me each night, each morning.
Listen to Nora Jones's Playing Along on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
What's up, everyone?
I'm Ego Mode of my next guest.
It's Will Farrell.
My dad gave me the best advice ever.
He goes, just give it a shot.
But if you ever reach a point where you're banging your head against the wall and it doesn't feel fun anymore, it's okay to quit.
If you saw it written down, it would not be an inspiration.
It would not be on a calendar of, you know, the cat just hang in there.
Yeah, it would not be.
Right, it wouldn't be that.
There's a lot in life.
Listen to Thanks Dad on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.