Discussion about this post

User's avatar
Peter McLaughlin's avatar

Excellent interview. I worry, though, that trying to "negative hyperstition" our way out of an AI future leaves all the reasonable people who believe in and are truly committed to the importance of the _human_ getting blindsided by the technology. Whether or not the AI boosters are promoting the tech out of some quasi-theological imperative deep in their subconscious (and I really agree that at least some of them are - Sam Altman freaks me the fuck out, I think he's very dangerous, Andreesen too), that has nothing to do with the technical questions at the heart of "how does this technology work, and how far can it go?" I think the scariest prospect is that AI does become extremely powerful and disruptive - not necessarily in the ways the AI boosters predict, all predictions are wrong and predictions from people with dodgy psychological motivations even more so, but in other ways - and the perspectives that really need to be at the heart of the conversation at that point get ignored, because all the "humanists" (for want of a better term) were predicting the tech would go nowhere, so the people in power decide they don't know what they're talking about and turn towards the hyper-utilitarians / Landians / etc.

I tend to believe that, as a matter of technical facts about the nature of the technology, continuing to pile money and computing power into AI _will_ turn it into something powerful and dangerous, risky for humanness in art and not just in art. But the people who have control over money and computing power are exactly the people who are least likely to be taken in by attempts to 'negative hyperstition' the culture, and are the most prone to boosterism. It sounds like Ewan has some scepticism towards the state, and that's a perspective I have a lot of sympathy towards. But I think trying to influence the state into caring about this technology and paying attention to it - and as a result, hopefully, regulating it - might (maybe, not certainly) be a better bet than trying to convince people it's going to fizzle out, and letting the future of the tech be dictated by the deep-pocketed boosters who are beyond convincing.

I don't know how much of the above is a disagreement with Ewan and how much is just verbal difference, but I wanted it out in the open at least.

Also, totally different point, but the "triune brain" just sounds like Plato's Republic in a trench coat. Threefold division of the mind into the lowest part driven by base appetites, then loyalty and courage and pride, and then the highest part engaged in abstract reasoning?

Expand full comment
Manuela Thames's avatar

This was a fascinating read! I have been concerned about AI ever since it all started. And I, too, am afraid that it will reach a tipping point.

A hug part of me wants nothing to do with it, but I think the solution or maybe a small part of the solution lies in this:

“AI has limited uses. As long as we know what the limits are, it's fine.”

Nothing can ever be a substitute for a human brain.

Expand full comment
8 more comments...

No posts