My current stance on AI is:
Fucking stop.
Find some other route to the glorious transhuman future.
There’s debate within the AI alignment community re whether the chance of AI killing literally everyone is more like 20% or 95%, but 20% means worse odds than Russian roulette.
Nate Soares ⏹️
2,106 posts
Trying to make AI not kill everyone
- back when I was young, I thought it was unrealistic for the Volunteer Fire Department to schism into a branch that fought fires and a branch that started them
- I wrote a book with Eliezer Yudkowsky. It’s about how smarter-than-human AI is on track to kill us all, written in hopes of bringing the conversation into the mainstream. Lots of people are alarmed; ~nobody wants to sound alarmist. The time is ripe. Preorders help. Link below.
- It's weird when someone says "this tech I'm making has a 25% chance of killing everyone" and doesn't add "the world would be better-off if everyone, including me, was stopped."
- It takes more cleverness to articulate a thought than to think it. If you're thinking at the limits of your abilities, you have thoughts you can't articulate.
- "our AIs that can't do long-term planning yet aren't making any long-term plans to subvert us! this must be becaues we're very good at alignment."
- The book I wrote with Eliezer Yudkowsky is now a New York Times Bestseller. I hope this is just the start of people around the world recognizing that the race to superintelligence is insanely reckless.
- Reminder: my reason for expecting AI to go poorly is, deep down, not about alignment being ultra-hard, but about Earth beeing a very derpy place.
- Whether or not criminals deserve due process is beside the point. The point is that due process is how the state determines whether or not someone is a criminal.
- Replying to @So8resRelatedly, one (among many) of my beefs w/ modern schools (& culture more generally) is how much it harps on the dark aspects of humanity, and how little it highlights the light. Humans are rad. Humanity is rad. Sometimes hapless, sometimes evil, but overall, fuck yeah.
- Americans: "I'll fucking do it, I'll cut my foot off" Canadians, revving chainsaw: "don't you dare. you think you're the only one who can cut their own foot off??"
- Replying to @Aella_Girlc'mon ladies, this is how we get kicked out of paradise
- Replying to @Grimezsz and @HumanHarlanpreorder link, for anyone who wants to grab a copy:



