Yoon is pointing to this breakthrough as solving alignment because it's significant enough for that to be plausible and it gives the cult an escape hatch from their failed prediction that alignment would be hard. Now they can say "alignment was hard, but we did it! It's a miracle!"

Show Post

Okay, so now we bring it back around: Why does Yoon think that this breakthrough is significant even for Yud, and why is Yud so megalomaniacal about contradicting him? Because Yoon is proposing it as an off-ramp for experts who joined Yud's cult in the 10s when its predictions seemed reasonable.

Show Post

His writings on genetic algo AI were compelling to some experts in the field, and a lot of more-or-less reasonable people joined his cult without realizing it was a cult and spent a lot of time insisting it wasn't a cult.

Show Post

Long thread, I promise this is going somewhere. Yudkowsky, the guy who blogged through the 10s about how cool it would be if there were science cults, started a cult that believes that MIRI is the only organization that can save the world from an evil AI god.

Show Post

Every time I get electro I'm like surely it won't hurt as much as last time 😩

Show Post