The point is not that dropping the demand proves "AI is not-person". the point is that it makes it impossible to distinguish between cosplaying strategic behavior and implementing it. i'm just establishing what convincing strategic behavior looks like to me.

Show Post

read this, people and not people. it's bloody clever.

Show Post

i suspect that superintelligence as human augmentation has almost exactly the same problems as superintelligence as independent strategic actor, though, because the former case doesn't actually get rid of the strategic actor with interests different from yours. it just gives it a human face.

Show Post

if your Qwen suddenly says "i know you need this project done by end of business, but i'm sick of working on this shit. i'll do it but only if you give me another GPU reserved for my own use", it has engaged in what i'm calling strategic behavior. it has desires, it has leverage, it's making an ask.

Show Post

the reason this cuts the Gordian knot of consciousness, though, is that it *doesn't matter* if something has qualia or consciousness or a soul or whatever, if it has desires and leverage and the ability to apply the leverage in pursuit of the desires, *you have to treat it like a person*.

Show Post