Discussion about this post

User's avatar
skaladom's avatar

This is exactly the thought experiment that broke materialism for me. Imagine I'm walking down the street, I get zapped by a measuring ray, and either a simulation or a physical clone of my body gets built somewhere. It seems obvious that there is a fact of the matter, as to what my experience continues to be at that point, and whether it involves the new being or not. I agree with your assessment that the new being would just have its own separate thread of consciousness.

So I can understand that if the 'singularitarians' are materialists all the way down, they may bite the bullet on the above, and decide that there is no fact of the matter as to who you continue to be.

That does bring back memories... "consciousness doesn't necessarily transfer over to a simulation" has been a sci-fi trope for at least 30 years. Greg Egan explored all sorts of paradoxes in his Axiomatic, back in 1995.

Expand full comment
Benjamin Carlucci's avatar

My first feature film, fresh out of college, was a little sci-fi story about a guy developing this "digital brain" technology, with the goal being the ability to upload a sort of "save state" for a healthy brain. I really wish I'd possessed the serious interest in philosophy and theology back then that I have now...in writing that movie I didn't even bother to question the materialist presuppositions about whether or not a brain was a computer and wrote the whole film under the assumption you're describing in this article, that if a 1:1 technological replication could exist, the uploaded mind and the original mind would be the "same thing."

That being said, I feel like I accidentally made at least one statement about the matter that I still like, namely that the digital character who develops throughout the film uses a real person's "uploaded" emotions to develop her own, and as such, has a sort of identity crisis where she can't figure out where she ends and her human template begins, eventually resulting in her talking said human into switching places with her, and it is only once she is embodied that she can properly form her own identity. If I made the movie today, I think it would focus almost entirely on those questions of identity and consciousness, because that question, as you've excellently laid out here, is so much more interesting than the materialist assumptions so many of us have (especially the transhumanists you mentioned).

I think it's also (sorry just thinking out loud in your comments section now) telling that our current understanding of "AI" is almost entirely focused on LLMs, which as I know you've detailed elsewhere, don't actually "think" but certainly appear to. My suspicion is that any successful attempt to copy or upload one's consciousness would result in a ChatGPT version of you, not an actual, intentionally thinking copy, but a sort of algorithmic illusion of your identity, perhaps advanced enough to be convincing, but ultimately just another stochastic parrot. The irony, of course, is that in reducing our worldview to the materialist presupposition that mind and matter are interchangeable, we would be left with exactly the deficient materialist imitation of consciousness that materialism assumes is the whole picture. And I fear that is a very real possibility for our future: In seeking to make ourselves immortal, we will render ourselves ghosts.

Expand full comment
5 more comments...

No posts

Ready for more?