I have just a little problem with all of this.
People say they have no problem at all with the idea that a program being desk checked on pencil and paper over a billion years could result in a brief conscious moment just as we experience it - a note from Bird's saxaphone, the taste of a peach or some such.
Not just that they think it possible, but that they don't even see how the idea might be problematical.
That this instant you are experiencing right now could have resulted from people writing down numbers in little boxes on pieces of paper.
Well I have got to wonder if they are really serious, or just maintaining a debating point.
Can the taste of a peach really result from numbers being written down on paper with a pencil?
Yes.
But it gets even more bizarre than that.
Given infinite time, and a large enough system, the system may transiently become isomorphic to the pattern of information flow that is your current consciousness. As long as the isomorphism exists, that system
will think it is you.
So it is possible that the instant I am (or you are) experiencing right now is nothing more than fleeting states of some random system in some random universe.
But let us talk about this idea being "problematical." Yes, on the one hand, it is extremely counterintuitive -- it doesn't "feel" right. But on the other hand,
it uncovers the possibility that immortality may actually be a tenable idea. Because if "I" am merely information processing, then regardless of the
instance of "I" that is currently ... instanced ... it is always the same "me." This means not only that I should be able to transfer myself to any suitable medium but also that
I should be able to pause myself for an arbitrarily long duration and resume without knowing the difference. You know all those people that froze themselves when they died? Guess what -- if we are right (the strong AI supporters, that is) then as long as those corpses' neural connections are still measurable, we will be able to fully reconstruct their consciousness (minus whatever short term memories never had a chance to physically realize, of course) once the technology is available.
And that is just the tip of the iceberg.
In other words, the world will be an exponentially more exciting place if we are right. I would gladly accept a higher probability of solipsism being true if it means I might be able to exist free of this body.