The point is the way people look at computers and computer programs. The object-oriented paradigm ... it's only a helpful fiction.
... The processor will look at some piece of data, and do something accordingly. The data won't do anything. ... The complexity of behaviour arises because the processor overwrites data ... and changes its behaviour according to what data it reads.
... If someone believes that a person might exist in a simulation - then what is their condition when the processor is executing another bit of code? Are they self-aware then - or just when they are being accessed?
So much of the discussion of the "world of the computer" relies on metaphor and illusion, which is treated as if it were objectively real.
OK, I see what you mean. I agree with the sentiment behind all of that - but I also see the same kind of thing in the human brain.
Patterns of electro-chemical pulses come in from the senses and trigger other patterns of electro-chemical activation around the brain. Some of pathways these patterns follow are reinforced more than others, these tend to be activated by similar patterns, some patterns suppress the activity on other pathways, some feedback on themselves, and so-on.
To echo your description above:
the incoming pulse patterns tend to activate the 'stronger' pathways, but the 'strength' of the connections that make up these pathways doesn't do anything until the pulses cascade down them. The complexity of behaviour arises because of the complexity of the architecture and the relationships between these pattern pathways; the strength of the connections tends to fade unless reinforced, new pathways can form when novel patterns are introduced, pathways indirectly feed back on themselves, reinforcing or suppressing, reinforcement may occur through repeated activity or a 'fixing' hormonal wash, or a flood of signals, and so-on.
If someone believes a person might exist in a brain, then what is their condition when a neuron is 'firing' in response to a pattern of pulses? Are they self-aware then or just when a pattern of activity is flowing through one branching pathway or another?
So much of the discussion of the "world of the mind" relies on metaphor and illusion, which is treated as if it were objectively real.
In either case, when you look at the elements that make up the system, you can neither see nor predict the activity of the whole system; the truly interesting behaviours are not the activities of the elements but the higher level abstractions of those activities.
A system that is the result of at least a
hundred million years of development and refinement by trial and error has, in a few
tens of years, developed remarkable machines - that already outperform many of its capabilities.
We are only just starting to tackle machine intelligence and we already have IBM's Watson - which can answer questions better than the world champions - questions thought to be the sole province of the highest intelligence and consciousness, without having either - it wasn't designed to have either. Nobody really thought it would beat world champions after only a few years development, and it couldn't have been made ten (maybe even five) years earlier because the technology just wasn't available. Machines like it are going to change our lives. It seems to me that if the same effort is put into developing some form of recognisable consciousness, the technology will soon become available, and it will happen. Whether a serious effort will be made, who knows.
People can make mocking reference to science-fiction, but I've lived it; given the choice between a Startrek communicator and my smartphone, I know which one I'd choose. Most of the everyday technology we have now was science-fiction (or not even dreamt of) when I was at school.