Look, I think -- I hope -- that we can all agree that you can't make a computer get up and walk across the room by having it run a sim of a human body standing up and walking across the room.
And I think/hope we can all agree that programming alone will not make a computer play music or produce a printout or display photographs. To do these things, we need hardware that's designed and built to do them.
But when it comes to being conscious, some folks contend that this one behavior is an exception, that it can result purely from programming, and that running a perfect sim of a brain will result in the computer being conscious. (Nevermind that the folks doing just that don't believe any such thing.)
When asked why, the reason given is that consciousness is a behavior resulting from computation, which makes it different.
To make a suitably programmed computer play music, we have to connect it to (or include within the computer) a
d/a converter, amplifier, and speaker. We do
not have to include or attach a guitar or a symphony orchestra.
To make a suitably programmed computer display a photograph, we have to connect it to
an output buffer and a display screen. We do
not have to attach a cat, mother-in-law, or mountain range, to display photographs of those things.
To make a suitably programmed computer walk, we do have to attach legs. But we can define what properties and abilities those legs need to have. Mechanical linkages, actuators, and sensors (force and position, typically), and a motive power source are required. Reflexes, balance, and control knobs for pace and speed are not required, because the computer provides those functions. So robot legs can suffice; we do not have to attach a man or a horse.
To make a suitably programmed computer conscious, what do we have to add?
If the answer is "an entire biological brain," that is a lot like requiring a symphony orchestra to be attached to a computer for it to play Beethoven's Ninth, or a live horse for it to walk. Which doesn't mean it can't be the right answer (though it is obviously wrong with regard to playing music or walking), but then the question is why no portion at all of the brain's activity in producing consciousness can be performed instead by the computer. Why not?
If the answer is "something, but we don't know what," then the question is, if you don't know what, what justifies the conclusion that any such "something" exists?
If the answer is "some portion of a biological brain, but we don't know what portion," the same question: what justifies the conclusion that the necessary portion is nonempty?
In all of the above examples, and all others used in this thread (flying an airplane, controlling a power plant, playing chess, etc.) we can state very specifically what additional hardware must be attached to a suitably programmed computer in order to create the corresponding real-world behavior. What additional hardware is required for the real-world behavior of consciousness? If we cannot answer, then why not, and what justifies any constraints or assumptions we place on that non-answer?
The computationalists' answer is clear and specific: no additional hardware is needed (though a minimal amount, e.g. a keyboard or microphone and a text display or audio output, would be needed for us to perceive the conscious behavior). What are the alternative answers?
Respectfully,
Myriad