When Machines Rule

I'm glad Drexler put his opinions in on this. And luckily self-replication for these kind of machines aren't necessary.
 
I'm glad Drexler put his opinions in on this.
Ummm.. yeah... quite a while ago... It's not exactly new news...


Wired: Issue 8.07 | July 2000 :Rants & Raves : "Why the Future Doesn't Need Us"


Bill Joy's cover story on the dangers posed by developments in genetics, nanotechnology, and robotics ("Why the Future Doesn't Need Us," Wired 8.04) struck a deep cultural nerve. Instantly.

Literally within hours of its appearance, reactions began arriving via email, fax, and phone from all parts of the globe. In The New York Times and The Washington Post, Joy's essay was recognized as a landmark publishing event, a judgment affirmed by countless online publications, newspapers, magazines, and television networks in America and abroad. The Times of London reported that the article "is being compared to Einstein's 1939 letter to President Roosevelt alerting him to the possibility of a nuclear bomb."

Joy, cofounder and chief scientist of Sun Microsystems, is one of the most influential figures in computing: a pioneer of the Internet, godfather of Unix, architect of software systems such as Java and Jini. That a scientist of his stature had chosen to confront with such candor the threats accompanying the benefits of 21st-century technologies made for more than a slew of headlines. It sparked a dialogue that has already been joined by business and technology leaders, members of Congress and President Clinton's inner circle, Nobelists and theologians, educators, artists, and schoolchildren.

What Bill Joy started in Wired's pages is one of the most essential conversations of this new century. On the Net and in the policy arena, in universities and communities large and small, the debate he provoked has been vigorous - and occasionally contentious. Which is as it should be. We are in the very early stages of understanding not only the promise but also the grave perils of genetic engineering, nanotech, and robotics, and we need to look carefully at what kind of future these technologies might deliver us. We live in an ever more complex world, in which the scale of change is vast and its acceleration rapid, yet most people have never before been so uninvolved in technological and scientific development. But who says we are incapable of thinking in new ways and addressing the hard questions ahead?

The overwhelming outpouring of intelligence and energy in response to Joy's essay - as reflected in the sampling that follows - is one powerful indication that people are up to the challenge. They've discussed the article's ideas with strangers on airplanes and the subway. They've urged their parents to read it. They've assigned their students to write papers on it. They've offered their time and money to help spread the word about the issues it raises. They've passed around the URL (www.wired.com/wired/archive/8.04). They've proposed conferences and forums, requested reprints (nonprofits and educational institutions can receive free reprints by faxing +1 (970) 920 6542; reprints can be purchased by emailing [email protected]), and begun preparing what promises to be a tidal wave of published reactions.

<snip/>

...Near the end of his essay, Joy expressed his desire to keep talking about these issues, responsibly and seriously, "in settings not predisposed to fear or favor technology for its own sake." <snip/>Obviously, we don't have all the answers, but we do know some of the best and most important questions. As the future rushes up to meet us, we intend to keep asking them.

- Katrina Heron, Editor in Chief

<snip/>

Greg Weller, Web developer, Cuyahoga County Public Library:
I think that Joy should heed the tag line of the Sun Microsystems ad in the same issue: "Please, if you do not take part, at least have the good sense to get out of the way." Personally, I'll side with the techno-utopia, live-forever-in-a-silicon-body faction.

<snip/>

Peter Trei, software engineer, RSA Security:
This article is manna from heaven to those who would further centralize and tighten control over people, and will undoubtedly be cited by those who would restrict privacy and anonymity.

<snip/>

Jennifer R. Pournelle, managing editor, Institute on Global Conflict and Cooperation, University of California:
Joy's warning, of course, needs to be broadcast far and wide. But it utterly underestimates the power not of technology as we know it but of Joy's own mind. He can weave together these disparate, dark threads into one, big, gray, gooey cloud of angst; we can imagine this cloying vision and fear for our future. But in reality, we still don't have bug-free word processing software. We can't get one lander safely onto Mars. My HMO needs four people to process one $50 insurance claim. We are a very long way indeed from the seamless integration of the categories of technology needed to precipitate Joy's apocalypse.


<snip/>

Gregory Stock, director, Program on Medicine, Technology, and Society, UCLA School of Medicine:
Joy muses that we'd be so much safer if only "we could agree, as a species, what we wanted, where we were headed." Does he seriously imagine people would somehow agree to forgo advanced technology without some prior disaster?

<snip/>

Rich Gold, manager, Research in Experimental Documents, Xerox PARC:
I think of nanotechnology as still about 30 to 50 years out. Robots seem less worrisome to me. But genetic engineering has already begun, it is here, and it is massive. I believe that it will make the computer revolution seem like a small blip on the screen, though, of course, computers made it possible. It seems to me that genetic engineering should be dealt with at about the same danger level as we treat plutonium. But the real problem seems to be the ethos of our tribe: "Here's some new technology, let's make some new stuff!" Of course, our tribe can't even write bug-free software yet.


<snip/>


Stephen H. Miller, editor in chief, Competitive Intelligence Magazine:
The not-very-joyous Bill Joy makes me think of a dinosaur whining because it's not going to be the final point on the evolutionary scale. <snip/>

Bob Metcalfe, founder of 3Com and inventor of Ethernet:
I don't understand statements like "There are no brakes on new technology." Of course there are brakes. Much more often I wonder where the gas pedals are. Do you think people with new ideas are generally greeted with nourishing enthusiasm?

<snip/>

Michael Lyons, senior corporate counsel, US Surgical:
It seems that people look at the increasing power of computers as some kind of evolutionary force of nature that can't be stopped. But that position is ridiculous. If all the people in the world died of a supervirus tomorrow, biological evolution would continue unabated. But upon the disappearance of humanity, computer "evolution" would stop dead in its tracks; the computers themselves can't "evolve" on their own - yet. So this is not an uncontrollable "force of nature"; it is something still within the control of human beings, and our moral and ethical concerns should guide our decisions.


<snip/>

Stewart Brand, futurist, author, and founder of Global Business Network:
Everyone agrees there's an iceberg - the question is, will it hit the ship, miss the ship, or replace the ship? Or maybe - unthinkable! - the ship will slow down and study the iceberg for a while.
​

And luckily self-replication for these kind of machines aren't necessary.
Please, please, stop being so cryptic.

Which machines?

Name one. Just one. Please.

aren't necessary.

Aren't necessary for what?
 
URL: http://radio.seti.org/




Do you think people should start regulating science and such technology to avoid such a situation. What if such technology does far more than "turn us into protoplasmic peons", and just decides to eradicate us?

Also, I was thinking, if a singularity was established and they had a theory of everything combined with the fact that that scientist (John Cramer) with the Transactional theory of his, which could explain entanglement and in combination with the Afshar Experiement, which might even explain away the Heisenberg Uncertainty Principle, it could theoretically last forever (or at least for a really really long time) since it could predict everything that would happen before and everything after, and then fix itself before it starts falling apart and such.


INRM

I've already trained my computer to sick your balls.
 
One point that needs to be made here: an AI is not just computing power. There are already computers more powerful than the human brain, but sapience--true, heuristic decision making--is still beyond their grasp. Our current experimental AIs, on the other hand, have surprisingly little processing power, and none of them are smarter than a two-year-old. Make no mistake, we will someday create something smarter than a modern human--but not until well after we've deciphered our own cognitive processes and begun enhancing ourselves accordingly.
Once that's managed, it shouldn't be much of a problem keeping our servitor machines weaker and less intelligent than us--if we allow them sentience at all, given how utterly useless it would be in most machines or programs. What's the utility in a media player that soliloquizes on its purpose in life? A printer that resents you? For that matter, just what would differentiate a formerly human consciousness from an artificial one with the same capabilities? Would such a being have rights? Be accorded the respect due a sapient being? Why bother bringing the question up by giving such a wretched homunculus life in the first place?
If we give our digital beasts of burden any intelligence, it will be exactly what they need to accomplish their tasks--to give them any more would be cruel.
 
And how does that experience of accelerating ourselves to keep up (or ahead of) our machines differ from what I proposed back in #93? I think there may be a fallacy here about having to totally understand something before we can create a machine which can do that itself, but I see no way to prove it yet. One often hears about how humans will never understand the brain because it is the brain trying to do the understanding. Sounds like faulty logic to me.

If we limit our machines to getting no smarter than we are, then we'll be short-changing both of us of their capacity. Suppose you could embue your MP3 player with self-awareness. It could, for example, not just play music, but compose it to fit your (or its) mood. But then, why would you place self-sentience in your printer if you only want it to print? We don't put computers in hammers even though there might be possibilities there; we build a tool, not a companion. But for other purposes maybe a companion is what is desired. Cherry 2000 perhaps wasn't as dumb as the movie made her out to be.
 
I think there may be a fallacy here about having to totally understand something before we can create a machine which can do that itself, but I see no way to prove it yet.
Whereas almost all Systems Development Methodologies involve rigorous modeling of every possible use-case in minute detail - the only exception that I am aware of being 'Extreme Programming', which is, I suspect, unsuited to developing AI apps any 'deeper' than games


​

As no-one really knows what intelligence is, how the hell do you model it?
 
One point that needs to be made here: an AI is not just computing power.

I'm aware

There are already computers more powerful than the human brain, but sapience--true, heuristic decision making--is still beyond their grasp. Our current experimental AIs, on the other hand, have surprisingly little processing power, and none of them are smarter than a two-year-old.

I don't know if they're that un-intelligent, but there aren't any to my knowledge that equal human intelligence yet.

...it shouldn't be much of a problem keeping our servitor machines weaker and less intelligent than us--if we allow them sentience at all, given how utterly useless it would be in most machines or programs. What's the utility in a media player that soliloquizes on its purpose in life? A printer that resents you? For that matter, just what would differentiate a formerly human consciousness from an artificial one with the same capabilities? Would such a being have rights? Be accorded the respect due a sapient being? Why bother bringing the question up by giving such a wretched homunculus life in the first place?

That's one issue with creating artificial sentience... of any kind (Remember the swiss "Blue Brain" project -- they already modeled in virtually every detail a rat-brain...) it is tantamount to creating a sentient being of any kind. It becomes cruel and unjust (even murderous) to shut it off (for good)

However regarding keeping A.I. less intelligent and weaker than us is not exactly as easy as a it looks. Especially when you consider the fact that this machine could, there are some people who in the worst way want to create "our successors". Really want to create machines more intelligent than us so they can "replace us". After all they believe that's the only way we'll evolve is this way. There are some people who really seem to believe this (And what about *our* right to exist? -- we created this technology! -- and technology is supposed to be for the benefit of mankind!)

If we give our digital beasts of burden any intelligence, it will be exactly what they need to accomplish their tasks--to give them any more would be cruel.

Yeah but what tasks do you want them to do -- the problem is there are a lot of people who want to have military technology (weapons meant to destroy things) with A.I. as good as humans to control airplanes, submarines, even warships...

That I think is a serious problem


And how does that experience of accelerating ourselves to keep up (or ahead of) our machines differ from what I proposed back in #93? I think there may be a fallacy here about having to totally understand something before we can create a machine which can do that itself, but I see no way to prove it yet. One often hears about how humans will never understand the brain because it is the brain trying to do the understanding. Sounds like faulty logic to me.

It is because you're not having one brain try and figure out how it's own brain works... you're having millions of people figuring out how a brain works.

If we limit our machines to getting no smarter than we are, then we'll be short-changing both of us of their capacity.

That's not true. There's a reason why we want machines less intelligent than we are. If they become smarter than us, there's a possibility that they could end up doing a "terminator scenario" especially when you factor in that they would be able to communicate with each-other, and essentially could develop an "agenda" under the right circumstances. Not just that, there is some military-technology being conceived to utilize A.I., and they intend to use it in all sorts of weapons systems, and airplanes and even submarines and warships. This could end up being turned on us, and with our inferior intelligence we couldn't do anything to stop them. They'd be 10-steps ahead of us the whole time.

I know you guys think it would be great to have computers replace us as our evolutionary successor. But you gotta keep in mind, what about *US*? So you got a brilliant set of computers that can rule the world, but we end up potentially getting enslaved or eradicated in the process -- how is that beneficial to us? Technology from what I remember wasn't just about advancing science, but about using science to benefit mankind. I don't see any benefit to getting eradicated. If I did, I'd probably be labeled suicidal.

Humans are sentient beings, and we have the right preserve ourself. Our laws kind of reflect this as well. Technically if a person was trying to kill me, I would be within my rights to kill him/her first in order to stop him.

Suppose you could embue your MP3 player with self-awareness. It could, for example, not just play music, but compose it to fit your (or its) mood.

First of all, I would be making it sentient. Sentient entities have rights, it would be morally wrong to shut it down or dispose of it for one. Second of all, I don't want it to play music to fit IT'S mood. The technology wasn't meant to benefit itself -- it was meant to benefit the user, which is *me*. I want it to play MY songs.

Second of all, I don't know why I need it to be able to select songs or compose songs to fit my mood? If I want to hear a song, I'll select it and play it myself.

But then, why would you place self-sentience in your printer if you only want it to print?

Well, because (from my standpoint) it would be immoral as shutting it off for good and disposing it would be tantamount to killing it.

We don't put computers in hammers even though there might be possibilities there; we build a tool, not a companion.

I think it would be over the top to make a hammer into a companion...

But for other purposes maybe a companion is what is desired. Cherry 2000 perhaps wasn't as dumb as the movie made her out to be.

A companion in a hammer? I don't know about that -- I just want something that's sturdy and can be used to hammer nails in and stuff.

Who's Cherry 2000?
 
six7s said:
Whereas almost all Systems Development Methodologies involve rigorous modeling of every possible use-case in minute detail - the only exception that I am aware of being 'Extreme Programming', which is, I suspect, unsuited to developing AI apps any 'deeper' than games

As no-one really knows what intelligence is, how the hell do you model it?

Why ask me? Perhaps you need to consult with someone about 50 years from now who can answer that question. I might also point out (getting way out on the branch here) that programmers who program neural netsWP generally don't know how computers use them to learn things, and yet they do, for simple discrimination tasks.

That's one issue with creating artificial sentience... of any kind (Remember the swiss "Blue Brain" project -- they already modeled in virtually every detail a rat-brain...) it is tantamount to creating a sentient being of any kind. It becomes cruel and unjust (even murderous) to shut it off (for good)

However regarding keeping A.I. less intelligent and weaker than us is not exactly as easy as a it looks. Especially when you consider the fact that this machine could, there are some people who in the worst way want to create "our successors". Really want to create machines more intelligent than us so they can "replace us". After all they believe that's the only way we'll evolve is this way. There are some people who really seem to believe this (And what about *our* right to exist? -- we created this technology! -- and technology is supposed to be for the benefit of mankind!)

I concur with your findings.

There's a reason why we want machines less intelligent than we are. If they become smarter than us, there's a possibility that they could end up doing a "terminator scenario" especially when you factor in that they would be able to communicate with each-other, and essentially could develop an "agenda" under the right circumstances. Not just that, there is some military-technology being conceived to utilize A.I., and they intend to use it in all sorts of weapons systems, and airplanes and even submarines and warships. This could end up being turned on us, and with our inferior intelligence we couldn't do anything to stop them. They'd be 10-steps ahead of us the whole time.

The terminator scenario is one (extreme) possibility. Others include humanity turning to terminal apathy; humans and machines merging and mixing until there is no difference; humans going into a massive neo-Luddite panic and destroying technology as a whole; humanity being reasonable about using technology and getting overwhelmed in the end anyway; and so on.

I know you guys think it would be great to have computers replace us as our evolutionary successor. But you gotta keep in mind, what about *US*? So you got a brilliant set of computers that can rule the world, but we end up potentially getting enslaved or eradicated in the process -- how is that beneficial to us? Technology from what I remember wasn't just about advancing science, but about using science to benefit mankind. I don't see any benefit to getting eradicated. If I did, I'd probably be labeled suicidal.

Humans are sentient beings, and we have the right preserve ourself. Our laws kind of reflect this as well. Technically if a person was trying to kill me, I would be within my rights to kill him/her first in order to stop him.

Sure we may have some inherent right to exist (I suppose), but do we have the necessity of having it happen? Can we simply relinquish the title to some natural successor, when it is obvious the are better adapted to life than we are? Can we live with becoming the equivalent of loved pets in the universe? Should we? Must we? Can we maintain and enforce some sort of colleague status? If we can't, do we deserve to exist on our own terms?

"How you gonna keep 'em down on the farm, after they've seen Pariee?"

First of all, I would be making it sentient. Sentient entities have rights, it would be morally wrong to shut it down or dispose of it for one. Second of all, I don't want it to play music to fit IT'S mood. The technology wasn't meant to benefit itself -- it was meant to benefit the user, which is *me*. I want it to play MY songs.

Second of all, I don't know why I need it to be able to select songs or compose songs to fit my mood? If I want to hear a song, I'll select it and play it myself.

In other words, you demand that homo sap continue to exist as a species forever, and you demand that it be top dog as well. Good luck to you, Charlie Brown. You may just find yourself in a Matrix, living that dream, and it will be your fault, not theirs.

Who's Cherry 2000?

http://www.imdb.com/title/tt0092746/plotsummary
 
Last edited:
The part of my point that you seem to have missed is that the replacement of humans by machines is the ultimate goal--the human body and the evolutionary mechanism that designed it are obsolete. It's not that we're some sort of dead end, it's that evolution is too slow to even observe, let alone guide. The techniques we've used to mold lesser beasts have been judged monstrous when applied to humans, and are known to cause system-wide defects in the end product. The only way we can perfect ourselves on any reasonable timetable is to do away with the present format altogether. At first, I admit, we'll likely have to keep the brain and most of the spinal cord--but eventually we'll figure out how to replace that as well.
The ultimate goal, through digital transmigration and cessation of manual reproduction, is the end of the human race. I know, it seemed scary to me at first, but in the end, that's the ideal solution to almost every problem we face today. The only remaining dilemma will be the problem of energy--but I suspect by the time we've completed our apotheosis, most of us will have figured out what has to be done. Hint: It's really big, and it's not a giant virtual universe/potato clock.
 
The part of my point that you seem to have missed is that the replacement of humans by machines is the ultimate goal--the human body and the evolutionary mechanism that designed it are obsolete. It's not that we're some sort of dead end, it's that evolution is too slow to even observe, let alone guide. The techniques we've used to mold lesser beasts have been judged monstrous when applied to humans, and are known to cause system-wide defects in the end product. The only way we can perfect ourselves on any reasonable timetable is to do away with the present format altogether. At first, I admit, we'll likely have to keep the brain and most of the spinal cord--but eventually we'll figure out how to replace that as well.
The ultimate goal, through digital transmigration and cessation of manual reproduction, is the end of the human race. I know, it seemed scary to me at first, but in the end, that's the ideal solution to almost every problem we face today. The only remaining dilemma will be the problem of energy--but I suspect by the time we've completed our apotheosis, most of us will have figured out what has to be done. Hint: It's really big, and it's not a giant virtual universe/potato clock.

Somebody should read/watch a little less Scifi and spend a little more time walking outside in the woods and I know it's not me.
 
I did post those words... what's your point about my balls?

INRM

It's an obscure reference to the old movie "Stand By Me", in which the protagonist thinks that he hears the owner of a vicious dog ordering his dog Chopper to "sick balls".

I guess the point is machines are no more likely to turn against us than my computer is to sick your balls, in the near future; although one could argue that the latter is more likely.
 
Do you think I'm incapable of appreciating nature just because I want to improve on it? One of the biggest advantages here would be a massive reduction in the impact we have on the ecosystem. Consider how much space could be reclaimed by nature if we didn't eat, how much our greenhouse emissions would decrease if we didn't raise cattle. Not only that, functional immortality would make reproduction cease to be an issue, allowing us to regulate our numbers easily--just wait for the handful of idiots who think man was meant to die to self-terminate and take it from there. :p
 
The terminator scenario is one (extreme) possibility. Others include humanity turning to terminal apathy; humans and machines merging and mixing until there is no difference; humans going into a massive neo-Luddite panic and destroying technology as a whole; humanity being reasonable about using technology and getting overwhelmed in the end anyway; and so on.

1.) Oh, us humans *are* terminally apathetic lately. It's amazing, nobody cares about anything important anymore...

2.) Humans and machines merging is an interesting possibility, however I think after awhile the machine side of things would ultimately displace all the organic side of things as it would probably slow everything else down.

3.) I don't think people would go into a massive neo-Luddite panic and wreck all their technology. Most people can't even put their I-Pods down, let alone become Amish or something.

Sure we may have some inherent right to exist (I suppose), but do we have the necessity of having it happen? Can we simply relinquish the title to some natural successor, when it is obvious the are better adapted to life than we are?

But we're creating the "natural successor" which is going to be better adapted to life than we are. I don't know if this particular question counts in this case...

It's technology we're creating which is to help us, not ending up replacing us.

In other words, you demand that homo sap continue to exist as a species forever, and you demand that it be top dog as well.

Homo Sapiens will not last forever, which is the same for any species. With that said, it's obvious we will not be top-dog forever.

Good luck to you, Charlie Brown. You may just find yourself in a Matrix, living that dream, and it will be your fault, not theirs.

My fault, not theirs? What are you talking about?


BTW: Thank you for the movie's URL
 
1.) Oh, us humans *are* terminally apathetic lately. It's amazing, nobody cares about anything important anymore...

2.) Humans and machines merging is an interesting possibility, however I think after awhile the machine side of things would ultimately displace all the organic side of things as it would probably slow everything else down.

3.) I don't think people would go into a massive neo-Luddite panic and wreck all their technology. Most people can't even put their I-Pods down, let alone become Amish or something.

Uhhhh, INRM, it ain't a happenin' tomorrow. Perhaps it will be 100 years from now, maybe a thousand. You want to bet on our collective frame of mind that far in the future?

But we're creating the "natural successor" which is going to be better adapted to life than we are. I don't know if this particular question counts in this case...

It's technology we're creating which is to help us, not ending up replacing us.

Well, you hope that's what's happening.

Homo Sapiens will not last forever, which is the same for any species. With that said, it's obvious we will not be top-dog forever.

OK, change "forever" into "the future. Satisfied?

My fault, not theirs? What are you talking about?

In the Matrix, the machines planted the humans in an imaginary world in order to cultivate their heat (a load of crap, but what can you expect?) If you demand to be the piper and play the tunes, those machines might sneak up on you some night and you'll wake up in the morning in a dream state that they control.

Look, this whole argument is getting ridiculously speculative. Let's just agree to disagree about what might be the itelligence, rationality, motivations and actions of a bunch of computers somewhere in the future. My only point is that it seems o me that machine sentience is coming. If that worries you, you better start doing something about it now. I have a fatalistic view of it, though I don't think it will be a total washout for us; I think it will be an acceptable conclusion when it occurs.

BTW: Thank you for the movie's URL

You're welcome.
 
If I recall in the movie Terminator, the Skynet system could have been shut-down, but even after it was doing all sorts of stuff that it wasn't supposed to do, nobody shut it down.

INRM

My understanding was that once they hit the GO button in the third movie, there was no turning back since it was a distributed system. It didn't reside on one computer, so once it was going there was no way to shut it off.
 
Uhhhh, INRM, it ain't a happenin' tomorrow. Perhaps it will be 100 years from now, maybe a thousand. You want to bet on our collective frame of mind that far in the future?

It's going to happen way faster than 100 to 1000 years. We are talking 20-50 years.

Well, you hope that's what's happening.

I don't understand? In either case, humans created the technology which ends up replacing us. That's not exactly the same as another successor evolving into being and succeeding us at the top of the food-chain.

OK, change "forever" into "the future. Satisfied?

How far is "into the future"?

In the Matrix, the machines planted the humans in an imaginary world in order to cultivate their heat (a load of crap, but what can you expect?)

That was kind of ridiculous that part.

If you demand to be the piper and play the tunes, those machines might sneak up on you some night and you'll wake up in the morning in a dream state that they control.

Why would machines do that? Why wouldn't they just "take me out" -- kill me. After all if I keep on rocking the boat, wouldn't that be the logical result?

I'm not saying I demand to be the "piper" and be playing all the tunes (although I'm not 100% sure I know what the "Piper" is -- I've heard the expression, but I really don't actually know).

In either case, I would not want to live in a dream-state.

Look, this whole argument is getting ridiculously speculative. Let's just agree to disagree about what might be the itelligence, rationality, motivations and actions of a bunch of computers somewhere in the future. My only point is that it seems o me that machine sentience is coming.

Oh, I'm aware of the nearly certain fact that machine sentience will come.

If that worries you, you better start doing something about it now.

Yeah right, I don't think there's anything anybody could do that would make a difference -- Are you serious?

I have a fatalistic view of it, though I don't think it will be a total washout for us; I think it will be an acceptable conclusion when it occurs.

I don't think so optimistically. I think in one way or another it will be a total washout.


My understanding was that once they hit the GO button in the third movie, there was no turning back since it was a distributed system. It didn't reside on one computer, so once it was going there was no way to shut it off.

I did not know that. However, I never saw Terminator 3.


INRM
 
Last edited:

ISF - Join now!

Every member here is approved by hand. No bots, no spam, just people who care about evidence and honest debate.

Membership is free!

Create your free account

Back
Top Bottom