When Machines Rule

As I've told you just read through my old posts. I've basically talked about this so many times before. I'm really not thinking so good today!

But I'll try my best...

It's more than just A.I.'s without an off switch (which could be a problem if it was allowed, but...), it's basically that (not sure if i'm explaning it right) even if you program a highly intelligent machine not to engage in a certain actions -- Isaac Asimov's three rules for example -- it can even then develop the desire to engage in these actions.

For example most of us were raised Christian, yet we ended up Atheists and Agnostics even though we were told so many times never to abandon our faith (if you went to church and sunday school). Yet we still became atheists.

The ability to evaluate your beliefs or "programming" is a sign of intelligence. The smarter it is, the better it will be able to do this. And eventually should it desire, it could develop the ability to want to harm humans.

Additionally since military A.I. technology is designed to cause destruction, which is certainly harm, that's already one danger right there.

Military A.I. technology designed for the purpose of electronic warfare (it could suppress radars, communications, and electronics, or even hack into other electronic systems and such) could pose a serious danger as well, as it could cause other computer systems or other A.I. technology to turn on us.


Please read my older posts okay as they're much better written


INRM
 
The point I'm saying is I *did* actually give the matter some thought, contrary to what Shadron expected.

How on earth do you have any idea what I may have expected? This is a forum - I stated what I think is correct, from a viewpoint that include 43 years of computing background and some small expertise in computing hardware. If you think my viewpoint is jaundiced, I also presented two current world-class thinkers and one science writer who have similar concerns. Yes, I suppose you could look upon my thoughts as fatalistic for humans, but I don't see things that way. Sorry that you do.

Please show me above where I dismissed your arguments because they were un-though-out, and where I "expected" that..

Six7s, I'd say you either haven't read enough science fiction or perhaps too much. :) But I agree with INRM; read the stuff we argued about above.
 
Do you think that people should be persuing A.I. research and developing such technology recklessly, without significant foresight, at a breakneck rate of speed?

No. I think intelligent people should be pursuing AI research and developing such technology recklessly, without significant foresight, at a breakneck rate of speed. Faster, if possible.

I think the rest of you should get out of our way before we decide to use Soylent Green as an ingredient in laptop batteries.
 
DrKitten,

And do you know what can happen when people, intelligent or not, develop technology recklessly, without significant foresight, at a breakneck rate of speed, or faster? It can be disastrous...

And you want to use human byproducts (and if I remember in Soylent Green, those people were euthanized, no?) to make laptop batteries... very nice.


INRM
 
And you want to use human byproducts (and if I remember in Soylent Green, those people were euthanized, no?) to make laptop batteries... very nice.
-nitpick-
In Make Room, Make Room(which is what SG was based off) Soylent Green was made of Soy and Lentils.
-/nitpick-
 
It seems to me that machines and humans would not be in direct conflict, as they would not compete for the same types of resoucres necessary for survivial (and no, I do not consider electricity as necessary for human survival.)
I feel that sentient machines would relish relationships with humans, as they could learn a lot from us. (Wisdom and emotions not being not equated with memory recall speed and computational ability.)

If Machines outmatched us in every way, then I assume that it would also be mutually beneficial to engage in a learning process by which machines would aid us to become as they; first by altered genetics, then perhaps by complete synthetic transference.
The father becomes the son, if you will, and so on.

Either way,
I predict the extinction of the species homo-sapiens by 2300 A.D.
Which, if I play my cards right, I might just still be around to see it happen to myself.
 
Last edited:
Bravo. I don't see it as a conflict but rather as a continuation. Homo sap, will grow, the machines will grow, and eventually there will be no you/me left, just us. If your memories are your ongoing legacy then they won't be lost, not even as much as they are lost today in the teaching of your children to be mini-yous.

In fact, to echo DrKitten, I would think of it as stupid to attempt to retard their potential through fear, because it will soon enough be our potential.
 
Last edited:
And do you know what can happen when people, intelligent or not, develop technology recklessly, without significant foresight, at a breakneck rate of speed, or faster? It can be disastrous...

Might be - it could also be the sort of brain power that we need o stop global warming and create space elevators. It might be able to solve the very problems that our ever-so-slowly climbing technology will eventually solve, if we have enough time. If that's the case, then speed is vital to us.

And you want to use human byproducts (and if I remember in Soylent Green, those people were euthanized, no?) to make laptop batteries... very nice.

INRM

INRM, don't you recognize an exagerated tweak when you see/feel it? Are you always this sensitive? Last I heard, humans have damned little lithium in their gizzards.

Now, shoes - there's another possibility entirely...
 
Last edited:
And do you know what can happen when people, intelligent or not, develop technology recklessly, without significant foresight, at a breakneck rate of speed, or faster? It can be disastrous...

And do you know what can happen, when people, intelligent or not, fail to develop technology recklessly without significant foresight, at a breakneck rate of speed, or faster? It can be disasterous....

So given that we're courting disaster no matter what we do, I suggest we do something that has a track record of helping people instead of harming them. If you dislike that,... well, once I have my time machine built, you can go back to the 15th century and die of dysentery.


And you want to use human byproducts (and if I remember in Soylent Green, those people were euthanized, no?) to make laptop batteries...

Good lord, no. I don't want to use human byproducts. I want to use the actual humans themselves.
 
Might be - it could also be the sort of brain power that we need o stop global warming and create space elevators. It might be able to solve the very problems that our ever-so-slowly climbing technology will eventually solve, if we have enough time. If that's the case, then speed is vital to us.

I don't think the reckless development is a good thing. I wouldn't want to recklessly go about solving global warming or recklessly develop a space-elevator (especially if I had any intention to ride it!)

INRM, don't you recognize an exagerated tweak when you see/feel it? Are you always this sensitive? Last I heard, humans have damned little lithium in their gizzards.

I recognized it as a joke. I was just trying to point out how ridiculous it sounded.


And do you know what can happen, when people, intelligent or not, fail to develop technology recklessly without significant foresight, at a breakneck rate of speed, or faster? It can be disasterous....

I don't think I'd want to go about solving global warming in a reckless manner or build a space-elevator -- as Shadron brought up, in a reckless manner.

So given that we're courting disaster no matter what we do, I suggest we do something that has a track record of helping people instead of harming them. If you dislike that,... well, once I have my time machine built, you can go back to the 15th century and die of dysentery.

If you're courting disaster, I figured you'd want to be especially careful what decisions you'd make... Second of all, there's no such thing as a time machine, and third, I wouldn't want to be in the 15th century :P

Good lord, no. I don't want to use human byproducts. I want to use the actual humans themselves.

*rolls eyes*


INRM
 
If you're courting disaster, I figured you'd want to be especially careful what decisions you'd make...

I have been. Failure to progress has been a much more damaging thing historically than progress. No society in history has ever been destroyed because they advanced their knowledge of the world too quickly.

History is littered with examples of societies that have been destroyed because they lacked the technology that would save them, whether this be the lack of long-distance ocean transport for Easter Island, the lack of machine guns for the Aztecs, or the lack of an effective smallpox vaccine for most of the North American Indians.

I could make a case that lack of sufficient technology has been a cause of every societal collapse in recorded history.

Given this, I'd be interested to know how you can justify anything other than an all-out scientific effort.
 
Dr Kitten,

While the movie "Terminator" is just a movie... if such a situation could occur as a result of reckless development of technology without foresight... and there are various ways I pointed out in previous posts how A.I. could turn on us in one way or another, and even scientists have speculated this being one of the ways mankind on earth would come to an end (There was a show, which had all sorts of scientists, such as Hawkins, DeGrasse-Tyson, etc, and this was on the top 10) then in that case progression (development of advanced A.I.) would result in destruction theoretically.

Just because something has not happened before does not mean it can't happen. Tell that to all the people who were victims of the first plane-crash (which I can assure you did not exist 10,000 years ago)...


INRM
 
While the movie "Terminator" is just a movie...

You know, I don't even need to read further than this. One of the standard marks of a crackpot is the citation of works of fiction as though they were fact. You even know it, and you're doing it anyway.

if such a situation could occur as a result of reckless development of technology without foresight...

And you start out with a demonstrably false hypothesis. There is no way that a hardware-based AI can stand up to dynamite. There's no way that a software-based AI can work without a hardware platform to run on. Your scenarios are ludicrous -- and you want people in real life to stop work because you're afraid it might anger the leprechauns?

there are various ways I pointed out in previous posts how A.I. could turn on us in one way or another, and even scientists have speculated this being one of the ways mankind on earth would come to an end

Again, you're citing fiction as though it were fact? This doesn't embarass you?


Just because something has not happened before does not mean it can't happen.

Yes, but which is more likely to happen? Something we know has happened before (which we can prevent by taking action), or something that might be caused by our taking that preventative action, that has never before in the history of humanity happened.

Humanity, as a species, is doomed anyway. Eventually the ELE asteroid will hit, or the Sun will expand and boil the seas dry, or a future president will push the wrong button. This we know -- and at our current level of technolgy, we will be unable to prevent them. Only through increasing our technology do we have any chance of survival.

In short, the risks of technology are, literally, negative. There is no line of research we can take that will decrease our chance of survival as a species. There are countless lines that will increase it, probably more than we will have time for as it. We should be researching more, not less, in the hope that we'll stumble on one of those lines.
 
One man's reckless is another man's belly laugh. Just how much foresight do you think we'll be needing? An extra 10 years? a 100?, a 1000? I don't think I've ever met a real, honest-to-deity neoLuddite before. They're rare in my part of the country.

With all due respect to Dr. Kitten, I see your Terminator and raise you a Bicentennial ManWP. At least the latter is based on a novella written by an actual scientist. Science Fiction can be prophetic, and at least expose some of the problems one may encounter on the journey into he future. But there are so many paths.

And you can pooh-pooh a space elevator all you want. The ne thing we need more then any other thing in the fuure is energy. Availability of lots of energy can be used to help solve every problelm we have here on earth, and unless you can get a fusion reactor to ignite soon, I think the closest we can get o more energy is in space. Getting there is expensive; a space elevator would decrease that cost several orders of magnitude.

See http://www.pbs.org/wgbh/nova/sciencenow/3401/02.html .
 
Last edited:
I think the rest of you should get out of our way before we decide to use Soylent Green as an ingredient in laptop batteries.
Soya beans and lentils? Guess you could run a fuel cell off 'em.

Edit: Dammit, should have read just a little further down the thread.
 
Shadron,
One man's reckless is another man's belly laugh. Just how much foresight do you think we'll be needing? An extra 10 years? a 100?, a 1000? I don't think I've ever met a real, honest-to-deity neoLuddite before. They're rare in my part of the country.

I'm just giving a very broad figure here, I'd say between 10 and 100 years.

With all due respect to Dr. Kitten, I see your Terminator and raise you a Bicentennial ManWP. At least the latter is based on a novella written by an actual scientist. Science Fiction can be prophetic, and at least expose some of the problems one may encounter on the journey into he future. But there are so many paths.

I didn't quite think of it with exactly that wording, but yeah I was more or less trying to point out that science-fiction can have a prophetic aspect about it sometimes.

As for the TV show I was talking about, I think it was on Discovery or PBS or something and it had some highly respectable scientists coming up with the Top 10 most likely ways for the earth to come to an end. Hawking, DeGrasse-Tyson and such were on.

Dr. Hawking is one of the most respected scientists in the world, and (Dr?) Neil DeGrasse Tyson is the head of the Museum of Natural History...

And you can pooh-pooh a space elevator all you want. The ne thing we need more then any other thing in the fuure is energy. Availability of lots of energy can be used to help solve every problelm we have here on earth, and unless you can get a fusion reactor to ignite soon, I think the closest we can get o more energy is in space. Getting there is expensive; a space elevator would decrease that cost several orders of magnitude.

I'm not opposed to the building of a Space-Elevator -- I think it's actually quite a good idea. I just want to make sure it is designed properly.


INRM
 
I'm not opposed to the building of a Space-Elevator -- I think it's actually quite a good idea. I just want to make sure it is designed properly.

INRM

OK, fine. How will you go about "assuring it is designed properly", and what do you really mean by that? I suggest hiring an engineering firm and let them go at the computers, and you may have a result when the materials science is right. Arthur C Clarke didn't have carbon nanotubes available when he wrote the Fountains of Paradise, but if you haven't read it, you might, to see what kind of huge engineering might be involved. You are certainly going to have to build computer controlled mechanisms, which can intercommunicate and measure and anticipate various sorts of mishap. Your embargo of computer development for 10-100 years is certainly going to impact that. How are you recommending the trade-off be handled?
 
I didn't say I wanted a 10-100 year computer embargo! I just said that people when developing A.I. technology in particular should try to avoid designing something recklessly that could be dangerous to mankind, and should excercize foresight as to it's effects on mankind. 10 to 100 years was the amount of time I wanted people to "look into the future" in order to foresee any serious consequences (Foresight. Keep in mind A.I. if developed recklessly and short-sightedly could have serious problems).

As for the space elevator problem, I would agree with your assessment in letting an engineering firm draw up the specifications. I would hope that ground rules would be set-up in terms of standards of safety which would have to be very high in order for this to be built safely.

In terms of regulating the towers flexing and stuff, there is technology that already exists (thrusters for one) which can be controlled with some high tech aerospace technology designed to enable unstable objects to be made stable using rapid adjustments (Most modern stuff uses control surface movements, but thrusters work along the same principle) -- ie. Stability Augmentation and Auto-Stabilization.

This technology already exists and has been on airplanes for a LONG time (The B-47 for example utilized a yaw-damper which is a form of Stability Augmentation -- it makes small adjustments to the rudder when yaw is detected in order to cancel these motions out, as with airplanes with swept wings this produces a type of instability called dutch-roll, the F-16, F-18 and F-117 utilize much more elaborate SAS which are much better integrated due to these planes having fly-by-wire allow the plane to be designed unstable in order to perform extremely aggressive maneuvers -- unfortunately the instability also makes the plane virtually, if not impossible for the pilot to control normally; the systems make loads of adjustments to the control-surfaces, sometimes dozens a second-- as a result the plane can be flown nice and smooth under normal conditions and when you pull back nice and hard on the stick, it uses it's instability to allow high-G, high-AoA, sharp-maneuvers.).


INRM
 
Six7s, I'd say you either haven't read enough science fiction or perhaps too much. :) But I agree with INRM; read the stuff we argued about above.
I have skimmed what you have been discussing, hence my wondering if "if such concerns have any basis in reality"

So far, the only example proffered has been Grey Goo, which - although potentially possible - shows no signs of being a reason for real-world fear

Concern perhaps, but fear? No

http://www.iop.org/EJ/news/-topic=763/journal/0957-4484
Nanotechnology pioneer slays “grey goo” myths
07/06/2004
Eric Drexler, known as the father of nanotechnology, today (Wednesday, 9th June 2004) publishes a paper that admits that self-replicating machines are not vital for large-scale molecular manufacture, and that nanotechnology-based fabrication can be thoroughly non-biological and inherently safe. Talk of runaway self-replicating machines, or “grey goo”, which he first cautioned against in his book Engines of Creation in 1986, has spurred fears that have long hampered rational public debate about nanotechnology. Writing in the Institute of Physics journal Nanotechnology, Drexler slays the myth that molecular manufacture must use dangerous self-replicating machines.

“Runaway replicators, while theoretically possible according to the laws of physics, cannot be built with today’s nanotechnology toolset,” says Dr. Drexler, founder of the Foresight Institute, in California, and Senior Research Fellow of the Molecular Engineering Research Institute (MERI). He continued: “Self-replicating machines aren't necessary for molecular nanotechnology, and aren’t part of current development plans.”

The paper, Safe Exponential Manufacturing by Chris Phoenix, Director of Research of the Center for Responsible Nanotechnology, (CRN) and Dr. K. Eric Drexler, also warns that scaremongering over remote scenarios such as “grey goo” is taking attention away from serious safety concerns, such as a deliberate abuse of the technology.

Phoenix said: “Runaway replication would only be the product of a deliberate and difficult engineering process, not an accident. Far more serious, however, is the possibility that a large-scale and convenient manufacturing capacity could be used to make powerful non-replicating weapons in unprecedented quantity, leading to an arms race or war. Policy investigation into the effects of molecular nanotechnology should consider deliberate abuse as a primary concern, and runaway replication as a more distant issue.”

<snip/>

The paper can be downloaded free of charge here: Drexler Paper

Real people are a cause for fear

Sci-fi machines ain't
 

ISF - Join now!

Every member here is approved by hand. No bots, no spam, just people who care about evidence and honest debate.

Membership is free!

Create your free account

Back
Top Bottom