Is This The Way The World Ends?

Via MR from Dominic Cummings:
This is why one of the world’s leading AI researchers, Stuart Russell (professor of computer science at Berkeley) has made this warning:
‘The capabilities of autonomous weapons will be limited more by the laws of physics — for example, by constraints on range, speed and payload — than by any deficiencies in the AI systems that control them. For instance, as flying robots become smaller, their manoeuvrability increases and their ability to be targeted decreases… Despite the limits imposed by physics, one can expect platforms deployed in the millions, the agility and lethality of which will leave humans utterly defenceless…
‘A very, very small quadcopter, one inch in diameter can carry a one- or two-gram shaped charge. You can order them from a drone manufacturer in China. You can program the code to say: “Here are thousands of photographs of the kinds of things I want to target.” A one-gram shaped charge can punch a hole in nine millimeters of steel, so presumably you can also punch a hole in someone’s head.
You can fit about three million of those in a semi-tractor-trailer. You can drive up I-95 with three trucks and have 10 million weapons attacking New York City. They don’t have to be very effective, only 5 or 10% of them have to find the target.
‘There will be manufacturers producing millions of these weapons that people will be able to buy just like you can buy guns now, except millions of guns don’t matter unless you have a million soldiers. You need only three guys to write the program and launch them.
So you can just imagine that in many parts of the world humans will be hunted. They will be cowering underground in shelters and devising techniques so that they don’t get detected. This is the ever-present cloud of lethal autonomous weapons… There are really no technological breakthroughs that are required. Every one of the component technologies is available in some form commercially… It’s really a matter of just how much resources are invested in it.

Comments

Post a Comment

Popular posts from this blog

Anti-Libertarian: re-post

The most pointed critique of social security and liberalism in general is the libertarian critique. The problem with libertarians, for a liberal, is that we have too much in common. We both believe in individual rights, tolerance of individual differences, and dislike government prescription of religion. The basic difference, it seems to me, is the different answers we give to Cain's (with thanks to the Captain - my original version had the corpse asking the question!) famous question: "Am I my brother's keeper?" That's not really my basic bitch against the libertarians though. My real complaint is the same as my complaint against most religion - its premise is a fraud. For those who can't stand to wait for the punchline, I believe that trying to implement libertarian principles leads to tyranny or social disintegration. Demonstrating that takes some historical (and pre-historical) context. For all but the last 15,000 or so of the 100,000 years the human spec...
Read more

Uneasy Lies The Head

Uneasy lies the head that wears a crown ........... Shakespeare Henry IV, Part II. So it is with us and our slightly distant primate cousins , so it seems. A 9-year study of wild baboons in Kenya by Princeton University and the Institute of Primate Research may turn conventional assumptions of alphas males upside down. The study found that alpha males have high testosterone levels, which allows them to dominate other baboons, get access to more food, and attract better mates. This is expected. Surprisingly, though, the alpha males also have high levels of stress hormone glucocorticoid, which scientists measured from their feces samples. In fact, the stress of alpha baboons was on par with low-ranking baboons. The convention wisdom is that access to food and females provides life security and thus less stress for dominant males. Conversely, weak males who are constantly threatened by starvation and physical violence from stronger males are thought to be more stressed. The st...
Read more

We Call it Soccer

The US played its best, and maybe only good game of World Cup, but lost thanks to brilliant goalkeeping by the Swedish keeper and the bizarre method soccer uses to settle ties when three US stars could not put the ball on frame from the 12 yard spot.  At the end it came down to a blocked shot that spun in by maybe a couple of centimeters. Well, that's football - too much like life.   Which brings me to a modest proposal.  Replace the thirty minute overtimes with as many 7-player 15 minute periods as needed to settle it.  Scoring should be much easier with fewer players.
Read more