Superintelligence: Paths, Dangers, Strategies

Renting vs. Buying This Textbook

Renting is usually cheapest if you only need the book for one term: you return it with a free prepaid label when the term ends. Buying used can beat renting when the sell-back price is high, so compare the sell-back price with the rental price before you decide. An eTextbook arrives instantly but usually expires. Rentals and used copies rarely include working access codes.

Always match the ISBN on your syllabus (9780198739838) before you order; different editions have different ISBNs.

About This Book

The human brain has some capabilities that the brains of other animals lack. It is to these distinctive capabilities that our species owes its dominant position. Other animals have stronger muscles or sharper claws, but we have cleverer brains. If machine brains one day come to surpass human brains in general intelligence, then this new superintelligence could become very powerful. As the fate of the gorillas now depends more on us humans than on the gorillas themselves, so the fate of our species then would come to depend on the actions of the machine superintelligence. But we have one advantage: we get to make the first move. Will it be possible to construct a seed AI or otherwise to engineer initial conditions so as to make an intelligence explosion survivable? How could one achieve a controlled detonation? To get closer to an answer to this question, we must make our way through a…