Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines; there would then unquestionably be an 'intelligence explosion,' and the intelligence of man would be left far behind. Thus the first ultraintelligent machine is the last invention that man need ever make.

In the modern world, science and society often interact in a perverse way. We live in a technological society, and technology causes political problems. The politicians and the public expect science to provide answers to the problems. Scientific experts are paid and encouraged to provide answers. The public does not have much use for a scientist who says, “Sorry, but we don’t know”. The public prefers to listen to scientists who give confident answers to questions and make confident predictions of what will happen as a result of human activities. So it happens that the experts who talk publicly about politically contentious questions tend to speak more clearly than they think. They make confident predictions about the future, and end up believing their own predictions. Their predictions become dogmas which they do not question. The public is led to believe that the fashionable scientific dogmas are true, and it may sometimes happen that they are wrong. That is why heretics who question the dogmas are needed.
As a scientist I do not have much faith in predictions. Science is organized unpredictability.

What are the primary, most important, or most limiting resources that human civilization depends on? Material resources are certainly significant. We need to build our civilization out of something, and we always seem to be facing a crisis of “peak” whatever—peak oil or peak helium—as our demand for a resource begins to outstrip our supplies. Land is also in limited supply. There is only so much land on Earth on which to grow our food, build our homes, and contain our industries. It would also be nice to leave some land for the other 10 million or so species that we share the planet with. I would argue, however, that the primary resource, the one resource to rule them all, is ideas. With science and technology, we have, so far, been able to overcome all our other resource limitations.