If Anyone Builds It, Everyone Dies: Why Superhuman AI Would Kill Us All

 
　　為了爭奪超級人工智慧王座的這場競賽，將人類置於滅絕的路上──但要改變這一切，現在還不算太遲。
 
　　2023年，上百名專家共同簽署了一封公開信，向全世界示警AI可能帶來的危機。從那一刻起，AI競賽不僅沒有停下腳步，反而更加速了競爭。企業和國家爭相競逐成為打造出超級人工智慧的第一人，全世界對於可能因此面臨的災難毫無準備。
 
　　公開信的其中兩位簽署者，Eliezer Yudkowsky和Nate Soares，數十年來投身於研究超級智慧可能的思考、行為和其達成目標的方式，他們的研究顯示，一定程度的人工智慧，會發展出自己的目標，而這些目標很可能與人類的目的相衝突──這個狀況一旦發生，超級人工智慧很可能將摧毀我們。
 
　　超級人工智慧如何能夠抹滅全人類的存在？它們為什麼會想這麼做？它們真的有「想要」的東西嗎？在這部作品中，兩位作者帶我們逐一檢視他們的理論和證據，展示一個可能發生的滅亡劇本，並解釋如果人類想要在這場災難中存活下來，需要付出什麼代價。(文/博客來編譯)

"May prove to be the most important book of our time.”—Tim Urban, Wait But Why

The scramble to create superhuman AI has put us on the path to extinction—but it’s not too late to change course, as two of the field’s earliest researchers explain in this clarion call for humanity.

In 2023, hundreds of AI luminaries signed an open letter warning that artificial intelligence poses a serious risk of human extinction. Since then, the AI race has only intensified. Companies and countries are rushing to build machines that will be smarter than any person. And the world is devastatingly unprepared for what would come next.
 
For decades, two signatories of that letter—Eliezer Yudkowsky and Nate Soares—have studied how smarter-than-human intelligences will think, behave, and pursue their objectives. Their research says that sufficiently smart AIs will develop goals of their own that put them in conflict with us—and that if it comes to conflict, an artificial superintelligence would crush us. The contest wouldn’t even be close.
 
How could a machine superintelligence wipe out our entire species? Why would it want to? Would it want anything at all? In this urgent book, Yudkowsky and Soares walk through the theory and the evidence, present one possible extinction scenario, and explain what it would take for humanity to survive. 
 
The world is racing to build something truly new under the sun. And if anyone builds it, everyone dies.

“The best no-nonsense, simple explanation of the AI risk problem I've ever read.”—Yishan Wong, Former CEO of Reddit