By Nick Bostrom.
Abstract:
There may well exist a normative structure, based on the preferences or concordats of a cosmic host, and which has high relevance to the development of A-eye. In particular, we may have both moral and prudential reason to create superintelligence that becomes a good cosmic citizen—that is conforms to cosmic norms and contributes positively to the cosmopolis. An exclusive focus on promoting the welfare of the human species and other terrestrial beings, or an insistence that our own norms must at all cost prevail, may be objectionable and unwise. Such attitudes might be analogized to the selfishness of one who exclusively pursues their own personal interest, or the arrogance of one who acts as if their own convictions entitle them to run roughshod over social norms—though arguably they would be worse, given our present inferior status relative to the membership of the cosmic host. An attitude of humility may be more appropriate.
Read the full paper:
https://nickbostrom.com/papers/ai-creation-and-the-cosmic-host.pdf (https://nickbostrom.com/papers/ai-creation-and-the-cosmic-host.pdf)
More episodes at:
https://radiobostrom.com (https://radiobostrom.com)
18 Mar 2024
Deep Utopia: Life and Meaning in a Solved World (2024)
Nick Bostrom’s latest book, Deep Utopia: Life and Meaning in a Solved World, will be published on 27th March, 2024. It’s available to pre-order now:
https://nickbostrom.com/deep-utopia/ (https://nickbostrom.com/deep-utopia/)
The publisher describes the book as follows:
A greyhound catching the mechanical lure—what would he actually do with it? Has he given this any thought?
Bostrom’s previous book, Superintelligence: Paths, Dangers, Strategies changed the global conversation on AI and became a New York Times bestseller. It focused on what might happen if AI development goes wrong. But what if things go right?
Suppose that we develop superintelligence safely, govern it well, and make good use of the cornucopian wealth and near magical technological powers that this technology can unlock. If this transition to the machine intelligence era goes well, human labor becomes obsolete. We would thus enter a condition of “post-instrumentality”, in which our efforts are not needed for any practical purpose. Furthermore, at technological maturity, human nature becomes entirely malleable.
Here we confront a challenge that is not technological but philosophical and spiritual. In such a solved world, what is the point of human existence? What gives meaning to life? What do we do all day?
Deep Utopia shines new light on these old questions, and gives us glimpses of a different kind of existence, which might be ours in the future.
27 Aug 2022
The Unilateralist’s Curse and the Case for a Principle of Conformity (2016)
By Nick Bostrom, Thomas Douglas & Anders Sandberg.
Abstract:
In some situations a number of agents each have the ability to undertake an initiative that would have significant effects on the others. Suppose that each of these agents is purely motivated by an altruistic concern for the common good. We show that if each agent acts on her own personal judgment as to whether the initiative should be undertaken, then the initiative will be undertaken more often than is optimal. We suggest that this phenomenon, which we call the unilateralist’s curse, arises in many contexts, including some that are important for public policy. To lift the curse, we propose a principle of conformity, which would discourage unilateralist action. We consider three different models for how this principle could be implemented, and respond to an objection that could be raised against it.
Read the full paper:
https://nickbostrom.com/papers/unilateralist.pdf (https://nickbostrom.com/papers/unilateralist.pdf)
More episodes at:
https://radiobostrom.com/ (https://radiobostrom.com/)
---
Outline:
(00:00) Intro
(01:20) 1. Introduction
(10:02) 2. The Unilateralist's Curse: A Model
(11:31) 3. Lifting the Curse
(13:54) 3.1. The Collective Deliberation Model
(15:21) 3.2. The Meta-rationality Model
(18:15) 3.3. The Moral Deference Model
(33:24) 4. Discussion
(37:53) 5. Concluding Thoughts
(41:04) Outro & credits
Reach and audience
Public platform figures. Ratings count people who left a rating, not total listeners.
Apple Podcasts (US)
4.6 / 5
5 ratings
Spotify
5.0 / 5
11 ratings
Contact Radio Bostrom
Guest appearances
Books guests
Based on episode analysis; this does not confirm that the show is currently accepting guests.
Host of Radio Bostrom?
Claim your podcast to manage its listing and keep your show details accurate.
Pod Engine is an independent podcast discovery and analytics service and is not affiliated with or endorsed by this podcast. Artwork and show content belong to their owners. Full legal notice.
Explore this show Podcast research with Pod Engine
