Against Proxy Optimization
Bibliographic Data
| ID | 21371497 |
|---|---|
| Authors | Sven Neth (0000-0003-4275-7581, University of Pittsburgh, Pittsburgh, Pennsylvania, USA, corresponding author) |
| Year | 2026 |
| Publication date | 2026-06-22 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Philosophy and Phenomenological Research (JOURNAL) |
| Journal identifiers | ISSN: 0031-8205 • E-ISSN: 1933-1592 |
| Publisher | Wiley (PUBLISHER • GB) |
| DOI | 10.1111/phpr.70138 |
| OpenAlex | W7165653736 |
| Language | EN |
| References cited | 24 |
I discuss conditions under which maximizing a proxy utility function is harmful and suggest this poses problems for applying decision theory
Expected utility hypothesis · Function (biology) · Optimization problem · Proxy (statistics) · Utility theory · Decision-Making and Behavioral Economics · Economic and Environmental Valuation · Game Theory and Voting Systems
Wandering Significance
The Possibility of Social Choice
Why Be Rational?
On the Folly of Rewarding A, While Hoping for B.
The Bargaining Problem
Hostile Epistemology
The Algorithmic Leviathan
Dimensions of value
Value Capture
Current cases of AI misalignment and their implications for future risks
Reward tampering problems and solutions in reinforcement learning
Off-switching not guaranteed
Infinite Prospects
On the Application of Inductive Logic
Persistent Disagreement and Polarization in a Bayesian Setting
Will AI avoid exploitation? Artificial general intelligence and expected utility theory
| Highly cited | No |
|---|