RSS

Align­ment tax

TagLast edit: Jul 22, 2022, 9:00 PM by Leo

An alignment tax (sometimes called a safety tax) is the additional cost of making AI aligned, relative to unaligned AI.

Approaches to the alignment tax

Paul Christiano distinguishes two main approaches for dealing with the alignment tax.[1][2] One approach seeks to find ways to pay the tax, such as persuading individual actors to pay it or facilitating coordination of the sort that would allow groups to pay it. The other approach tries to reduce the tax, by differentially advancing existing alignable algorithms or by making existing algorithms more alignable.

Further reading

Askell, Amanda et al. (2021) A general language assistant as a laboratory for alignment, arXiv:2112.00861 [Cs].

Xu, Mark & Carl Shulman (2021) Rogue AGI embodies valuable intellectual property, LessWrong, June 3.

Yudkowsky, Eliezer (2017) Aligning an AGI adds significant development time, Arbital, February 22.

Related entries

AI alignment | AI governance | AI forecasting | differential progress

  1. ^

    Christiano, Paul (2020) Current work in AI alignment, Effective Altruism Global, April 3.

  2. ^

    For a summary, see Rohin Shah (2020) A framework for thinking about how to make AI go well, LessWrong, April 15.

Paul Chris­ti­ano: Cur­rent work in AI alignment

EA GlobalApr 3, 2020, 7:06 AM
80 points
3 comments24 min readEA link
(www.youtube.com)

My per­sonal cruxes for work­ing on AI safety

BuckFeb 13, 2020, 7:11 AM
136 points
35 comments44 min readEA link

Safety tax functions

Owen Cotton-BarrattOct 20, 2024, 2:13 PM
23 points
1 comment6 min readEA link
(strangecities.substack.com)

AI safety tax dynamics

Owen Cotton-BarrattOct 23, 2024, 12:21 PM
21 points
9 comments6 min readEA link
(strangecities.substack.com)

[Linkpost] Jan Leike on three kinds of al­ign­ment taxes

AkashJan 6, 2023, 11:57 PM
29 points
0 comments1 min readEA link

Align­ing AI with Hu­mans by Lev­er­ag­ing Le­gal Informatics

johnjnaySep 18, 2022, 7:43 AM
20 points
11 comments3 min readEA link

New co­op­er­a­tion mechanism—quadratic fund­ing with­out a match­ing pool

Filip SondejJun 5, 2022, 1:55 PM
55 points
11 comments5 min readEA link