Some very half-baked brainstormed ideas for increasing the likelihood of getting to something like Plan A or S:
General public targeted messaging needs to directly funnel people towards taking action that actually increases likelihood of policy change. Right now it seems like a lot of it is just trying to get people to take AI x-risk seriously in the first place. This is good and should continue but it should also direct people to email or call their representatives or lobby them in person if they’re able, and to ask them to support specific bills (PauseAI’s work is the closest example that comes to mind). Politicians can generally be modeled as trying to get re-elected and if enough people do this it directly signals to them that there are enough people who care about this enough to go out of their way to contact them, i.e. there are a lot of people whose votes it could sway, so they’re more likely to do it. Concretely if we got more AI safety content creators to say in their videos something like “if you want to help with this, contact your representative and tell them to support these bills and why it matters to you. You can use this email template if you don’t have much time but it’s even more effective to call or do this in person (or whatever else)” (essentially the advice in this US lobbying guide). Also might be good to get them to use referral links to maybe measure the rate of conversion for views on the video to number of people who do that? (This could also make the impact more legible to grantmakers I would imagine)
Due to the concentrated benefits vs diffuse costs problem, the other main way of spurring political action aside from getting more voters to signal they care is to minimize the perceived cost by the companies lobbying against AI regulation. The Montreal Protocol wouldn’t have succeeded if not for the main company lobbying against it finding harmless alternatives to the substances that were depleting the ozone layer and being given several decades to switch. If we can shift the discourse from people saying “shut it all down” vs “erm no you Luddite this is just like every other time people were worried about new technology” to the common ground of “I know you’re skeptical but there’s enough risk here that it’s clear we should at least be setting ourselves up to be more prepared to respond to new risks as they emerge” and then point specifically to the HuggingFace incident and related reports that followed making it clear we need to mandate incident reporting and/or liability standards for frontier labs, I imagine that would be far more agreeable. Another related part of this is most people who dismiss a binding international treaty do so on the grounds that there’s no point, because everyone would just defect or that it would “strangle innovation”, except I never see anyone challenging them with the progress and tractability of verification for international AI governance as a field already is, and there are plenty of initial measures that wouldn’t be particularly costly to implement so there might be work to be done there. Then again a ton of them just use galaxy brain motivated reasoning and don’t engage in good faith, but I imagine it could shift the people who do engage in good faith.
In general I don’t think a lot of people realize how much minimizing friction to contribute and giving people specific asks that don’t take much of their time makes a difference, e.g. open letters that have >1k signatures from top experts get tons of attention despite taking like 1 minute of each participant’s time. But for example, the pacing the frontier letter essentially just called on the White House to work towards an international treaty to pace the frontier, I suspect it would have been better to specifically name e.g. some of the early asks in AI 2040 that don’t cost much but set them up better to respond to new risks as they emerge and are harder to dismiss as “strangling innovation”.
The 2028 US presidential election will be critical for international AI governance. When candidates are campaigning I suspect it may be high leverage to get a lot of AI safety people to show up and ask during e.g. Q&A events if they will address AI risks (even if only in low cost incremental ways that are hard to dismiss as strangling innovation/the seeking common ground strategy) to signal that a lot of people care, and make them more inclined to support it insofar as it gets them additional swing voters. During the presidential debates if we can get the reporters to ask what they’ll do about emerging AI risks that would probably help too.
Among Congress people who care about AI risk, I’ve seen a lot of them specifically link news articles in tweets to justify why their bill is needed. Maybe news coverage is unusually high leverage and there’s work to be done in finding strategies for getting more of it, especially that focus on specific proposed bills/interventions/advocacy groups/etc.? For example, I think the AI red lines campaign was one of the best examples of this.
A bit pessimistic about this one given I don’t think I could have done much better than this post which only got ~300 upvotes, but if we can get more AI safety people to want to pivot/contribute to political will work in the first place that would be great, the case for it being the biggest bottleneck to making the future of AI go well by such a large margin that it’s worth trading off whatever personal fit people have in other fields feels strong to me. Maybe we could channel them to the parts that are still more technical feeling like working on verificiation, because to my understanding that’s one of the main technical governance bottlenecks right now in the sense that it makes it harder to deny the infeasibility of a treaty. There’s probably a lot of low hanging fruit in at least convincing more people to fund this type of work, it kind of baffles me that there isn’t more funding for it? It also might help to explicitly frame the projects as “increasing the likelihood of getting to Plan A or S from AI 2040”, I like to think about it in this way as it serves as a baseline for big picture strategy to try to do better than, and most AI safety people already seem convinced that increasing the likelihood of something like that is one of if not the most important thing to focus on for actually making the long-term future of AI go well (although few of them seem to actually update their behavior based on that so idk).
OpenAI and Anthropic like to signal that they’re interested in working towards AI safety governance, and as this post points out, the top labs have unusually high leverage in influencing the White House’s decisions. It’s unclear what they’re actually concretely doing for this. There’s probably more work to be done in holding them accountable to actually concretely taking initiative towards supporting specific interventions, or getting employees there to use their collective bargaining power to demand them to? idk. Again, helps to have prepared specific asks to minimize friction for what they have to do. A similar example that comes to mind to perhaps model after is what Alex Turner tried to do to get GDM to not service ICE. This particular example was a failure story so maybe this isn’t a promising direction, but his postmortem on it literally became the most upvoted LW post of all time within a few weeks, so who knows, maybe there’s more to be done here.
While writing this I realized there’s a gap in my knowledge for what can be done to lobby the U.S. executive branch in the first place, so I should probably figure that out and raise awareness of it for other people. Per this post, “In several international forums over the past 18 months, US positioning has been the ultimate bottleneck. My main answer to this is thatit’s a priority to do insider work at the White House for those who can access it.”
I suspect there can be better funnels for getting AI safety people to pivot to govt. facing work with minimal friction. Insider policy work is seemingly one of the highest leverage ways an individual can influence the decisions made, but if I were to try to get involved in that right now I wouldn’t know where to start other than just trying to cold email other people already in US AI policy with feedback that’s insightful enough to their policy interests for them to see as worth responding to. Many other existing pipelines I know of seem to be built for people with strong policy backgrounds already, i.e. people with ~equivalent demonstrated expertise of a policy Master’s degree.
I’m largely new to working on this and haven’t investigated these too deeply yet so there are probably some obvious things I’m missing here. Thoughts?
Some very half-baked brainstormed ideas for increasing the likelihood of getting to something like Plan A or S:
General public targeted messaging needs to directly funnel people towards taking action that actually increases likelihood of policy change. Right now it seems like a lot of it is just trying to get people to take AI x-risk seriously in the first place. This is good and should continue but it should also direct people to email or call their representatives or lobby them in person if they’re able, and to ask them to support specific bills (PauseAI’s work is the closest example that comes to mind). Politicians can generally be modeled as trying to get re-elected and if enough people do this it directly signals to them that there are enough people who care about this enough to go out of their way to contact them, i.e. there are a lot of people whose votes it could sway, so they’re more likely to do it. Concretely if we got more AI safety content creators to say in their videos something like “if you want to help with this, contact your representative and tell them to support these bills and why it matters to you. You can use this email template if you don’t have much time but it’s even more effective to call or do this in person (or whatever else)” (essentially the advice in this US lobbying guide). Also might be good to get them to use referral links to maybe measure the rate of conversion for views on the video to number of people who do that? (This could also make the impact more legible to grantmakers I would imagine)
Due to the concentrated benefits vs diffuse costs problem, the other main way of spurring political action aside from getting more voters to signal they care is to minimize the perceived cost by the companies lobbying against AI regulation. The Montreal Protocol wouldn’t have succeeded if not for the main company lobbying against it finding harmless alternatives to the substances that were depleting the ozone layer and being given several decades to switch. If we can shift the discourse from people saying “shut it all down” vs “erm no you Luddite this is just like every other time people were worried about new technology” to the common ground of “I know you’re skeptical but there’s enough risk here that it’s clear we should at least be setting ourselves up to be more prepared to respond to new risks as they emerge” and then point specifically to the HuggingFace incident and related reports that followed making it clear we need to mandate incident reporting and/or liability standards for frontier labs, I imagine that would be far more agreeable. Another related part of this is most people who dismiss a binding international treaty do so on the grounds that there’s no point, because everyone would just defect or that it would “strangle innovation”, except I never see anyone challenging them with the progress and tractability of verification for international AI governance as a field already is, and there are plenty of initial measures that wouldn’t be particularly costly to implement so there might be work to be done there. Then again a ton of them just use galaxy brain motivated reasoning and don’t engage in good faith, but I imagine it could shift the people who do engage in good faith.
In general I don’t think a lot of people realize how much minimizing friction to contribute and giving people specific asks that don’t take much of their time makes a difference, e.g. open letters that have >1k signatures from top experts get tons of attention despite taking like 1 minute of each participant’s time. But for example, the pacing the frontier letter essentially just called on the White House to work towards an international treaty to pace the frontier, I suspect it would have been better to specifically name e.g. some of the early asks in AI 2040 that don’t cost much but set them up better to respond to new risks as they emerge and are harder to dismiss as “strangling innovation”.
The 2028 US presidential election will be critical for international AI governance. When candidates are campaigning I suspect it may be high leverage to get a lot of AI safety people to show up and ask during e.g. Q&A events if they will address AI risks (even if only in low cost incremental ways that are hard to dismiss as strangling innovation/the seeking common ground strategy) to signal that a lot of people care, and make them more inclined to support it insofar as it gets them additional swing voters. During the presidential debates if we can get the reporters to ask what they’ll do about emerging AI risks that would probably help too.
Among Congress people who care about AI risk, I’ve seen a lot of them specifically link news articles in tweets to justify why their bill is needed. Maybe news coverage is unusually high leverage and there’s work to be done in finding strategies for getting more of it, especially that focus on specific proposed bills/interventions/advocacy groups/etc.? For example, I think the AI red lines campaign was one of the best examples of this.
A bit pessimistic about this one given I don’t think I could have done much better than this post which only got ~300 upvotes, but if we can get more AI safety people to want to pivot/contribute to political will work in the first place that would be great, the case for it being the biggest bottleneck to making the future of AI go well by such a large margin that it’s worth trading off whatever personal fit people have in other fields feels strong to me. Maybe we could channel them to the parts that are still more technical feeling like working on verificiation, because to my understanding that’s one of the main technical governance bottlenecks right now in the sense that it makes it harder to deny the infeasibility of a treaty. There’s probably a lot of low hanging fruit in at least convincing more people to fund this type of work, it kind of baffles me that there isn’t more funding for it? It also might help to explicitly frame the projects as “increasing the likelihood of getting to Plan A or S from AI 2040”, I like to think about it in this way as it serves as a baseline for big picture strategy to try to do better than, and most AI safety people already seem convinced that increasing the likelihood of something like that is one of if not the most important thing to focus on for actually making the long-term future of AI go well (although few of them seem to actually update their behavior based on that so idk).
OpenAI and Anthropic like to signal that they’re interested in working towards AI safety governance, and as this post points out, the top labs have unusually high leverage in influencing the White House’s decisions. It’s unclear what they’re actually concretely doing for this. There’s probably more work to be done in holding them accountable to actually concretely taking initiative towards supporting specific interventions, or getting employees there to use their collective bargaining power to demand them to? idk. Again, helps to have prepared specific asks to minimize friction for what they have to do. A similar example that comes to mind to perhaps model after is what Alex Turner tried to do to get GDM to not service ICE. This particular example was a failure story so maybe this isn’t a promising direction, but his postmortem on it literally became the most upvoted LW post of all time within a few weeks, so who knows, maybe there’s more to be done here.
While writing this I realized there’s a gap in my knowledge for what can be done to lobby the U.S. executive branch in the first place, so I should probably figure that out and raise awareness of it for other people. Per this post, “In several international forums over the past 18 months, US positioning has been the ultimate bottleneck. My main answer to this is that it’s a priority to do insider work at the White House for those who can access it.”
I suspect there can be better funnels for getting AI safety people to pivot to govt. facing work with minimal friction. Insider policy work is seemingly one of the highest leverage ways an individual can influence the decisions made, but if I were to try to get involved in that right now I wouldn’t know where to start other than just trying to cold email other people already in US AI policy with feedback that’s insightful enough to their policy interests for them to see as worth responding to. Many other existing pipelines I know of seem to be built for people with strong policy backgrounds already, i.e. people with ~equivalent demonstrated expertise of a policy Master’s degree.
I’m largely new to working on this and haven’t investigated these too deeply yet so there are probably some obvious things I’m missing here. Thoughts?