Update: We did a follow-up survey 4 months after the retreat, asking participants what impact the retreat had on them. Here is a summary of the responses:
36 people responded (~54% of participants)
Personal prioritization
7 people reported their prioritization which area to work in was influenced by the retreat
One person quit their previous job to do a career transition to AI safety
One person decided to keep working on their current topic rather than switch as they had considered before
One person started to work on a research topic they wouldn’t have focused on otherwise
Connections
26 people mentioned they made connections they found useful, e.g. for research discussions.
7 people started research collaborations with people from the retreat
Applying for training programs and funding
5 people applied to SERI MATS as a result of the retreat
4 people got accepted into the online training program
2 people got accepted into the in-person research program
4 people applied for funding (1 accepted, 1 rejected, 2 unclear)
3 people wrote a post, and one person created a youtube channel
One is unsure whether their post was a result of the retreat
For one it was their first ever post
Other/Miscellaneous
3 people reported the retreat didn’t change much for them personally, but they think they were able to help others
All three were mentioned by others in the feedback as being particularly helpful
13 people said they got a better picture of the AI safety landscape in general
6 people reported they got a motivation boost from feeling part of a community of like-minded people
3 people mentioned they went to EAG London because of the retreat
One person shifted focus within their area of work
One person got useful experimental results they think they wouldn’t have gotten without the input from the retreat
(Note that the survey consisted of a free text field, and the categories I made up for summarizing the results are pretty subjective. Also note that some people mentioned that they started projects or applied for things, but would have done so even without the retreat. I did not include those in my count.)
I think these results are really helpful to improve the picture of how such a retreat is valuable for people!
The biggest surprise for me is the amount of tangible results (research collaborations, getting into SERI MATS, concrete projects, career changes) that came out of the retreat. There were 9 people who said in the feedback form that they want to start a project as a result of the retreat (the form they filled out right at the end of the retreat). I would have guessed that maybe 5 would actually follow through after the initial motivation directly after the retreat has worn off. And I think that would have been a very good result already. Instead, it was more than 9 people who started projects after the retreat!
I still have the intuition that the more vague effects of the retreat (such as feeling part of a community) are really important, potentially more so than the tangible outcomes. And these vague things are probably not measured very well by a survey that asks “What impact did the retreat have on you?”, because it is just easier to remember concrete than vague things.
Overall, these survey results make me even more excited about this kind of AI safety retreat!
Update: We did a follow-up survey 4 months after the retreat, asking participants what impact the retreat had on them. Here is a summary of the responses:
36 people responded (~54% of participants)
Personal prioritization
7 people reported their prioritization which area to work in was influenced by the retreat
One person quit their previous job to do a career transition to AI safety
One person decided to keep working on their current topic rather than switch as they had considered before
One person started to work on a research topic they wouldn’t have focused on otherwise
Connections
26 people mentioned they made connections they found useful, e.g. for research discussions.
7 people started research collaborations with people from the retreat
Applying for training programs and funding
5 people applied to SERI MATS as a result of the retreat
4 people got accepted into the online training program
2 people got accepted into the in-person research program
4 people applied for funding (1 accepted, 1 rejected, 2 unclear)
One person became a teaching assistant for the ML safety course
Concrete projects
At least 2 people took the AGISF 201 course
4 people started field-building projects
3 people wrote a post, and one person created a youtube channel
One is unsure whether their post was a result of the retreat
For one it was their first ever post
Other/Miscellaneous
3 people reported the retreat didn’t change much for them personally, but they think they were able to help others
All three were mentioned by others in the feedback as being particularly helpful
13 people said they got a better picture of the AI safety landscape in general
6 people reported they got a motivation boost from feeling part of a community of like-minded people
3 people mentioned they went to EAG London because of the retreat
One person shifted focus within their area of work
One person got useful experimental results they think they wouldn’t have gotten without the input from the retreat
(Note that the survey consisted of a free text field, and the categories I made up for summarizing the results are pretty subjective. Also note that some people mentioned that they started projects or applied for things, but would have done so even without the retreat. I did not include those in my count.)
I think these results are really helpful to improve the picture of how such a retreat is valuable for people!
The biggest surprise for me is the amount of tangible results (research collaborations, getting into SERI MATS, concrete projects, career changes) that came out of the retreat. There were 9 people who said in the feedback form that they want to start a project as a result of the retreat (the form they filled out right at the end of the retreat). I would have guessed that maybe 5 would actually follow through after the initial motivation directly after the retreat has worn off. And I think that would have been a very good result already. Instead, it was more than 9 people who started projects after the retreat!
I still have the intuition that the more vague effects of the retreat (such as feeling part of a community) are really important, potentially more so than the tangible outcomes. And these vague things are probably not measured very well by a survey that asks “What impact did the retreat have on you?”, because it is just easier to remember concrete than vague things.
Overall, these survey results make me even more excited about this kind of AI safety retreat!