I think we should have more EA contests. EA contests can generate direct value, help people develop/test their aptitudes, incentivize people to develop inside views, and help organizations find potential hires.
Also, I recently ran a small contest at a retreat (skip to the “Minimum Viable Contest” section to see how that went).
What is an EA Contest?
An “EA Contest” is essentially a call for proposals that includes a monetary reward to winners. In other words, a contest includes a contest prompt (e.g., work on X problem) and a prize (e.g., the winners get $Y).
First, I think contests can provide direct value. For example, it seems plausible that winning entries to the Creative Writing Contest could be used to generate EAs or increase the motivation of existing EAs.
Second, I think contests help people test their aptitudes. I have met many EAs who think “ah, I have no idea if I’m a good fit for X, and I wish there were easy ways to test it.” Contests can give these people a straightforward, low-friction way to test out their fit for a particular aptitude.
For example, the Eliciting Latent Knowledge Contest provides a clear way to test your fit for theoretical alignment research. This reduces friction considerably. To spell it out:
Ron: How can I test my fit for theoretical alignment research?
Hermione: Well, theoretical alignment is a pretty messy and confusing area at the moment. I suggest you read a bunch of posts in the area and try to find holes in the arguments. But also be aware that many of the posts are unhelpful and inaccurate, so part of your job is to figure out which posts actually make compelling arguments.
Ron: Oh, uh, okay… *filled with confusion*
Harry: Actually, Ron, another option is to try the Eliciting Latent Knowledge Contest! There’s a defined problem that you can work on, all of the content is in one Google Doc, and it seems like you could get a “taste” for this work by investing about 30 hours.
Ron: Oh, wow. That seems less nebulous– I’ll give it a shot!
Third, I think contests improve the critical thinking of the EA community. Contests often incentivize people to engage with primary sources, form their own ideas/opinions, and refine their thoughts on a topic. Contests can also be used to help people develop inside views on important topics.
For example, let’s imagine a hypothetical contest that involves red-teaming Open Philanthropy’s EA/LT survey. There could be direct benefits to this kind of contest (e.g., helping us better understand how to interpret the results; finding ways that OP can improve the survey design).
But I think the other benefit– which might be even more important– is that this contest would get more people to read the Open Phil survey (in detail) & generate their own interpretations. This illustrates a broader point: contests can incentivize people to defer less and form inside views more.
Fourth, I think contests help EA orgs identify untapped talent & potential hires. The Creative Writing Contest, for example, cast a spotlight on several talented EA writers. If an EA org is looking for creative writers, there’s now a pool to draw from. The Eliciting Latent Knowledge contest may also be used to help the Alignment Research Center find potential hires (indeed, this might be the primary goal of the contest!).
What could go wrong?
First, this could waste EA time. This is especially concerning if there’s a contest that looks appealing but actually produces little value. This is a waste of money and time (I’m especially concerned about the latter. A “bad contest” could suck up hundreds of hours of EA time, and EA time is a valuable/limited resource.)
Second, this could just flop. Maybe people are busy and contests just don’t generate a lot of interest. In this world, we still waste some EA time (e.g., the time of the contest organizers and grantmakers).
Third, maybe contests provide a bad incentive structure. People might optimize for “winning” rather than “discovering true and valuable ideas.” Contests may also discourage teamwork and sharing ideas.
Fourth, contests could generate a lot of publicity. Poor branding, marketing, or execution could harm the reputation of the movement.
Minimum Viable Contest
I recently ran a “Contest Contest” at a CEA retreat. I offered a $500 prize to whoever could come up with the best contest idea.
The contest lasted 24 hours, and I received 11 submissions (there were about 25 people at the retreat).
The winner (as judged by me, somewhat arbitrarily) was Ashley Lin, who came up with the following contest idea:
Design-A-Gap-Year Contest: “Prompt: imagine you received $20,000 to fund a gap year to do the most good. What would you do? Competition: present a gap year plan to judges that is impactful and feasible. Maybe the winner even gets funded!”
I was also really excited about another idea, so I offered a “surprise” 2nd place prize. This idea came from Kaivu Hariharan:
Community Building Reflection Contest: “Money for the best write up of detailed reflection on campus community building over a semester (eventually posted on the EA forum) - what the incoming hypotheses were, what worked, what didn’t, what was tried, what was the landscape like, funding, etc.”
Conclusion
Overall, I think the minimum viable product went well, and I’m excited to see more EA contests. I think well-run contests could a) generate direct impact, b) help people test relevant aptitudes, c) improve epistemics by encouraging people to form their own opinions/models, and d) help organizations identify talent & potential hires.
How You Can Help
I may apply for funding to run at least one contest in the upcoming months. Please reach out if you:
Have contest ideas.
Have any general advice on launching/running contests.
Want to help me brainstorm or run a contest.
Think this is a bad idea, or think there are harms/downsides/limitations that I might not be considering.
We Should Run More EA Contests
TLDR
I think we should have more EA contests. EA contests can generate direct value, help people develop/test their aptitudes, incentivize people to develop inside views, and help organizations find potential hires.
Also, I recently ran a small contest at a retreat (skip to the “Minimum Viable Contest” section to see how that went).
What is an EA Contest?
An “EA Contest” is essentially a call for proposals that includes a monetary reward to winners. In other words, a contest includes a contest prompt (e.g., work on X problem) and a prize (e.g., the winners get $Y).
Examples include the Creative Writing Contest, the Philosophy Contest, and the Eliciting Latent Knowledge Contest.
Why Are EA Contests Valuable?
First, I think contests can provide direct value. For example, it seems plausible that winning entries to the Creative Writing Contest could be used to generate EAs or increase the motivation of existing EAs.
Second, I think contests help people test their aptitudes. I have met many EAs who think “ah, I have no idea if I’m a good fit for X, and I wish there were easy ways to test it.” Contests can give these people a straightforward, low-friction way to test out their fit for a particular aptitude.
For example, the Eliciting Latent Knowledge Contest provides a clear way to test your fit for theoretical alignment research. This reduces friction considerably. To spell it out:
Ron: How can I test my fit for theoretical alignment research?
Hermione: Well, theoretical alignment is a pretty messy and confusing area at the moment. I suggest you read a bunch of posts in the area and try to find holes in the arguments. But also be aware that many of the posts are unhelpful and inaccurate, so part of your job is to figure out which posts actually make compelling arguments.
Ron: Oh, uh, okay… *filled with confusion*
Harry: Actually, Ron, another option is to try the Eliciting Latent Knowledge Contest! There’s a defined problem that you can work on, all of the content is in one Google Doc, and it seems like you could get a “taste” for this work by investing about 30 hours.
Ron: Oh, wow. That seems less nebulous– I’ll give it a shot!
Third, I think contests improve the critical thinking of the EA community. Contests often incentivize people to engage with primary sources, form their own ideas/opinions, and refine their thoughts on a topic. Contests can also be used to help people develop inside views on important topics.
For example, let’s imagine a hypothetical contest that involves red-teaming Open Philanthropy’s EA/LT survey. There could be direct benefits to this kind of contest (e.g., helping us better understand how to interpret the results; finding ways that OP can improve the survey design).
But I think the other benefit– which might be even more important– is that this contest would get more people to read the Open Phil survey (in detail) & generate their own interpretations. This illustrates a broader point: contests can incentivize people to defer less and form inside views more.
Fourth, I think contests help EA orgs identify untapped talent & potential hires. The Creative Writing Contest, for example, cast a spotlight on several talented EA writers. If an EA org is looking for creative writers, there’s now a pool to draw from. The Eliciting Latent Knowledge contest may also be used to help the Alignment Research Center find potential hires (indeed, this might be the primary goal of the contest!).
What could go wrong?
First, this could waste EA time. This is especially concerning if there’s a contest that looks appealing but actually produces little value. This is a waste of money and time (I’m especially concerned about the latter. A “bad contest” could suck up hundreds of hours of EA time, and EA time is a valuable/limited resource.)
Second, this could just flop. Maybe people are busy and contests just don’t generate a lot of interest. In this world, we still waste some EA time (e.g., the time of the contest organizers and grantmakers).
Third, maybe contests provide a bad incentive structure. People might optimize for “winning” rather than “discovering true and valuable ideas.” Contests may also discourage teamwork and sharing ideas.
Fourth, contests could generate a lot of publicity. Poor branding, marketing, or execution could harm the reputation of the movement.
Minimum Viable Contest
I recently ran a “Contest Contest” at a CEA retreat. I offered a $500 prize to whoever could come up with the best contest idea.
The contest lasted 24 hours, and I received 11 submissions (there were about 25 people at the retreat).
The winner (as judged by me, somewhat arbitrarily) was Ashley Lin, who came up with the following contest idea:
Design-A-Gap-Year Contest: “Prompt: imagine you received $20,000 to fund a gap year to do the most good. What would you do? Competition: present a gap year plan to judges that is impactful and feasible. Maybe the winner even gets funded!”
I was also really excited about another idea, so I offered a “surprise” 2nd place prize. This idea came from Kaivu Hariharan:
Community Building Reflection Contest: “Money for the best write up of detailed reflection on campus community building over a semester (eventually posted on the EA forum) - what the incoming hypotheses were, what worked, what didn’t, what was tried, what was the landscape like, funding, etc.”
Conclusion
Overall, I think the minimum viable product went well, and I’m excited to see more EA contests. I think well-run contests could a) generate direct impact, b) help people test relevant aptitudes, c) improve epistemics by encouraging people to form their own opinions/models, and d) help organizations identify talent & potential hires.
How You Can Help
I may apply for funding to run at least one contest in the upcoming months. Please reach out if you:
Have contest ideas.
Have any general advice on launching/running contests.
Want to help me brainstorm or run a contest.
Think this is a bad idea, or think there are harms/downsides/limitations that I might not be considering.