EA Forum Prize: Winners for November 2018
CEA is pleased to announce the winners of the November 2018 EA Forum Prize!
In first place (for a prize of $999*): stefan.torges, âTakeaways from EAFâs Hiring Roundâ.
In second place (for a prize of $500): Sanjay, âWhy we have over-rated Cool Earthâ.
In third place (for a prize of $250): AdamGleave, â2017 Donor Lottery Reportâ.
*As it turns out, a prize of $1000 makes the accounting more difficult. Who knew?
What is the EA Forum Prize?
Certain posts exemplify the kind of content we most want to see on the EA Forum. They are well-researched and well-organized; they care about informing readers, not just persuading them.
The Prize is an incentive to create posts like this, but more importantly, we see it as an opportunity to showcase excellent content as an example and inspiration to the Forumâs users.
That said, the winning posts werenât âexclusivelyâ great. Our users published dozens of excellent posts in the month of November, and we had a hard time narrowing down to three winners. (There was even a three-way tie for third place this month, so we had to have a runoff vote!)
About the November winners
While this wasnât our express intent, Novemberâs winners wound up representing an interesting cross-section of the ways the EA community creates content.
âTakeaways from EAFâs Hiring Roundâ uses the experience of an established EA organization to draw lessons that could be useful to many other organizations and projects. The hiring process is documented so thoroughly that another person could follow it almost to the letter, from initial recruitment to a final decision. The author shares abundant data, and explains how EAFâs findings changed their own views on an important topic.
âWhy we have over-rated Cool Earthâ is a classic example of independent EA research. The author consults public data, runs his own statistical analyses, and reaches out to a charity with direct questions, bringing light to a subject on which the EA community doesnât have much knowledge or experience. He also offers alternative suggestions to fight climate change, all while providing enough numbers that any reader could double-check his work with their own assumptions.
To quote one comment on the post:
This sort of evaluation, which has the potential to radically change the consensus view on a charity, seems significantly under-supplied in our community, even though individual instances are tractable for a lone individual to produce.
â2017 Donor Lottery Reportâ is a different kind of research post, from an individual who briefly had resources comparable to an entire organizationâand used his fortunate position to collect information and share it with the community. He explains his philosophical background and search process to clarify the limits of his analysis, and shares the metrics he plans to use to evaluate his grants (which adds to the potential value of the post, since it opens the door for a follow-up post examining his results).
Qualities shared by all three winners:
Each post had a clear hierarchy of information, helping readers navigate the content and making discussion easier. Each author seems to have kept readers in mind as they wrote. This is crucial when posting on the Forum, since much of a postâs value relies on its being read, understood, and commented upon.
The authors didnât overstate the strength of their data or analyses, but also werenât afraid to make claims when they seemed to be warranted. We encourage Forum posts that prioritize information over opinion, but that doesnât mean that informative posts need to avoid opinion: sometimes, findings point in the direction of an interesting conclusion.
The voting process
All posts made in the month of November, save for those made by CEA staff, qualified for voting.
Prizes were chosen by seven people. Four of them are the Forumâs moderators (Max Dalton, Howie Lempel, Denise Melchin, and Julia Wise). The other three are the EA Forum users who had the most karma at the time the new Forum was launched (Peter Hurford, Joey Savoie, and Rob Wiblin).
All voters abstained from voting for content written by themselves or by organizations they worked with. Otherwise, they used their own individual criteria for choosing posts, though they broadly agree with the goals outlined above.
Winners were chosen by an initial round of approval voting, followed by a runoff vote to resolve ties.
Next month
The Prize will continue with rounds for December and January! After that, weâll evaluate whether we plan to keep running it (or perhaps change it in some way).
We hope that the Forumâs many excellent November posts will provide inspiration for more great material in the coming months.
Feedback on the Prize
Weâd love to hear any feedback you have about the EA Forum Prize. Leave a comment or contact Aaron Gertler with questions or suggestions.
- EA FoÂrum Prize: WinÂners for FeÂbruÂary 2019 by 29 Mar 2019 1:53 UTC; 46 points) (
- EA FoÂrum Prize: WinÂners for DeÂcemÂber 2018 by 30 Jan 2019 21:05 UTC; 46 points) (
- EA FoÂrum Prize: WinÂners for March 2019 by 7 May 2019 1:36 UTC; 45 points) (
- LatÂest ReÂsearch and UpÂdates for December by 4 Jan 2019 12:38 UTC; 37 points) (
- EA FoÂrum Prize: WinÂners for JanÂuary 2019 by 22 Feb 2019 22:27 UTC; 30 points) (
- EA FoÂrum Prize: WinÂners for May 2019 by 12 Jul 2019 1:48 UTC; 25 points) (
- 21 May 2020 14:15 UTC; 8 points) 's comment on 2017 Donor LotÂtery Report by (
- 21 May 2020 14:13 UTC; 3 points) 's comment on TakeÂaways from EAFâs Hiring Round by (
- 21 May 2020 14:14 UTC; 2 points) 's comment on Why we have over-rated Cool Earth by (
- 22 May 2020 3:22 UTC; 2 points) 's comment on InÂgreÂdiÂents for creÂatÂing disÂrupÂtive reÂsearch teams by (
I really like the prize idea as a method of content curation â I wasnât planning to read Sanjayâs Cool Earth post (because I didnât understand what it was about & it didnât seem relevant to my interests at first brush), but now I will.
Thanks all for making this happen :-)
A little strange that a postâs karma isnât part of the prize evaluation process.
(I guess it is implicitly, would be interesting to see an explicit karma component.)
I canât speak for any of the voters, but they can use any criteria they want (taking our goals for the Forum as a set of suggestions that, in practice, they broadly agree with). Iâd guess that karma is something that voters consider, because itâs a reasonable measure of how helpful people actually found a post.
Is the runoff vote also approval voting?
Thanks for splitting your questions into different comments! Good policy for threads that arenât too crowded. The runoff vote was plurality-wins, because we didnât want a tie to further delay the announcement (our voters have a lot of other things on their plates). Weâll keep iterating on the process as we move forward.