I’m a senior software developer in Canada (earning ~US$70K in a good year) who, being late to the EA party, earns to give. Historically I’ve have a chronic lack of interest in making money; instead I’ve developed an unhealthy interest in foundational software that free markets don’t build because their effects would consist almost entirely of positive externalities.
I dream of making the world better by improving programming languages and developer tools, but AFAIK no funding is available for this kind of work outside academia. My open-source projects can be seen at loyc.net, core.loyc.net, ungglish.loyc.net and ecsharp.net (among others).
Based on Habryka’s point, what if “stage 1b” allowed the two reviewers to come to their own conclusions according to their own biases, and then at the end, each reviewer is asked to give an initial impression as to whether it’s fund-worthy (I suppose this means its EV is equal to or greater than typical GiveWell charity) or not (EV may be positive, but not high enough).
This impression doesn’t need to be published to anyone if, as you say, the point of this stage is not to produce an EV estimate. But whenever both reviewers come to the same conclusion (whether positive or not), a third reviewer is asked to review it too, to potentially point out details the first reviewers missed.
Now, if all three reviewers give a thumbs down, I’m inclined to think … the applicant should be notified and suggested to go back to the drawing board? If it’s just two, well, maybe that’s okay, maybe EV will be decidedly good upon closer analysis.
I think reviewers need to be able (and encouraged) to ask questions of the applicant, as applications are likely to be have some points that are fuzzy or hard to understand. It isn’t just that some proposals are written by people with poor communication skills; I think this will be a particular problem with ambitious projects whose vision is hard to articulate. Perhaps the Q&As can be appended to the application when it becomes public? But personally, as an applicant, I would be very interested to edit the original proposal to clarify points at the location where they are first made.
And perhaps proposals will need to be rate-limited to discourage certain individuals from wasting too much reviewer time?