This list should have karma hidden and entries randomised. I guess most poeple do not read and vote all the way to the bottom. I certainly didn’t the first time I read it.
I agree; something like Reddit’s contest mode would be useful here. I’ve sorted the list by “newest first” to avoid mostly seeing the most upvoted entries.
I’m (pleasantly) surprised by the number of entries! But as a result the Forum seems pretty far from optimal as a platform for this discussion. Would be helpful to have a way to filter by focus area, for example.
The winners have been announced. It’s interesting to note the low correlation between comment karma and awards. Of the (3 out of 6) public submissions, the winners had a mean of 20 karma [as of posting this comment], minimum 18, and the (9 out of 15) honourable mentions a mean of 39 (suggesting perhaps these were somewhat weighted “by popular demand”), minimum 16. None of the winners were in the top 75 highest rated comments; 8⁄9 of the publicly posted honourable mentions were (including 4 in the top 11).
There are 6 winners and 15 honourable mentions listed in OP (21 total); the top 21 public submissions had a mean karma of 52, minimum 38; the top 50 a mean of 40, minimum 28; and the top 100 a mean of 31, minimum 18. And there are 86 public submissions not amongst the awardees with higher karma than the lowest karma award winner. See spreadsheet for details.
Given that half of the winners were private entries (2/3 if accounting for the fact that one was only posted publicly 2 weeks after the deadline), and 40% of the honourable mentions, one explanation could be that private entries were generally higher quality.
Note karma is an imperfect measure (so in addition to the factor Nathan mentions, maybe the discrepancy isn’t that surprising).
Alternatively, there could be an alternate ranking mode where you get two comments shown at once and you choose if one is better if they are about the same. Even a few people doing that would start to get a sense of if they agree with the overall ranking.
This list should have karma hidden and entries randomised. I guess most poeple do not read and vote all the way to the bottom. I certainly didn’t the first time I read it.
I agree; something like Reddit’s contest mode would be useful here. I’ve sorted the list by “newest first” to avoid mostly seeing the most upvoted entries.
I’m (pleasantly) surprised by the number of entries! But as a result the Forum seems pretty far from optimal as a platform for this discussion. Would be helpful to have a way to filter by focus area, for example.
Yeah I suggest it should be done like this, with search and filters as you suggest.
https://forum.effectivealtruism.org/posts/KigFfo4TN7jZTcqNH/the-future-fund-s-project-ideas-competition?commentId=G7aLWq4zypE77Fn6f
To prove the point: ATM the most upvoted comment is also the oldest one—Pablo’s Retrospective grant evaluations.
The winners have been announced. It’s interesting to note the low correlation between comment karma and awards. Of the (3 out of 6) public submissions, the winners had a mean of 20 karma [as of posting this comment], minimum 18, and the (9 out of 15) honourable mentions a mean of 39 (suggesting perhaps these were somewhat weighted “by popular demand”), minimum 16. None of the winners were in the top 75 highest rated comments; 8⁄9 of the publicly posted honourable mentions were (including 4 in the top 11).
There are 6 winners and 15 honourable mentions listed in OP (21 total); the top 21 public submissions had a mean karma of 52, minimum 38; the top 50 a mean of 40, minimum 28; and the top 100 a mean of 31, minimum 18. And there are 86 public submissions not amongst the awardees with higher karma than the lowest karma award winner. See spreadsheet for details.
Given that half of the winners were private entries (2/3 if accounting for the fact that one was only posted publicly 2 weeks after the deadline), and 40% of the honourable mentions, one explanation could be that private entries were generally higher quality.
Note karma is an imperfect measure (so in addition to the factor Nathan mentions, maybe the discrepancy isn’t that surprising).
Alternatively, there could be an alternate ranking mode where you get two comments shown at once and you choose if one is better if they are about the same. Even a few people doing that would start to get a sense of if they agree with the overall ranking.