I hadn’t noticed the discrepancy before between the conversation notes test and their other tests, which generally read something like this:
“This test should require somewhere between X and Y hours of work; please send us your work, even if it’s incomplete, after Y hours.”
Adjusting the notes test seems like a good step, or at least asking applicants how much time they spent, so that there’s a clear tradeoff between speed and thoroughness (maybe it’s the case that a slightly messy four-hour test gets as good a score as a better eight-hour test, and Open Phil would be happy to consider both, or something like that).
I hadn’t noticed the discrepancy before between the conversation notes test and their other tests, which generally read something like this:
“This test should require somewhere between X and Y hours of work; please send us your work, even if it’s incomplete, after Y hours.”
Adjusting the notes test seems like a good step, or at least asking applicants how much time they spent, so that there’s a clear tradeoff between speed and thoroughness (maybe it’s the case that a slightly messy four-hour test gets as good a score as a better eight-hour test, and Open Phil would be happy to consider both, or something like that).