Looks like a great idea, very glad someone is pursuing the roll-up-your-sleeves method here.
I think the best addition to this that you could make is a business plan—basically, how much would it cost to replicate how many studies, how would you best choose studies for replication to maximize efficiency / impact, how much / how long until you were replicating 1 or 10% of top studies, etc. I’d also personally like to see a different version of “what has been achieved” that didn’t lean as much on collaborations / work of collaborators, as I find these basically meaningless.
The budget section (omitted here) has more of these details.
Re: selection, the idea is systematically replicating all new research in top journals, to change researchers’ expectations from (a) expecting to have basically no one scrutinize their work to (b) expecting at least some post-publication review. This incentivizes researchers to improve the quality of their work.
Re: collaborators, I4R currently works by asking academics to volunteer to replicate papers.
Looks like a great idea, very glad someone is pursuing the roll-up-your-sleeves method here.
I think the best addition to this that you could make is a business plan—basically, how much would it cost to replicate how many studies, how would you best choose studies for replication to maximize efficiency / impact, how much / how long until you were replicating 1 or 10% of top studies, etc. I’d also personally like to see a different version of “what has been achieved” that didn’t lean as much on collaborations / work of collaborators, as I find these basically meaningless.
The budget section (omitted here) has more of these details.
Re: selection, the idea is systematically replicating all new research in top journals, to change researchers’ expectations from (a) expecting to have basically no one scrutinize their work to (b) expecting at least some post-publication review. This incentivizes researchers to improve the quality of their work.
Re: collaborators, I4R currently works by asking academics to volunteer to replicate papers.