And without minimizing all the effort that went into the list, it was compiled fairly quickly with a specific purpose in mind. For example, I’d expect OP to devote more of the limited time available to classifying grants near where it expected the new bars to be. For example, ensuring high accuracy in tier 1 vs 2 vs 3 (maybe even vs. high 4) probably wasn’t at the top of the priority list. So it would probably be safer to view the determined tiers as +/- 1 tier, which significantly limits usefulness.
Also, unless OP released a ranked list, we wouldnt know where in a tier the grant fell. My guess is that there isn’t that much difference in absolute quality between the bottom of tier 4 and the top of tier 5, and that line could move based on market conditions, cause area allocation, etc.
And without minimizing all the effort that went into the list, it was compiled fairly quickly with a specific purpose in mind. For example, I’d expect OP to devote more of the limited time available to classifying grants near where it expected the new bars to be. For example, ensuring high accuracy in tier 1 vs 2 vs 3 (maybe even vs. high 4) probably wasn’t at the top of the priority list. So it would probably be safer to view the determined tiers as +/- 1 tier, which significantly limits usefulness.
Also, unless OP released a ranked list, we wouldnt know where in a tier the grant fell. My guess is that there isn’t that much difference in absolute quality between the bottom of tier 4 and the top of tier 5, and that line could move based on market conditions, cause area allocation, etc.
I do think that at least grantees should be told.