I strongly upvoted this post because I’m extremely interested in seeing it get more attention and, hopefully, a potential rebuttal. I think this is extremely important to get to the bottom of!
At first glance your critiques seem pretty damning, but I would have to put a bunch of time into understanding ACE’s evaluations first before I would be able to conclude whether I agree your critiques (I can spend a weekend day doing this and writing up my own thoughts in a new post if there is interest).
My expectation is that if I were to do this I would come out feeling less confident than you seem to be. I’m a bit concerned that you haven’t made an attempt at explaining why ACE might have constructed their analyses this way.
But like I’m pretty confused too. It’s hard to think of much justification for the choice of numbers in the ‘Impact Potential Score’ and deciding the impact of a book based on the average of all books doesn’t seem like the best way to approach things?
I strongly upvoted this post because I’m extremely interested in seeing it get more attention and, hopefully, a potential rebuttal. I think this is extremely important to get to the bottom of!
At first glance your critiques seem pretty damning, but I would have to put a bunch of time into understanding ACE’s evaluations first before I would be able to conclude whether I agree your critiques (I can spend a weekend day doing this and writing up my own thoughts in a new post if there is interest).
My expectation is that if I were to do this I would come out feeling less confident than you seem to be. I’m a bit concerned that you haven’t made an attempt at explaining why ACE might have constructed their analyses this way.
But like I’m pretty confused too. It’s hard to think of much justification for the choice of numbers in the ‘Impact Potential Score’ and deciding the impact of a book based on the average of all books doesn’t seem like the best way to approach things?
Hi Mathias,
Thank you for your comment!
We would definitely be interested in hearing your thoughts. We’ve set post notifications on for your profile, and look forward to seeing your post!