Great work! I wonder if there are any ways to track quality adjusted engagement since that what we’ve mostly been optimizing for the last few years. E. g. if low-quality page views/joins/listeners are going down it seems hard to compensate with an equal number of high quality ones because they’re harder to create. 80k’s impact adjusted plan changes metric is the only suitable metric I can think of.
Impact adjusting is fairly values sensitive and may differ dramatically even between EAs, which is why I’d prefer to report raw data and let other people attempt their own impact adjustments on top of it.
I don’t think you get enough information from pageview tracking to be able to impact adjust each pageview, but perhaps you could track engagement hours (as 80K does) or engagement on particular target pages. Additionally you could impact adjust based on source (e.g., weighing growth in 80K pageviews higher than growth in Future Perfect pageviews).
The pledge counts and donation totals also likely lend themselves to impact adjusting fairly well, as you could impact adjust based on charities donated to (most of the raw data to do this is available) or the kind of pledge taken.
Great work! I wonder if there are any ways to track quality adjusted engagement since that what we’ve mostly been optimizing for the last few years. E. g. if low-quality page views/joins/listeners are going down it seems hard to compensate with an equal number of high quality ones because they’re harder to create. 80k’s impact adjusted plan changes metric is the only suitable metric I can think of.
Impact adjusting is fairly values sensitive and may differ dramatically even between EAs, which is why I’d prefer to report raw data and let other people attempt their own impact adjustments on top of it.
I don’t think you get enough information from pageview tracking to be able to impact adjust each pageview, but perhaps you could track engagement hours (as 80K does) or engagement on particular target pages. Additionally you could impact adjust based on source (e.g., weighing growth in 80K pageviews higher than growth in Future Perfect pageviews).
The pledge counts and donation totals also likely lend themselves to impact adjusting fairly well, as you could impact adjust based on charities donated to (most of the raw data to do this is available) or the kind of pledge taken.