Facebook ads: can you really do A/B testing on a comparable audience?
On Facebook ‘Lift testing’
… can you really compare ‘ad A vs ad B’ to see which works better on a comparable audience?
Braun and Schwartz (Hat tip, Josh Lewis)… seem to think this is NOT possible in the current FB setup (and maybe not on most platforms either). … Because of the way each ad design is separately targeted/optimized to its ‘best audience’.
Smartly seems to imply that multi-cell lift tests do not suffer from this problem.
… But it’s unclear if this really implements ‘target then randomize’.
Facebook ads: can you really do A/B testing on a comparable audience?
On Facebook ‘Lift testing’
… can you really compare ‘ad A vs ad B’ to see which works better on a comparable audience?
Braun and Schwartz (Hat tip, Josh Lewis)… seem to think this is NOT possible in the current FB setup (and maybe not on most platforms either). … Because of the way each ad design is separately targeted/optimized to its ‘best audience’.
Smartly seems to imply that multi-cell lift tests do not suffer from this problem.
… But it’s unclear if this really implements ‘target then randomize’.