Benchmarks will become useless due to eval awareness¹ (read this backwards originally)
Useless is a strong word. But yea I think they could easily end up being negative EV by giving us a false sense of security and the chance it’s meaningless seems p high. If mech interp is “good enough” maybe the two can remain useful together.
Useless is a strong word. But yea I think they could easily end up being negative EV by giving us a false sense of security and the chance it’s meaningless seems p high. If mech interp is “good enough” maybe the two can remain useful together.