A relevant question I’m not sure about: for people who talk to politicians about AI risk, how useful are benchmarks? I’m not involved in those conversations so I can’t really say. My guess is that politicians are more interested in obvious capabilities (e.g. Claude can write good code now) than they are in benchmark performance.
A relevant question I’m not sure about: for people who talk to politicians about AI risk, how useful are benchmarks? I’m not involved in those conversations so I can’t really say. My guess is that politicians are more interested in obvious capabilities (e.g. Claude can write good code now) than they are in benchmark performance.