(1) seems worth funding to the extent that it’s fund-able (like if it were an open source software project)
I’m less optimistic about public advocacy. As ML models have had a greater impact on peoples lives, there’s already been more of a public movement looking for more transparency and accountability for these models (which could include structured access). It seems like this isn’t a very strong incentive to existing companies’ products.
(5) I like a lot, and would fit well with structured evaluation programmes, like BIG-Bench
(1) seems worth funding to the extent that it’s fund-able (like if it were an open source software project)
I’m less optimistic about public advocacy. As ML models have had a greater impact on peoples lives, there’s already been more of a public movement looking for more transparency and accountability for these models (which could include structured access). It seems like this isn’t a very strong incentive to existing companies’ products.
(5) I like a lot, and would fit well with structured evaluation programmes, like BIG-Bench