I am quite interested in exploring this more. We currently have a prosaic list of potential capstone projects, intended to be done by AGI Safety Fundamentals programme participants after the course. I think forms a prototype of this proposal, however one main difference is it’s not really about cutting-edge research, more like skilling-up and fit-testing ideas.
Some questions I am interested in exploring further to see where the needs are for this meta-project:
Do AIS researchers have a list of projects ready-to-go that they don’t publicly advertise? My guess: probably? Most people have too many threads they want to pursue in not enough time—in my experience it doesn’t take long to get to this point in a research career.
If researchers do have lists of project ideas, why don’t they share the lists already? My guesses as to why: 1) They haven’t (all) written them down in a sharable format 2) There’s no logical place to put them (e.g. a board doesn’t exist), so no obvious inspiration to publish a list or proof that it’s impactful. 3) Working on a project requires a lot of context on previous work done in the same vein. Supporting people who want to pursue a project idea would be a lot of work for the idea-originator, to get the project off the ground. With a public board, the researcher doesn’t get to vet candidates who might try to take the projects on, which might make it difficult to manage deciding who they want to work with or not on top of doing their regular work. Vetting and management/ops are some of the things AI safety camp and CERI summer research fellowship offers, for that reason.
Why don’t other fields have public lists of ideas? E.g. is there a list of research ideas for nuclear fusion? I don’t think there is—so other fields also do project coordination behind closed doors, in academic institutions and conferences. My guess as to why: other fields may just not be well coordinated and maybe we could just do better. They also don’t have as much untied funding for individual researchers to spring up and take stuff on, outside of universities/institutions.
I think there are multiple reasons: a) If there is no explicit board people just don’t do it because there is no norm and it’s work. b) If you post about your research it might be scooped. c) People haven’t written up the projects in a sharable format. d) You might not find the right people on such a board?!
I think there are many failure modes for such a board but it seems worth a try at least.
I guess most other fields don’t have such a board because sharing culture isn’t very strong and you’re incentivized to be secret and not share to achieve personal goals.
Thanks for proposing this, it’s a great idea!
I am quite interested in exploring this more. We currently have a prosaic list of potential capstone projects, intended to be done by AGI Safety Fundamentals programme participants after the course. I think forms a prototype of this proposal, however one main difference is it’s not really about cutting-edge research, more like skilling-up and fit-testing ideas.
Some questions I am interested in exploring further to see where the needs are for this meta-project:
Do AIS researchers have a list of projects ready-to-go that they don’t publicly advertise?
My guess: probably? Most people have too many threads they want to pursue in not enough time—in my experience it doesn’t take long to get to this point in a research career.
If researchers do have lists of project ideas, why don’t they share the lists already?
My guesses as to why:
1) They haven’t (all) written them down in a sharable format
2) There’s no logical place to put them (e.g. a board doesn’t exist), so no obvious inspiration to publish a list or proof that it’s impactful.
3) Working on a project requires a lot of context on previous work done in the same vein. Supporting people who want to pursue a project idea would be a lot of work for the idea-originator, to get the project off the ground.
With a public board, the researcher doesn’t get to vet candidates who might try to take the projects on, which might make it difficult to manage deciding who they want to work with or not on top of doing their regular work.
Vetting and management/ops are some of the things AI safety camp and CERI summer research fellowship offers, for that reason.
Why don’t other fields have public lists of ideas? E.g. is there a list of research ideas for nuclear fusion? I don’t think there is—so other fields also do project coordination behind closed doors, in academic institutions and conferences.
My guess as to why: other fields may just not be well coordinated and maybe we could just do better. They also don’t have as much untied funding for individual researchers to spring up and take stuff on, outside of universities/institutions.
Interested if you or others have thoughts!
I think there are multiple reasons:
a) If there is no explicit board people just don’t do it because there is no norm and it’s work.
b) If you post about your research it might be scooped.
c) People haven’t written up the projects in a sharable format.
d) You might not find the right people on such a board?!
I think there are many failure modes for such a board but it seems worth a try at least.
I guess most other fields don’t have such a board because sharing culture isn’t very strong and you’re incentivized to be secret and not share to achieve personal goals.