In engineering, there are many horrendous conceptual issues that just don’t come up in practice. (I have in mind stuff like finite element analysis, a method which works really well despite its assumptions being constantly violated.)
Similarly, there things which are conceptually fine but practically intractable once you try and do them.
The idea with Elicit seems to be to try a difficult but tractable alignment problem, and so work out what problems we’re overblowing and what we’re overlooking.
Not at Ought, but I can try:
In engineering, there are many horrendous conceptual issues that just don’t come up in practice. (I have in mind stuff like finite element analysis, a method which works really well despite its assumptions being constantly violated.)
Similarly, there things which are conceptually fine but practically intractable once you try and do them.
The idea with Elicit seems to be to try a difficult but tractable alignment problem, and so work out what problems we’re overblowing and what we’re overlooking.