Definitely possible for the job prompt—do you have any thoughts on how else to ask the question about “best jobs” in a way that makes it clear that we mean “best” in the moral sense?
(Again I did try varying the prompt a bit and the results seemed similar, but I always used the word “moral”. I don’t want to say something like “I don’t mean best for me, I mean best for the world”, since that’s asking for a consequentialist answer.)
Other comments make me think the language wasn’t a big factor, but trying to model what my college-aged self would have asked before hearing about EA: “what career will help other people the most” / “what career will make the world a better place”
Okay, interesting—that’s baking in an EAish (or at least consequentialist) framing that I was trying to cut out by just saying “most moral”, but fair point that maybe EAs just use the word “moral” next to “jobs” unusually often and that outweighs this.
In any case, yes, as Linch has pointed out, it seems these effects are small—trying your prompts now, they seem to produce answers about as EA-coded as the “morally speaking” one.
Yep that word “moral” was the only dubiously EA coded looking one in your prompts to me. But like you say results seem to hold which is kind of wild...
Definitely possible for the job prompt—do you have any thoughts on how else to ask the question about “best jobs” in a way that makes it clear that we mean “best” in the moral sense?
(Again I did try varying the prompt a bit and the results seemed similar, but I always used the word “moral”. I don’t want to say something like “I don’t mean best for me, I mean best for the world”, since that’s asking for a consequentialist answer.)
Other comments make me think the language wasn’t a big factor, but trying to model what my college-aged self would have asked before hearing about EA: “what career will help other people the most” / “what career will make the world a better place”
Okay, interesting—that’s baking in an EAish (or at least consequentialist) framing that I was trying to cut out by just saying “most moral”, but fair point that maybe EAs just use the word “moral” next to “jobs” unusually often and that outweighs this.
In any case, yes, as Linch has pointed out, it seems these effects are small—trying your prompts now, they seem to produce answers about as EA-coded as the “morally speaking” one.
Yep that word “moral” was the only dubiously EA coded looking one in your prompts to me. But like you say results seem to hold which is kind of wild...