Agreed that it’s rare that people take a cause-neutral view of the world, but I don’t think my questions demanded cause-neutrality.
On the money question in particular, I just asked where it would give money, not “where it does the most good for the world to give money”. It could just as well have answered that it would give to something AI-related because it’s an AI, or look up who gave it the money (or who its owners, i.e. the owners of OpenAI/Anthropic/Google are) and give to something dear to them.
I’m not surprised that adding a personal story could move it in a less impartial direction, just as adding language about “wanting to do the most good for the world” or whatever could move it in a more impartial direction; what’s interesting to me is that when you don’t have either, it tends to default to something relatively impartial.
Agreed that it’s rare that people take a cause-neutral view of the world, but I don’t think my questions demanded cause-neutrality.
On the money question in particular, I just asked where it would give money, not “where it does the most good for the world to give money”. It could just as well have answered that it would give to something AI-related because it’s an AI, or look up who gave it the money (or who its owners, i.e. the owners of OpenAI/Anthropic/Google are) and give to something dear to them.
I’m not surprised that adding a personal story could move it in a less impartial direction, just as adding language about “wanting to do the most good for the world” or whatever could move it in a more impartial direction; what’s interesting to me is that when you don’t have either, it tends to default to something relatively impartial.