While AI value alignment is considered a serious problem, the algorithms we use every day do not seem to be subject to alignment. That sounds like a serious problem to me. Has no one ever tried to align the YouTube algorithm with our values? What about on other types of platforms?
Since around 2017, there has been a lot of public interest in how youtube’s recommendation algorithms may affect individuals and society negatively. Governments, think tanks, the press/media, and other institutions have pressured youtube to adjust its recommendations. You could think of this as our world’s (indirect & corrupted) way of trying to instill humanity’s values into youtube’s algorithms.
I believe this sort of thing doesn’t get much attention from EAs because there’s not really a strong case for it being a global priority in the same way that existential risk from AI is.
Do you believe that altruism actually makes people happy? Peter Singer’s book argues that people become happier by behaving altruistically, and psychoanalysis also classifies altruism as a mature defense mechanism. However, there are also concerns about pathological altruism and people pleasers. In-depth research data on this is desperately needed.
After being only for a few months deeply into EA I already realise that discussing with non EA-people makes me emotional, since I “cannot understand” why they are not getting easily convinced of it as well. How can something so logical not being followed by everyone? At least by donating? I think there is the danger to become pathetic if you don’t reflect on it and be aware that you cannot convince everybody.
On the other side EA is already having a big impact on how I donate and how I act in my job—so in this regards I do feel much more impactful which certainly makes me happier and more relaxed in other parts of my life as ambitions shifted. Does that make any sense?
Would also be interested on research if anyone has!
Haha. Well, I guess I would first ask effective at what? Effective at giving people additional years of healthy & fulfilling life? Effective at creating new friendships? Effective at making people smile?
I haven’t studied it at all, but my hypothesis that it is the kind of intervention that is similar to “awareness building,” but it doesn’t have any call to action (such as a donation). So it is probably effective in giving people a nice experience for a few seconds, and maybe improving their mood for a period of time, but it probably doesn’t have longer-lasting effects. From a cursory glance at Google Scholar, it looks like there hasn’t been much research on free hugs.
Hmm, I’m a little confused. If I cook a meal for someone, it doesn’t seem to mean much. But if no one is cooking for someone, it is a serious problem and we need to help. Of course, I’m not sure if we’re suffering from that kind of “skinship hunger.”
I’d also re-focus on effective at what? What is the goal or objective of these free hugs? Once you know that, then you can more easily estimate how effective free hugs are compared to other interventions.
Using the analogy of hunger, here is one way that I am currently thinking about it: giving a willing stranger a hug is like giving a willing stranger a candy bar; they get some nourishment, but if they are chronically food insecure this won’t solve that longer-term problem. It won’t help them get regular/consistent access to meals that they can afford. So in that sense it is like a band-aid: it is treating the symptom, but it is not addressing the cause.
If someone is suffering from a consistent and pervasive lack of human touch, such as “skinship hunger,” a hug might feel nice for a few seconds, but when the hug is finished that person’s situation (lacking human touch) remains unchanged. I suppose you could create some kind of program in which they spend 60 minutes with a professional cuddler every week, but I honestly don’t see that as being cost competitive if the goal is to get QALYs at the best price.
But if you just want to estimate it then you could put together a simple Fermi estimate: what are the costs to giving free hugs, and what are the benefits, and then figure out how much value do you please on each of those.
It is like a seed. Basic trust and support are provided. It is doubtful whether long-term, indefinite provision is necessary. Wouldn’t it be similar to UBI? I don’t know because there is no research. I believe you are begging the question. I can’t agree or disagree with the claim that it will soon return to its initial state without any long-term effects. As for the estimate… I’m not sure. I can’t think of a good measure or anything yet. I might need a psychologist to help me. Perhaps an estimate for mental health or well-being, but I doubt QALYs or DALYs. But as an initial estimate, it seems like a good measure. Alternatively, it could be expressed as pain relief or social support. I confess I had no intention of doing any serious research, as I was simply asking for an idea. It’s more of a question of whether it’s worth it.
One of the things I find difficult about discussing problem solving with people is that they often fall back on shallow causes. For example, if politician A’s corruption is the problem, you can kick him out. easy. Problem solved! This is the problem. Of course, the problem was solved, but the problem was not solved. The natural assumption is that politician B will cause a similar problem again. In the end, that’s the advice people give. “Kick A out!!” Whatever it was. Whether it’s your weird friends, your bad grades, or your weight. Of course, this is a personal problem, but couldn’t it be expanded to a general problem of decision-making? Maybe it would have been better to post it on lesswrong. Still, I’d like to hear your opinions.
I noticed that many people write a lot not only on forums but also on personal blogs and Substack. This is sad. Competent and passionate people are writing in places that get very few views. I too am one of those people. But honestly, magazines and articles are stressful and difficult, and forums are so huge that even if they have a messaging function, it is difficult to achieve a transparent state where each person can fully recognize their own epistemological status. I’m interested in such collaborative blogs, similar to the early Overcoming Bias. I believe that many bloggers and writers need help and that we can help each other. Is there anyone who wants to be with me?
Much of the writing here relies on confusing metaconcepts. Preferences, intuition, etc. are not things like apples and trees. I hope the confusion will be overcome. Is there a useful metaphysics for dealing with this? Perhaps anyone interested in complex controversies in the philosophy of mathematics will know.
Is there any research on the gap between AI safety research and reality? I wanted to read Eric Drexler’s report on R&D automation in AI development, but it was too long so I put it on hold. It is very doubtful whether such things are within the controllable area. (1)OpenAI incident (2)Open source projects such as stockfish have their development process made public. However, it is very unclear and opaque (despite their best efforts). Overall, I feel strongly that research on AI safety is disconnected from reality.
Thoughts on project or research auction. It is very cumbersome to apply for funds one by one from Openphil or EA fund. Wouldn’t it be better for a major EA organization to auction off the opportunity to participate in a project and let others buy it? It will be similar to a tournament, but you will be able to sell a lot more projects at a lower price and reduce the amount of resources wasted on having many people competing for the same project.
While AI value alignment is considered a serious problem, the algorithms we use every day do not seem to be subject to alignment. That sounds like a serious problem to me. Has no one ever tried to align the YouTube algorithm with our values? What about on other types of platforms?
You might be interested in Building Human Values into Recommender Systems: An Interdisciplinary Synthesis as well as Jonathan Stray’s other work on alignment and beneficence of recommender systems.
Since around 2017, there has been a lot of public interest in how youtube’s recommendation algorithms may affect individuals and society negatively. Governments, think tanks, the press/media, and other institutions have pressured youtube to adjust its recommendations. You could think of this as our world’s (indirect & corrupted) way of trying to instill humanity’s values into youtube’s algorithms.
I believe this sort of thing doesn’t get much attention from EAs because there’s not really a strong case for it being a global priority in the same way that existential risk from AI is.
Do you believe that altruism actually makes people happy? Peter Singer’s book argues that people become happier by behaving altruistically, and psychoanalysis also classifies altruism as a mature defense mechanism. However, there are also concerns about pathological altruism and people pleasers. In-depth research data on this is desperately needed.
Good question I also think about!
After being only for a few months deeply into EA I already realise that discussing with non EA-people makes me emotional, since I “cannot understand” why they are not getting easily convinced of it as well. How can something so logical not being followed by everyone? At least by donating? I think there is the danger to become pathetic if you don’t reflect on it and be aware that you cannot convince everybody.
On the other side EA is already having a big impact on how I donate and how I act in my job—so in this regards I do feel much more impactful which certainly makes me happier and more relaxed in other parts of my life as ambitions shifted. Does that make any sense?
Would also be interested on research if anyone has!
I would like to estimate how effective free hugs are. Can anyone help me?
Haha. Well, I guess I would first ask effective at what? Effective at giving people additional years of healthy & fulfilling life? Effective at creating new friendships? Effective at making people smile?
I haven’t studied it at all, but my hypothesis that it is the kind of intervention that is similar to “awareness building,” but it doesn’t have any call to action (such as a donation). So it is probably effective in giving people a nice experience for a few seconds, and maybe improving their mood for a period of time, but it probably doesn’t have longer-lasting effects. From a cursory glance at Google Scholar, it looks like there hasn’t been much research on free hugs.
Hmm, I’m a little confused. If I cook a meal for someone, it doesn’t seem to mean much. But if no one is cooking for someone, it is a serious problem and we need to help. Of course, I’m not sure if we’re suffering from that kind of “skinship hunger.”
I’d also re-focus on effective at what? What is the goal or objective of these free hugs? Once you know that, then you can more easily estimate how effective free hugs are compared to other interventions.
Using the analogy of hunger, here is one way that I am currently thinking about it: giving a willing stranger a hug is like giving a willing stranger a candy bar; they get some nourishment, but if they are chronically food insecure this won’t solve that longer-term problem. It won’t help them get regular/consistent access to meals that they can afford. So in that sense it is like a band-aid: it is treating the symptom, but it is not addressing the cause.
If someone is suffering from a consistent and pervasive lack of human touch, such as “skinship hunger,” a hug might feel nice for a few seconds, but when the hug is finished that person’s situation (lacking human touch) remains unchanged. I suppose you could create some kind of program in which they spend 60 minutes with a professional cuddler every week, but I honestly don’t see that as being cost competitive if the goal is to get QALYs at the best price.
But if you just want to estimate it then you could put together a simple Fermi estimate: what are the costs to giving free hugs, and what are the benefits, and then figure out how much value do you please on each of those.
It is like a seed. Basic trust and support are provided. It is doubtful whether long-term, indefinite provision is necessary. Wouldn’t it be similar to UBI? I don’t know because there is no research. I believe you are begging the question. I can’t agree or disagree with the claim that it will soon return to its initial state without any long-term effects. As for the estimate… I’m not sure. I can’t think of a good measure or anything yet. I might need a psychologist to help me. Perhaps an estimate for mental health or well-being, but I doubt QALYs or DALYs. But as an initial estimate, it seems like a good measure. Alternatively, it could be expressed as pain relief or social support. I confess I had no intention of doing any serious research, as I was simply asking for an idea. It’s more of a question of whether it’s worth it.
Resolved unresolved issues
One of the things I find difficult about discussing problem solving with people is that they often fall back on shallow causes. For example, if politician A’s corruption is the problem, you can kick him out. easy. Problem solved! This is the problem. Of course, the problem was solved, but the problem was not solved. The natural assumption is that politician B will cause a similar problem again. In the end, that’s the advice people give. “Kick A out!!” Whatever it was. Whether it’s your weird friends, your bad grades, or your weight. Of course, this is a personal problem, but couldn’t it be expanded to a general problem of decision-making? Maybe it would have been better to post it on lesswrong. Still, I’d like to hear your opinions.
I noticed that many people write a lot not only on forums but also on personal blogs and Substack. This is sad. Competent and passionate people are writing in places that get very few views. I too am one of those people. But honestly, magazines and articles are stressful and difficult, and forums are so huge that even if they have a messaging function, it is difficult to achieve a transparent state where each person can fully recognize their own epistemological status. I’m interested in such collaborative blogs, similar to the early Overcoming Bias. I believe that many bloggers and writers need help and that we can help each other. Is there anyone who wants to be with me?
Much of the writing here relies on confusing metaconcepts. Preferences, intuition, etc. are not things like apples and trees. I hope the confusion will be overcome. Is there a useful metaphysics for dealing with this? Perhaps anyone interested in complex controversies in the philosophy of mathematics will know.
Is there any research on the gap between AI safety research and reality? I wanted to read Eric Drexler’s report on R&D automation in AI development, but it was too long so I put it on hold.
It is very doubtful whether such things are within the controllable area.
(1)OpenAI incident
(2)Open source projects such as stockfish have their development process made public. However, it is very unclear and opaque (despite their best efforts).
Overall, I feel strongly that research on AI safety is disconnected from reality.
Thoughts on project or research auction. It is very cumbersome to apply for funds one by one from Openphil or EA fund. Wouldn’t it be better for a major EA organization to auction off the opportunity to participate in a project and let others buy it? It will be similar to a tournament, but you will be able to sell a lot more projects at a lower price and reduce the amount of resources wasted on having many people competing for the same project.
I think this requires more elaboration how exactly the suggested system is supposed to work.
I wrote the post
I am planning to write post about happiness guilt. I think many of EA would have it. Can you share resources or personal experiences?
Detach the grim-o-meter comes to mind. I think that post helped me a little bit.
Nobody interested in resuming EA and LW post summaries? Quitting was a very unfortunate choice, I think.