[TO ML RESEARCHERS AND MAYBE TECH EXECUTIVES] When you look at society’s problems, you can observe that many of our structural problems come from strong optimizers.
Companies, to keep growing once they’re big enough, start having questionable practices such as tax evasion, preventing new companies from entering markets, capturing regulators to keep their benefits etc.
Policymakers who are elected are those who are doing false promises, who are ruthless with their adversaries and who are using communication without caring about truth.
Now, even these optimizers that are hard to fight against, are very limited in their capabilities. They’re limited by coordination costs, by their limited ability to forecast or by their limited ability to process relevant information. AI poses the risk to break down these barriers and be able to optimize much more strongly. And thus, the feeling that you may have next to these companies and policymakers, i.e that you can’t stop them even if you the way they’re cheating, will be multiplied tenfold next to smarter AIs.
[TO ML RESEARCHERS AND MAYBE TECH EXECUTIVES]
When you look at society’s problems, you can observe that many of our structural problems come from strong optimizers.
Companies, to keep growing once they’re big enough, start having questionable practices such as tax evasion, preventing new companies from entering markets, capturing regulators to keep their benefits etc.
Policymakers who are elected are those who are doing false promises, who are ruthless with their adversaries and who are using communication without caring about truth.
Now, even these optimizers that are hard to fight against, are very limited in their capabilities. They’re limited by coordination costs, by their limited ability to forecast or by their limited ability to process relevant information. AI poses the risk to break down these barriers and be able to optimize much more strongly. And thus, the feeling that you may have next to these companies and policymakers, i.e that you can’t stop them even if you the way they’re cheating, will be multiplied tenfold next to smarter AIs.