This feels somewhat analogous to how a lossless compression algorithm can’t work on all inputs at once, and a learning algorithm can’t be superior on every problem at once. For each algorithm, you can construct an example where it fails miserably.
Yet we still have whole industries dedicated to using learning and compression algorithms, because you can manufacture ones that work for all realistic problems, which is a family that doesn’t include that pathological construction.
This feels somewhat analogous to how a lossless compression algorithm can’t work on all inputs at once, and a learning algorithm can’t be superior on every problem at once. For each algorithm, you can construct an example where it fails miserably.
Yet we still have whole industries dedicated to using learning and compression algorithms, because you can manufacture ones that work for all realistic problems, which is a family that doesn’t include that pathological construction.