I think there very much is a limitation in the loss function, when you consider efficiency of results. In chess, stockfish and alphazero don’t just match the best chess players, they exceed them by a ridiculous level, and that’s right now. Whereas GPT, with the same level of computation, still hasn’t figured out how not to make illegal moves.
I can’t rule out that a future GPT version will be able to beat the best human, by really good pattern matching on what a “winning” game looks like. But that’s still pattern matching on human games. Stockfish has no such limitation.
I think there very much is a limitation in the loss function, when you consider efficiency of results. In chess, stockfish and alphazero don’t just match the best chess players, they exceed them by a ridiculous level, and that’s right now. Whereas GPT, with the same level of computation, still hasn’t figured out how not to make illegal moves.
I can’t rule out that a future GPT version will be able to beat the best human, by really good pattern matching on what a “winning” game looks like. But that’s still pattern matching on human games. Stockfish has no such limitation.