What I’m saying is that a joint probability can encode “how to check a Python string against the relevant grammar”. Learning such a joint probability (a procedure which may not involve actually seeing any Python strings) seems difficult, but seeming difficulty isn’t nearly enough to convince me that it’s impossible.
Right .. but I see that as a problem if you claim that Python doesn’t have a relevant grammar. Of course everyone knows it has a grammar so no one claims this. But people DO claim that natural language does not have a grammar. This is what I have a problem with. If they said natural language has a grammar and “neural networks can check a natural language string against the relevant grammar”, I would have no problems. But then these people would not be in a position to claim that they have discovered something new about language, just like we are not in a position to claim that we have discovered anything about Python.
What I’m saying is that a joint probability can encode “how to check a Python string against the relevant grammar”. Learning such a joint probability (a procedure which may not involve actually seeing any Python strings) seems difficult, but seeming difficulty isn’t nearly enough to convince me that it’s impossible.
Right .. but I see that as a problem if you claim that Python doesn’t have a relevant grammar. Of course everyone knows it has a grammar so no one claims this. But people DO claim that natural language does not have a grammar. This is what I have a problem with. If they said natural language has a grammar and “neural networks can check a natural language string against the relevant grammar”, I would have no problems. But then these people would not be in a position to claim that they have discovered something new about language, just like we are not in a position to claim that we have discovered anything about Python.