I lack the ML expertise to judge this paper, but my sense is it means you can create a pretty good working chatbot on a bunch of licensed textbooks.
Having said that, I don’t see how a neural network could generate the variety of seemingly fitting responses that ChatGPT does for various contexts (eg. news, social situations) without neural weights being adjusted to represent patterns found in those contexts.
I’m curious what you think of this, and if it impedes what you’re describing being effective or not: https://arxiv.org/abs/2309.05463
Two thoughts:
I lack the ML expertise to judge this paper, but my sense is it means you can create a pretty good working chatbot on a bunch of licensed textbooks.
Having said that, I don’t see how a neural network could generate the variety of seemingly fitting responses that ChatGPT does for various contexts (eg. news, social situations) without neural weights being adjusted to represent patterns found in those contexts.
What are your thoughts?