Thanks for sharing the original definition! I didn’t realise Turing had defined the parameters so precisely, and that they weren’t actually that strict! I
I probably need to stop saying that AI hasn’t passed the Turing test yet then. I guess it has! You’re right that this ends up being an argument over semantics, but seems fair to let Alan Turing define what the term ‘Turing Test’ should mean.
But I do think that the stricter form of the Turing test defined in that metaculus forecast is still a really useful metric for deciding when AGI has been achieved, whereas this much weaker Turing test probably isn’t.
(Also, for what it’s worth, the business tasks I have in mind here aren’t really ‘complex’, they are the kind of tasks that an average human could quite easily do well on within a 5-minute window, possibly as part of a Turing-test style setup, but LLMs struggle with)
Thanks for sharing the original definition! I didn’t realise Turing had defined the parameters so precisely, and that they weren’t actually that strict! I
I probably need to stop saying that AI hasn’t passed the Turing test yet then. I guess it has! You’re right that this ends up being an argument over semantics, but seems fair to let Alan Turing define what the term ‘Turing Test’ should mean.
But I do think that the stricter form of the Turing test defined in that metaculus forecast is still a really useful metric for deciding when AGI has been achieved, whereas this much weaker Turing test probably isn’t.
(Also, for what it’s worth, the business tasks I have in mind here aren’t really ‘complex’, they are the kind of tasks that an average human could quite easily do well on within a 5-minute window, possibly as part of a Turing-test style setup, but LLMs struggle with)
By that definition, ELIZA would have passed the Turing test in 1966
Show me a 1966 study showing 70% of a representative sample of the general population mistake ELIZA for an human after 5 minutes of conversation.