A machine with no understanding at all could still talk its way through the Turing Test

Ned Block imagined 'Blockhead', a machine with an unimaginably huge lookup table pairing every possible conversation history with a canned response, able to pass the Turing Test purely by table lookup with zero real thought. Since nobody would call that genuine intelligence, Block argued, passing the Turing Test can't actually prove a machine understands anything. The thought experiment remains a core challenge to behaviorist theories of mind.

— Ned Block, Psychologism and Behaviorism — The Philosophical Review, 1981