Turing test

The "standard interpretation" of the Turing test, in which player C, the interrogator, is given the task of trying to determine which player – A or B – is a computer and which is a human. The interrogator is limited to using the responses to written questions to make the determination.[1]

The Turing test, originally called the imitation game by Alan Turing in 1949,[2] is a test of a machine's ability to exhibit intelligent behaviour equivalent to that of a human. In the test, a human evaluator judges a text transcript of a natural-language conversation between a human and a machine. The evaluator tries to identify the machine, and the machine passes if the evaluator cannot reliably tell them apart. The results would not depend on the machine's ability to answer questions correctly, only on how closely its answers resembled those of a human. Since the Turing test is a test of indistinguishability in performance capacity, the verbal version generalizes naturally to all of human performance capacity, verbal as well as nonverbal (robotic).[3]

The test was introduced by Turing in his 1950 paper "Computing Machinery and Intelligence" while working at the University of Manchester.[4] It opens with the words: "I propose to consider the question, 'Can machines think?'" Because "thinking" is difficult to define, Turing chooses to "replace the question by another, which is closely related to it and is expressed in relatively unambiguous words".[5] Turing describes the new form of the problem in terms of a three-person party game called the "imitation game", in which an interrogator asks questions of a man and a woman in another room in order to determine the correct sex of the two players. Turing's new question is: "Are there imaginable digital computers which would do well in the imitation game?"[2] This question, Turing believed, was one that could actually be answered. In the remainder of the paper, he argued against the major objections to the proposition that "machines can think".[6]

Since Turing introduced his test, it has been highly influential in the philosophy of artificial intelligence, resulting in substantial discussion and controversy, as well as criticism from philosophers like John Searle, who argue against the test's ability to detect consciousness.[7][8]

Since the mid 2020s, several large language models such as ChatGPT have passed modern, rigorous variants of the Turing test.[9][10][11]

  1. ^ Image adapted from Saygin 2000
  2. ^ a b (Turing 1950). Turing wrote about the ‘imitation game’ centrally and extensively throughout his 1950 text, but apparently retired the term thereafter. He referred to ‘[his] test’ four times—three times in pp. 446–447 and once on p. 454. He also referred to it as an ‘experiment’—once on p. 436, twice on p. 455, and twice again on p. 457—and used the term ‘viva voce’ (p. 446). See also #Versions, below. Turing gives a more precise version of the question later in the paper: "[T]hese questions [are] equivalent to this, 'Let us fix our attention on one particular digital computer C. Is it true that by modifying this computer to have an adequate storage, suitably increasing its speed of action, and providing it with an appropriate programme, C can be made to play satisfactorily the part of A in the imitation game, the part of B being taken by a man?'" (Turing 1950, p. 442)
  3. ^ Oppy, Graham & Dowe, David (2011) The Turing Test Archived 20 March 2012 at the Wayback Machine. Stanford Encyclopedia of Philosophy.
  4. ^ "The Turing Test, 1950". turing.org.uk. The Alan Turing Internet Scrapbook. Archived from the original on 3 April 2019. Retrieved 23 April 2015.
  5. ^ Turing 1950, p. 433.
  6. ^ Turing 1950, pp. 442–454 and see Russell & Norvig (2003, p. 948), where they comment, "Turing examined a wide variety of possible objections to the idea of intelligent machines, including virtually all of those that have been raised in the half century since his paper appeared."
  7. ^ Saygin 2000.
  8. ^ Russell & Norvig 2003, pp. 2–3, 948.
  9. ^ Scott, Cameron. "Study finds ChatGPT's latest bot behaves like humans, only better | Stanford School of Humanities and Sciences". humsci.stanford.edu. Archived from the original on 26 March 2024. Retrieved 26 March 2024.
  10. ^ Mei, Qiaozhu; Xie, Yutong; Yuan, Walter; Jackson, Matthew O. (27 February 2024). "A Turing test of whether AI chatbots are behaviorally similar to humans". Proceedings of the National Academy of Sciences. 121 (9): e2313925121. Bibcode:2024PNAS..12113925M. doi:10.1073/pnas.2313925121. ISSN 0027-8424. PMC 10907317. PMID 38386710.
  11. ^ Jones, Cameron R.; Bergen, Benjamin K. (31 March 2025), Large Language Models Pass the Turing Test, arXiv:2503.23674

© MMXXIII Rich X Search. We shall prevail. All rights reserved. Rich X Search