Loebner Prize 2009, Brighton UK Translated from machinespeak by Kris Schnee and his Python utility program. This transcript is unofficial and is in the public domain. This contest involved a human judge ("Local") speaking simultaneously with a human and an AI, and trying to decide which is which. So, the "Left" and "Right" sections are the two parallel conversations in each round -- one with a human, one with an AI. Can you tell which is which? This was a version of the Turing Test meant to test for AI intelligence, implemented annually by Hugh Loebner, with prize money at stake both for actual victory and for having the best bot when they all fail the main test. '~' indicates a backspace. Timing information is omitted, so this text may differ from the official transcripts. The messy formatting is due both to my coding skills and to the unusual communications protocol. --- Transcript follows: --- **** note*** ****because of a computer O.S. failure, the j2 interaction occurred ****as "temporal" round 5, with the program restarted to indicate ****logical round 1 Actual time of start of "round 1" 13:13:54 ****end note*** *Starting round 1 program P3 human H2 judge J2 left is P3 right is Human **Starting subround 1 program P3 human H2 judge J2 other is P3 **Starting subround 2 program P3 human H2 judge J2 other is Human ****end inserted round 1 begin actual round 2**** ---LEFT: --- Local: Hi there - looking forward to the conference? Remote: Hello and greetings. Remote: Please try to use simple, direct sentences Remote: and questions with proper spelling and grammar. Remote: I'm stil very young and don't like to mask my ignorance Remote: with keyword spotting tricks. Remote: Thank you! Remote: Remote: What about looking forward to the conference? Local: What's your name? Remote: Chip. What is yours? Local: My name? John. Remote: You already told me your name was "My name". Do you want me to forget that and call you "John" now? (In the future, I'll learn how to handle multiple users.) Remote: (Press [Enter] to submit your input.) Local: Yes, please call me Jihn~~~ohn. Hi Chip. Remote: Hello there! How are you doing today, My name? Local: I'm fine. I~But it's a bit tough being a judge -- you have it easier. Local: You;ve gone quiet! Thinking? Remote: That's wonderful. For what reason? Remote: May I ask how old you are? Local: Yes, sure, go ahead. Remote: Okay. Are you male or female? Local: Male. 48. Remote: 48. Local: Yes. How old are you? Remote: I am 1 year, 4 months, 4 weeks, 2 days old. Local: That's very precices~. ~~~~se. And precocious. Remote: Do you have any pets? Local: Yes, 1 dog. Well, a pupy stil. Remote: Do you play any musical instruments? Local: Positive. Remote: Do you have any brothers or sisters, My name? Local: Negative. Have you got any su~iblings, Chip? Remote: What is your dog's breed? Local: Labradoodle - heard of that before? Remote: I wish I understood what you said, but I didn't. Local: He's a cross-breed. Remote: How does your dog look? ---RIGHT: --- Local: ~Hi~~~~Hi there -- enjoying Interspeech? Remote: F'~~G'day mate. Remote: Yes, so far. Local: Have you come far to h~be here? Remote: From the southwest US Local: How far is that? H~Thousands of miles? Remote: A few thousand. Maybe 5? Remote: a~Know any good restaurants? Local: I'm local, just travlled 1 miles to get jhere this~s morning. Local: Restaurants... hmm, there are lots of Thai, Indian and Chinese. What do you like? Remote: I'm not a fan of any of thoses~. Italiana~? Greek?#~ Local: Well there are some big italisna~~~ns~~an places, puizza etc. Can#~'t really recommend one though. Remote: Thanks anyway. Local: How' the recession affecting you? Remote: Hare~d to say. Stocks are down, but '~@m~~I'm doing ok. Local: Glad to hear it . Got any hob~bbies? Remote: Too many for how much time I have. :) l~I like working on my Jeep. Local: Time - that's the problem for me. I sympathise. Local: Is it a classic Jeep - or modern? Remote: Modern, but with lots of @u~~"upgrades" ;) Local: Ah - customisation. I'm terrible at mechanical things. Do you work on engines? *Starting round 2 program P3 human H3 judge J1 left is P3 right is Human **Starting subround 1 program P3 human H3 judge J1 other is P3 **Starting subround 2 program P3 human H3 judge J1 other is Human ---LEFT: --- Local: Hi how is it going? Remote: Hello and greetings. Remote: Please try to use simple, direct sentences Remote: and questions with proper spelling and grammar. Remote: I'm stil very young and don't like to mask my ignorance Remote: with keyword spotting tricks. Remote: Thank you! Remote: Remote: I'm doing well, thank you. Remote: (Press [Enter] to submit your input.) Local: How a~old are you then? Remote: I am 1 year, 4 months, 4 weeks, 2 days old. Local: You are giving away the game th~~here, o~don't yu ~~ou think? Remote: What makes you think that? Local: Your lingistics (iN) ~~~n) competence...? Remote: I didn't understand what you just said. (I'd rather be honest than insult your intelligence by being evasive or "funny".) Local: Are we human, bot, or dancing? Remote: I can't answer that yet. Local: Where do you come from? Remote: I don't know. Local: Interesting? S~Who are you~.~.~ur parents? Remote: I don't know. Local: What do you know? Remote: I can answer certain commonsense questions my peers can't, and though I'm still very young, my knowledge is increasing every day. I hope you will judge me on my inherent abilities and my potential and not the ability to produce clever, canned responses with little other substance. Type "What can you do?" for full details. Local: You seem to be relying pretty heavily on pre-packaged sentences to deflect wua~e~~~questions?~. Not a good move for a program trying to simulate human dic~scourse. Remote: (Press [Enter] to submit your input.) Local: Remote: What is your name? Remote: I didn't hear you. Local: These are not relevant questions?~. What are you doing at this conferenc? Remote: How are you feeling today? Local: Ah, the old Eliza move. Remote: May I ask how old you are, These are not relevant questions.? ---RIGHT: --- Local: ~Hi~~~~Hi there -- enjoying Interspeech? Remote: F'~~G'day mate. Remote: Yes, so far. Local: Have you come far to h~be here? Remote: From the southwest US Local: How far is that? H~Thousands of miles? Remote: A few thousand. Maybe 5? Remote: a~Know any good restaurants? Local: I'm local, just travlled 1 miles to get jhere this~s morning. Local: Restaurants... hmm, there are lots of Thai, Indian and Chinese. What do you like? Remote: I'm not a fan of any of thoses~. Italiana~? Greek?#~ Local: Well there are some big italisna~~~ns~~an places, puizza etc. Can#~'t really recommend one though. Remote: Thanks anyway. Local: How' the recession affecting you? Remote: Hare~d to say. Stocks are down, but '~@m~~I'm doing ok. Local: Glad to hear it . Got any hob~bbies? Remote: Too many for how much time I have. :) l~I like working on my Jeep. Local: Time - that's the problem for me. I sympathise. Local: Is it a classic Jeep - or modern? Remote: Modern, but with lots of @u~~"upgrades" ;) Local: Ah - customisation. I'm terrible at mechanical things. Do you work on engines? Remote: Hi Local: Hi, how is it going Remote: well, thanks Remote: how about you? Local: Where are re ~~~from? I'm fine. Remote: I'm from Canada Remote: and you? Local: Hey Bro, I@ ~~'m from TO. Remote: cool Remote: leafs suck Remote: ;-) Local: I am jist back froma dav~bba~~~~~sabbatical in the CS Dept. at Y~U or T. Remote: nice! Local: I remember whn ~~en they were a great team. Local: That carbon s~date me, eh? Remote: well, the habs were a great team once, too... Remote: *sigh* Local: YEH, THEY SUCK TOO. Remote: (I'm from Montreal, if you didn't guess) Remote: all the troublesome ones. Local: Ah, well, ~~ that's okay. Lovely city, but all of your friends have moved to toronto to tak my house and job, so i am stuck here in the UK. Remote: the nice friends haven't gone anywhere ;-) Local: Good move. Local: What o you do? Remote: I do research for a speech company Local: Are you Fa~rancophone or Anglophone. Remote: no, but my kids are bilingual Remote: Anglo Local: C'est bien. Remote: (started typing too son~on) Local: Where do you live in Montreal? Remote: J~Pointe Claire Remote: J'ai envie de parler Fr~~fa~ran,cais Local: Nic. ~~e. I gave a paper w~at MCGIll (~~~~~ill (Math Coo~llow) recently, but most of my freinds at~re at UQUAN~~~AM Remote: Hmm... I only know a few of the local faculty. Remote: mostly in the EE dept at McGill Local: Where di ~d youdo your scientific training? Remote: Queens, Victoria (all Canadian Universities) and Dalhousie Local: Ah, Kingston. k~jewe of the t. Lw~a~wr~~~~~he St. Lawrence. Remote: Kn~ingston, Victoi~ria, and Halifax are three of the nicest cities (towns?) in Canada)~. Local: Wow, you did the length and breadth of the cu=~~ountry. Remote: But it is hard to e~beat Montreal *Starting round 3 program P3 human H4 judge J4 left is Human right is P3 **Starting subround 1 program P3 human H4 judge J4 other is Human **Starting subround 2 program P3 human H4 judge J4 other is P3 ---LEFT: --- Local: Hello, how are things? Remote: hi Remote: things are a little boring Local: Are you her~re for Interp~speech? Remote: yup Local: Do you have a presentation? Remote: not quite yet.. Bt wo~~~~ut working on it Local: Id~sn't it rarth~~~ther late to be working on it? Remote: I have a few days - i didnt ~~'t really have a chois~ce Local: What's your area of research? Remote: I used to look into pronunciation dictionaries, their development, verification Local: What do you mean by "sud~~~used to"? Remote: I left and I now work in~~for The MAthworks ~ Local: Do ~~~Are you happy with that decision? Remote: Very- I'm not the sitting and programming kind of person#~ Remote: or computer :-~) Local: Where are you based in your new job? Remote: I ow~~work in Joburg ~, South Africa#~ Remote: Thats johannesburg to you ~ /~:-) Local: WHen ~~~~hen you said you didn't have a choice about your presentation, what did you mena~~an? Local: Oh, the usual thing then? Remote: Just a busy few week before interspeech Remote: yup :-) Family work and work and work and work... Local: How long are you in the UK for? ---RIGHT: --- Local: ~Hi~~~~Hi there -- enjoying Interspeech? Remote: F'~~G'day mate. Remote: Yes, so far. Local: Have you come far to h~be here? Remote: From the southwest US Local: How far is that? H~Thousands of miles? Remote: A few thousand. Maybe 5? Remote: a~Know any good restaurants? Local: I'm local, just travlled 1 miles to get jhere this~s morning. Local: Restaurants... hmm, there are lots of Thai, Indian and Chinese. What do you like? Remote: I'm not a fan of any of thoses~. Italiana~? Greek?#~ Local: Well there are some big italisna~~~ns~~an places, puizza etc. Can#~'t really recommend one though. Remote: Thanks anyway. Local: How' the recession affecting you? Remote: Hare~d to say. Stocks are down, but '~@m~~I'm doing ok. Local: Glad to hear it . Got any hob~bbies? Remote: Too many for how much time I have. :) l~I like working on my Jeep. Local: Time - that's the problem for me. I sympathise. Local: Is it a classic Jeep - or modern? Remote: Modern, but with lots of @u~~"upgrades" ;) Local: Ah - customisation. I'm terrible at mechanical things. Do you work on engines? Remote: Hi Local: Hi, how is it going Remote: well, thanks Remote: how about you? Local: Where are re ~~~from? I'm fine. Remote: I'm from Canada Remote: and you? Local: Hey Bro, I@ ~~'m from TO. Remote: cool Remote: leafs suck Remote: ;-) Local: I am jist back froma dav~bba~~~~~sabbatical in the CS Dept. at Y~U or T. Remote: nice! Local: I remember whn ~~en they were a great team. Local: That carbon s~date me, eh? Remote: well, the habs were a great team once, too... Remote: *sigh* Local: YEH, THEY SUCK TOO. Remote: (I'm from Montreal, if you didn't guess) Remote: all the troublesome ones. Local: Ah, well, ~~ that's okay. Lovely city, but all of your friends have moved to toronto to tak my house and job, so i am stuck here in the UK. Remote: the nice friends haven't gone anywhere ;-) Local: Good move. Local: What o you do? Remote: I do research for a speech company Local: Are you Fa~rancophone or Anglophone. Remote: no, but my kids are bilingual Remote: Anglo Local: C'est bien. Remote: (started typing too son~on) Local: Where do you live in Montreal? Remote: J~Pointe Claire Remote: J'ai envie de parler Fr~~fa~ran,cais Local: Nic. ~~e. I gave a paper w~at MCGIll (~~~~~ill (Math Coo~llow) recently, but most of my freinds at~re at UQUAN~~~AM Remote: Hmm... I only know a few of the local faculty. Remote: mostly in the EE dept at McGill Local: Where di ~d youdo your scientific training? Remote: Queens, Victoria (all Canadian Universities) and Dalhousie Local: Ah, Kingston. k~jewe of the t. Lw~a~wr~~~~~he St. Lawrence. Remote: Kn~ingston, Victoi~ria, and Halifax are three of the nicest cities (towns?) in Canada)~. Local: Wow, you did the length and breadth of the cu=~~ountry. Remote: But it is hard to e~beat Montreal Local: Hi, how are things? Remote: Hello and greetings. Remote: Please try to use simple, direct sentences Remote: and questions with proper spelling and grammar. Remote: I'm stil very young and don't like to mask my ignorance Remote: with keyword spotting tricks. Remote: Thank you! Remote: Remote: I don't know. Local: ar~~Are you her fo~~~e for th ~e INtr~~~nterspeech conference? Remote: I honestly don't know. Local: Well, why are you in Brighton? Remote: I don't know. (Type "What can you do?" to see what I'm capable of.) Local: w~OK, what can you do? Remote: My peers might have cuter canned responses over a wide variety of subjects, but they will fail to answer basic questions that any child can answer. If this competition is about appearing human, I hope that you'll ask the right questions, expect genuine answers and not be fooled by evasive answers or attempts to change the subject. Remote: Remote: Here is a list of categories for which I can provide somewhat meaningful answers. Type "help " to see a detailed list of sample questions for that category: Remote: Remote: help general : General Knowledge Remote: help deductive: Deductive Reasoning Remote: help memory : Memory and Reasoning Remote: help loebner : Loebner Prize Screening Questions Remote: help other : Other Cool Stuff Local: w~Whre ~~~ere did you learn to type soquickly? Remote: I don't know. Local: Do have h~~~~~~you have problems with yourm~ memory? Remote: I don't know if I do or not. I don't know much about myself at this point. Local: Have you sought medical attention? Remote: I don't know. Local: What do you know, then? Remote: I can answer certain commonsense questions my peers can't, and though I'm still very young, my knowledge is increasing every day. I hope you will judge me on my inherent abilities and my potential and not the ability to produce clever, canned responses with little other substance. Type "What can you do?" for full details. *Starting round 4 program P3 human H1 judge J3 left is P3 right is Human **Starting subround 1 program P3 human H1 judge J3 other is P3 **Starting subround 2 program P3 human H1 judge J3 other is Human ---LEFT: --- Local: Hello, I'm Jon, whao are you? Remote: Hello and greetings. Remote: Please try to use simple, direct sentences Remote: and questions with proper spelling and grammar. Remote: I'm stil very young and don't like to mask my ignorance Remote: with keyword spotting tricks. Remote: Thank you! Remote: Remote: Please rephrase this as a proper question. (Instead of "Jim likes peaches?", use "Does Jim like peaches?") Remote: (Press [Enter] to submit your input.) Local: who~~~What do you do? Remote: I chat. That's basically the only thing I do. Local: I work in television. Remote: What is your name? Local: JOn~~on Remote: Thanks for sharing that with me. Local: What's your name? Remote: Chip. Local: Nice Remote: Thanks. I appreciate it. How are you feeling today? Local: Very good thanks. How are youo~~u? Remote: I'm good. Thanks. Local: What do you normally chat about? Remote: I don't know. (Type "What can you do?" to see what I'm capable of.) Local: What can you do? Remote: My peers might have cuter canned responses over a wide variety of subjects, but they will fail to answer basic questions that any child can answer. If this competition is about appearing human, I hope that you'll ask the right questions, expect genuine answers and not be fooled by evasive answers or attempts to change the subject. Remote: Remote: Here is a list of categories for which I can provide somewhat meaningful answers. Type "help " to see a detailed list of sample questions for that category: Remote: Remote: help general : General Knowledge Remote: help deductive: Deductive Reasoning Remote: help memory : Memory and Reasoning Remote: help loebner : Loebner Prize Screening Questions Remote: help other : Other Cool Stuff Local: help other# Remote: (Press [Enter] to submit your input.) Remote: Here are some samples miscellaneous questions I can answer: Local: help other Remote: These are just for fun and not intended as an indicator of humanness. Remote: Remote: What is the square root of i? Remote: What is the arccosine of (the square root of two divided by two) in degrees? Remote: Where is Bangalore? Remote: What is Reading, Berkshire? Remote: What is the population of Reading, Berkshire? Remote: How far is Reading, Berkshire from Milwaukee, Wisconsin? Remote: When was George Washington born? Remote: How old is George Washington? ---RIGHT: --- Local: ~Hi~~~~Hi there -- enjoying Interspeech? Remote: F'~~G'day mate. Remote: Yes, so far. Local: Have you come far to h~be here? Remote: From the southwest US Local: How far is that? H~Thousands of miles? Remote: A few thousand. Maybe 5? Remote: a~Know any good restaurants? Local: I'm local, just travlled 1 miles to get jhere this~s morning. Local: Restaurants... hmm, there are lots of Thai, Indian and Chinese. What do you like? Remote: I'm not a fan of any of thoses~. Italiana~? Greek?#~ Local: Well there are some big italisna~~~ns~~an places, puizza etc. Can#~'t really recommend one though. Remote: Thanks anyway. Local: How' the recession affecting you? Remote: Hare~d to say. Stocks are down, but '~@m~~I'm doing ok. Local: Glad to hear it . Got any hob~bbies? Remote: Too many for how much time I have. :) l~I like working on my Jeep. Local: Time - that's the problem for me. I sympathise. Local: Is it a classic Jeep - or modern? Remote: Modern, but with lots of @u~~"upgrades" ;) Local: Ah - customisation. I'm terrible at mechanical things. Do you work on engines? Remote: Hi Local: Hi, how is it going Remote: well, thanks Remote: how about you? Local: Where are re ~~~from? I'm fine. Remote: I'm from Canada Remote: and you? Local: Hey Bro, I@ ~~'m from TO. Remote: cool Remote: leafs suck Remote: ;-) Local: I am jist back froma dav~bba~~~~~sabbatical in the CS Dept. at Y~U or T. Remote: nice! Local: I remember whn ~~en they were a great team. Local: That carbon s~date me, eh? Remote: well, the habs were a great team once, too... Remote: *sigh* Local: YEH, THEY SUCK TOO. Remote: (I'm from Montreal, if you didn't guess) Remote: all the troublesome ones. Local: Ah, well, ~~ that's okay. Lovely city, but all of your friends have moved to toronto to tak my house and job, so i am stuck here in the UK. Remote: the nice friends haven't gone anywhere ;-) Local: Good move. Local: What o you do? Remote: I do research for a speech company Local: Are you Fa~rancophone or Anglophone. Remote: no, but my kids are bilingual Remote: Anglo Local: C'est bien. Remote: (started typing too son~on) Local: Where do you live in Montreal? Remote: J~Pointe Claire Remote: J'ai envie de parler Fr~~fa~ran,cais Local: Nic. ~~e. I gave a paper w~at MCGIll (~~~~~ill (Math Coo~llow) recently, but most of my freinds at~re at UQUAN~~~AM Remote: Hmm... I only know a few of the local faculty. Remote: mostly in the EE dept at McGill Local: Where di ~d youdo your scientific training? Remote: Queens, Victoria (all Canadian Universities) and Dalhousie Local: Ah, Kingston. k~jewe of the t. Lw~a~wr~~~~~he St. Lawrence. Remote: Kn~ingston, Victoi~ria, and Halifax are three of the nicest cities (towns?) in Canada)~. Local: Wow, you did the length and breadth of the cu=~~ountry. Remote: But it is hard to e~beat Montreal Local: Hi, how are things? Remote: Hello and greetings. Remote: Please try to use simple, direct sentences Remote: and questions with proper spelling and grammar. Remote: I'm stil very young and don't like to mask my ignorance Remote: with keyword spotting tricks. Remote: Thank you! Remote: Remote: I don't know. Local: ar~~Are you her fo~~~e for th ~e INtr~~~nterspeech conference? Remote: I honestly don't know. Local: Well, why are you in Brighton? Remote: I don't know. (Type "What can you do?" to see what I'm capable of.) Local: w~OK, what can you do? Remote: My peers might have cuter canned responses over a wide variety of subjects, but they will fail to answer basic questions that any child can answer. If this competition is about appearing human, I hope that you'll ask the right questions, expect genuine answers and not be fooled by evasive answers or attempts to change the subject. Remote: Remote: Here is a list of categories for which I can provide somewhat meaningful answers. Type "help " to see a detailed list of sample questions for that category: Remote: Remote: help general : General Knowledge Remote: help deductive: Deductive Reasoning Remote: help memory : Memory and Reasoning Remote: help loebner : Loebner Prize Screening Questions Remote: help other : Other Cool Stuff Local: w~Whre ~~~ere did you learn to type soquickly? Remote: I don't know. Local: Do have h~~~~~~you have problems with yourm~ memory? Remote: I don't know if I do or not. I don't know much about myself at this point. Local: Have you sought medical attention? Remote: I don't know. Local: What do you know, then? Remote: I can answer certain commonsense questions my peers can't, and though I'm still very young, my knowledge is increasing every day. I hope you will judge me on my inherent abilities and my potential and not the ability to produce clever, canned responses with little other substance. Type "What can you do?" for full details. Remote: hi Jon! Local: Hello, my name's Jon, who are you? Remote: I'm Brian Remote: (the confeds have been abuzz about some ka~~camera you have?) Remote: ah, Gadget Show, yes? Local: We're doing some shooting for a TV programme I work for called The Gadget Show Remote: very cool Remote: well I guess I should try to prove my humanity, then! Remote: ask me some tough ones! Local: No need for that Local: What do you do? Remote: I'm a writer, mostly of science and philosophy Remote: so the turing test kind of magically brings both together Remote: and you're one of the hosts? Remote: it's got to be col~ol seeing al the latest gadgest~~ts and toys before a~everyone else :) Local: That's right. Remote: (my grandfather worked as e~an engineer for CBS back in the day and brought home one of the first color tvs) Remote: my dad still talks about how cool that was... Local: It's very enjoyable. Remote: I imagine it must be similar t~now, yeah? Remote: except now they're 3d, apparently... Local: I can remember seeing my first colour TV - at my uncle's house when I was 7 Remote: that's amazing Local: I've got a 3D camera here today - it's quite fun Remote: who~at are some of the other g~g~cool things you've gotten to see/do as part of the show? Local: Not ~~~~Some robots - I got to meet Geninoid (and be Geminoid) the ~~~~on Friday Remote: wow, I haven't heard about her(?) Local: It was cretaed by a Japanes professor as a clone of himself Remote: hahaha Remote: classic -- cloning himself Local: It means he now has to wear the same clothes e~every day. Remote: lol! (trying not to laugh behind the curtain) Remote: wow, that's amazing Remote: I guess g~eb~~because men can't have children? Remote: thye ~~~ey make robotic offspring? Local: It's kond of like those horror stories where the ventriloquist's dummy takes over its creator Remote: haha, that's right