all eyes will be on one competitor but he's not breaking a sweat we're not talking nerves of steel more like a rock-solid member of silicon my name is Watson for the first time in history a computer will compete in the ultimate brain game Jeopardy for the site is sue created once the excitement and tension are palpable it's gonna be edge of your seat it's gonna be nerve wracking a four-year Odyssey comes down to this what really is gonna happen and you just don't know you don't know there are more than reputations at stake some say
a watson victory could signal a new age a revolution in artificial intelligence it used to be the case that intelligence lists chess you can play chess that's intelligence but taking on spoken language and ferocious wordplay means engaging by a whole new set of rules it requires more than just memory to match wits with you Watson just understanding the question is a pretty big deal how will Watson do Nova gets unique access to the making of Watson shadowing the IBM team working around the clock training and test driving Watson by Blake Edwards Watson what is the
Pink Panther and we couldn't write rules for every combination of word and phrases and context refining powerful new tools of computing it took a huge job with machine learning to like glue Watson what is men yes you got it and creating a machine that can learn from its mistakes what is mosquito no holiday no artificial sweetener on now no he'll understand the question I don't understand what we don't listen a category that was one of the tenses days I've ever had you fall flat on your face but I expect to get fired no but maybe
we came back and the game was neck-and-neck Wordsworth said they sore but never Rome Watson what is Skylark that is correct he is Watson ready to face the game's all-time champions this is too daunting a task for a computer I think we've gone from impressed to blown away when man takes on machine who will win Watson what is Preet yes nova takes you inside the world of artificial intelligence and the quest to build a computer like none before it good luck Watson smartest machine on earth right now on Nova for 10 seconds way out taken
Dave Ferrucci is a nervous parent he spent the last four years building a revolutionary new computer and it's about to face its biggest test in front of an audience of millions hello my name is Watson I hope we will have a good game today but first I have to test my voice when the cameras rolled the computer called Watson will make history as it competes on the popular quiz show Jeopardy jeopardy it's frightening right I mean it's a different experience very different experience for scientists isn't here and you have this happen live Ferrucci has reason
to fear Watson is playing for a million-dollar jackal against the game's toughest competitors Brad Rutter Jeopardy's biggest money winner and Ken Jennings famous for winning 74 consecutive games there's some contestants pride I want to beat my human competition but you know as a species I would like mankind to defeat the big bad computer let's finish leaders of World War 2 all right this big bad computer is the culmination of four years intensive work iBM has put once and through hundreds of practice games with a stand-in host and real contestants after Germany invaded the Netherlands this
Queen her family and cabinet fled to London react twist Beatrix no Watson who is Wilhemina that is correct it's a human standing there with their carbon and water versus the computer with all of its silicon and its main memory in its disk it seems like it should be easy for the computer to win with its enormous memory and processing power but the human brain makes an intimidating opponent especially on Jeopardy Geoffrey questions are tricky they have puns in them they have little jokes in them just understanding the question is a pretty big deal this trusted
friend was the first non-dairy powdered creamer Watson what is milk no Maria what is coffee made thank you humans communicate very fluently in natural language and that's where computers struggle dramatically right now Watson is on the verge of conquering that challenge here we go a garment worn by a child perhaps aboard an operatic ship Watson what is pinafore yes how did you get that if Watson wins on Jeopardy it will be a major breakthrough in a quest that's gone on for decades the audacious dream to build a machine as smart as a person the quest
for artificial intelligence Aion when we started doing AI the goal was why can't we build a person we all know how to make people that's easy what if we could build one out of silicon pioneers drew their inspiration from the world of science fiction as a child Isaac Asimov turns up so here I'm a adolescent and and the robots are intelligent machines are or part of my life your service let's let's see about getting them built in the early days computers grow rapidly more powerful quickly mastering complex equations the first programs we wrote at MIT
solve problems that only very educated people could solve like problems in calculus ER and then algebra the computer pioneers thought they were on a fast track to building human-like intelligence I constantly expect that within 10 or 15 years we will find emerging from the laboratories something not too far from the robot a cross-sectional pain in the beginning we thought well maybe 10 or 15 years and we'll have something that's really smart in the beginning people really were amazed at how much computers could do well you see something is improving very fast you simply assume it
will continue improving that fast indefinitely in the 60s confidence was so high it inspired one of the most iconic film characters of all time oh how do you read me do you read me huh affirmative time I read you when I was a kid I saw 2001 a Space Odyssey and how was just the best thing ever open the pod bay doors please oh I'm sorry Dave I'm afraid I can't do that you know it was a murdering psychopath hell well but it was intelligent could talk to people that see people could lip-read could all
this stuff a machine that could do that and I've never even seen a real computer at that time Bishop takes Knight spawn more than 40 years after the creation of hell no real computer or robot has been able to interact with humans as seamlessly as Hollywood imagines tell me what is love the problem is our own human computer the brain a complex entity that's defied any attempts at replication we just have no idea how sophisticated the brain was the computer has always been king when it comes to calculation and processing huge amounts of data but
simple skills that humans master early in life like understanding language or recognizing objects continue to baffle researchers now people vastly misjudged how subtle we are when we're intelligent people just hugely underestimated that but the dream of building a computer they could talk and match wits with humans never really died and a few years ago a new plan was hatched sparked by an unlikely event in vogue nerds operas this eldest Valkyrie is stereotypically dressed in a horned helmet and breastplate Ken whose Brunhilde Gera wrecked in 2004 Ken Jennings 74 game winning streak on Jeopardy set the
country of buzz and caught the eye of an IBM executive while out to dinner all sudden the entire restaurant cleared out to the bar that I'm sitting out to go see Ken Jennings this grand ole opry comedy star used to wear a straw hat with the dollar 98 price tag still attached yeah whose Minnie Pearl Minnie Pearl LD Charles liquor wondered if a computer could ever play as well as Ken Jennings so we pitched the idea to some of I be M's top scientists for the ones that knew Jeopardy they said sure how that's just
too hard I think the the prevailing view was um you know these questions were difficult to understand difficult even comprehend what was being asked yeah I was like no way I was like no way but one researcher Dave Ferrucci was intrigued my view was maybe this isn't as completely impossible as we think it is and now for over 40 years jeopardy has been pop culture's IQ test clues are given as answers and contestants have to respond in the form of a question mother 1600 it's a larger vessel that guards and supplies smaller ones christina was
a mothership mothership yes the show central concede is a little syntactic reversal whereby they give you an answer and use the fly a question you don't say George Washington you say who is George Washington to win contestants need to be human encyclopedias because essentially everything under the Sun first in this round you know the categories at the same second Alex tells the folks at home a category one you have to have a broad knowledge because we have 13 categories on each show Kate's bad h4 400 for the record Thomas Edison invented the first practical one
of these in 1877 contestants also have to be fast sorry Oh what is the phone it back good they typically have three seconds or less to come up with an answer the mortar and pestle is a symbol of this profession Ariel what is the pharmacist pharmacist is right to compete on Jeopardy IBM's computer must have an enormous knowledge base because they will not be connected to the Internet but the far bigger challenge for the machine will be understanding clues which can be extremely convoluted or obscure you'll find this flower before pickle bottom in a line
of handbags and bedding and that would be petunia back to you Ariel there'll be a lot of puns there'll be double meanings and these are things the computers historically at herbal add human language is a minefield for computers consider this sentence well as ago I shot an elephant Oh wearing my pajamas what was I wearing the pajamas was the elephant wearing the pajamas right so they're different interpretations different ways to parse the sentence the word shot you know what's really going on there is already ambiguity in there actually be shooting sort of a hunting shooting
let some photographer and immersed in that context I may interpret that as shooting with the camera which one that I means if you look at the context but a computer has no context it's just an electronic brain in a box in 2006 Ferrucci tackles this challenge along with the best and brightest programmers from IBM and the country's top AI labs the way we solve this is actually to start they run a test we had a existing state of the art system that people worked on for a number of years and we tried applying that to
the Jeopardy challenge they feed one of IBM's most sophisticated computer programs hundreds of Jeopardy questions like this one in 1698 this comic Discoverer took a ship called the paramour pink on the first purely scientific sea voyage the correct answer is who is Edmund Halley the computer says who is Peter Sellers the computer ran a search through a million documents looking for keywords from the clue it home Dinh on a description of one of the Pink Panther films in which one character was a paramour or mistress the star of the movie Peter Sellers it's probably the
last answer a human would come up with but it's typical for computers the team has a long way to go just how far becomes clear when they compare the computer to the best human players they create a graph called the cloud each dot represents a jeopardy champions performance Jennings is at the top you see is a cloud that's around dancer around 50% the winners do and they get around 90 percent correct and where is the computer in this cloud if we ask it to answer all the questions if you own 10% of questions right you
can't go on jumpy like that I mean the best humans are 90% 92% we weren't even close to win it jeopardy the team will need a whole new way to tackle human language one that takes advantage of the computers basic strengths edits electronic core computer speaks a very simple language binary code on or off but with that simple code it can follow instructions and solve complex problems once reserved for intellectual Giants used to be the case that intelligence lists chess and if you can play chess that's intelligence computers have mastered the game chess is easy
for computers because the rules are very well-defined and very clear the rules of chess are relatively simple a board of 64 squares each piece pawn Knight Queen can move a certain way and there's a single goal take out your opponent's king for humans it is the ultimate game of strategy the way computers play chess is not at all the way people play chess we humans look at the board and have conceptual ideas like control the center attack on the right I'm very different from the way computers play chess a chess-playing computer looks at virtually every
possible move it could make and every response every way the game could play out computers play chess through searching a tree moves down to a very deep level looking ahead on every possible path but they do it by brute force I go 20 30 40 news ahead and seeing all the bad things that can happen person can't look that many moves ahead broadly this is the power behind the most famous chess game in the history of AI when in 1997 another IBM computer named deep blue beat the reigning world champion Garry Kasparov the chess world
champion walked away from the match never looking back at the computer that just beat up the victory makes the blue look pretty smart but is it deep blue that's only acting as if it's intelligent it's not really intelligent in the way that we humans are it's good at one thing it's playing chess I can't do anything else there's no other understanding the world it's just about chess moves this lack of understanding has hampered every computer program that's tackled human language a perfect example is a program from the 1960s called Eliza Eliza was one of the
first programs that had anything resembling human conversation it was a dialogue you type things in and type things back how do you do please tell me your problem I'm feeling sad then it types back did you come to me because you're feeling sad Eliza was programmed to respond like a psychiatrist but it had no real insight instead it followed simple rules and rearranged key phrases so if I say I'm dead it responds do you enjoy being dead it doesn't have any understanding that Dead is a different kind of condition really is just doing the sort
of fill in the blanks kind of a turn magic anyone who tried to solve the language problem hit the same brick wall the computers profound ignorance of what we take for granted every day there's just so much more that we know that we don't know we know I mean just we know all kinds of stuff like you press the UP button in the elevator that means it's going to go up or milk is white or water is wet and it's just stuff that we know that we don't even realize we know that's one of the
things that makes it hard all the common-sense knowledge a human brain collects naturally seems much too complex to program into a computer but that hasn't stopped one scientist from trying so we have actually manually entered about six million rules that's about three percent of what it's going to need to know in terms of actually spanning what you and I would call human common sense for the last 25 years Doug Lynott has been leading a team trying to create human-like intelligence by teaching a computer common sense rule by rule the program is called psych and at
headquarters the walls are covered with logic diagrams in a way that the the magic of this the power of this is if you just tell it each rule one by one by one and you give it general logical reasoning capabilities that's all you need to do so far psych has six million rules and can answer a lot of common sense questions like this one Kenna can can can psych says no and it explains why here it's essentially saying the reason why cans can't can-can on is that cans or inanimate objects and it knows that Can
Can dancing requires at least partially having a brain and using it it's just enough for psych to get the right answer for the right reason 25 years ago many experts considered rules and logic the best hope for building artificial intelligence but it's become clear these alone are not enough it's not just a matter of piling in more and more stuff there are basic principles that we didn't understand putting in more and more stuff doesn't get you basic principles at IBM as Dave Ferrucci and his team tackle the Jeopardy challenge they know that facts and rules
are just the beginning we couldn't write rules for every combination of word and phrases in context they need a new system more fluid and flexible to navigate the twists and turns of many different kinds of jeopardy questions they named their system Watson after IBM founder Thomas Watson the electronic Watson consists of 2,800 processors that's like 6,000 high-end home computers altogether it's the size of 10 refrigerators the team starts filling his memory banks with about 10 million documents most downloaded from the internet because when Watson plays Jeopardy he must stand alone just like his human competitors
all kinds of content ok encyclopedias dictionaries the sorai books plays you name it the entire world book encyclopedia Wikipedia the Internet Movie Database much of the New York Times archive and the Bible are just some Watson's resources and to build on Watson's foundation of data and rules the team turns to a powerful tool in the computing world it's called machine learning machine learning is just like human learning from examples before people would just write rules right rules by hand nowadays it's all based on examples to understand how machine learning works consider for a moment the
letter A what if you had to describe it to a computer it's a real problem faced by the US Postal Service whose computers must decipher all kinds of addresses printed and handwritten we all know what an it looks like I know when I see it but there's just way too many different types of a's there are fonts where the a is just a triangle pointing up right that that's an a pretty quickly realize there is no simple set of rules that you can write down currently for a program to determine whether a letter is an
A or not humans might not be able to come up with the rules that reliably identify all kinds of a's but it turns out a computer can do it for itself if you give it enough examples any way you do it is you just get an A send it to the program and say that's a name here's another a different one that's an a here's another a it's a different one that's an 8 then you would give it another example and you would give it another example and you would do that a million times the
computer hunts for patterns among all those examples and it finds them so the next time it beats a letter a even one it hasn't seen before it will recognize it this is machine learning and it's a crucial element of Watson's programming the team trains once but here instead of letters the examples are tens of thousands of old jeopardy questions along with a cheat sheet of all the correct answers using machine learning Watson will hunt for patterns between the type of question the correct answer and the kinds of evidence that support that answer now we do
this over thousands of questions so we come up with some way to weigh the evidence on average so that we come up with the right answer now when he's faced with a brand new question Watson uses what he'd learned from these patterns and declares his confidence in each possible answer in the end we get a list that says here's a top answer and were 75 percent sure it's right Watson has now become a complex architecture of rules raw data and machine learning that enables him to use statistics to choose the right answer to test out
the system the team scours the holes for IBM employees who can play jeopardy and everyone squeezes into a conference room in 1978 new jersey monthly reporter Steven Levy famously found this man's brain Watson what he's pong times Albert Einstein's yes the Fifth Amendment says that private property shall not be taken for public use without this Watson what is just compensation yes with this new system Watson searches into the winners cloud we took the huge job with machine learning Watson with a commanding lead twenty four thousand eight hundred and sixty-three we saw a huge jump performance
we were like woke up to now appearing on the TV show has only been a dream but once it is performing so well day for Ruchi decides it's time to call jeopardy in December 2009 jeopardy producers arrived at IBM to size up they Ferrucci z' new creation like any human contestant Watson must audition to earn his spot on the show you spent all this time you know developing the system and pushing its capabilities then here you are sitting here all the executives are there you hear computer you think well of course that computer should have
all the answers you hear about QA technology well isn't this just a big search engine and they're waiting to see you know what really is gonna happen and you just don't know you don't know to impress the executives IBM builds a makeshift studio hires comedian Todd Crain to act as game show host and brings in former TV contestants that was one of the tents of days I've ever had because we had never seen it play against jeopardy players like together and I remember they could day before you know we're tuning everything you know I was
putting in the best strategy that we had was bringing the best stuff that we had I thought well this is just gonna kill him random what is the cat's in the cradle it was correct as I am the horse yes what is Crocodile Rock yes now they were just like professional athletes it was a really tough few games for us in the first round it seems that Watson is auditioning not for a game show but a sitcom where do we go next l underscore underscore underscore underscore phenom bang there are suddenly unexpected bugs that need
fixing we weren't doing with Roman numerals well so it'll say like Henry v we would say Henry VIII in 1682 he came to the throne at the age of 10 along with his weak minded half-brother ivan v watson what is peter more specific what is Peter I know Kerry you're David Gary cuz Peter the Great that is correct in final jeopardy where contestants must place bets and write down the answer things only get worse no under the category flags the clue is in a policy begun in 2002 as a symbol of the war on terrorism
u.s. Navy ships fly the 18th century flag with this forward motto you know a little bit something about eighteenth-century flags David let's see if you did what is the forward model we're looking for David what is don't tread on me that is correct let's see if Watson got it right what is the peril Watson didn't recognize the word motto and after scanning through millions of documents he found the word terrorism associated with September 11th so frequently that seemed like the best answer by the time they break for lunch it's humans to Watson zero and it's
not clear if Watson will ever be ready for prime time this was taking a risk for me in the sense that he's sitting here and saying you know what I think this is possible and then you fall flat on your face and people say well we're never gonna believe Ferrucci again did I expect to get fired no but maybe ha but after lunch the producers are treated to a different side of Watson we came back and the third game was neck-and-neck incredibly competitive in act 3 of an 1846 Verdi opera this scourge of God is
stabbed to death by his lover Oda Bella Watson what is Pattillo be more specific what is Attila the Hun thank you very much - till the Hun I'll take that then afternoon Watson climbs back in the game Wordsworth said they soar but never roam this brit-brats unease disease what is Skylark that is correct it's a device clamped to the wheel of a parked car with overdue tickets as correct Watson what is boot be more specific what is Denver boot that is correct this African American folk war laborer before I let that steam drill beat me
down I'll die with my hammer in my hand Watson what is John Henry that is correct so I began Watson it may appear that Watson has redeemed himself but the producers are troubled by his erratic performance their verdict Watson isn't strong enough for Jeopardy at least not yet why is Watson so erratic to understand his weaknesses you have to appreciate the complexity of the task consider this clue Keanu Reeves had a Nokia phone but it took a landline to slip in and out of this the title of a 1999 sci-fi flick the correct response is
what is the matrix but how can one s'en figure that out first he breaks down the clue into grammatical parts identifying key words and phrases then Watson's powerful search engines churn through millions of documents including the Internet Movie Database we do next is we take these documents and we pull out candidate and answers and we'll pull out okay Keanu Reese that could be candidate pullout Nokia will pull out the matrix other movie starring Keanu Reeves also become possible answers I'll pull out the matrix to pull out Speed Bill and Ted's Excellent Adventure all this stuff
and Watson pulls out other famous sci-fi flicks like Blade Runner and it generates hundreds of possible answers with hundreds of choices how can Watson pick the one answer that's correct next thing that Watson is going to do is going to take those answers and say well let's assume all of them might be right so these are its competing hypotheses Watson starts considering evidence for and against each candidate using rules like a movie is sometimes called a flick and we'll look at things like well it's looking for a flick is this can advance or flick is
the matrix a flick yes it's speed a flake yes this counter is a flick no and so we're starting to learn something within a matter of milliseconds Watson analyzes every possible answer in hundreds of different ways and scores each piece of evidence behind every answer in the list that's a lot of scores problem is you have all these different scores and they don't agree you know some of the scores are gonna say the matrix is right answer some of the scores you and say counter reaches the right answer so we're gonna think matrix 2 is
the right answer and a lot of scores think Bladerunner is the right answer because it shows up so often as a sci-fi play so you need someone at the end to listen to all these different votes and decide what's gonna be the best answer this is where Watson's machine learning kicks in having studied thousands of other jeopardy questions and their correct answers Watson has learned what evidence is and what's not what machine learning will start to do is learn how to weigh them differently and say weigh questions like this calling on a phone not calling
on a phone not so important on this other stuff will have a sci-fi movie is the person named the character and that will be very very important for questions like this in this case he successfully weighs the evidence and identifies sci-fi flicks from 1999 starring Keanu Reeves so he picks the one answer matching all those elements the matrix Watson's elaborate system doesn't always work but without machine learning he wouldn't stand a chance machine learning isn't just important for Watson it's driving a revolution in computing it plays a major role in computer models that predict the
weather days in advance and all those recommendations you get from Amazon or Netflix no human is writing up rules about your likes and dislikes instead computers are comparing your preferences to millions of other customers and finding patterns and learning about you today machine learning is conquering many problems once thought to complex for computers like speech recognition in the earlier days people decided that they would try to program computers to recognize speech which word am I saying that pick up the big block at the right side in the 60s this voice directed block world was the
height of technology computers could be programmed to recognize the audio signals of specific words and phrases pick up every small block but they had to be reprogrammed for every new speaker because everyone's speech is slightly different even though it's very easy for you and I to recognize the word Ice Cube Ice Cube it's very difficult for us to write down the rules that would allow a computer to look at the microphone signal and seeing that it's ice cube but now computers are trained with millions of examples of human speech here's a microphone signal and this
is the word ice cube ice cube here's another one you end up with much more successful speech recognition systems today speech recognition software though not perfect is remarkably accurate and getting better all the time all the ones we have today are based on machine learning simply because it works the best and some programs are taking it a step further where do you come from not only transcribing your speech haha but translating it into a foreign language as well Shanghai it's very nice to meet you I go Shinji and now every language has so much ambiguity
double meanings and metaphors what are your specials today accurate computer translation seemed impossible with the old rules based approach together 2000 euro top 5 these specials roast beef fried rice all of these interactions are so complex that you couldn't in your lifetime write all these rules is just too enormous to daunting an effort my wife asked me to buy some crackers Donna got got a stock rice crackers Alex Weibull fed a computer millions of examples of English text keys together with their translations into about a dozen different languages now he's got a program that can
run on your phone or iPad do you often go shopping here and translates on the go honey are you cooking on us my needs team us machine learning has been so successful mastery more and more tasks once only done well by humans the computer program translates between languages some researchers believe it may be a crucial building block for making real artificial intelligence there are two ways of building intelligence you either know how to write down the recipe word you let it grow itself and it's pretty clear that we don't know how to write down the
recipe machine learning is all about giving it the capability to grow itself some people find the idea of a machine that can learn threatening but when Watson's having a bad day it's hard to imagine him threatening anyway so we were way ahead we were almost locking out we get the Daily Double there's like two or three clues laughs so what do we do we've been big so we can lock him out I'll wager $5,200 okay the team is nervous they know Watson will never make the cut on Jeopardy unless he can stop making dumb mistakes
here's a clue it was about letters and it was a woman wrote to Bissell right before the artists in the late 40s a mother wrote to this artist that his picture number nine looked like some of her son's finger-painting grants with Rembrandt one who is Rembrandt really although Watson recognizes most dates he doesn't know that the forties refer to the 1940s and my brother forties artist we answered with Rembrandt there's a time to time from we all know that it was Jackson Pollock Watson loses that game got the idol wrong and ponder and his opponents
show him no mercy humans whoa sometimes the reason something is right answer is very obvious to a human like for example it may be asking for a she or a he this first lady was born Thelma Katherine Ryan on March 16 1912 in Nevada Watson who is Richard Nixon oh here you go right Patricia yeah who is Pat Nixon that is correct Richard Nixon was never a first lady we I want to understand what it was our new gender stance to this system it's not in this system by knowledge people take offense at being called
the wrong gender Watson doesn't care about stuff like that it's making statistical judgments based on how different pieces of evidence have gone together in questions and answers that we've given it the two famous comedians noses that made impressions what is Jimmy Durante more specific sorry all I know is what is Jimmy Durante saying it's lower doesn't make it right um hear how Todd crane makes fun of the computer and yeah I had my my kids I had them sign the confidentiality agreement and come in and see couple use games and you know what their comment
was why does the host make fun of watts and daddy this what are you doing websites name also refers to a type of nervous laugh Watson what is evil laugh oh no in terms of comedy duo's he is the best straight man in the business I'm gonna kick yourself Twitter because he doesn't he doesn't get it he doesn't get why his his appropriate appropriate answer is funny and that's there's you can you can't ask for better writing than that it looks a while okay we could all take a joke but over and over again and
watch this defenseless right so he's making fun of and criticizing a defenseless computer that represents people with real feelings real families or maybe if I don't have any feelings my kids up feelings and feelings are intensified but the fact there's just one more month before the Jeopardy producers will return to make a decision what you have control the pressure is on to boost Watson's strengths and eliminate his weaknesses his strengths are obvious he dominates when it comes to purely factual questions Watson usually does very well at these factoids questions looking up facts history geography entertainment
Clark Gable was happy to see him come in and finish directing Gone with the Wind Watson who is Victor Fleming that is correct Watson you choose again for 1600 please his westerns include wagon master and Fort Apache Watson who is John Ford good for 1600 who is Mike Nichols good for 12 last flew on the board for $800 here it is revenge of in 1978 was the fifth in this series of comedies directed by Blake Edwards Watson what is the Pink Panther I just want to check your buzzers are working just wonders want to check
in and wake you from your nap Watson has made it into the clown but nowhere near championship-level Ferrucci must come up with a plan to somehow step up his performance before the Jeopardy producers return the team has spent almost four years enormous intellectual and emotional energy and tens of millions of dollars on developing Watson but all this effort isn't just for a machine that can play jeopardy iBM has much bigger goals I'm already looking sort of beyond Jeopardy I'm thinking where can we go from here Ferrucci imagines a day when Watson might perform much like
the computer and Star Trek captain just starts talking to the computer and they say computer computer good a storm of such magnitude caused a power surge in the transporter circuits it's an information seeking tool that's capable of understanding your question creating a momentary interdimensional contact with a parallel universe and dialoguing with you to make sure that you get what you want we do have one of those I I don't have one of those right you don't need to be a starship commander to find this helpful in a world overflowing with data intelligent expert systems that
can answer vital questions have been the Holy Grail now we could be close to all Watson MD think of it this way there's a bunch of information new diagnosis new treatment options new discoveries can anybody keep that all in their head all at once a machine that could access and organize all that information could help doctors analyze symptoms and wade through piles of medical journals it changes the paradigm in which we work with computers that's the vision how am i doing I hope we will have a good game today but first I have to test
my voice to make before that vision can be fulfilled before Watson can even compete on Jeopardy the team needs to get more bugs out of his system one of Watson's most embarrassing weaknesses is he cannot hear instead Watson receives each Jeopardy clue as an electronic text message at the same moment his competitors see it on the board not as a result he doesn't know the other contestants answers only the female of this equine pest of the family tube in a day feeds on blood the male feeds on nectar bill puts the mosquito No Watson what
is mosquito no Harvey what's a horsefly yes thank you for not saying mosquito good job good for $2,000 re Ferrucci and the team have been working furiously to boost Watson's performance as part of their plan Watson will now receive correct answers electronic after their reveal if the fix works it will be in the nick of time the Jeopardy producers are back and they're about to determine Watson's fate no this was a measure of our progress and we wanted to hear yeah you're there you've made it the new and improved Watson gets his first big test
with a category called celebrations of the month Administrative Professionals Day and national CPAs goof-off Day Watson what is holiday no that's not even close really Watson fails because he doesn't get that in this category the answer must be the name of a month something his human competition quickly figures out Arthur what is April what is April April 18th is never if I understand why would I don't understand the question I don't understand what we don't listen to categorize d-day at an anniversary and Magna Carta but now he electronically receives these correct responses Arthur what is
June good for 200 can he learn from the answers national would Watson pose here is it seiz awhile all the answers I've seen have been the month in which this thing in the clue occurs Matt what is November good for for so then it knows in the next clue to look for what month is this this thing occurring I've celebrations for six celebrations for six national teacher day in Kentucky Derby Day Watson what is May yes you got it very nicely done Watson took us for thanks to the team's efforts Watson is soaring higher in
the cloud and now approaching the level of champions like Ken Jennings Watson is on a roll cheers again you're tramping for six teams of them jacques-cartier found this largest island of the Hokulea archipelago while searching for gold Watson what is Montreal yes who is simply alone hi good what is Providence where is Romeo Watson what is child that was right and acute all the same time the Jeopardy executives have seen enough I think we've gone from impressed to blown away very nicely done mom finally Watson will get his chance on Jeopardy a computer playing against
human champions they say it can think in a game that is a very symbol of intelligence but can it think like a jeopardy champion it will be a contest the world has never seen good luck Watson but does this mean that the dream of artificial intelligence is coming true some artificial intelligence to me is trying to get computers the new staff that if people did them you'd say oh they're demonstrating their people us that's what makes humans humans that stuff they're doing but without experience or emotion can a computer like Watson ever learn and understand
the world the way we humans do from early childhood on right now no machine can understand the meaning of a play what what it means to be King Lear or Macbeth or Hamlet to be or not to be that is the question no machine can understand the parables on the judeo-christian Bible all they can do is grovel through data and find regularities but for Dave for Ruchi that kind of understanding was never the goal it's like when we'll merge as a human because it doesn't connect the information to a human experience the human cognition when
you think about a great symphony and when a human sits down with that that music is affecting that human of emotional level my computer doesn't have that human experience doesn't have that human emotion it's not human it's a computer Watson may never experience the world the way we do but with his enormous knowledgebase his skill at interpreting language and his ability to learn yes could he actually be considered intelligent oh my god it is more intelligent than the average Jeopardy player in answering jeopardy question that's impressively intelligent good afternoon mr. Trebek I've been waiting for
this moment for a very very very long time finally it's show time Watson is now taking the stage where his intelligence will be put to the ultimate test in front of millions of Jeopardy viewers I think I dream about jeopardy questions now I have nightmares about jeopardy questions has the team done enough they're about to find out as Watson meets the world's two best jeopardy players Brad Rutter and Ken Jennings we've never had this caliber of player and there's a reason why Ken 174 games in a row there's a reason why Brad has never been
beat by a human the whole team has been waiting four years for this moment let's play jeopardy here we go four-letter word for the iron fitting on the hoof of a horse or a card dealing box in a casino Watson what is shoe you are right you get to pick at first man and machine look evenly man Watson who is Jude yes dad what is the 19 Oscar the 1900 yes Watson what is glass judgment correct Ken what is grease grace at the end of the first round it's anyone's game Sauron is right that puts
you into a tie for the lead the first round 5,000 5,000 they could beat us you know we've seen it happen spying games well certainly if you wanted to clip a graphic about me that's a lot but as the match continues Watson dominates consistently beating the humans to the buzz Watson who is Isaac Newton you are right - is CS Lewis yes what is guitar right it starts to look like a blow-up that you move to 36,000 when in the last round Ken Jennings stages a combinational newspaper raised its newsstand price by 25 cents to
a dollar Ken what is USA Today right Ken what our national borders good Martin Luther King yes you're right going into final jeopardy anything can happen miss model boy - stupid answer yeah here is the clue william Wilkinson's an account of the principalities of Wallachia and Moldavia inspired this authors most famous novel who is Bram Stoker you are correct the author of Dracula over to Ken Jennings now and we find who is Stoker I for one welcome our new computer if Watson gets this one he will win if we get Final Jeopardy right I'm gonna
kiss Eric now we come to Watson we're looking for Bram Stoker and we find who is Brad a little oh man we won and I think people will say yep Wasel is the best player no question Watson's victory is a major milestone for AR but perhaps an even greater achievement for the human intelligence that created you you a seagull a BBC
