Skip to main content

IBM's Watson

In 2005, Nico Schlaefer, a grad student at Carnegie Mellon University, built a statistical query system and wrote a thesis he called Statistical Thought Expansion later named Ephyra. IBM was impressed. Nico worked three summers on Watson. He is now a PhD candidate at CM and an IBM PhD Fellow.

In the Tourette syndrome example given below, Watson was unable to answer until they included more of the symptoms and signs in the database. Q & A as done with Watson seems analogues to Clinical Data & Differential Diagnosis. To make Watsons job easier, enter clinical data in a relational database in simple consistent terms. Likewise, list the sum total of medical diagnostic information in the same simple consistent terms. The relational database can correlate and list the match ups as diagnostic possibilities. A statistical program -- and here is where Watson comes in -- can list the probility of each. Furthermore, a statistical program can conduct an ongoing adjustment to the probable diagnosis based on realtime outcome as determined by subsequent information.

This is not to say that the computer makes the diagnosis, but it does give, at a glance, all of the possibilities. In fact quite the reverse, the statistical program improves its selections and statistics based on the clinician’s evolving and final diagnosis.

In practice, this computer directed diagnostics can be done on an off the shelf database program. Watson may be too hard to move around, and I imagine that the off the shelf database on the clinician’s own computer will be a bit less expensive. The important aspect, however, is still the statistical application. I guess that the articles about the development of Watson do not divulge all of the statistical mechanism, which makes up the AI of Watsons prenominal performance.

Simplicity, however, is the thing that works best with clinicians, and I would bet that there is already a simple statistical application that will function with a relational database. Schlaefer describes source expansion, and for us that source is medical information, all of it -- in simple database terms with criteria of diagnosis.

http://www.stanford.edu/class/cs124/AIMagzine-DeepQA.pdf A description of Watson

Found in Probably Irrelevant, from an interview. “Information Retrieval in IBM’s Watson: An interview with Nico Schlaefer,” Posted on March 17th, 2011 by Jon Elsas

http://probablyirrelevant.org/2011/03/ir-in-ibms-watson-an-interview-with-nico-schlaefer/

“Nico Schlaefer: Here is a question for which source expansion helped:

What is the name of the rare neurological disease with symptoms such as: involuntary movements (tics), swearing, and incoherent vocalizations (grunts, shouts, etc.)?

This is a question from the TREC 8 evaluation [pdf], but if written as a statement (”This rare neurological disease has symptoms such as …”) I think it could also pass as a Jeopardy! question. The answer is “Tourette syndrome”.

We first tried to answer this question using Wikipedia as a source, and there is indeed an article about “Tourette syndrome” in our copy of Wikipedia, but unfortunately it doesn’t mention most of the keywords in the question and Watson wasn’t able to get the answer. We then expanded Wikipedia, and “Tourette syndrome” was one of the topics that was automatically selected. The expanded article contains the following text passages which, by the way, all come from different websites:

• Rare neurological disease that causes repetitive motor and vocal tics

• The first symptoms usually are involuntary movements (tics) of the face, arms, limbs or trunk.

• Tourette’s syndrome (TS) is a neurological disorder characterized by repetitive, stereotyped, involuntary movements and vocalizations called tics.

• The person afflicted may also swear or shout strange words, grunt, bark or make other loud sounds.

These passages jointly almost perfectly cover the question keywords. I think the only content word that is not in there is “incoherent”. This made it very easy for Watson to find the answer.”

Comments

Popular posts from this blog

Existentialism

There are more things in this World Horatio, than are dreamed of in your philosophies Shakespeare Definitions from Oxford Languages · Learn more: adjective relating to existence. "The climate crisis is an existential threat to the world." PHILOSOPHY concerned with existence, especially human existence as viewed in the theories of existentialism. "The existential dilemma is this: because we are free, we are also inherently responsible." LOGIC (of a proposition) affirming or implying the existence of a thing. the existential proposition that truth and reality are constructed fictions" Even physicists struggle with truth. Reality in the laws of physics repeatedly give way to new findings. The James Webb Telescope finds galaxies beyond the time and space of the established Universe. Anthropologists find evidence of civilizations earlier than documented history. What is truth? The use of the word existential as a syndrome for virtual truth begs the question o...

Silent Voices

Civilizations under pressure often produce voices that crystallize their deepest questions. These are rarely kings or generals, but philosophers, teachers, and public figures who step into the square to provoke. Their role is not to rule but to make society face itself. In ancient Athens, that voice was Socrates. He wrote nothing. He simply asked: What is justice? What is virtue? What is the good life? His relentless questioning unsettled his fellow citizens, and Athens condemned him to death. He refused to flee, insisting that the examined life was the only life worth living. His death turned him into a symbol of Athens’ own unease. Our world has its own public voices. In recent years, Charlie Kirk became one of them. Whatever one thought of his politics, he drew large crowds, not only on American campuses but even in London and among Māori in New Zealand. He thrived on dialogue — fielding questions, sparring with critics, drawing applause. The style was different. Socrates aimed a...

Domestic Labor

A smal incrament of domestic economic activity drives a large increase in the GDP. Vvelocity times money supply equals gross domestic product (GDP). The Velocity in single didgits when multiplied by money in the trillions has far greater effect than interest rates. For many decades, society overlooked and denounced Domestic labord. IRS reporting requirements, imcontax on the worker and social stigma discouraged if not eliminated this valuable segment of the labor force. Tax free, regulation free, domestic employment would add a significant boost to the overall economy, employ the unemployable, and provide shelter to the homeless, not a hundred percent, but to a significant degree. Think affordable houskeeping, cooking, and babysitting for the single mother working long hours.