(1982) Kahneman & Tversky - Variants of Uncertainty
(1982) Kahneman & Tversky - Variants of Uncertainty
Variants of uncertainty*b
DANIEL KAHNEMAN
University of British Columbia
AMOS TVERSKY
Stanford University
Abstract
*This work was supported by the Office of Naval Research under Contract N00014-79X-0077 to
Stanford University. Repriiit requests should be sent to Deniel Kahneman, Department of Psychology,
University of British Columbia, 2075 Wesbrook Mall, Vancouver B.C., Canada V6T lW5.
144 6) Kahneman and A. lbersky
Uncertainty is a fact with which all forms of life must be prepared to con-
tend. At all levels of biological complexity there is uncertainty about the
significance of signs or stimuli and about the possible consequences of
actions. At all leuels, {ction must be taken before the uncertainty is resolved,
and a proper balance must be achieved between a high level of specific readi-
ness for the events that are most likely to occur and a general ability to res-
pond appropriately when the unexpected happens. Because the focus of the
present treatment is on belief rather than on action, we shall not discuss the
remarkable processes by which lower organisms distribute their response
effort in accordance with probabilities of reinforcement (Herrnstein, 1970).
Our principal concern in this section is with perceptual uncertainty.
Perceptual expectations
Before the event there are expectations. After the event there may be sur-
prise. Surprise has been studied mainly by psychophysical methods, and it
has been measured by the various indicators of the orienting response (Lynn,
1966; Sokolov, 1969) and by the P300 component of event-related poten-
tials (Donchin, Bitter and McCaUum, 1978; Duncan-Johnson and Donchin,
1977). Expectancies have been studied in many contexts, and by a wide
variety of methods.
Our discussion of perceptual expectancies will be organized ardund the
scheme shown in Figure 1, which distinguishes three main types of expecta-
tions. The first major distinction separates active from passive expectations:
an active expectation occupies consciousness and draws on the limited capa-
city of attention; in contrast, a passive expectation is automatic and effort-
less, and is better described as a disposition than as an activity (Posner, 1978).
Some expectancies are relatively permanent. Long-lasting expectancies
about covariations of attributes defme the perceptual categories that we use
to organize and encode experience (Broadbent, 197 1). Specific expectations
about objects, e.g., that rooms and windows are likely to be rectangular,
function as permanent assumptions which help determine the interpretation
Variantsof uncertainty 145
Figure 1. Perceptualexpectancies.
Expectancies
\
Passive .%ctive
1 ‘mporary
(&arch)
/
Permanent Temporary
(categories and (priming)
assumptions)
have not been primed. In contrast, a signal which causes the subject to pre-
pare actively for a particular target also slows the response to unanticipated
targets. In the language of probability theories, active expectations obey a
principle of complementarity: a high degree of preparation for a particular
event is achieved at the expense of a loss of preparation for other event%
Passive priming is associated with a non-complementary pattern of beneGt
without cost.
Passive expectations and conscious anticipations can conflict, and there is
evidence that the passive process exerts greater influence on the interpreta-
tion of ambiguous stimuli. Epstein and Rock (1960) pitted the two types of
expectations against one another, using a picture in which a left-looking and
a right-looking profiie were joined to form a pattern of reversible figure-
ground organization. Observers of the composite picture only saw one of the
profiles, which appropriated the common contour. Having constructed two
profiles which could be joined in this fashion? Epstein and Rock presented
the profiles separately in regular alternation for a number of trials, creating
a conscious expectation that each would always be followed by the other.
The composite was then presented for the first time, and the face that the
subjects saw in it was recorded. In accord with the priming effect, the ob-
servers almost always saw the profile that had been shown on the preceding
trial, rather th;ln the one which they consciously expected to occur.
A related demonstration of a conflict between different levels of expec-
tation has been reported, irl which the P300 component of the EEG was the
mair, dependent variable. The P300 is a positive deflection in the EEG, which
occurs about 300 msec after the presentation of any stimulus that the ob-
server treats as significant or relevant to the task. Ma,ny careful studies have
demonstrated a close link between the prior probabilities tif events and the
magnitude of the P300 deflections that they elicit (Donchin, Ritter and Mc-
Callum, 1978). When a subject is exposed to a Bernoulli series, frequently
repeated events elicit a smaller P300 than do rare ones. Furthermore, a run
of repetitions of the same event is associated with a steadily decreasing P300,
suggesting an increase in the subjective probability of further repetitions. In
contrast, the conscious expectation of repetitions decrea! es consistently
during a long run, by the familiar gambler’s fallacy. Evidently, an observer
can be prepared, or ‘primed’ for one event while consciously expecting
another-and can show physiological evidence of surprise at the occurrence
of an event that was consciously predicted. Thus, there is a sense in which
an individual can have conflicting probabilities for the same event at the same
time. These observations suggest an image of the mind as a bureaucracy (Den-
nett, 1978) in which different parts have access to different data, assign them
different weights and hold different views of the situation.
Variantsof uncertainty 147
Perception as (abet
then it also appears to be further away than if it is seen as small (lttelson and
Kilpatrick, 195 1).
The second observation is that perceptual construction appears to be a
hierarchical process, in which decisions about the global features of the scene
constrain and dominate decisions about the objects Icontained in it. The dis-
torted room provides the best example. What is seen is not a compromise
between two extreme views: normal-sized people in a distorted room, or
oddly-sized people in a normal room. The latter view simply dominates the
former, as if the shape of the room were computed before the processing of
the people in it begins. Whether similar rules can be shown to operate, :for
example, in the construction of scenarios of future events is a problem that
well deserves study.
The preceding section sought to show that the rules that govern perceptual
expectancies differ from the rules of probability theory. The present section
extends this analysis to the experiences of doubt and uncertainty that judg-
ments of subjective probability are assumed to reflect. As we shall see, the
notion of probability refers in natural language to several distinct states of
mind, to which the rules of the standard calculus of probability may not be
equally applicable.
To appreciate the complexity of expectations, consider one of their mani-
festations: the surprise that we experience when an expectation is violated.
Imagine that a coin is to be tossed 40 times. What number of ‘heads’ would
you expect? If you assume that the coin is fair, you would probably state
that the 20-20 result is more likely than any other, yet you would be more
surprised by this outcome than by a result of 22 ‘heads’ and 18 ‘tails’. Is the
‘true’ subjective probability of the two events indicated by the considered
judgment of their relative likelihood, or by the involuntary reaction of sur-
prise which they would elicit?
One possible interpretation is that the example illustrates a conflict be-
tween two approaches to the judgment of probability: the judpment that the
most likely outcome is 20-20 derives from knowledge of the i-ules of chance,
but outcomes such as 22-18 or 17-23 are more probable at another level
where probability is determined by representat’veness. A slightly uneven out-
come represents both the fairness of the coin and the randomness of tossing,
which is not at all represented by the exactly even result. In this view, the
greater psychological reality of expectations based on repreientativeness
manifests itself in the suprise reaction.
Variantsof uncertainty 149
better’. Thus, natural language allolws a privileged role to the best guess, and
the identification of the favored guess conveys information about the alter-
natives to which it may fairly be compared. The mention of a favorite ath-
lete indicates that he is to be compared to other individual athletes, rather
than to a disjunction of possible winners. One consequence of this rule is
that it is sometimes possible to ‘predict’ an event which is considered less
probable than its complement, if the complement is naturally coded as a
disjunction.
A related restriction applies to expressions of confidence. A statement of
confidence expresses one’s uncertainty in a prediction, estimate or inference
to which one is already committed. Thus, it is natural to ask ‘how confident
are you that you are right ?‘, but it is anomalous to ask ‘how confident are
you that you are wrong ?‘. Confidence is the subjective probability or degree
of belief as,ociated with what we ‘think’ will happen.
Common language also provides a large number of expressions to talk of
events which may happen, although we do not necessarily ‘think’ they will.
Thus, people assess the chances of candidates, estimate the risks of different
activities, give odds for football games and understand forecasters’ statements
about the probability of rain. We now turn to a more detailed analysis of the
states of uncertainty which such statements may express, following the
scheme shown in Figure 2. The two levels of the figure, attributions of un-
certainty and variants of uncertainty, are discussed in the following sections.
Uncertainty
as pr$?perties that be:long to exterr.dl objects, but pains, feelings and memo-
ries Bre attributed to the experiencing subject rather than to the eliciting
object.
The attribution of uncertainty can sometimes be inferred from a simple
linguistic test: is it alppropriate to describe the assessment of uncertainty as
‘the probability is.. , ‘? Or shou!d one say ‘my probability is.. . ‘? In contrast
to the Bayesian view, which treats all probabilities as subjective and personal,
natural language marks the distinction between internal and external uncer-
tainty. Thus it is legitimate to speak of ‘the best estimate of the probability
of a change of regime in Saudi Arabia within the next year’, but it is anoma-
lous to say ‘the best estimate of the probability that the Nile is the largest
river in the world is.. . ‘. Best estimates of probability belong to the public
domain. Expressions af private ignorance do not.
This test does not always distinguish internal from external uncertainty.
For example, one may speak of the probability that Marlowe wrote Hamlet
although this uncertainty is attributed to our ignorance rather than to the
strength of Marlowe’s propensity to write plays. The use of ‘the probability’
in this example is justified by the existence of a public body of knowledge,
which reduces but doles not eliminate the uncertainty about the authorship
of Hamlet. Not everybody need have access to this knowledge, but the esti-
mated probability refers to a reasonable or consensual inference from the
152 D. Kahnemanand A. TversIg
available evidence. In the example of the Nile, however, the public body of
evidence certainly includes the correct answer, and ignorance can only be
private.
The attribution of uncertainty about an event to dispositions or to igno-
rance depends, among other things, on timing. Uncertainty about past events
is likely to be experienced as ignorance, especially if the truth is known to
someone else, whereas uncertainty about the future is more naturally attri-
buted to the dispositions of the relevant system. Indeed, it has been noted
that people exhibit different attitudes to the outcome of a coin toss, depend-
ing on whether or not the coin has already been tossed (Rothbart and Snyder,
1970).
Variants of uncertainty
The second level of Figure 2 distinguishes four prototypical variants of un-
certainty, identified by the nature of the data that the judge might consider
in evaluating probability. External uncertainty can be assessed in two ways:
(i) a distributional mode, where the case in question is seen as an instance of
a class of similar cases, for which the relative frequencies of outcomes are
known, or can be estimated; (ii) a singular mode, in which probabilities are
assessed by the propensities of the particular case at hand. The two modes
of judgment are illustrated by the following true story.
A team that was concerned with the development of a high school curric-
ulum on thinking under uncertainty was conducting a planning session. The
question was raised of the time that would be required to complete the first
version of a textbook. The participants in the discussion were asked to esti-
mate this value as realistically as possible; the seven estimates ranged from
18 months to three years. The team leader then turned to one of the partici-
pants, an educator with considerable expertise in the problems of curriculum
development, with the following question: ‘What has been the experience of
other teams that have tried to write a textbook and develop a curriculum in
a new arca, where no previous course of study existed? How long did it take
them to complete a textbook, from a stage comparable to the present state
c c our project ?“. The chilling implications of the answer appeared to surprise
tne expert who gave it, much as they surprised the other participants: ‘Most
teams I could think of failed, and never completed a textbook. For those
that succeeded, completion times have ranged from five to nine years, with
a median of seven’.
Subsequent probing revealed that all participants had produced their ini-
tial estimate in the singular mode, by constructing plans and scenarios, with
SOme allowance of safety margins for unforeseen contingencies. Because of
Varim ts ofuncertainty 153
Discussion
Although the language of probability can be used to express any form of un-
certamty, the laws of probability theory do not apply to all variants of un-
certainty with equa1 force. These laws are most likely to be accepted, and
satisfied in intuitivG judgments, when an external uncertainty is assessed in a
distributional or frequent&tic mode. For example, complementarity of sub-
Variantsof uncertainty 15 5
References
Broadbent, D. E. (1967) Word-frequency effect and response bias. Psychol. Rev., 74, 1- 15.
Broadbent, ;y. E. (197 1) Decision and Stress. London, Academic Press.
Cohen, 1. J. (1977) The Plobuble and the Provable. Oxford, Clarendon Press.
Dennett, D. C. (1978) Brainstorms. Cambridge, Bradford Books.
Donchin, E., Ritter, W. and McCallum, W. C. (1978) Cognitive psychophysiology: The endogeneous
components of the ERP. In E. Callaway, P. Tueting and S. H. Koslow (eds.), Everwelated
Brain Potentials in Man. NEWYork, Academic Press.
Duncan-Johnson, C. C. and Donchin, E. (1977) On quantifying surprise: The variation of event-related
potentials with subjective probability. Psychophysiol., I4,456-467.
Einhorn, H. J. and Hogarth, R. M. (1981) Behavioral decision theory: Processes of judgment and
choice. An. Rev. Psychol., 32, 53-88.
Elksberg, D. (1961) Risk, ambiguity and the Savage axioms. Q. J. Econ., 75, 643-669.
Epstein, W. and Rock, i. (1960) Perceptual set as an artifact of recency. Amer. J. Psychol., 73, 214-
228.
Foss, D. J. and Blank, M. A. (1980) Identifying the speech codes. Cog. Psychol., 12, 1-31.
Herrnstein, R. J. (1970) On the law of effect. J. exper. Anal. Behav., 13, 243-266.
Howell, W. C. and Burnett, S. A. (1978) Uncertainty measurement: A cognitive taxonomy. Orguniz.
Behav. Hum. Perf.. 22.45-68.
Ittelson, W. H. and Kilpatrick, F. P. (1951) Experiments in perception. Sci. Amer., 18.5, 50-55.
%&neman, u., Slavic, P. and Tversky, A. (eds.) (in press) Judgmen? under Uncertainty.’ Heuristics
and Biases. New York, Cambridge University Press.
KSneman, D. and Tversky, A. (1979) Intuitive prediction: Biases and corrective procedures. TiMS
Studies in Management Science, I 2, 3 13 - 3 27.
Kahneman, D..and Tversky, A. (1982) On the study of st ltistical intuitions. Cog., II, 123-141.
Kilpatrick, F 3. (1961) Explorations in Transactional Psychology. New York, New York University
Press.
Lichtenstein, S., Fischhoff, B. and Phillips, L. (in press) Calibration of probabilities: The state of the
art to 1980. In D. Kahnemari, P. Slavic and A. Tversky (eds.), Judgment under Uncertainty:
Heuristics and Biases. New York, Cambridge University Press.
Lynn, R. (1966) Attention, Arousal and the Orientation Reaction. Oxford, Pergamon.
Morton, J. (1969) Interaction of information in word recognition. Psychol, Rev., 76, 165-178.
Nisbett. R. E. and Ross, L. (1980) Human Inference Strategies and Shortcomings. Englewood Cliffs,
NJ, Prentice-Hall_
Poster, M. 1. (1978) Chronometric Explorations of Mind. Hillsdale, NJ, Lawrence Earlbaum Associates.
wfa, H. (196k) Risk, ambiguity and the Savage axioms: Comment. Q. J. Econ., 7.5 690-694.
Rothbart, M. and Snyder, hf. (1970) Confidence in the prediction and postdiction of an uncertain
event. &tad. J. behav. Sci., 2, 38-43.
Shafer, G. (1976) A Mathematical Theory of Evidence. Princeton, Princeton University Press.
Vatian ts of uncertainty 157
Slavic, P., Fischhoff, B. and Lichtenstein, S. (1977) Behavioral decision theory. An. Rev. Psychol., 28,
l-38.
Sokolov, E. N. (1969) The modeling properties of the nervous system. In I. Maltzman and K. Cole
(eds.), Handbook of Contemporary Soviet Psychology. New York, Basic Rooks.
Tversky, A. and Kahneman, D. (1974) Judgment under uncertainty: Heuristi and biases. Science,
185, 1124-1131.
Warren, R. M. (1970) Perceptual restoration of missing speech sounds. Science, Z67, 393-395.
Rt%umr
Contrastant avec les theories formelles de jugement et de decision qui utilisent une notion unique de
probabilit8, les analyses psychologiques des rcponses g Pincertitude indiquent une grande varieti dans
les processus et les experiences qui peuvent ob& 6 diffirentes rGgles. On a passe en revue les formes
616mentaire.s d’attente et de surprise en perception. L’analyse ph&romt%rologique prCsent6e distingue
les attributions externes (disposition) des attributions internes (ignorance) de I’incertitude. L’estima
tion de l’incertitude peut refaire selon diff&ents modes selon qu’elle se centre sur les frequences, lcs
tendances, la force des arguments, une conviction issue d’une experience directe, etc. Ces variatiors
d’incertitude sont associ&es avec diffbrentes expressions du langage naturel, clles suggtrent cgaiemeni
des interp&tations philosophiques concurrentes de la probabilit6.