This is a file in the archives of the Stanford Encyclopedia of Philosophy.

Preferences

The notion of preference has a central role in many disciplines, including moral philosophy and decision theory. Preferences and their logical properties also have a central role in rational choice theory, a subject that in its turn permeates modern economics, as well as other branches of formalized social science. The notion of preference and the way it is analysed vary between these disciplines. A treatment is still lacking that takes into account the needs of all usages and tries to combine them in a unified approach. This entry surveys the most important philosophical uses of the preference concept and investigates their compatibilities and conflicts.

• 1. Preference logic
  • 1.1 Concepts and notation
  • 1.2 Completeness
  • 1.3 Transitivity
  • 1.4 Order typology
  • 1.5 Combinative preferences
  • 1.6 Preference-based monadic value predicates
• 2. Preference and value
• 3. Preferences and choice
  • 3.1 Choice functions and their properties
  • 3.2 Constructing choice from preference
  • 3.3 Constructing preference from choice
• 4. Reasons for preferences
  • 4.1 Property-preferences
  • 4.2 Aspect-preferences
• 5. Preference criticism
• 6. Preference change
  • 6.1 Evidence for preference change
  • 6.2 Time preferences
  • 6.3 Doxastic preference change
  • 6.4 Valuational preference change
• 7. Preference combination
  • 7.1 Aggregation and voting
  • 7.2 Condorcet's paradox
  • 7.3 Formal representation
  • 7.4 Arrow's theorem
  • 7.5 Procedural preferences
• Bibliography
• Other Internet Resources
• Related Entries

---

1. Preference logic

Although not all philosophical references to preference make use of formal tools, preferences are almost always assumed to have structural properties of a type that is best described in a formalized language. The logic of preference is therefore a suitable starting point of this entry. The study of the structural properties of preferences can be traced back to Book III of Aristotle's Topics. Since the early twentieth century several philosophers have studied the structure of preferences with logical tools. In 1957 and in 1963, respectively, Sören Halldén and Georg Henrik von Wright proposed the first complete systems of preference logic (Halldén 1957, von Wright 1963). The subject also has important roots in utility theory and in the theory of games and decisions. The preferences studied in preference logic are usually the preferences of rational individuals, but preference logic is also used in psychological research where the emphasis is on actual preferences as revealed in behaviour.

1.1 Concepts and notation

There are two fundamental comparative value concepts, namely “better” (strict preference) and “equal in value to” (indifference) (Halldén 1957, 10). The relations of preference and indifference between alternatives are usually denoted by the symbols ≻ and ∼ or alternatively by P and I. In accordance with a long-standing philosophical tradition, A≻B is taken to represent “B is worse than A”, as well as “A is better than B”.

The objects of preference are represented by the relata of the preference relation (A and B in A≻B). In order to make the formal structure determinate enough, every preference relation is assumed to range over a specified set of relata. In most applications, the relata are assumed to be mutually exclusive, i.e. none of them is compatible with, or included in, any of the others. Preferences over a set of mutually exclusive relata are referred to as exclusionary preferences. When the set of relata are mutually exclusive, it is customary to call them an alternative set, or set of alternatives A.

In philosophy, alternatives are commonly taken to be states of the world. They are represented as sentences or propositions. In contrast to this, economics commonly conceives of alternatives as bundles of goods. They are represented as vectors, where each position in the vector represents a specific good, and the scalar at that position denotes the number of units of that good. For convenience, economists often operate in two-goods worlds, where one good—the numeraire—stands for all the other goods (money is the most common numeraire). The countability of such bundles allows formulating two important preference properties. Preferences are monotone if larger bundles are always preferred to smaller bundles of the same goods, i.e. if A=⟨a₁,…,a_n⟩ is preference ranked and there is a bundle B=⟨b₁,…,b_n⟩ such that for at least one i: a_i>b_i and for all other j: a_j≥b_j, then A≻B. Preferences are homothetic if all indifference sets are related by proportional expansions among rays, i.e. if A∼B, then aA∼aB for any a≥0. These properties allow inferring a preference relation over many alternatives on the basis of only a few observations. However, this type of alternative contains a difficult ambiguity. For example, it is not coffee per se that one prefers to tea per se. Consumers may prefer drinking coffee to drinking tea, and merchants may prefer stocking coffee to stocking tea, etc. If preferences are subjective evaluations of the alternatives, then what matters are the results that can be obtained with the help of these goods, not the goods themselves. Whether an agent has a preference e.g. for a batch of wood over a crate of bricks will depend on whether she intends to use it to generate warmth, build a shelter or create a sculpture. Economists have tried to solve this ambiguity by coupling preferences over goods with household production functions (Lancaster 1966, Becker and Michael 1973); but as these components are very difficult to determine, it is often thought more parsimonious to stick with the sentential or propositional representations of states of the world.

The following four properties of the two exclusionary comparative relations are usually taken to be part of the meaning of the concepts of (strict) preference and indifference:

(1) A≻B → ¬(B≻A)    (asymmetry of preference)

(2) A∼B → B∼A    (symmetry of indifference)

(3) A∼A    (reflexivity of indifference)

(4) A≻B → ¬(A∼B)    (incompatibility of preference and indifference)

It follows from (1) that strict preference is irreflexive, i.e. that ¬(A≻A).

The relation ≽, “at least as good as” (or more precisely: “better than or equal in value to”), can be defined as follows:

A≽B ↔ A≻B ∨ A∼B    (weak preference)

The alternative notation R is sometimes used instead of ≽.

For reasons of convenience, weak preference is usually taken to be the primitive relation of preference logic. Then both (strict) preference and indifference are introduced as derived relations, as follows:

A≻B if and only if A≽B and ¬(B≽A)

A∼B if and only if A≽B and B≽A

≻ is the strict part of ≽ and ∼ its symmetric part.

Two common notational conventions should be mentioned. First, chains of relations can be contracted. Hence, A≽B≽C abbreviates A≽B ∧ B≽C, and A≻B≻C∼D abbreviates A≻B ∧ B≻C ∧ C∼D. Second, the ancestral symbol * is used to contract repeated uses of the same relation; hence ≻* stands for ≻ repeated any finite non-zero number of times (and similarly for the other relations). Thus A≻*C denotes that either A≻C or there are B₁ … B_n such that A≻B₁ ∧ B₁≻B₂ ∧ … B_n−1≻B_n ∧ B_n≻C.

1.2 Completeness

In most applications of preference logic, it is taken for granted that the following property, called completeness or connectedness, should be satisfied:

A≽B ∨ B≽A

or equivalently:

A≻B ∨ A∼B ∨ B≻A

The assumption of completeness is useful in many applications, not least in economics. Bayesian decision theory is a case in point. The Bayesian decision maker is assumed to make her choices in accordance with a complete preference ordering over the available options. However, in many everyday cases, we do not have, and do not need, complete preferences. Consider a person who has to choose between five objects A, B, C, D, and E. If she knows that she prefers A to the others, she does not have to make up her mind about the relative ranking among B, C, D, and E.

There are three major types of preference incompleteness. First, incompleteness may be uniquely resolvable, i.e. resolvable in exactly one way. The most natural reason for this type of incompleteness is lack of knowledge or reflection. Behind what we perceive as an incomplete preference relation there may be a complete preference relation that we can arrive at through observation, logical inference, or some other means of discovery.

Secondly, incompleteness may be multiply resolvable, i.e. possible to resolve in several different ways. In this case it is genuinely undetermined what will be the outcome of extending the relation to cover the previously uncovered cases.

Thirdly, incompleteness may be irresolvable. The most natural reason for this is that the alternatives differ in terms of advantages or disadvantages that we are unable to put on the same footing. A person may be unable to say which she prefers—the death of two specified acquaintances or the death of a specified friend. She may also be unable to say whether she prefers the destruction of the pyramids in Giza or the extinction of the giant panda. In environmental economics, as a third example, it is a controversial issue whether and to what extent environmental damage is comparable to monetary loss.

Two alternatives are called “incomparable” whenever the preference relation is incomplete with respect to them. The term “incommensurable” is usually reserved for cases when the incompleteness is irresolvable. In moral philosophy, irresolvable incompleteness is usually discussed in terms of the related notion of a moral dilemma.

1.3 Transitivity

By far the most discussed logical property of preferences is the following:

A≽B ∧ B≽C → A≽C    (transitivity of weak preference)

The corresponding properties of the other two relations are defined analogously:

A∼B ∧ B∼C → A∼C    (transitivity of indifference)

A≻B ∧ B≻C → A≻C    (transitivity of strict preference)

A weak preference relation ≽ is called quasi-transitive if its strict part ≻ is transitive.

Many other properties have been defined that are related to transitivity. The following three are among the most important of these:

A∼B ∧ B≻C → A≻C    (IP-transitivity)

A≻B ∧ B∼C → A≻C    (PI-transitivity)

There is no series A₁,…,A_n of alternatives such that A₁ ≻…≻A_n≻A₁    (acyclicity)

All of these are weakenings of the transitivity of ≽. In other words, if ≽ satisfies transitivity then ≻  and ∼ are also transitive, and furthermore, IP-transitivity, PI-transitivity and acyclicity hold.

Furthermore, if ≽ is transitive, then no cycles containing ≻ are possible, i.e. there are no A and B such that A≽*B≻A. Preferences with such a ≻-containing cycle are called cyclic preferences.

Transitivity is a controversial property, and many examples have been offered to show that it does not hold in general. A classic type of counterexample to transitivity is the so-called Sorites Paradox. It employs a series of objects that are so arranged that we cannot distinguish between two adjacent members of the series, whereas we can distinguish between members at greater distance (Armstrong 1939, Armstrong 1948, Luce 1956). Consider 1000 cups of coffee, numbered C₀, C₁, C₂, … up to C₉₉₉. Cup C₀ contains no sugar, cup C₁ one grain of sugar, cup C₂ two grains etc. Since one cannot taste the difference between C₉₉₉ and C₉₉₈, they are equally good (of equal value), C₉₉₉∼C₉₉₈. For the same reason, we have C₉₉₈∼C₉₉₇, etc. all the way up to C₁∼C₀, but clearly C₀ ≻ C₉₉₉. This contradicts transitivity of indifference, and therefore also transitivity of weak preference.

In another famous example by Warren S. Quinn, a medical device has been implanted into the body of a person (the self-torturer). The device has 1001 settings, from 0 (off) to 1000. Each increase leads to a negligible increase in pain. Each week, the self-torturer “has only two options—to stay put or to advance the dial one setting. But he may advance only one step each week, and he may never retreat. At each advance he gets $10,000.” In this way he may “eventually reach settings that will be so painful that he would then gladly relinquish his fortune and return to 0” (Quinn 1990, 79).

In an important type of counterexample to transitivity of strict preference, different properties of the alternatives dominate in different pairwise comparisons. Consider an agent choosing between three boxes of Christmas ornaments (Schumm 1987). Each box contains three balls, coloured red, blue and green, respectively; they are represented by the vectors ⟨R₁,G₁,B₁⟩, ⟨R₂,G₂,B₂⟩, and ⟨R₃,G₃,B₃⟩. The agent strictly prefers box 1 to box 2, since they contain (to her) equally attractive blue and green balls, but the red ball of box 1 is more attractive than that of box 2. She prefers box 2 to box 3, since they are equal but for the green ball of box 2, which is more attractive than that of box 3. And finally, she prefers box 3 to box 1, since they are equal but for the blue ball of box 3, which is more attractive than that of box 1. Thus,

R₁≻R₂∼R₃∼R₁,
G₁∼G₂≻G₃∼G₁,
B₁∼B₂∼B₃≻B₁; and
⟨R₁,G₁,B₁⟩≻⟨R₂,G₂,B₂⟩≻⟨R₃,G₃,B₃⟩≻⟨R₁,G₁,B₁⟩.

The described situation yields a preference cycle, which contradicts transitivity of strict preference. (Notice the structural similarity to Condorcet's Paradox, discussed in section 7.2.)

These and similar examples can be used to show that actual human beings may have cyclic preferences. It does not necessarily follow, however, that the same applies to the idealized rational agents of preference logic. Perhaps such patterns are due to irrationality or to factors, such as lack of knowledge or discrimination, that prevent actual humans from being rational. There is a strong tradition, not least in economic applications, to regard full ≽-transitivity as a necessary prerequisite of rationality.

The most famous argument in favour of preference transitivity is the money pump argument. The basic idea was developed by F.P. Ramsey (1928a, 182), who pointed out that if a subject's behaviour violated axioms of probability and preference, then “[h]e could have a book made against him by a cunning better and would then stand to lose in any event”. The argument is developed in more detail in Davidson et al. (1955).

The following example can be used to show how the argument works in a non-probabilistic context (Hansson 1993): A certain stamp-collector has cyclic preferences with respect to three stamps, denoted A, B, and C. She prefers A to B, B to C, and C to A. Following Ramsey, we may assume that there is an amount of money, say 10 cents, that she is prepared to pay for exchanging B for A, C for B, or A for C. She comes into a stamp shop with stamp A. The stamp-dealer offers her to trade in A for C, if she pays 10 cents. She accepts the deal.

For a precise notation, let ⟨X,V⟩ denote that the collector owns stamp X and has paid V cents to the dealer. She has now moved from the state ⟨A,0⟩ to the state ⟨C,10⟩.

Next, the stamp-dealer takes out stamp B from a drawer, and offers her to swap C for B, against another payment of 10 cents. She accepts, thus moving from the state ⟨C,10⟩ to ⟨B,20⟩. The shop-owner can go on like this forever. What causes the trouble is the following sequence of preferences:

⟨C,10⟩ ≻ ⟨A,0⟩
⟨B,20⟩ ≻ ⟨C,10⟩
⟨A,30⟩ ≻ ⟨B,20⟩
⟨C,40⟩ ≻ ⟨A,30⟩
⟨B,50⟩ ≻ ⟨C,40⟩
⟨A,60⟩ ≻ ⟨B,50⟩
…

The money-pump argument relies on a particular way to combine preferences in two dimensions, which is only possible if two crucial assumptions are satisfied: (1) The primary alternatives (the stamps) can be combined with some other commodity (money) to form composite alternatives. (2) For each preferred change of primary alternatives, there is some non-zero loss of the auxiliary commodity (money) that is worth that change. The money-pump can be used to extract money from a subject with cyclic preferences only if these two conditions are satisfied.

A critic can argue that the construction of preferences for the combined alternative set {⟨A,0⟩, ⟨C,10⟩, ⟨B,20⟩, ⟨A,30⟩, ⟨C,40⟩, ⟨B,50⟩…} out of preferences over the primary alternative set ({A,B,C}) should not be performed in the straightforward simple way that was indicated in the examples. Therefore, although widely used, money-pumps are not philosophically uncontroversial.

Another argument for the normative appropriateness of preference transitivity suggests that transitivity is constitutive of the meaning of preference. Drawing an analogy to length measurement, Davidson (1976, 273) asks: “If length is not transitive, what does it mean to use a number to measure length at all? We could find or invent an answer, but unless or until we do, we must strive to interpret ‘longer than’ so that it comes out transitive. Similarly for ‘preferred to’”. Violating transitivity, Davidson claims, thus undermines the very meaning of preferring on option over others. A critic, however, can point out possible connections between intransitive preferences and choice (see section 3). Although these are very basic connections that may not capture the full meaning of choosing according to one's preferences, their mere existence challenges Davidson's argument.

Yet another argument rests on the importance of preferences for choice. When agents choose at once from all the elements of an alternative set, then preferences should be choice guiding. They should have such a structure that they can be used to guide our choice among the elements of that set. But when choosing e.g. from {A,B,C}, a preference relation ≻ such that A≻B≻C≻A does not guide choice at all: any or none of the alternatives should be chosen according to ≻ (This will be discussed in more depth in section 3.2). The transitivity of preference, it is therefore suggested, is a necessary condition for a meaningful connection between preferences and choice. A critic, however, can point out that preferences are important even when they cannot guide choices. Take e.g. preferences over lottery outcomes: these are real preferences, regardless of the fact that one cannot choose between lottery outcomes. Further, the necessary criteria for choice guidance are much weaker than weak transitivity (Hansson 2001, 23-25; compare also versions of decision theory in which transitivity fails, e.g. Fishburn 1991). Last, the indifference relation does not satisfy choice guidance either. That does not make it irrational to be indifferent between alternatives. Thus choice guidance can be an argument for the normative appropriateness of transitivity only under certain restrictions, if at all. (For further discussion, see Anand 1993).

1.4 Order typology

Two more properties of preference relations need to be specified. A relation is antisymmetric if

A≽B ∧ B≽A → A=B    (antisymmetry of preference)

A relation is weakly connected if

For all A≠B, A≻B ∨ B≻A

The categories summarized in the table below (based on Sen 1970a) are standardly used to denominate preference relations that satisfy certain logical properties.

	Properties	Name(s)
1.	reflexive, transitive	Preorder, Quasi-order
2.	reflexive, transitive, anti-symmetric	Partial order
3.	irreflexive, transitive	Strict partial order
4.	reflexive, transitive, complete	Total preorder, Complete quasi-ordering, Weak ordering
5.	reflexive, transitive, complete, anti-symmetric	Chain, Linear ordering, Complete ordering
6.	asymmetric, transitive, weakly connected	Strict total order, Strong ordering

1.5 Combinative preferences

Sections 1.1-1.3 were devoted to exclusionary preferences, i.e. preferences that refer to a set of mutually exclusive alternatives. In practice, people also have preferences between relata that are not mutually exclusive. These are called combinative preferences.

Relata of combinative preferences typically are not specified enough to be mutually exclusive. To say that one prefers having a dog over having a cat does neglect the possibility that one may have both at the same time. Depending on how one interprets it, the preference expression may say very different things. It may mean that one prefers a dog (and no cat) to a cat (and no dog). Or, if one already has a cat, it may mean that one prefers a dog and a cat to just having a cat. Or, if one already has a dog, it may mean that one prefers just a dog to having a cat and a dog. Insofar as each of these relata may contain a number of possible worlds, logicians and decision theorists commonly take combinative preferences to have states of affairs as their relata. These are represented by sentences in sentential logic. It is usually assumed that logically equivalent expressions can be substituted for each other. The bundle-of-goods notion from economics can be equally applied, although most economists implicitly assume these bundles to be mutually exclusive. Last, combinative preferences can be defined over properties of objects. This will be discussed in section 4.1.

Properties such as completeness, transitivity and acyclicity can be transferred from exclusionary to combinative preferences. In addition, there are interesting logical properties that can be expressed with combinative preferences but not with exclusionary preferences. The following are some examples of these (some of which are controversial):

p≽q → p≽(p∨q)≽q    (disjunctive interpolation)

p≽q → ¬q≽¬p    (contraposition of weak preference)

p∼q → ¬q∼¬p    (contraposition of indifference)

p≻q → ¬q≻ ¬p    (contraposition of strict preference)

p≽q ↔ (p∧¬q)≽(q∧¬p)    (conjunctive expansion of weak preference)

p≻q ↔ (p∧¬q)≻(q∧¬p)    (conjunctive expansion of strict preference)

p∼q ↔ (p∧¬q)∼(q∧¬p)    (conjunctive expansion of indifference)

(p∨q)≽r ↔ p≽r ∧ q≽r    (left disjunctive distribution of ≽)

p≽(q∨r) ↔ p≽q ∧ p≽r    (right disjunctive distribution of ≽)

A common approach to combinative preferences is to derive them from exclusionary preferences, which are then taken to be more basic. In most variants of this approach, the underlying alternatives (to which the exclusionary preferences refer) have been possible worlds, represented by maximal consistent subsets of the language (Rescher 1967, von Wright 1972, Hansson 1996a). Possible world modelling has the advantages of generality and logical beauty, but it also has the disadvantage of cognitive unrealism. In practice, we are not capable of deliberating on anything approaching the size of completely determinate possible worlds. Instead, we restrict our deliberations to objects of manageable size. It can therefore be argued that a more realistic approach should be based on smaller alternatives that cover all the aspects under consideration—but not all the aspects that might have been considered. This approach may be seen as an application of Simon's “bounded rationality view” (Simon 1957, 196-200, Hansson 1996b).

The derivation of combinative preferences from exclusionary preferences can be produced with a representation function. By this is meant a function f that takes us from a pair ⟨p,q⟩ of sentences to a set f(⟨p,q⟩) of pairs of alternatives (perhaps possible worlds). Then p≽_fq holds if and only if A≽B for all ⟨A,B⟩ ∈ f(⟨p,q⟩) (Hansson 2001, 70-73).

1.6 Preference-based monadic value predicates

In addition to the comparative notions, “better” and “of equal value”, informal discourse on values contains monadic (one-place) value predicates, such as “good”, “best”, “very bad”, “fairly good”, etc. Predicates representing these notions can be inserted into a formal structure that contains a preference relation. Most of the monadic predicates in common use belong to two major categories, the positive and negative predicates (Hansson 1990). A predicate H is ≽-positive if and only if it satisfies the property:

(Hp ∧ q≽p) → Hq

It is ≽-negative if and only if it satisfies the property:

(Hp ∧ p≽q) → Hq

It can straightforwardly be shown that a monadic predicate H satisfies ≽-positivity if and only if its negation ¬H satisfies ≽-negativity.

Two major attempts have been made to define the principal monadic predicates “good” and “bad” in terms of the preference relation. One of these defines “good” as “better than its negation” and “bad” as “worse than its negation” (Brogan 1919).

G_N p ↔ p≻¬p    (negation-related good)

B_N p ↔ ¬p≻p    (negation-related bad)

The other definition requires that we introduce, prior to “good” and “bad”, a set of neutral propositions. Goodness is predicated of everything that is better than some neutral proposition, and badness of everything that is worse than some neutral proposition. The best-known variant of this approach was proposed by Chisholm and Sosa (1966). According to these authors, a state of affairs is indifferent if and only if it is neither better nor worse than its negation. Furthermore, a state of affairs is good if it and only if is better than some indifferent state of affairs, and bad if and only if some indifferent state of affairs is better than it.

G_I p ↔ (∃q)(p≻q∼¬q)    (indifference-related good)

B_I p ↔ (∃q)(¬q∼q≻p)    (indifference-related bad)

The negation-related and the indifference-related “good” respectively “bad” do not necessarily coincide. Both definitions have been developed with complete preference relations in mind, but extensions are available that cover the more general cases (Hansson 2001).

2. Preference and value

Preferences can be interpreted as expressions of value. A≻B then means that more value is assigned to A than to B, and A∼B that the same value is assigned to the two. Values are usually taken to be adequately expressible in numerical terms. Let u (as in “utility”) be a value function that assigns a real number to each element of the alternative set. We can then construct a model of preference logic in the following way:

A≻B iff u(A)>u(B)    (Exact value representation)

A preference relation has an exact value representation only if it satisfies both completeness and transitivity. The inverse is generally true only for finite A. If A is infinite, not all complete and transitive preference relations can be represented by a utility function (for a counter-example based on a lexicographic preference relation, see Debreu 1954).^[1] It is important to note that the value function used for exact value representation only needs to carry ordinal information: a higher number assigned to A than to B only signifies that A is preferred to B, not how much A is preferred to B. Thus it should be clear that ≻ is represented by any function u′ that is a positive monotone transformation of u. (The only currently accepted way to incorporate cardinal information into a value function is by making value comparisons over lotteries, and using the probabilities of these lotteries—either as objective probabilities or in the form of subjective beliefs—as an interval measure. This procedure falls within the domain of decision theory and will not be discussed any further here.)

An incomplete preference ordering also has a value representation of the following type:

If A≻B, then u(A)>u(B)

The inverse is obviously not true. However, under fairly wide circumstances, given the set of all utility functions thus defined, one can find the preference relation (Aumann 1962).

As can be seen from the “cups of coffee” example mentioned in section 1.3, the exact value representation of preferences is too demanding for some purposes. If u(A)> u(B), but u(A)-u(B) is so small that it cannot be discerned, then A≻B cannot be expected to hold. One way to represent this feature is to employ a cardinal utility function and to introduce a fixed limit of indiscernibility, such that A≻B holds if and only if u(A)−u(B) is larger than that limit. Such a limit is commonly called a just noticeable difference (JND).

A≻B iff u(A)−u(B)>δ,    (JND representation, δ>0)

If the set of alternatives is finite, then ≽ has a JND representation if and only if ≽ is complete, and satisfies the two properties that for all A,B,C,D: A≻B ∧ B≻C → A≻D ∨ D≻C and A≻B ∧ C≻D → A≻D ∨ C≻B.

Another interesting construction is to assign to each alternative an interval instead of a single number. This requires two real-valued functions, u_max and u_min, such that for all A, u_max(A)≥ u_min(A). Here, u_max(A) represents the upper limit of the interval assigned to A, and u_min(A) its lower limit. A ≻B holds if and only if all elements of the interval assigned to A have higher value than all elements of the B interval:

A≻B iff u_min(A)> u_max(B)    (Interval representation)

It has been shown that a preference relation ≽ has an interval representation if and only if it satisfies completeness and the property that for all A,B,C,D: A≻B ∧ C≻D → A≻D ∨ C≻B.

A final generalization is to let the threshold of discrimination depend on both relata.

A≻B iff u(A)−u(B)>σ(A, B)    (Doubly variable threshold representation, σ(A,B)>0)

If the set of alternatives is finite, then ≽ has a doubly variable threshold representation if and only if it satisfies acyclicity.

3. Preferences and choice

There is a strong tradition, particularly in economics, to equate preference with choice. Preference is considered to be hypothetical choice, and choice to be revealed preference.

3.1 Choice functions and their properties

Given an alternative set A, we can represent (hypothetical) choice as a function C that, for any given subset B of A, delivers those elements of B that a deliberating agent has not ruled out for choice. For brevity's sake we will call them 'chosen elements'. The formal definition of a choice function is as follows:

C is a choice function for A if and only if it is a function such that for all B ⊆ A: (1) C(B) ⊆ B, and (2) if B ≠ ∅, then C(B) ≠ ∅.

A large number of rationality properties have been proposed for choice functions. The five most important of these are described here.

If B ⊆ A then B ∩ C(A) ⊆ C(B)    (Property α, “Chernoff”)

This property states that if some element of subset B of A is chosen from A, then it is also chosen from B. According to property α, removing some of the alternatives that are not chosen does not influence choice. This is a very basic and quite reasonable requirement of choice; however, consider the following example. Erna is invited to an acquaintance's house for dinner. Her choice for dessert is between an apple (which is the last piece of fruit in the fruit basket) (X) and nothing instead (Y). Because Erna is polite, she chooses Y. Had she faced a choice between an apple (X), nothing (Y) and an orange (Z), she would have taken the apple. Thus her choices are:

C({X,Y,Z}) ={X}

and

C({X,Y}) ={Y},

which violate property α. More generally, property α is reasonably violated when alternatives are preferred for their position in an alternative set, when the set of alternatives itself constitutes important information about the alternative chosen, or when certain alternatives provide the chooser with the freedom to reject them (Sen 1993, 501-503).^[2]

The second property states that if X and Y are both chosen from B, a subset of A, then one of them cannot be chosen in A without the other also being chosen.

If B ⊆ A and X, Y ∈ C(B), then X ∈ C(A) iff Y ∈ C(A)    (Property β)

Property β is more controversial than property α. As Sen (1970a, 17) points out, property α states that if the world champion in some game is a Pakistani, then he must also be the champion in Pakistan, while property β states that if some Pakistani is a world champion, then all champions of Pakistan must be world champions.

The third property requires that an element X that is chosen from every set in a particular class must also be chosen from their union.

C(B₁) ∩ … ∩ C(B_n) ⊆ C(B₁ ∪ … ∪ B_n)    (Property γ, Expansion)

As an example of property γ, if the town's best ladies' hairdresser is also the town's best gents' hairdresser, then (s)he is the best hairdresser in town.

In contrast to the above three properties that are mainly found in the social choice literature, the following two properties are standardly employed in economics.

The fourth property is the so-called Weak Axiom of Revealed Preferences (WARP). It says that if X is chosen when Y is available, then there cannot be an alternative set B containing both alternatives for which Y is chosen and X is not.

If X,Y∈A and X∈C(A), then for all B, if X∈B, and Y∈C(B), then X∈C(B)    (WARP)

WARP is equivalent to the combination of properties α and β (Sen 1971, 50). Thus it also suffers from their problems, in particular the problems of property β. Consider an agent who chooses to stay at a friend's house for a cup of tea (T) rather than to go home (H), but who leaves in a hurry when the friend offers a choice between tea and cocaine (C) at his next visit. Thus the visitor chose C({T,H}) ={T}, and C({T,H,C}) ={H}, and hence violates β and WARP.

The fifth and strongest of the properties of a choice function is the so-called strong axiom of revealed preferences (SARP). In essence, SARP is a recursive closure of WARP.^[3]

If

X₁,X₂, …, X_n∈A₁,
X₂, …, X_n∈A₂,
…,
X_n-1,X_n∈A_n−1,
X_n∈A_n, and
X₁∈C(A₁), X₂∈C(A₂), …, X_n∈C(A_n),

then

for all B with X₁,X₂,…,X_n∈B, if X_i∈C(B), i∈{1,…,n},

then X₁,X₂,…,X_i−1∈C(B)    (SARP)

Simplified, SARP says that if from a set of alternatives A₁, X is chosen while Y is available, and if in some other set of alternatives A₂, Y is chosen while Z is available, then there can be no set of alternatives containing alternatives X and Z for which Z is chosen and X is not. (SARP says this for chains of unlimited length). SARP is much stronger than α, β and γ combined. However, for choice functions that specify choices over all subsets of the alternative set with at most three elements, SARP is equivalent to WARP and hence to properties α and β (Sen 1971, 50).

3.2 Constructing choice from preference

A choice function that is defined on the basis of a preference relation is called relational (also binary). The most obvious way to construct a choice function from a preference relation ≽ is to have the function always choose the elements that are best according to ≽:

C^B(B) = {X ∈ B | ∀Y ∈ B: (X≽Y)}    (The best choice connection)

C^B is a choice function (i.e. satisfies the defining criteria for a choice function given in section 3.1) if and only if ≽ is complete and acyclical. Such a choice function satisfies properties α and γ. Furthermore, C^B satisfies property β if and only if ≽ is transitive and complete (Sen 1970a, 19).

When the underlying preference relation is incomplete, there may not be an element that is preferred to all other elements. A function C constructed according to the best choice connection will then be empty, and hence not a choice function. To avoid this, an alternative connection constructs the choice function as choosing those elements that are not dispreferred to any other elements of the set:

C^L(B) = {X ∈ B | ∀Y ∈ B: ¬(Y≻X)}    (The non-dominance choice connection)

C^L is a choice function if and only if ≽ is acyclical. Such a choice function satisfies properties α and γ. Furthermore, C^L satisfies property β if and only if ≽ is transitive and complete (Herzberger 1973).

When the preference relation over A is cyclical, neither C^B nor C^L may be a relational choice function for A. In the simplest case, with a cyclical preference A≻B≻C≻A, C^B(A,B,C) = C^L(A,B,C) = ∅. Schwarz (1972) therefore proposes a third relational choice function, which operates even on the basis of cyclical preferences. He constructs the choice connection in two steps. In the first step, alternatives from A are grouped into sets B so that no alternative outside of the set B is preferred to any alternative in it. Further, these sets are formed so that removing some alternatives from the set would result in that alternative being preferred to an alternative in the set. Let S be the set of these sets. Formally, B is in S iff:

(1) B ∈ ℘(A)

(2) for all X,Y: if X∈A\B and Y∈B then not X ≻Y

(3) for all F⊂B there is a Y∈F such that for some X∈A\F: X≻Y

The choice function is then defined as the union of S:

C^O(A) = ∪ S    (The optimization choice connection)

C^O is a choice function for any asymmetric ≻. With cyclical preference A≻B≻C≻A, C^O(A,B,C)={A,B,C}. C^O satisfies properties α and γ if and only if ≽ is acyclical. Furthermore, C^O satisfies property β if and only if ≽ is transitive and complete.

3.3 Constructing preference from choice

The close connections between preference axioms and choice axioms can also be employed to construct a preference ordering from a choice function that satisfies certain axioms. In economics, the revealed preference approach has been used to define preference in terms of choice. Historically, this approach developed out of the pursuit of behaviouristic foundations for economic theories—i.e. the attempt to eliminate the preference framework altogether. Today, it serves to derive preference orderings from an agent's observed choices, and to test the empirical validity of the preference axioms by testing for the violation of choice axioms (Grüne-Yanoff 2004).

There are many ways to construct preference relations from observed choices. Three prominent ones are introduced here. The first defines an alternative X as “at least as good as” an alternative Y if and only if X is chosen from some set of alternatives that also contains Y.

X≽SY iff for some B, X∈C(B) and Y∈B	(1)
X≻SY iff X≽SY and not Y≽SX
X∼SY iff X≽SY and Y≽SX

If the choice function is defined over all subsets of B, ≽^S is complete. ≻^S does not necessarily satisfy transitivity of strict preference, transitivity of indifference, IP- or PI-transitivity.

A second construction method defines an alternative X as “at least as good as” an alternative Y if and only if X is chosen from the binary set that contains Y.

X≽BY iff X∈C({X,Y})	(2)
X≻BY iff X≽BY and not Y≽BX
X∼BY iff X≽BY and Y≽BX

If the choice function is defined over all binary subsets of a set of alternatives, ≽^B is complete. However, ≽^B does not necessarily satisfy transitivity of strict preference, transitivity of indifference, IP- or PI-transitivity.

A third method defines an alternative X as “strictly preferred to” an alternative Y if and only if X is chosen from some set of alternatives that also contains Y, but Y is not chosen from that set.

X≻RY iff for some B, X∈C(B) and Y∈[B\C(B)]	(3)
X≽RY iff not X≻RY
X∼RY iff X≽RY and Y≽RX

If the choice function is defined over all relevant subsets of the set of alternatives, ≽^R is always complete. However, ≻^R may violate transitivity of strict preference, and ≽^R may violate transitivity of indifference, IP- or PI-transitivity.

In constructing ≽^B, if C({X,Y})={X,Y}, then indifference holds, i.e. X∼^BY. However, this is not the only possible interpretation. One can interpret C({X,Y})={X,Y} either as an indifference between X and Y or as incomparability between these two alternatives. Extra information is required to distinguish the two. One possibility of obtaining such extra information is the small improvement argument (Chang 1997, 23-26). When observing an agent choosing C({X,Y}) = {X,Y}, the observer makes the agent repeat the choice, now with an offer of a small independent incentive i attached to one of the alternatives. If the agent chooses C({X∧i,Y}) = {X∧i}, the observer may conclude that the agent was indifferent between X and Y, and that the addition of i to X shifted the balance to X ∧i over Y. If the agent however chooses C({X∧i,Y}) = {X∧i,Y}, then the observer may conclude that X and Y were incomparable for the agent, and that the addition of i to X did not alter X's incomparability to Y. Because the agent's evaluation of i is presupposed, this method is not uncontroversial.

The elicitation of preferences through choices is of particular importance in economics, where prices and choices of large groups of agents are often the only available empirical data. The revealed preference method proceeds in two steps. In the first step, an agent's observed choice of a goods bundle X_i = ⟨x₁,…,x_n⟩ in combination with the prices P_i = ⟨p₁,…,p_n⟩ for these goods determine the set of alternatives from which the agent chooses. If the agent chooses X_i = ⟨x_i1,…,x_in⟩ under prices P_i = ⟨p_i1,…,p_in⟩, her budget is B = X_i × P_i = ⟨x_i1,…,x_in⟩ × ⟨p_i1,…,p_in⟩, assuming that she spends all her resources. Under price regime P_i, she can thus choose between all goods bundles X_j that are affordable under the budget B, i.e. for which X_i × P_i ≥ X_j × P_i. In the second step, preference construction method (1) is applied. If the agent is observed choosing bundle X_i from budget B, then X_i is declared weakly preferred to all X_j affordable under B. The revealed preference connection, in accord with method (1), is then formulated as:

X_i≽^CX_j if and only if X_i × P_i ≥ X_j × P_i

X≻^CY iff X≽^CY and not Y≽^CX

X∼^CY iff X≽^CY and Y≽^CX

It may be the case that an agent chooses X_i under prices P_i and X_j under prices P_j, even though X_i × P_i ≥ X_j × P_i and X_j × P_j ≥ X_i × P_j. The revealed preference method then elicits X_i≻^CX_j and X_j≻^CX_i, which violates asymmetry of strict preference. To avoid this undesirable conclusion, only those choices are considered that satisfy the Weak Axiom of Revealed Preferences (WARP). It says that if X is chosen when Y is available, then there can be no budget set containing both alternatives for which Y is chosen and X is not (see section 3.1). Thus, asymmetry of ≻^C is secured.

As discussed in section 3.1, for situations that specify choices over all subsets (up to three elements) of the alternative set, WARP also ensures that the relation ≽^C is transitive. For practical purposes, however, this method is not very helpful, as the space of prices and goods bundles is very large. Social scientists do not have the resources to observe agents' choices from all relevant preference sets. If they want to derive a transitive preference relation from a choice function not defined over all subsets (up to three elements), then they have to restrict themselves to consider only choices that satisfy the strong axiom of revealed preferences (SARP). It says that if X is chosen when Y is available, and if in some other budget set Y is chosen when Z is available, then there can be no budget set containing alternatives X and Z for which Z is chosen and X is not. Thus, transitivity of ≽^C is ensured.

The above-discussed theoretical effort sees preferences as completely tied to choices. Various caveats concerning this connection are in order. First, it must be pointed out that choices and preferences are in fact entities of quite different categories. Preferences are states of mind whereas choices are actions. The strong behaviourist program, which sought to eliminate the notion of preference by reducing it to choices, is therefore rightly regarded with suspicion today.

Secondly, it is necessary to distinguish between those agents who indeed have preferences as state of minds—e.g. humans, and maybe higher animals—and those agents who do not—e.g. machines, plants or institutions. The former category may choose on the basis of their preferences, and hence the above-discussed effort can aim at eliciting the preferences on which their choices are based. The latter category, despite their lack of states of mind, may nevertheless exhibit behaviour that can be interpreted as relational choice. In those cases, one can only speak of preferences reconstructed from choice, without claiming that these agents actually have preferences at all.

Thirdly, it seems obvious that there are preferences over alternatives that one cannot choose between—for example preferences for winning a certain prize of a lottery, or for particular configurations of Paradise. This contradicts the claim that preferences exclusively transpire from choices. One way to substantiate preferences over alternatives that one cannot choose between is to ask people what they prefer. Their answers can be interpreted as further choice evidence—as verbal or writing behaviour. This interpretation treats their answers on a par with all other forms of behaviour. It thus acknowledges that their answers are possibly influenced by other preferences, e.g. for privacy, status or pretend play, and explains why answers may not be true. Alternatively, their answers can be interpreted as introspective reports. This interpretation treats answers as agents' privileged access to their own minds; and it becomes difficult to explain "false" answers.

Fourthly, some choices are not based on stable preferences over actions, but are constructed from more basic cognitive and evaluative elements. A simple choice—like e.g. choosing between two candies—may be based on a preference for a world in which one eats candy X over a world in which one eats candy Y. But more complex choices—e.g. choosing one's higher education—depends on what one believes these choices to bring about, and how one evaluates the consequences of these choices. In those cases, a more complex framework specifies beliefs about the likelihood of possible states of the world, preferences over the consequences of choices in those worlds, and an aggregation mechanism of these preferences under those beliefs. Often, this framework yields a preference relation over actions much like the simple case. However, alternative frameworks, where this is not the case, have been developed (e.g. Loomes and Sugden 1982).

Last, the introspective concept of preference is closely connected to the notion of welfare. An agent who prefers X to Y is expected to judge herself to be better off with X than with Y. But if preferences are tightly linked to choice, the welfare interpretation is jeopardized. As Sen argues, people choose not only on the basis of their concern for their own welfare, but also on the basis of commitments—e.g. traditions, habits, moral maxims, etc. (Sen 1977). So it seems that preferences can either be interpreted as welfare judgements, or as the basis of choices, but not as both at the same time.

4. Reasons for preferences

Rational choice theory conceives of choices as rational if they are (correctly) derived from a complete and transitive preference ordering over the choice alternatives. But we rarely consider those who justify their choice only by saying “Because I preferred to do this” as giving reasons. Interestingly, the structures that represent common notions of reason often involve preferences themselves, so that a two-level framework emerges: preferences of the reason-giving type give rise to preferences that are the basis of choice. In the following, two notions of reason-giving preferences are discussed.

4.1 Property-preferences

Minimally, the explanation or justification of a choice requires showing that the agent had preferences over the possible consequences or other properties of the alternative actions, as well as a way to connect those preferences over consequences/properties to preferences over choice alternatives. Decision theory, which models preferences over consequences, thus considers reasons for choice and action. But it only considers a shallow notion of reasons, namely preferences over states of affairs or prospects. A deeper notion of reasons, as Pettit (1991) argues, acknowledges that desires, and hence preferences, have two quite different sorts of objects—prospects and properties—and that the preferences we form over different prospects are determined by the properties that we think they have. For example, when I say that I prefer my living room to be painted pink rather than grey I indicate a preference for a specific state of affairs out of a set of fixed alternatives. When I say that I prefer pink to grey, however, I express a preference for a property that may be realised in an indefinite number of states of affairs. The presence of one of these properties will make any prospect more attractive to me; at the limit its realisation in one of a number of alternatives between which I am otherwise indifferent will lead me to prefer that alternative. Decision theory has traditionally not treated this property-dimension of deliberation. By introducing an appropriate connecting principle between prospect and property preferences, one imposes an additional consistency constraint on the rational agent: his prospect preferences must cohere with his preferences over those properties that the prospects realise. Grüne-Yanoff (2006) argues that the connecting principle cannot be a logical connection, but must be based on the causal beliefs of the agent. A preference ordering over prospects and properties is consistent if all prospect preferences cohere with the preferences over those properties that the agent believes to be causally relevant for bringing about the prospect.

4.2 Aspect-preferences

Another way to model reasons within the preference framework is to leave the individuation of alternatives intact, and instead multiply the number of preference orderings over these alternatives for each individual. These represent the individual's partial judgements of the same alternative from different points of view—e.g. moral, political, economic or aesthetic. Let each of these judgements be represented by a complete and transitive preference ordering. Then the evaluation of the alternatives in set A according to all aspects yields a bundle (≽₁, ≽₂, …, ≽_n) of n aspect orderings. To arrive at a single overall evaluation of A, the agent needs to employ a formation rule F, which in itself has nothing to do with choosing between alternatives but with evaluating preferences on a meta-level according to the agent's specific character. Steedman and Krause (1986) discuss different types of formation rules, which map a bundle (≽₁, ≽₂, …, ≽_n) onto a single preference relation. The first formation rule describes a very cautious character, who considers an alternative at least as good as another only if she considers it at least as good in every aspect.

F_P (≽₁, ≽₂, …, ≽_n) = ∩ ≽_i    (Pareto type)

The outcome of F_P is transitive, but not complete. The other extreme is a character who considers one alternative at least as good as another if she strictly prefers it even just according to one aspect.

F_S (≽₁, ≽₂, …, ≽_n) = ∪ ≻_i    (Sen type)

The outcome of F_S is complete, but not transitive. In between these two extremes, one can define many kinds of counting rules that determine the overall preference for an alternative according to the numbers of aspects in its favour. The outcome of majority rule defined this way will always be complete, but not transitive, while a rule involving a certain threshold will neither be transitive nor complete.

Last, another type of formation rule considers one alternative at least as good as another if it is strictly preferred according to the most relevant aspect, and in case of a tie, according to the next relevant aspect.

For all X,Y∈A: F_H (≽₁, ≽₂, …, ≽_n) = X≽_kY, where ≽_k is the first in a relevance reordered (≽_s1, ≽_s2, …, ≽_sn) such that X∼_kY does not hold    (Hierarchical type)

The outcome of F_H is always a transitive and complete ordering. These are only some examples of possible formation rules.

As will become clear in section 7, all these formation rules are structurally identical to social choice functions. This is not surprising: many philosophers, Plato and Bishop Butler amongst them, have drawn the analogy between intrapersonal conflict and citizens' diverging preferences within a state. This also means, as will be discussed in section 7.4, that there is no formation rule that satisfies four seemingly plausible conditions and that in general yields a transitive and complete overall preference ordering. If those conditions really are applicable to intrapersonal conflict (as Steedman and Krause 1986 argue), then an agent who is rational in the sense that she has reasons for her evaluations (i.e. aspect preferences) may well not be rational in the sense that she has a transitive and complete preference ordering that can be mechanically derived (via a formation rule) from these reasons. Instead, deliberating on the basis of multiple, conflicting reasons often requires creativity: “Reasons do not come with previously assigned weights; the decision process is not one of discovering such precise weights but of assigning them. The process not only weighs reasons, it (also) weights them” (Nozick 1981, 244). This particularly pertains to judgements and deliberations that are important, complex or unfamiliar, such as gambles, jobs, careers, homes, partnerships, or surgical treatments. Instead of reading them off some master list, these preferences have to be constructed by an adaptive decision maker (Payne, Bettman and Johnson 1993).

Such creative and adaptive weighting processes are sensitive to task complexity, time pressure, response mode, framing effects, and other contextual factors. One therefore cannot expect that agents in all cases do come up with a transitive and complete preference ordering. Levi has argued for the importance of cases where “an agent may terminate deliberation and take decisions without having resolved the moral, political, economic and aesthetic conflicts relevant to their predicaments” (Levi 1986, 246). These considerations add to the controversy of the normative justification of transitivity and completeness as rationality requirements. “People do and should act as problem solvers, not maximizers, because they have many different and incommensurable … goals to achieve” (Kranz 1991, 34).

5. Preference criticism

In practical reasoning, it is an important issue whether preferences are rationally criticisable. Preference sets as discussed so far have been portrayed as open to rational criticism only insofar as (i) they have been inconsistent, violating some of the rationally justifiable preference axioms, or (ii) they (in combination with beliefs) commit the agent to inferences that make the resulting preference sets inconsistent.

Can there be rationally justifiable claims that certain intrinsic preferences—i.e. those preferences that are not dependent on other preferences—are wrong, or should be changed? The Humean position answers no. Hume distinguished reason from the passion, and argued “that reason alone can never be a motive to any action of the will;…that it can never oppose passion in the direction of the will” (Treatise Book II, Part III, Section III). Humeans often took this distinction between beliefs and desires not only to imply that beliefs alone cannot motivate action, but also that desires are not open to similar rational criticism as beliefs. Therefore, Humeans conclude, preferences can only be criticised if they are extrinsic—i.e. are instrumentally derived from other preferences on the basis of beliefs—or inconsistent. This is a very minimal position on preference criticism, but it has been questioned regardless. On the one hand, the criticism of extrinsic preferences ultimately turns out to be a criticism of false beliefs, and hence does not count as preference criticism. On the other hand, it has been questioned whether a Humean position can allow even such a preference criticism on the basis of inconsistency (Broome 1993).

Several authors have argued for a more substantial criticism of preferences, including that of intrinsic ones. Some radical approaches deny the duality of mental states and argue that some or all preferences are in fact a kind of belief—and hence are open to the same rational criticism that beliefs are. Two defences have been presented to counter this challenge. First, it has been claimed that that desires (standing for motivation in general) are fundamentally distinct from epistemic states in their direction of fit. Beliefs are directed to fit the world; hence their insufficient fit provides the basis for their criticism. Desires are directed to fit the world to them; hence they lack this basis for criticism (Smith 1987). Second, Humeans have argued that the D(esire)-A(s)-B(elief) thesis is incompatible with Bayesian decision theory and also with other, non-quantitative, decision theories (Lewis 1988, Collins 1991, Byrne/Hajek 1997).

A less radical approach exploits the multitude of relations in which preference stands with other concepts, some of which were discussed in this entry (choice, introspection, welfare, inferential commitments, values). Bringing these perspectives into a compatible whole is a form of criticism (Kusser 1989). However, it was argued earlier that some of these perspectives are incompatible (e.g. preferences as welfare judgements and preferences as reconstructed from choices). It is an open question how the unification attempt can persist in the face of these incompatibilities.

Last, agents may form second-order preferences. An addict may prefer not to prefer smoking; a malevolent person may prefer not to prefer evil actions; an indolent may prefer not to prefer to shun work; a daydreamer may prefer not to prefer what cannot be realised, etc. First-order preferences are criticisable if they do not comply with second-order preferences. (For accounts of second-order preferences, see Frankfurt 1971, Sen 1977.)

Whether preferences are rationally criticisable crucially depends on how a thus criticised agent is capable of modifying her intrinsic preferences in the light of such criticism. To criticise someone for a characteristic that he does not or did not have any influence over—e.g. for being born under a dictatorship—does not merit the label “rational”. Thus it is a crucial question whether preference criticism can in principle lead to its abandonment or change. Brandt (1979, 1998) claims that agents are capable of modifying their preferences by merely reflecting upon relevant beliefs. He gives the example of a rich man who has an aversion to luxury goods that he acquired in his poverty-stricken childhood. Brandt is convinced that “if only he could discriminate, and tell himself firmly, and maybe repeatedly, that his situation in life has changed, he would be able to overcome his disability” (Brandt 1998, 73). Critics have argued that the plausibility of this example rests on an ambiguity about the role of beliefs. If the rich man's aversion to luxury goods rests on the belief that consumption will deplete his resources, and he prefers to stay wealthy, then a correction of this belief will change his aversion to luxury goods. But in this case, the aversion is an extrinsic preference, instrumentally depending on his preference to stay wealthy. The criticism is directed against the belief, and not against the preference at all. If however the rich man's aversion has become a trait of his (it may have been originally formed in the light of his belief that he will have to starve later, but now his preference stands independently of that belief), it is not so clear that any criticism will bring about a change of that preference. The rich man may well say that he knows that he is rich enough to afford any luxury good, and still insist that he has the aversion—and one may not want to call him irrational for that. He may further claim that even if he wanted to, he could not affect his preference with his changed belief. If, on the other hand, he could, that may be considered evidence for the aversion being an extrinsic preference. This puts doubt on the claim that preferences can be manipulated by rational reflection. Rather, it seems that insight into a preference's inappropriateness does not lead to its change—a claim that was commonly accepted amongst Hume's contemporaries: “Neither benevolence nor any other affection or desire can be directly raised by volition” (Hutcheson (1738, 274).

But even if preferences cannot be directly manipulated by volition, insight into the inappropriateness of a preference may motivate engaging in (non-rational) processes or putting oneself in particular circumstances thatfacilitate preference change. Methods of self-restraint, self-command and self-improvement have been extensively described (Schelling 1984, Elster 1989, 2000). Already Hume described the possibility of rationally choosing such expedience (Grüne-Yanoff & McClennen 2006).

Critics have argued against the possibility of rationally choosing such indirect preference-modifying strategies. Millgram (1998) argues that knowledge of the way such desires-at-will were brought about makes it impossible that they actually function as the desires they are intended to be. He gives the example of a car salesman, who, in order to be successful in his work, makes himself prefer the various useless knick-knacks that the brand he represents offers for its cars. When the salesman is laid off, the car-dealer offers him a car with all the useless extras that he made himself prefer. Because he remembers how he acquired these preferences, he chooses not to act on them. So, Millgram argues, the desire-at-will is not the same as a similar, but genuine desire for these car extras. What is missing, he points out, are the backward-directed inferential commitments that genuine preferences bring with them. Only if one forgets that one acquired a specific preference at will, or if one also acquires the inferential commitments of such a preference, can preferring-at-will be successful. These conditions, however, may not be as demanding as Millgram thinks they are. In section 6.4, a model of preference change is discussed that models the necessary consistency adjustments which follow a preference formation. As long as these consistency adjustments are made, Millgram's conditions for desiring-at-will are satisfied. It is plausible that for most cases of self-restraint, self-command and self-improvement, these adjustments will in fact be made. Only in extreme cases such as “desiring at pill”—acquiring a desire by self-administering a preference-altering drug—does his argument therefore apply.

6. Preference change

Preferences have at least three relevant temporal dimensions. Future preferences may differ from present preferences because their relata (or the agent's beliefs about the relata) have changed. They may further differ because the agent's subjective evaluation of the relata has changed. Last, even if future preferences do not differ from present preferences on these two accounts, future preferences may differ because they are formed from another point of view than present preferences are.

Section 6.1 explains why preference change requires explanatory and theoretical treatment.^[4] In the following sections, three types of explanatory models are discussed. Time preference models (section 6.2) only refer to the temporal occurrence of a preference. Doxastic change models (section 6.3) investigate how a change of an agent's beliefs leads to a change in her preferences. Valuational change models (section 6.4) investigate how a change in an agent's basic evaluations leads to a change in her preferences.

6.1 Evidence for preference change

Some authors have argued that preference change is only a superficial perception, and that the underlying preferences remain stable over time. But there are at least four arguments to the effect that people's preferences really do change over time. First, many successful explanations of behavioural change have interpreted the empirical behavioural evidence as preference change. These explanations can be differentiated into models of external influences and models of internal coherence. External influence models attempt to establish general links between external events and agents' preference formations. They include, for example, social imitation (Leibenstein 1950), parental influence (Cavalli-Sforza 1973), habit formation (Pollack 1976), or the effect of production patterns on consumption (Duesenberry 1949). Internal coherence models take certain external influences as given, and model the preference change as an accommodation of these external influences. They include, for example, the influence of ethnic values (Borjas 1992), religious convictions (Iannaccone 1990), or the effect of cognitive dissonance on preferences (Elster 1982).

A second argument for preference change is based on the correlations between physiological changes and changes in behaviour. Changes in blood sugar levels, for example, are correlated to feeding behaviour, sexual behaviour varies with hormonal changes, and many behavioural patterns change with increasing age (for references and discussion, see Loewenstein 1996). These correlations are not determinate; each of these behavioural changes can be resisted. Hence it is plausible to incorporate these potential physiological effects as visceral preferences in the general preference framework, and to treat the relevant physiological changes as closely connected with preference changes.

Third, we all have introspective evidence for our own preferences changing over time. The favourite activities of a child are replaced by new pleasures as we grow up. Thus was the experience of Shakespeare's Benedick: “…but doth not the appetite alter? A man loves the meat in his youth that he cannot endure in his age” (Much ado about nothing Act II, Scene III). Even in adult life, we are literally overcome by sudden and very radical changes of preference. Nowhere are these changes more acute than with respect to love, as Bertrand Russell describes at the hand of his own example (Russell 1992, 195). It would be strange to claim that it is only our beliefs about the different types of activities that change. Explanations in terms of preference change are much more in line with how we spontaneously interpret our experiences of such changes.

Last, certain concepts like taste refinement or self-restraint cannot be understood without a notion of real preference change. In particular, self-restraint presupposes that the motivational components of one's self can change, for example, through maturation or social influence; and that one can and should plan one's future self by curbing appetites or by designing the environment in ways that affect one's preferences.

6.2 Time preferences

Models involving time preferences analyze preference change on the basis of the temporal occurrence of the preference alone. Time preferences are thus best specified over a tuple consisting of alternatives A,B and times t₁,t₂, so that (A,t₁)≽(B,t₂). The particular character of time preferences consists in their dependence on the time factor. Thus for many A,B: (A,t_i) ∼ (B,t_i) holds, whereas (A,t_i+j) ∼ (B,t_i+j) does not hold. Insofar as this temporal factor of evaluations can be separated from time-independent factors of evaluations, one speaks of pure time preferences.

The standard approach to this issue in economic analysis treats preference as based on value. Value is dealt with in a bifactorial model, in which the value of a future good is assumed to be equal to the product of two factors. One of these factors is a time-independent evaluation of the good in question, i.e. the value of obtaining it immediately. The other factor represents the subject's pure time preferences. It is a function of the length of the delay, and is the same for all types of goods. The most common type of time preference function can be written

v(A,t_i) = v(A,t_i-1) × (1−r)^t

where r is a discount rate and t = t_i−t_i-1 the duration of the delay. This is the discounted utility model, proposed by Samuelson (1937), which still dominates in economic analysis.

There is a wealth of evidence that the discounted utility model does not adequately represent human behaviour. For a simple example, consider a person who prefers one apple today to two apples tomorrow, but yet (today) prefers two apples in 51 days to one apple in 50 days. Although this is a plausible preference pattern, it is incompatible with the discounted utility model. It can however be accounted for in a bifactorial model with a declining discount rate. Pioneered by Ainslie (1992), psychologists and behavioural economists have therefore proposed to replace Samuelson's exponential discounting model with a model of hyperbolic discounting. The hyperbolic model discounts the future consumption with a parameter inversely proportional to the delay of the consumption, and hence covers examples like the above.

Other deviations from the discounted utility model have also been demonstrated. Experimental evidence indicates that we tend to discount gains more than losses, and small amounts more than large amounts. Discount rates also differ between different goods (such as money and health). For some—but only some—types of goods, improving sequences of outcomes are preferred to declining sequences. These are all patterns that cannot be handled in the bifactorial model with its object-independent time preferences (Loewenstein et al 2002). Given the empirical evidence, it is an open question whether the concept of “time preferences” is at all descriptively adequate.

It is a separate question whether pure time preferences are rational. Critics argue that one should want one's life, as a whole, to go as well as possible, and that counting some parts of life more than others interferes with this goal (Pigou, 1920; Ramsey, 1928b; Rawls 1971). According to this view, it is irrational to prefer a smaller immediate good to a greater future good, because now and later are equally parts of one life. Choosing the smaller good or the greater bad makes one's life, as a whole, turn out worse: “Rationality requires an impartial concern for all parts of our life. The mere difference of location in time, of something's being earlier or later, is not a rational ground for having more or less regard for it” (Rawls 1971, 293). Critics of pure temporal preferences often attribute apparent departures from temporal neutrality to a cognitive illusion (which causes people to see future pleasures or pains in some diminished form) or to a weakness of will (which causes people to choose options against their better judgment).

Against the temporal neutrality of preferences, some have argued that there is no enduring, irreducible entity over time to whom all future utility can be ascribed; they deny that all parts of one's future are equally parts of oneself (Parfit 1984). They argue, instead, that a person is a succession of overlapping selves related to varying degrees by memories, physical continuities, and similarities of character and interests, etc. By this view, it may be just as rational to discount one's "own" future preferences, as to discount the preferences of another distinct individual, because the divisions between the stages of one's life may be as “deep” as the distinctions between individuals.

6.3 Doxastic preference change

Two kinds of beliefs are especially important for doxastic models. The first is the belief that a state X is instrumental in bringing about a desired state Y. Take for example the belief that fluoride prevents dental cavities. This can lead a person to prefer fluoride toothpaste to others. If she comes to disbelieve this connection, she may well abandon this preference. More generally, if X∧Y is preferred to X∧¬Y, then a rise of the probability that Y given X will result in a rise in the desirability of X, and vice versa.

The second kind of belief relevant for doxastic preference change concerns prospects that influence the preference for other prospects without being probabilistically related. For example, one's preference for winning a trip to Florida in the lottery will crucially depend on one's belief about the weather there during the specified travel time, even though these two prospects are probabilistically unrelated. More generally, if X∧Y is preferred to X∧¬Y, with X and Y probabilistically not correlated, then a rise of the probability that X will result in a rise in the desirability of Y (even if it does not affect the probability of Y), and vice versa.

Jeffrey (1977) provides a simple model of preference change as the consequence of an agent coming to believe a proposition A to be true. His model incorporates both kinds of belief relevant for doxastic preference change. It is based on the notion of conditional preferences. Jeffrey treats preferences as a relation over propositions, viz. sets of possible worlds. They are represented by a utility function U (see section 2), such that:

X≽Y iff U(X) ≥ U(Y)

U(X) in turn is defined as the weighted average of the utility u of all the possible worlds w in which X is true:

U(X) = [1/P(X)] ∑_w∈X [u(w) × P(w|X)]

where P is the probability weight (Jeffrey's original notation here is adapted to the discrete case). ⟨u,P⟩ represents the unconditional preference ≽ if P is the probability distribution based on the agent's actual information. The conditional preference ordering ≽_A, in contrast, is represented by the tuple ⟨u,P_A⟩, where P_A is the probability distribution based on the counterfactual scenario that the agent accepts proposition A as true. That is, the agent imagines that if he changed his whole belief system from P to P_A (and hence specifically P(A)<1 to P_A(A)=1), then he would have the preference relation ≽_A as represented by ⟨u,P_A⟩ (for more discussion on the existence and uniqueness conditions of conditional preferences, see Luce and Krantz 1971, Joyce 1999, chapter 4, Bradley 1999). Jeffrey shows that the posterior utility function U_A is related to the prior utility function U as follows:

UA(X)	=	[1/PA(X)] ∑w∈X [u(w) × PA(w|X)]
	=	[P(A)/P(A∩X)] ∑w∈X∩A [u(w) × P(w|A∩X)/P(A)]
	=	U(A∩X)

Conditional preferences allow modelling doxastic preference change. What matters for an agent's evaluation and behaviour are his unconditional preferences, ≽_t, which are unconditional only in the sense that they rely on the agent's actual information at time t. When the agent accepts a new proposition A at time t+1, his conditional-on-A preferences become his unconditional preferences at t+1: ≽_t+1 = ≽_A.

Jeffrey's model is restricted in two ways. First, it requires an evaluative function u defined over the atoms of the propositional space, viz. possible worlds. Thus for all doxastically changed preference orderings, the preferences over worlds remain identical. Second, the model only considers the effects of a belief change to certainty. But it is plausible that one's preference—say, for a vacation in Florida—changes just because one believes that it is more likely that there will be a Hurricane next week. Jeffrey's model can be generalised by introducing a more general probability updating rule (e.g., Jeffrey conditionalisation). An alternative solution is proposed in a new paper by Bradley (2006), albeit under relatively strong assumptions on the relation between prior and posterior unconditional preferences.

Before leaving the topic, an important discussion from economics needs mentioning, namely the question whether models of doxastic preference change are capable in principle to represent all preference changes. This question originates with an important paper by Stigler and Becker (1977), who argued that a wide range of phenomena which are commonly thought of as preference changes—like addiction, habitual behaviour, advertising and fashions—can be explained by stable, well-behaved preferences. In a rather informal fashion, they argue that such explanations involve only changes in information (more precisely: prices and income), while leaving preferences intact. As a result of this, economists largely abandoned the discusion of preference change, believing that all preference change phenomena can be explained in this way. Prima facie, their proposed explanations exhibit important similarities to the discussed accounts of doxastic preference change. The results from that discussion, which show that models of doxastic preference change are subject to relatively strong constraints, may therefore put doubt on the orthodox position in economics that models of doxastic preference change are capable in principle to represent all preference changes.

6.4 Valuational preference change

Models of valuational change investigate how a change in an agent's basic evaluations leads to a change in her preferences. In comparison to models of belief change, these models face the problem of unboundedness. Beliefs are bounded by certainty, while valuations are principally unbounded. Arguably, this difference is based on beliefs being subject to the concept of truth, while no such criterion exists for preferences. However, assuming that

1. reproductive success is an increasing function of material payoffs, and
2. individual preferences are inherited either by genetic transmission or imitation,

it has been claimed that certain preferences (at least in particular environments) may be rationalised as evolutionarily stable. This argument has—without much rigour—been employed to equate preferences with maximal material payoffs (Friedman 1953, 22). Both of these assumptions have been criticised. Many preferences are at least ambiguous with respect to their fitness effects (think a preference for living in Europe over living in the US, or a preference for realistic over romantic literature). And it is controversial whether preferences are inherited or transmitted. Hence the evolutionary stability of preferences provides at most an incomplete account of preference change. Given the unboundedness of preferences, the prospects of a comprehensive account of valuational change along these lines therefore look somewhat dim.

Hansson (1995) suggest differentiating valuational change into preference formation and preference change, and construct a formalised model of preference change proper. If an agent forms a specific preference as a result of some experience, further changes in her overall preference state are often necessary to regain consistency. The model of preference change proper shows which path consistency restoration will take, conditional on the previous state and the available dynamic information, and it determines what the ensuing state will look like.

7. Preference combination

One of the central issues in the social sciences is how to make decisions that reflect the choices and preferences of individuals.

7.1 Aggregation and voting

Two major types of combinations of preferences are relevant in social science and social philosophy. First, an official such as a social planner may have the task to satisfy the preferences or choices of individuals as far as possible, which is not easily done if their opinions diverge. Such an official will need some form of aggregation procedure that can be used to make a decision that is based on individual wishes. Secondly, individuals can make a joint decision, which is normally done by using some form of voting procedure.

In the former case, it would seem reasonable for the social planner to use (individual) preferences as inputs into the procedure, whereas its outcome will be a (social) choice. In other words, this will typically be a preference-to-choice procedure. A practical reason for this is that in order to obtain a workable solution to a social problem, the planner can use information not only about what each individual would prefer most but also about how they value other alternatives.

In contrast, a voting procedure does not consist in combining the preferences of the participants. The objects of combinations are votes, that in most voting systems take the form of opting for one of the alternatives under consideration. (Of course, individuals can be expected to vote in a way that reflects their preferences, but it is nevertheless the votes, not the preferences, that are inputs into the voting procedure.) Therefore, it is more adequate to represent voting as a choice-to-choice procedure.

These distinctions have often not been made in the literature on preference combinations. Most formal studies in this area have been devoted to preference-to-preference or preference-to-choice combinations, that are assumed to represent both joint decisions (voting) and decisions based on individual wishes. However, in the interpretation of formal results in this area, these distinctions can be essential.

7.2 Condorcet's paradox

Preference aggregation and social decision processes were studied already in the 18^th century. The most important result from those studies is Condorcet's paradox.

To introduce the paradox, consider three individuals, i₁, i₂, and i₃, who are going on a trip together. They have three countries to choose between, namely Argentina (A), Bolivia (B), and Columbia (C), and their decision will be made by simple majority. i₁'s preferences are as A≻B≻C, whereas i₂'s are B≻C≻A and i₃'s are C≻A≻B. It is then impossible for them to make a decision that is stable in the sense that no majority can be made against it. Hence, if i₁ should manage to convince i₃ to settle for A that is her second-best alternative, then i₂ has reasons to form a coalition with i₃ in favour of C. Then, however, it would be sensible for i₁ and i₂ to form instead a coalition in favour of B. This gives i₃ a good motive to offer i₁ a coalition in favour of C, etc.

Based on this result, it would seem natural to search for another voting procedure that differs from the majority method in not giving rise to this form of cycles. No such method was found, but it was not until the 20^th century that formal results that refer to all possible voting (or decision) procedures were obtained.

7.3 Formal representation

The formal study of social choices and decisions is dominated by a fruitful formal model that was developed by Kenneth Arrow. In the Arrovian framework, collective decisions are modelled as aggregations of individual preferences over the options that the procedure has been set up to decide between. It is usually described as representing a voting procedure, and that terminology will be used here.

The model contains an n-tuple (vector) of individuals, namely those that take part in the voting procedure. The reason why the individuals are not represented as a set is that a set is unordered. In order to cover decision procedures in which individuals differ in their influence on the decision, the individuals must be distinguishable. This is obtained by using a vector representation.

The decision procedure concerns a set of alternatives that society has to choose between. In preference-to-choice and choice-to-choice procedures, the outcome is an element of that alternative set, or possibly a tie outcome (meaning that no social choice was made). In preference-to-preference procedures, the outcome is a preference relation over the set of alternatives.

The inputs of the decision procedure can also vary. In a voting procedure, the inputs are the votes of the individual participants. In the most common forms of voting, the votes refer to elements of the alternative set. However, there are also voting procedures in which voters state not only their first alternative, but also a list of how they rank the other alternatives. In a multi-stage process, the inputs may be more adequately represented as strategies for how to vote at each stage. In a general framework, that covers these various options, the individual inputs are usually called strategies. A voting pattern is an assignment of a strategy to each participant, in the form of an n-tuple.

A social choice function takes us from each voting pattern, i.e., total input, to an outcome. The outcome may either be one of the alternatives that the procedure has been set up to choose between, or it may be the tie outcome (λ).

Summarizing the above, a voting procedure can be identified with a quadruple ⟨I,A,S,r⟩ such that (in the case when the outcome is a social choice):

I = ⟨i₁,...i_n⟩ is an n-tuple of individuals.

A = {x,y...} is the set of (decision-)alternatives. A∪{λ} is the set of outcomes, where λ is the tie outcome.

S = {s₁,...,s_m} is the set of strategies. An n-tuple π = ⟨α₁,...,α_n⟩ of elements of S is called a voting pattern. For each k, π assigns α_k to i_k.

r, the social choice function, is a function from the set of voting patterns to the set of outcomes.

Social choice theory is the study of properties of social choice functions.

7.4 Arrow's theorem

Kenneth Arrow (1963) studied social choice functions in a preference-to-preference framework. In this framework, a social choice function is a function from a vector of individual preference relations over a set A of alternatives, ⟨≽₁,…,≽_n⟩, to a collective preference relation ≽ over the same set of alternatives, hence ≽ = r(⟨≽₁,…,≽_n⟩). It is assumed that ≽₁,…,≽_n and ≽ are all weak orderings, i.e. they are complete, reflexive, and transitive.

Arrow proposed that a procedure of social choice should satisfy the following four axioms:

(1) Unlimited domain: r is a total function, i.e. it yields an outcome for all voting patterns.

(2) Pareto principle: If X≻_iY for all i∈{1,..n}, then X≻Y

(3) Independence of irrelevant alternatives: Let ⟨≽₁,…,≽_n⟩ and ⟨≽′₁,…,≽′_n⟩ be such that for all for all i ∈{1,...n} and all X, Y ∈A: X≽_iY if and only if X≽′_iY. Let ≽ = r(⟨≽₁,…,≽_n⟩) and ≽ = r(⟨≽′₁,…,≽′_n⟩). Then X≽Y if and only if X≽′Y.

(4) Non-dictatorship: There is no i ∈{1,..,n} such that for all X, Y ∈A: X≻Y if and only if X≻_iY.

These conditions all seem highly plausible. The first condition says that for any combination of individual preferences, the rule should yield a collective preference ordering. According to the second condition, if all individuals agree in preferring X to Y, then X should be collectively preferred to Y. According to the third condition, the collective preference between X and Y should depend only on how the individuals order these same two alternatives. In other words, the collective ordering of X and Y should not be changed if the individuals move some third alternative Z up or down in their preference orderings, without changing the order between X and Y. According to the fourth criterion, there should be no individual whose influence is so strong that her or his preferences determine the collective preference ordering, thereby making the other participants in the procedure superfluous.^[5]

Arrow showed that these four conditions are not compatible, in other words there is no function r that satisfies all of them. A large number of additional impossibility results have been obtain that strengthen Arrow's result in various ways. In particular, corresponding results for preference-to-choice procedures are easily obtainable (Sen, 1970a).

Another important impossibility result is obtained by introducing the notion of individual freedom into the theory of social choice. Sen codified the sphere of individual freedom as a sphere in which the person's individual preferences, and these alone, should determine the social preference. For this purpose, he introduced the condition of minimal liberalism.

Minimal liberalism: There are two individuals j, k ∈{1,…n}and four alternatives X, Y, Z, W ∈ A such that X≻Y if and only if X≻_jY, Y≻X if and only if Y≻_jX, Z≻W if and only if Z≻_kW, and W≻Z if and only if W≻_kZ.

Sen showed that there is no social choice function that satisfies the following three conditions: Unlimited domain, the Pareto principle and Minimal liberalism (the “impossibility of the Paretian liberal”) (Sen 1970b).

The impossibility results are highly general in nature. They put limits on all social procedures in which social preferences, choices or decisions are supposed to be responsive to individual preferences. This includes social planning, voting procedures and also the workings of markets. Of course, this does not mean that such procedures are impossible, only that they have to disobey at least one of the four conditions mentioned above.

7.5 Procedural preferences

In the Arrovian framework, collective decisions are modelled as aggregations of individual preferences over the options that the procedure has been set up to decide between. However, individuals who take part in collective decision procedures often have preferences that do not refer exclusively to these options (decision-alternatives). Besides wanting the outcome to be as good as possible (according to her own standard), a participant may have preferences such as the following:

1. She prefers to be part of the winning coalition.
2. She prefers the decision to be taken by as large a majority as possible. (This may lead a committee member to vote for another alternative than the one that she actually prefers most, in order to contribute to unanimity.)
3. She prefers to cast her own vote for as good an alternative as possible. Such “principled” preferences may prevent a participant from taking part in a coalition that would change the outcome, say, from her third-best to her second-best alternative. (This is one of the mechanisms through which candidates that have no chance to get elected still receive votes.)
4. She may want the outcome of the voting procedure to be X, but yet prefer to vote for Y, since Y is more in strict accord with her ideals (although it is sadly unrealistic as things are at present).

In cases like these, the preferences that guide the voter's decision do not refer exclusively to the decision-alternatives that the procedure aims at choosing between. Her preferences have a procedural component. In order to express such preferences, the Arrovian framework can be extended by generalizing the format for representing individual preferences. For each individual i, let the preference relation ≽i have the set of voting patterns (hence not the set of alternatives) as its domain. This is sufficient for expressing procedural preferences of the types referred to above. (Hansson 1992, 1996c) Consider for instance a preference for consensus in a voting procedure with three participants and simple majority rule. A person who strictly prefers consensus should prefer the voting pattern ⟨X,X,X⟩ to each of the patterns ⟨Y,X,X⟩, ⟨X,Y,X⟩, and ⟨X,X,Y⟩, for all distinct X and Y in A. (The original Arrovian framework can be treated as a special case of this extension, namely the case in which for all individuals i and all voting patterns π and π′, if r(π) = r(π′) then π∼_iπ′.)

As Condorcet's paradox shows even more clearly than Arrow's theorem, in the context of voting, the impossibility results of social choice theory give rise to instability: Whatever the outcome, there is a coalition that has something to gain by reopening the issue and repeating the voting procedure. Therefore, the decision process would seem to have a tendency to go on forever. In studies using the extended framework with procedural preferences, it has been shown that instability can be eliminated or its probability substantially reduced with the introduction of certain types of procedural preferences. This is no surprise; we all know that individuals striving for consensus find it easier to reach an agreement than individuals who have no preference for consensus. Procedural preferences can explain why there seems to be more stability (less circularity) in the voting procedures of the real world than what could be expected on the basis of (Arrovian) social choice theory. However, instability is in many cases not replaced by the ideal situation in which there is exactly one stable outcome, which is not the tie outcome. Instead, these procedural preferences give rise to multi-stability (two or more stable outcomes) or tie-stability (tie is the only stable outcome). A decreased occurrence of instability is therefore bought at the price of an increased occurrence of multi-stability and tie-stability (Hansson 1992b). It can however be argued that since instability tends to prevent the decision process from coming to an end, it is a more pernicious phenomenon than multi-stability and tie-stability.

Bibliography

• Ainslie, George, 1992, Picoeconomics: The Strategic Interaction of Successive Motivational States Within the Person, Cambridge: Cambridge University Press.
• Anand, Paul, 1993, “The Philosophy of Intransitive Preference”, Economic Journal, 103/: 337-346.
• Arrow, Kenneth J., 1963, Social Choice and Individual Values, New Haven and London: Yale University Press, first edition 1951.
• Armstrong, Wallace E., 1939, “The Determinateness of the Utility Function”, Economic Journal, 49: 453-467.
• –––, 1948, “Uncertainty and the Utility Function”, Economic Journal, 58: 1-10.
• Aumann, Robert J., 1962, “Utility Theory Without the Completeness Axiom”, Econometrica, 30/3: 445-462.
• Becker, Gary S. and Michael, Robert T., 1973, “On the New Theory of Consumer Behavior”, The Economic Approach to Human Behavior, Chicago: University of Chicago Press, 1976, 131-149.
• Böckenholt, Ulf, 2002, “A Thurstonian Analysis of Preference Change”, Journal of Mathematical Psychology, 46: 300-314.
• Borjas, George J, 1992, “Ethnic Capital and Intergenerational Mobility,” The Quarterly Journal of Economics, 107/1: 123-50.
• Bradley, Richard, 2006, “Radical Probabilism and Mental Kinematics”, Philosophy of Science, forthcoming.
• –––, 1999, “Conditional Desirability”, Theory and Decision, 47/1: 23-55.
• Brandt, Richard B., 1979, A Theory of the Good and the Right, Oxford: Oxford University Press.
• –––, 1998, “The Rational Criticism of Preferences”, in Preferences, edited by Fehige, Christoph and Ulla Wessels, Berlin and New York: de Gruyter, 63-77.
• Brogan, Albert P., 1919, “The Fundamental Value Universal”, Journal of Philosophy, Psychology and Scientific Method, 16: 96-104.
• Broome, John, 1993, “Can a Humean be moderate?”, in Value, Welfare and Morality, edited by R. G. Frey and Christopher Morris, Cambridge: Cambridge University Press, 51-73.
• Byrne, Alan and Alan Hájek, 1997, “David Hume, David Lewis, and Decision Theory”, Mind, 105: 422-428.
• Cavalli-Sforza, L.Luca and M. W. Feldman, 1973, “Cultural Versus Biological Inheritance: Phenotypic Transmission from Parents to Children”, Human Genetics, 25: 618-637.
• Chang, Ruth, ed., 1997, Incommensurability, Incomparability, and Practical Reason, Cambridge: Cambridge University Press.
• Chisholm, Roderick and Ernest Sosa, 1966, “On the Logic of Intrinsically Better” American Philosophical Quarterly, 3: 244-49.
• Collins, John, 1988, “Belief, Desire, and Revision”, Mind, 97: 333-42.
• Davidson, Donald, 1976, “Hempel on Explaining Action”, Essays on Actions and Events, Oxford: Oxford University Press, 1980, 261-275.
• Davidson, Donald, John McKinsey and Patrick Suppes, 1955, “Outlines of a formal theory of value, I”, Philosophy of Science, 22: 140-160.
• Debreu, Gerard, 1954, “Representation of a Preference Ordering by a Numerical Function”, in Thrall et al. (eds) Decision Processes, New York: John Wiley, 159-66.
• Duesenberry, James S., 1949, Income, Saving, and the Theory of Consumer Behavior, Cambridge, Mass. and London: Harvard University Press.
• Elster , 1979, Ulysses and the Sirens, Cambridge: Cambridge University Press.
• –––, 1982, “Sour Grapes: Utilitarianism and the Genesis of Wants”, in Amartya Sen and Bernard Williams (1982), eds., Utilitarianism and Beyond, Cambridge: Cambridge University Press, 219-238.
• –––, 2000, Ulysses Unbound, Cambridge: Cambridge University Press.
• Fishburn, Peter C., 1991, “Nontransitive additive conjoint measurement”, Journal of Mathematical Psychology, 35: 1-40.
• Frankfurt, Harry, 1971, “Freedom of the Will and the Concept of a Person”, Journal of Philosophy, 68: 5-20.
• Friedman, Milton, 1953, “The Methodology of Positive Economics”, in Essays in Positive Economics, Chicago: University of Chicago Press.
• Grüne-Yanoff, Till, 2004, “The problems of testing preference axioms with revealed preference theory”, Analyse & Kritik, 26/2: 382-397.
• –––, 2006, “Why don't you want to be rich? Preference explanations on the basis of causal structure” in: Campbell, J.K., O'Rourke, M. (eds.): Topics in Contemporary Philosophy: Explanation and Causation, Cambridge, Mass. and London: MIT Press.
• –––, and Edward McClennen, 2006, “Hume's Framework for a Natural History of the Passions' (with Edward McClennen) in: Margaret Schabas and Carl Wennerlind (eds.) Hume's Political Economy, London and New York: Routledge
• Halldén, Sören, 1957, On the Logic of Better, Lund: Library of Theoria.
• Hansson, Sven Ove, 1990, “Defining ‘good’ and ‘bad’ in terms of ‘better’”, Notre Dame Journal of Formal Logic, 31: 136-149.
• –––, 1992a, “A Procedural Model of Voting”, Theory and Decision, 32: 269-301.
• –––, 1992b, “The Difference Model of Voting”, Notre Dame Journal of Formal Logic, 33: 576-592.
• –––, 1993, “Money-Pumps, Self-Torturers and the Demons of Real Life”, Australasian Journal of Philosophy, 71: 476-485.
• –––, 1995, “Changes in Preference”, Theory and Decision, 38: 1-28.
• –––, 1996a, “What is Ceteris Paribus Preference?”, Journal of Philosophical Logic, 25: 307-332.
• –––, 1996b, “Decision-Making Under Great Uncertainty”, Philosophy of the Social Sciences, 26: 369-386.
• –––, 1996c, “Social Choice With Procedural Preferences”, Social Choice and Welfare, 13: 215-230.
• –––, 2001, The Structure of Values and Norms, Cambridge: Cambridge University Press.
• Herzberger, Hans G., 1973, “Ordinal Preference and Rational Choice”, Econometrica, 41/2: 187-237.
• Hutcheson, Francis, 1726, An Inquiry into the Original of Our Ideas of Beauty and Virtue in Two Treatises, ed. Wolfgang Leidhold, Indianapolis: Liberty Fund, 2004.
• Iannaccone, Laurence R, 1990, “Religious Practice: A Human Capital Approach”, Journal for the Scientific Study of Religion, 29: 297-314.
• Jeffrey, Richard C, 1977, “A Note on the Kinematics of Preference”, Erkenntnis, 11: 135-141.
• Joyce, James, 1999, Foundations of Causal Decision Theory, Cambridge: Cambridge University Press.
• Krantz, David. H.,1991, “From Indices to Mappings: The Representational Approach to Measurement”, in D. R. Brown & J. E. K. Smith, (Eds.), Frontiers of Mathematical Psychology: Essays in honor of Clyde Coombs, Berlin, Heidelberg and New York: Springer Verlag.
• Kusser, Anna, 1989, Dimensionen der Kritik von Wünschen, Frankfurt am Main: Athenäum.
• Lancaster, Kevin J., 1966, “A New Approach to Consumer Theory”, Journal of Political Economy, 74: 132-57.
• Leibenstein, Harvey, 1950, “Bandwagon, Snob, and Veblen Effects in the Theory of Consumer Demand”, Quarterly Journal of Economics, 64: 183-207.
• Levi, Isaac, 1986, Hard Choices, Cambridge: Cambridge University Press.
• Lewis, David, 1988, “Desire as Belief”, Mind, 97: 323 - 332.
• Loewenstein, George, 1996, “Out of Control: Visceral Influences on Behavior”, Organizational Behavior and Human Decision Processes, 65: 272-92.
• Loewenstein, G., Read, D. and Baumeister, R. eds, 2002, Time and Decision: Economic and Psychological Perspectives on Intertemporal Choice. New York: Russell Sage Foundation Press.
• Loomes, G. and R. Sugden. (1982). “Regret Theory: An Alternative Theory of Rational Choice Under Uncertainty”, The Economic Journal, 92: 805-824.
• Luce, R. Duncan 1956, “Semiorders and a Theory of Utility Discrimination, Econometrica, 24: 178-191.
• –––, and Krantz, DH, 1971, “Conditional Expected Utility”, Econometrica, 39: 253-271.
• Millgram, Elijah, 1998, “Deciding to Desire”, in Preferences, edited by Fehige, Christoph and Ulla Wessels, Berlin and New York: de Gruyter, 3-25.
• Nozick, Robert, 1981, Philosophical Explanations, Cambridge: Belknap Press.
• Parfit, Derek, 1984, Reasons and Persons, Oxford: Oxford University Press.
• Payne, John W., James R. Bettman and Eric J. Johnson, 1993, The Adaptive Decision Maker, Cambridge: Cambridge University Press.
• Pettit, Philip, 1991, “Decision Theory and Folk Psychology”, in Rules, Reasons, and Norms: Selected Essays, Oxford: Oxford University Press, Oxford, 2002, 192-221.
• Pigou, Arthur, C., 1920, The Economics of Welfare, London: MacMillan & Co.
• Pollack, Robert A., 1976, “Habit Formation and Long Run Utility Functions”, Journal of Economic Theory, 13: 272-297.
• Quinn, Warren S., 1990, “The Puzzle of the Self-Torturer”, Philosophical Studies, 59: 79-90.
• Ramsey, Frank P., 1928, “Truth and Probability”, in The Foundations of Mathematics and other Logical Essays, ed. R. B. Braithwaite, London: Routledge & Kegan Paul, 1950.
• –––, 1928b, “A Mathematical Theory of Saving”, Economic Journal, 38: 543-59.
• Rawls, John, 1971, A Theory of Justice, Oxford: Oxford University Press.
• Rescher, Nicholas, 1967, “Semantic Foundations for the Logic of Preference”, in The Logic of Decision and Action, Pittsburgh: University of Pittsburgh Press.
• Russell, Bernard, 1992, The Autobiography of Bertrand Russell, London and New York: Routledge.
• Samuelson, Paul A., 1937, ”A Note on Measurement of Utility”, Review of Economic Studies, 4: 155-61.
• Schelling, Thomas, C. 1984, “The Intimate Contest for Self-Command”, in Choice and Consequence: Perspectives of an Errant Economist, Cambridge, Mass.: Harvard University Press, 57-82.
• Schumm, George F., 1987, “Transitivity, Preference and Indifference”, Philosophical Studies, 52: 435-437.
• Schwartz, Thomas, 1972, “Rationality and the Myth of the Maximum”, Nous, 6: 97-117.
• Sen, Amartya, 1970a, Collective Choice and Social Welfare, San Francisco: Holden Day, Inc..
• –––, 1970b, “The Impossibility of a Paretian Liberal”, Choice Welfare and Measurement, Cambridge, Mass.: Harvard University Press, 1982, 285-290.
• –––, 1971, “Choice Functions and Revealed Preference”, Choice Welfare and Measurement, Cambridge, Mass.: Harvard University Press, 1982, 41-53.
• –––, 1977, “Rational Fools“, Choice Welfare and Measurement, Cambridge, Mass.: Harvard University Press, 1982, 84-106.
• –––, 1993, “Internal Consistency of Choice”, Econometrica, 61/3: 495-521.
• Smith, Michael, 1987, “The Humean Theory of Motivation”, Mind, 96: 36-61.
• Simon, Herbert, 1957, Models of Man, John Wiley&Sons, New York.
• Steedman, Ian and Ulrich Krause, 1986, “Goethe's Faust, Arrow's Possibility Theorem and the Individual Decision-Taker”, in Jon Elster, ed., The Multiple Self, Cambridge: Cambridge University Press, 197-232.
• Stigler, George J. and Gary S. Becker, 1977, “De Gustibus Non Est Disputandum”, American Economic Review, 67: 76-90.
• von Wright, Georg H., 1963, The Logic of Preference, Edinburgh: Edinburgh University Press.
• –––, 1972, “The Logic of Preference Reconsidered”, Theory and Decision, 3: 140-169.

Other Internet Resources

• The Norms And Preferences Network

Related Entries

economics, philosophy of | economics and economic justice | practical reason | Sorites paradox | St. Petersburg paradox | well-being

Copyright © 2006 by
Sven Ove Hansson <soh@kth.se>
Till Grüne-Yanoff <till.grune@helsinki.fi>