Dynamic inconsistency

In economics, dynamic inconsistency or time inconsistency describes a situation in which a decision-maker's preferences change over time in such a way that a preference can become inconsistent at another point in time. This can be thought of as there being many different "selves" within decision makers, with each "self" representing the decision-maker at a different point in time; the inconsistency occurs when all preferences are not aligned.

The term "dynamic inconsistency" is more closely affiliated with game theory, whereas "time inconsistency" is more closely affiliated with behavioral economics.

In game theory

In the context of game theory, dynamic inconsistency is a situation in a dynamic game where a player's best plan for some future period will not be optimal when that future period arrives. A dynamically inconsistent game is subgame imperfect. In this context, the inconsistency is primarily about commitment and credible threats. This manifests itself through a violation of Bellman's Principle of Optimality by the leader or dominant player, as shown in Simaan and Cruz (1973a, 1973b).

For example, a firm might want to commit itself to dramatically dropping the price of a product it sells if a rival firm enters its market. If this threat were credible, it would discourage the rival from entering. However, the firm might not be able to commit its future self to taking such an action because if the rival does in fact end up entering, the firm's future self might determine that, given the fact that the rival is now actually in the market and there is no point in trying to discourage entry, it is now not in its interest to dramatically drop the price. As such, the threat would not be credible. The present self of the firm has preferences that would have the future self be committed to the threat, but the future self has preferences that have it not carry out the threat. Hence, the dynamic inconsistency.

In behavioral economics

In the context of behavioral economics, time inconsistency is related to how each different self of a decision-maker may have different preferences over current and future choices.

One common way in which selves may differ in their preferences is they may be modeled as all holding the view that "now" has especially high value compared to any future time. This is sometimes called the "immediacy effect" or "temporal discounting". As a result, the present self will care too much about himself and not enough about his future selves. The self control literature relies heavily on this type of time inconsistency, and it relates to a variety of topics including procrastination, addiction, efforts at weight loss, and saving for retirement.

Time inconsistency basically means that there is disagreement between a decision-maker's different selves about what actions should be taken. Formally, consider an economic model with different mathematical weightings placed on the utilities of each self. Consider the possibility that for any given self, the weightings that self places on all the utilities could differ from the weightings that another given self places on all the utilities. The important consideration now is the relative weighting between two particular utilities. Will this relative weighting be the same for one given self as it is for a different given self? If it is, then we have a case of time consistency. If the relative weightings of all pairs of utilities are all the same for all given selves, then the decision-maker has time-consistent preferences. If there exists a case of one relative weighting of utilities where one self has a different relative weighting of those utilities than another self has, then we have a case of time inconsistency and the decision-maker will be said to have time-inconsistent preferences.

It is common in economic models that involve decision-making over time to assume that decision-makers are exponential discounters. Exponential discounting posits that the decision maker assigns future utility of any good according to the formula

$U(t) = U(0) e^{-\rho t}$

where $t=0$ is the present, $U(0)$ is the utility assigned to the good if it were consumed immediately, and $\rho$ is the "discount factor", which is the same for all goods and constant over time. Mathematically, it is the unique continuous function that satisfies the equation

$U(t_1)/U(t_2) = U(t_1+c)/U(t_2+c)$

that is, the ratio of utility values for a good at two different moments of time only depends on the interval between these times, but not on their choice. (If you're willing to pay 10% over list price to buy a new phone today instead of paying list price and having it delivered in a week, you'd also be willing to pay extra 10% to get it one week sooner if you were ordering it six months in advance.)

If $\rho$ is the same for all goods, then it is also the case that

$U_A(t_1)/U_B(t_1) = U_A(t_2)/U_B(t_2)$

that is, if good A is assigned higher utility than good B at time $t_{1}$ , that relationship also holds at all other times. (If you'd rather eat broccoli than cake tomorrow for lunch, you'll also pick broccoli over cake if you're hungry right now.)

Exponential discounting yields time-consistent preferences. Exponential discounting and, more generally, time-consistent preferences are often assumed in rational choice theory, since they imply that all of a decision-maker's selves will agree with the choices made by each self. Any decision that the individual makes for himself in advance will remain valid (i.e., an optimal choice) as time advances, unless utilities themselves change.

However, empirical research makes a strong case that time inconsistency is, in fact, standard in human preferences. This would imply disagreement by people's different selves on decisions made and a rejection of the time consistency aspect of rational choice theory.

For example, consider having the choice between getting the day off work tomorrow or getting a day and a half off work one month from now. Suppose you would choose one day off tomorrow. Now suppose that you were asked to make that same choice ten years ago. That is, you were asked then whether you would prefer getting one day off in ten years or getting one and a half days off in ten years and one month. Suppose that then you would have taken the day and a half off. This would be a case of time inconsistency because your relative preferences for tomorrow versus one month from now would be different at two different points in time—namely now versus ten years ago. The decision made ten years ago indicates a preference for delayed gratification, but the decision made just before the fact indicates a preference for immediate pleasure.

More generally, humans have a systematic tendency to switch towards "vices" (products or activities which are pleasant in the short term) from "virtues" (products or activities which are seen as valuable in the long term) as the moment of consumption approaches, even if this involves changing decisions made in advance.

One way that time-inconsistent preferences have been formally introduced into economic models is by first giving the decision-maker standard exponentially discounted preferences, and then adding another term that heavily discounts any time that is not now. Preferences of this sort have been called "present-biased preferences". The hyperbolic discounting model is another commonly used model that allows to obtain more realistic results with regard to human decision-making.

A different form of dynamic inconsistency arises as a consequence of "projection bias" (not to be confused with a defense mechanism of the same name). Humans have a tendency to mispredict their future marginal utilities by assuming that they will remain at present levels. This leads to inconsistency as marginal utilities (for example, tastes) change over time in a way that the individual did not expect. For example, when individuals are asked to choose between a piece of fruit and an unhealthy snack (such as a candy bar) for a future meal, the choice is strongly affected by their "current" level of hunger. Individuals may become addicted to smoking or drugs because they underestimate future marginal utilities of these habits (such as craving for cigarettes) once they become addicted.^[1]

Stylized examples

In a game theory context, an announced government policy of never negotiating with terrorists over the release of hostages constitutes a time inconsistency example, since in each particular hostage situation the authorities face the dilemma of breaking the rule and trying to save the hostages. Assuming the government acted consistently in not ever breaking the rule, it would make it irrational for a terrorist group to take hostages. (Of course, in the real world terrorists might not act rationally.)
Students, the night before an exam, often wish that the exam could be put off for one more day. If asked on that night, such students might agree to commit to paying, say, $10 on the day of the exam for it to be held the next day. Months before the exam is held, however, students generally do not care much about having the exam put off for one day. And, in fact, if the students were made the same offer at the beginning of the term, that is, they could have the exam put off for one day by committing during registration to pay $10 on the day of the exam, they probably would reject that offer. The choice is the same, although made at different points in time. Because the outcome would change depending on the point in time, the students would exhibit time inconsistency.
Monetary policy makers suffer from dynamic inconsistency with inflation expectations, as politicians are best off promising lower inflation in the future. But once tomorrow comes lowering inflation may have negative effects, such as increasing unemployment, so they do not make much effort to lower it. This is why independent central banks are believed to be advantageous for a country. Indeed, "a central bank with a high degree of discretion in conducting monetary policy would find itself under constant political pressure to boost the economy and reduce unemployment, but since the economy cannot exceed its potential GDP or its natural rate of unemployment over time, this policy would instead only lead to higher inflation in the long run".^[2] The first paper on this subject was published by Finn E. Kydland and Edward C. Prescott in the Journal of Political Economy in 1977, which eventually led to their winning the Nobel Prize in Economics in 2004.^[3]
One famous example in literature of a mechanism for dealing with dynamic inconsistency is that of Odysseus and the Sirens. Curious to hear the Sirens' songs but mindful of the danger, Odysseus orders his men to stop their ears with beeswax and ties himself to the mast of the ship. Most importantly, he orders his men not to heed his cries while they pass the Sirens; recognizing that in the future he may behave irrationally, Odysseus limits his future agency and binds himself to a commitment mechanism (i.e., the mast) to survive this perilous example of dynamic inconsistency. This example has been used by economists to explain the benefits of commitment mechanisms in mitigating dynamic inconsistency.^[4]
A curious case of dynamic inconsistency in psychology is described by Read, Loewenstein & Kalyanaraman (1999). In the experiment, subjects of the study were offered free rentals of movies which were classified into two categories - "lowbrow" (e.g., The Breakfast Club) and "highbrow" (e.g., Schindler's List) - and researchers analyzed patterns of choices made. In the absence of dynamic inconsistency, the choice would be expected to be the same regardless of the delay between the decision date and the consumption date. In practice, however, the outcome was different. When subjects had to choose a movie to watch immediately, the choice was consistently lowbrow for the majority of the subjects. But when they were asked to pick a movie to be watched at later date, highbrow movies were chosen far more often. Among movies picked four or more days in advance, over 70% were highbrow.
People display a consistent bias to believe that they will have more time in the future than they have today. Specifically, there is a persistent belief among people that they are "unusually busy in the immediate future, but will become less busy shortly". However, the amount of time you have this week is generally representative of the time you have in future weeks. When people are estimating their time and when deciding if they will make a commitment, they anticipate more "time slack" in future weeks than the present week. Experiments by Zauberman & Lynch (2005) on this topic showed that people tend to discount investments of time more than money. They nicknamed this the "Yes...Damn!" effect because people tend to commit themselves to time-consuming activities like traveling to a conference under the false impression that they will be less busy in the future.^[5]^[6]^[7]

References

↑ George Loewenstein; O'Donoghue, T.; Rabin, M. (2003). "Projection Bias in Predicting Future Utility" (PDF). The Quarterly Journal of Economics. 118 (4): 1209–1248. doi:10.1162/003355303322552784. Archived from the original (PDF) on June 16, 2012.
↑ Christopher Crowe; Ellen E. Meade (Fall 2007). "The Evolution of Central Bank Governance Around the World". Journal of Economic Perspectives. 21 (4): 69–90. doi:10.1257/jep.21.4.69.
↑ Finn E. Kydland; Edward C. Prescott (June 1977). "Rules Rather than Discretion: The Inconsistency of Optimal Plans" (PDF). Journal of Political Economy. 85 (3): 473–492. doi:10.1086/260580. JSTOR 1830193.
↑ Martin Wolf (2004). "The Market Crosses Borders". Why Globalization Works. New Haven, CT: Yale University Press. p. 91. ISBN 9780300102529.
↑ Wayne McIntyre (December 18, 2011). "Watch Out for the 'Yes, Damn!' Effect. It's a Credibility Killer.". FunnelBoard Blog.
↑ John G. Lynch, Jr.; Gal Zauberman (February 2005). "Resource Slack and Propensity to Discount Delayed Investments of Time Versus Money" (PDF). Journal of Experimental Psychology: General. 134 (1): 23–37. doi:10.1037/0096-3445.134.1.23.
↑ John G. Lynch, Jr.; Gal Zauberman (Spring 2006). "When Do You Want It? Time, Decisions, and Public Policy" (PDF). Journal of Public Policy & Marketing. 25 (1): 67–78. doi:10.1509/jppm.25.1.67.

Bibliography

Auernheimer, Leonardo (1974). "The Honest Government's Guide to the Revenue From the Creation of Money". Journal of Political Economy. 82 (3): 598–606. doi:10.1086/260216. JSTOR 1829849.
Barro, Robert J.; Gordon, David B. (1983). "A Positive Theory of Monetary Policy in a Natural Rate Model". Journal of Political Economy. 91 (4): 589–610. doi:10.1086/261167. JSTOR 1831069.
Klein, Paul (2009). "Time consistency of monetary and fiscal policy". The New Palgrave Dictionary of Economics (2nd ed.).
Read, Daniel; Loewenstein, George; Kalyanaraman, Shobana (1999). "Mixing virtue and vice: combining the immediacy effect and the diversification heuristic" (PDF). Journal of Behavioral Decision Making. 12 (4): 257–273. doi:10.1002/(SICI)1099-0771(199912)12:4<257::AID-BDM327>3.0.CO;2-6.
Rogoff, Kenneth (1985). "The Optimal Degree of Commitment to an Intermediate Monetary Target". Quarterly Journal of Economics. 100 (4): 1169–1189. doi:10.2307/1885679. JSTOR 1885679.
Simaan, M.; Cruz, J. B., Jr. (1973a). "On the Stackelberg Strategy in Nonzero-Sum Games". Journal of Optimization Theory and Applications. 11 (5): 533–555. doi:10.1007/BF00935665.
Simaan, M.; Cruz, J. B., Jr. (1973b). "Additional Aspects of the Stackelberg Strategy in Nonzero-Sum Games". Journal of Optimization Theory and Applications. 11 (6): 613–626. doi:10.1007/BF00935561.
Strotz, R. H. (1955–56). "Myopia and Inconsistency in Dynamic Utility Maximization". Review of Economic Studies. 23 (3): 165–180. JSTOR 2295722.
Yeung, David W. K. and Leon A. Petrosyan. Subgame Consistent Economic Optimization: An Advanced Cooperative Dynamic Game Analysis (Static & Dynamic Game Theory: Foundations & Applications), Birkhäuser Boston; 2012. ISBN 978-0817682613

External links

Topics in game theory

Definitions	Normal-form game Extensive-form game Escalation of commitment Graphical game Cooperative game Succinct game Information set Hierarchy of beliefs Preference

Equilibrium concepts	Nash equilibrium Subgame perfection Mertens-stable equilibrium Bayesian Nash equilibrium Perfect Bayesian equilibrium Trembling hand Proper equilibrium Epsilon-equilibrium Correlated equilibrium Sequential equilibrium Quasi-perfect equilibrium Evolutionarily stable strategy Risk dominance Core Shapley value Pareto efficiency Gibbs equilibrium Quantal response equilibrium Self-confirming equilibrium Strong Nash equilibrium Markov perfect equilibrium

Strategies	Dominant strategies Pure strategy Mixed strategy Tit for tat Grim trigger Collusion Backward induction Forward induction Markov strategy

Classes of games	Symmetric game Perfect information Simultaneous game Sequential game Repeated game Signaling game Screening game Cheap talk Zero-sum game Mechanism design Bargaining problem Stochastic game n-player game Large Poisson game Nontransitive game Global games Strictly determined game Potential game

Games	Prisoner's dilemma Traveler's dilemma Coordination game Chicken Centipede game Volunteer's dilemma Dollar auction Battle of the sexes Stag hunt Matching pennies Ultimatum game Rock-paper-scissors Pirate game Dictator game Public goods game Blotto games War of attrition El Farol Bar problem Fair division Fair cake-cutting Cournot game Deadlock Diner's dilemma Guess 2/3 of the average Kuhn poker Nash bargaining game Prisoners and hats puzzle Trust game Princess and monster game Monty Hall problem Rendezvous problem

Theorems	Minimax theorem Nash's theorem Purification theorem Folk theorem Revelation principle Arrow's impossibility theorem

Key figures	Albert W. Tucker Amos Tversky Ariel Rubinstein Daniel Kahneman David K. Levine David M. Kreps Donald B. Gillies Drew Fudenberg Eric Maskin Harold W. Kuhn Herbert Simon Hervé Moulin Jean Tirole Jean-François Mertens John Harsanyi John Maynard Smith John Nash John von Neumann Kenneth Arrow Kenneth Binmore Leonid Hurwicz Lloyd Shapley Melvin Dresher Merrill M. Flood Oskar Morgenstern Paul Milgrom Peyton Young Reinhard Selten Robert Aumann Robert B. Wilson Roger Myerson Samuel Bowles Thomas Schelling William Vickrey

See also	All-pay auction Alpha–beta pruning Bertrand paradox Bounded rationality Combinatorial game theory Confrontation analysis Coopetition List of game theorists List of games in game theory No-win situation Topological game Tragedy of the commons Tyranny of small decisions

This article is issued from Wikipedia - version of the 12/3/2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.