We study time-inconsistent recursive stochastic control problems, i.e., for which Bellman's principle of optimality does not hold. For this class of problems classical optimal controls may fail to exist, or to be relevant in practice, and dynamic programming is not easily applicable. Therefore, the notion of optimality is defined through a game-theoretic framework by means of subgame-perfect equilibrium: we interpret our preference changes which, realistically, are inconsistent over time, as players in a game for which we want to find a Nash equilibrium. The approach followed in our work relies on the stochastic (Pontryagin) maximum principle: we adapt the classical spike variation technique to obtain a characterization of equilibrium strategies in terms of a generalized second-order Hamiltonian function defined through pairs of backward stochastic differential equations, even in the multidimensional case. The theoretical results are applied in the financial field to finite horizon investment-consumption policies with non-exponential actualization. Here the existence of non-trivial equilibrium policies is also ascertained.

Subgame-perfect equilibrium strategies for time-inconsistent recursive stochastic control problems

Mastrogiacomo, E;Tarsia, M
2023-01-01

Abstract

We study time-inconsistent recursive stochastic control problems, i.e., for which Bellman's principle of optimality does not hold. For this class of problems classical optimal controls may fail to exist, or to be relevant in practice, and dynamic programming is not easily applicable. Therefore, the notion of optimality is defined through a game-theoretic framework by means of subgame-perfect equilibrium: we interpret our preference changes which, realistically, are inconsistent over time, as players in a game for which we want to find a Nash equilibrium. The approach followed in our work relies on the stochastic (Pontryagin) maximum principle: we adapt the classical spike variation technique to obtain a characterization of equilibrium strategies in terms of a generalized second-order Hamiltonian function defined through pairs of backward stochastic differential equations, even in the multidimensional case. The theoretical results are applied in the financial field to finite horizon investment-consumption policies with non-exponential actualization. Here the existence of non-trivial equilibrium policies is also ascertained.
2023
2023
Equilibrium strategy; Maximum principle; Portfolio management; Recursive stochastic control problem; Time-inconsistency
Mastrogiacomo, E; Tarsia, M
File in questo prodotto:
File Dimensione Formato  
Subgame-perfect-equilibrium-strategies-for-time_2023_Journal-of-Mathematical.pdf

accesso aperto

Descrizione: article
Tipologia: Versione Editoriale (PDF)
Licenza: Creative commons
Dimensione 599.32 kB
Formato Adobe PDF
599.32 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11383/2160491
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 1
social impact