Please use this identifier to cite or link to this item: https://hdl.handle.net/10419/81097 
Year of Publication: 
2013
Series/Report no.: 
Working Papers No. 475
Publisher: 
Bielefeld University, Institute of Mathematical Economics (IMW), Bielefeld
Abstract: 
In this paper we prove a deterministic approximation theorem for a sequence of Markov decision processeswith finitely many actions and general state spaces as they appear frequently in economics, game theory and operations research. Using viscosity solution methods no a-priori differentiabililty assumptions are imposed on the value function. Applications for this result can be found in large deviation theory, and some simple economic problems.
Subjects: 
Markov decision processes
optimal control
viscosity solutions
stochastic approximation
JEL: 
C02
C44
C61
Persistent Identifier of the first edition: 
Document Type: 
Working Paper

Files in This Item:
File
Size
250.15 kB





Items in EconStor are protected by copyright, with all rights reserved, unless otherwise indicated.