29035
20130605083003.0
oai:doc.rero.ch:20120427143923-SC
cdu33
rero_explore
postprint
dissertation
cdu1
preprint
hegge
cdu16
journal
book
thesis
report
thesis_urn
cdu34
eng
33
Filar, J.-A.
Sch. of Math., Univ. of South Australia, Adelaide
eng
Decomposition and parallel processing techniques for two-time scale controlled Markov chains
2000
eng
Deals with a class of ergodic control problems for systems described by Markov chains with strong and weak interactions. These systems are composed of a set of m subchains that are weakly coupled. Using results established by Abbad et al. (1992). We formulate a limit control problem the solution of which can be obtained via an associated nondifferentiable convex programming (NDCP) problem. The technique used to solve the NDCP problem is the analytic center cutting plane method (ACCPM) which implements a dialogue between, on one hand, a master program computing the analytical center of a localization set containing the solution and, on the other hand, an oracle proposing cutting planes that reduce the size of the localization set at each main iteration. The interesting aspect of this implementation comes from two characteristics: (i) the oracle proposes cutting planes by solving reduced sized Markov decision problems (MDP) via a linear program (LP) or a policy iteration method; (ii) several cutting planes can be proposed simultaneously through a parallel implementation on m processors. The paper concentrates on these two aspects and shows, on a large scale MDP obtained from the numerical approximation “a la Kushner-Dupuis” of a singularly perturbed hybrid stochastic control problem, the important computational speed-up obtained
eng
Markov processes ; convex programming ; decision theory ; linear programming ; parallel processing ; singularly perturbed systems ; stochastic systems
Gondzio, J.
Department of Mathematics & Statistics, The University of Edinburgh, UK
Haurie, Alain
Université de Genève
Moresino, Francesco
Haute école de gestion de Genève
Vial, J.-P.
Université de Genève
Proceedings of the 39th IEEE Conference on Decision and Control, 2000
2000/1//711-716
Moresino_2000_decomposition.pdf
application/pdf
548483
http://doc.rero.ch/record/29035/files/Moresino_2000_decomposition.pdf
order:1
Texte intégral
Haute école de gestion de Genève
Centre de recherche appliqué en gestion (CRAG)
Campus de Battelle, Bâtiment F, 7 route de Drize, 1227 Carouge
Haute école de gestion de Genève
Genève
doc.support@rero.ch
POSTPRINT
HEGGE
ART_INPROC
20120427143923-SC