Skip to content

Latest commit

 

History

History
46 lines (46 loc) · 1.72 KB

2008-07-09-kveton08a.md

File metadata and controls

46 lines (46 loc) · 1.72 KB
abstract title year layout series publisher issn id month tex_title firstpage lastpage page order cycles bibtex_author author date note address container-title volume genre issued pdf extras
Approximate linear programming (ALP) is an efficient approach to solving large factored Markov decision processes (MDPs). The main idea of the method is to approximate the optimal value function by a set of basis functions and optimize their weights by linear programming (LP). This paper proposes a new ALP approximation. Comparing to the standard ALP formulation, we decompose the constraint space into a set of low-dimensional spaces. This structure allows for solving the new LP efficiently. In particular, the constraints of the LP can be satisfied in a compact form without an exponential dependence on the treewidth of ALP constraints. We study both practical and theoretical aspects of the proposed approach. Moreover, we demonstrate its scale-up potential on an MDP with more than 2100 states.
Partitioned linear programming approximations for MDPs
2008
inproceedings
Proceedings of Machine Learning Research
PMLR
2640-3498
kveton08a
0
Partitioned linear programming approximations for MDPs
341
348
341-348
341
false
Kveton, Branislav and Hauskrecht, Milos
given family
Branislav
Kveton
given family
Milos
Hauskrecht
2008-07-09
Reissued by PMLR on 09 October 2024.
Proceedings of the 24th Conference on Uncertainty in Artificial Intelligence
R6
inproceedings
date-parts
2008
7
9