关键词:动态系统; 预测状态表示; 发现核心测试; 学习模型参数; 规划算法
Survey of predictive state representations
LEI Zhu, LIU Feng, ZHAO Zhi-hong
(School of Software Engineering, Nanjing University, Nanjing 210093, China)
Abstract:Predictive state representations(PSRs) are new models for discrete-time finite action and observation stochastic systems. Because a PSR represents the system’s state as a set of predictions of the observable outcomes of tests performed in the system, it can solve the computing problems in exist stochastic decision systems. This paper introduced the principles of PSR models, surveyed the PSR model and planning techniques, analyzed and compared the fundamental principles behind the modeling and planning algorithms of PSR, pointed out the development trend, and gave the challenges that the research of PSR was facing.
Key words:stochastic systems; predictive state representations(PSR); discovery core-test; learning parameters; planning ......