********************************************************************


                                                     Seminar

             Department of Systems Engineering and Engineering Management
                                  The Chinese University of Hong Kong

------------------------------------------------------------------------------------------

 

 

 

Title

:

Dynamic Programming or Direct Comparison

 

 

 

Speaker

:

Prof. Xi-Ren Cao

 

 

Shanghai Jiao Tong University

 

 

Institute for Advanced Study, Hong University of Science and technology

 

 

 

Date

:

Jan 20th, 2011 (Thursday)

 

 

 

Time

:

4:30 p.m. - 5:30 p.m.

 

 

 

Venue

:

Room 513

 

 

William M.W. Mong Engineering Building

 

 

(Engineering Building Complex Phase 2)

 

 

CUHK

 

 

 

------------------------------------------------------------------------------------------

Abstract:
 

The standard approach to control and optimization of stochastic systems is based on dynamic programming. Recently, an alternative approach to stochastic learning and optimization has been developed. The approach is based on sensitivity; it was first developed for discrete event dynamic systems and is being extended to continuous-time and continuous state systems. The basic idea is as follows: fundamentally, one can only compare the performance of two policies at a time; and therefore, when developing optimization theories and methodologies, one has to first study the difference of the performance of any two polices. It turns out that many results in optimization can be obtained by a direct comparison of the performance of any two policies based on this performance difference formula. We found that this “direct comparison” method is essential for optimization.

 

This approach has some advantages over the dynamic programming approach: It is simple and intuitive clear because it is based on a direct comparison of any two policies. The approach applies in the same way to different performance criteria, including finite and infinite-horizon problems, impulse control and singular control. Furthermore, the approach brings some new insights that leads to new methods and results in control and optimization; for example, it may be applied to non-smooth functions and lead to a solution without using viscocity solution. We may also develop event-based optimization and gradient-based learning, etc.


-------------------------------------------------------------------------------------------

Biography:
 

Xi-Ren Cao received the M.S. and Ph.D. degrees from Harvard University, in 1981 and 1984, respectively. From 1984 to 1986, he was a research fellow at Harvard University. From 1986 to 1993, he worked as consultant engineer/engineering manager at Digital Equipment Corporation, Massachusetts, U.S.A. From 1993 to 2010, he was with the Hong Kong University of Science and Technology (HKUST), where he served as reader/professor/chair professor. Since July 2010, he is a chair professor of Shanghai Jiao Tong University and an affiliate member of the Institute for Advanced Study, Hong Kong University of Science and Technology. 

 

Dr. Cao owns three patents in data- and tele- communications and published three books in the area of performance optimization and discrete event dynamic systems. He received the Outstanding Transactions Paper Award from the IEEE Control System Society in 1987, the Outstanding Publication Award from the Institution of Management Science in 1990, Outstanding Service Award from IFAC in 2008., and the National Natural Science Award (2nd class), China, in 2009. He is a Fellow of IEEE (1996), a Fellow of IFAC (2008), and is/was the Chairman of IEEE Fellow Evaluation Committee of IEEE Control System Society, Editor-in-Chief of Discrete Event Dynamic Systems: Theory and Applications, Associate Editor at Large of IEEE Transactions of Automatic Control, and Board of Governors of IEEE Control Systems Society and on the Technical Board of IFAC. His current research areas include and financial engineering, stochastic learning and optimisation, performance analysis of economic systems, and discrete event dynamic systems.


************************* ALL ARE WELCOME ************************

 

 

 

Host

:

Prof. Chen Nan

Tel

:

(852)2609 8237

Email

:

nchen@se.cuhk.edu.hk

 

 

 

Enquiries

:

Prof. Nan Chen or Prof. Sean X. Zhou

 

:

Department of Systems Engineering and Engineering Management

 

 

CUHK

Website

:

http://www.se.cuhk.edu.hk/~seem5201

Email

:

seem5201@se.cuhk.edu.hk

 

 

 

********************************************************************