Stochastic Control as a Non-Equilibrium Statistical Physics: Gauge Invariant Bellman Equation
published: Oct. 16, 2012, recorded: September 2012, views: 4050
Slides
Related content
Report a problem or upload files
If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Description
In Stochastic Control (SC) one minimizes average cost-to-go, consisting of the cost-of-control (amount of efforts), the cost-of-space (where one wants the system to be) and the target cost (where one wants the system to finish), for the system obeying a forced and controlled Langevien dynamics. We generalize the SC problem adding to the cost-to-go a term accounting for the cost-of dynamics, characterized by a vector potential. We provide variational derivation of the generalized gauge-invariant Bellman-Hamilton-Jacobi equation for the optimal average cost-to-go, where the control is expressed in terms of current and density functionals, and discuss examples, e.g.ergodic control of particle-on-a-circle illustrating non-equilibrium space-time complexity over current/flux. The talk is based on a joint work with M. Chertkov, J. Bierkens and H.J. Kappen.
Link this page
Would you like to put a link to this lecture on your homepage?Go ahead! Copy the HTML snippet !
Write your own review or comment: