The Parameter Server
published: Jan. 16, 2013, recorded: December 2012, views: 1153
Report a problem or upload filesIf you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
In this talk I will discuss a number of vignettes on scaling optimization and inference. Despite arising from very different contexts (graphical models inference, convex optimization, neural networks), they all share a common design pattern - a synchronization mechanism in the form of a parameter server. It formalizes the notion of decomposing optimization problems into subsets and reconciling partial solutions. I will discuss some of the systems and distribution issues involved in building such a system.
Download slides: nipsworkshops2012_smola_parameter_server_01.pdf (23.0 MB)
Link this pageWould you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !