Alternating Direction Method of Multipliers

author: Stephen P. Boyd, Department of Electrical Engineering, Stanford University
published: Jan. 25, 2012,   recorded: December 2011,   views: 50521


Related content

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Lecture popularity: You need to login to cast your vote.
  Delicious Bibliography


Problems in areas such as machine learning and dynamic optimization on a large network lead to extremely large convex optimization problems, with problem data stored in a decentralized way, and processing elements distributed across a network. We argue that the alternating direction method of multipliers is well suited to such problems. The method was developed in the 1970s, with roots in the 1950s, and is equivalent or closely related to many other algorithms, such as dual decomposition, the method of multipliers, Douglas-Rachford splitting, Spingarn's method of partial inverses, Dykstra's alternating projections, Bregman iterative algorithms for $\ell_1$ problems, proximal methods, and others. After briefly surveying the theory and history of the algorithm, we discuss applications to statistical and machine learning problems such as the lasso and support vector machines.

See Also:

Download slides icon Download slides: nipsworkshops2011_boyd_multipliers_01.pdf (356.4┬áKB)

Help icon Streaming Video Help

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Reviews and comments:

Comment1 Tobby, June 22, 2021 at 11:04 a.m.:

That's great! Thanks for sharing this post with us! Being a student of the computer science department, this video lecture is so useful for me. I am currently doing my job at this site and I like their other opportunities! The computer science has been an important area of subject to study more!

Write your own review or comment:

make sure you have javascript enabled or clear this field: