We will try to give an elementary account of bounds for "regularized least squares" that reflects our current knowledge. The framework for the discussion is that of Reproducing Kernel Hilbert Spaces, with a regression point of view. As a corollary of these ideas we will see some estimates for the binary classification problem. The talk will be based on joint work with Felipe Cucker and Ding-Xuan? Zhou.