Regularization is a technique for optimization in defined spaces. To avoid a convergence over pathological points, the reseacher define a sub-space were only exist non-pathological cases. This new space is named a regularized space.
The theory of regularization is a very important aspect of the optimization methods.
