What does regularization do in machine learning?medium

Type
conceptual
Topic
regularization
Frequency
common
Tags
regularization, l1, l2
Answer

Regularization penalizes model complexity to improve generalization.

Explanation

L1 can encourage sparse weights, while L2 discourages large weights. Both reduce overfitting by making the learned function less sensitive to noise.

Follow-upHow is L1 regularization different from L2 regularization?