Understanding Overfitting and Underfitting

Definition of overfitting in modeling

In mathematical modeling, overfitting is when an analysis matches a specific dataset too closely—often by capturing noise rather than the underlying structure—so it performs poorly on additional or unseen data. An overfitted model typically has more parameters (or flexibility) than the data can justify, which allows it to “memorize” the training examples instead of learning generalizable patterns. Overfitting is closely tied to model complexity and the training/selection process. It can occur when the model is chosen based on training performance rather than validation or test performance, and it is more likely when training is done for too long or when data are scarce. A common symptom is decreasing training error while validation (or test) error increases, indicating that the model is fitting idiosyncrasies of the training set rather than learning trends that generalize.

0/2 modes complete

Overfitting causes: noise memorization

0/2 modes complete