The variance is the average squared difference between individual values and the mean of the entire set of values in mathematics and statistics. In other words, variance shows how spread out the values are. In machine learning, the variance is an error caused by the sensitivity of a model to small variations in the training set. High variance reflects a tendency of the model to learn random noise from the input features leading to model overfitting.