Standard Deviation

It's like a ruler measuring how far arrows spread out from the center of a target on average.

Definition Standard deviation is a statistical number that shows how spread out data points are from their average. A smaller number means the data points cluster tightly around the mean, while a larger number means they are scattered widely.

Equal Averages Don't Always Mean Equal Performance

Imagine two archers who each shoot five arrows.

Archer A scores 8, 8, 8, 8, and 8, giving an average of 8 points. Archer B scores 10, 10, 8, 6, and 6, which also averages 8 points. Their average scores are identical, but their performances look completely different.

Archer A's arrows cluster tightly right around the 8-ring. Archer B hits two bullseyes but also shoots two wild 6-pointers, creating a wide spread. Standard deviation is the single number that shows how spread out data points are around their average.

When shots cluster tightly like Archer A's, the standard deviation is small. When shots are scattered and inconsistent like Archer B's, the standard deviation is large.

SD Concept: Archer A vs B Shot Grouping Archer A (Avg 8) Low SD Consistent Archer B (Avg 8) High SD Scattered & Uneven

How to Measure Distance from the Average

To calculate standard deviation, you first measure how far each data point is from the average. This distance is called a 'deviation'โ€”simply your score minus the mean.

However, scores above average produce positive (+) deviations, while scores below average produce negative (-) deviations. If you simply add all these deviations together, they cancel each other out and always equal zero.

To solve this, statisticians squared each deviation to eliminate the negative signs, then averaged them. This value is called 'variance.' But squaring makes the numbers huge and squares the original unit (like points squared), making it hard to interpret. Taking the square root restores the original scale and unitโ€”and that final number is standard deviation.

A Step Further: Normal Distribution and Test Scores

Beyond measuring spread, standard deviation serves as a yardstick for calculating probabilities. Many real-world traits, like heights or test scores, follow a bell-shaped curve known as a 'normal distribution.'

In a normal distribution, about 68% of all data falls within one standard deviation of the mean (plus or minus). Expand that to two standard deviations, and it covers about 95%. Thanks to this rule, knowing just your score, the average, and the standard deviation lets you quickly find your percentile rank.

For example, if an exam has a mean of 70 and a standard deviation of 10, scoring 80 puts you in roughly the top 16%. But if the standard deviation were only 5 points, an 80 would place you in the top 2.5%โ€”an exceptional result.

Normal Distribution & SD Interval 95.4% (ยฑ2ฯƒ) 68.2% (ยฑ1ฯƒ) -1ฯƒ Mean +1ฯƒ

๐Ÿค” Common misconceptions

โœ• Myth

A small standard deviation always means high performance or superior quality.

โœ“ Fact

Standard deviation measures consistency around the average, not how high or low the values are. If every student scores zero on an exam, the standard deviation is 0 because there is zero spread.

๐Ÿงบ Where you meet it

1 Even if two cities share the same annual average temperature, a city with a high standard deviation experiences scorching summers and freezing winters.
2 In stock investing, a stock with a high standard deviation has wide price swings, meaning higher risk and volatility.
๐Ÿ’ก In one sentence

Standard deviation is a fundamental metric that measures how spread out data points are from their average, expressed in the original unit of measurement.