The Central Idea

A compact description of a quantitative distribution should usually address four questions:

  1. What is the shape?
  2. Where is the center?
  3. How large is the spread?
  4. Are there any unusual observations?

These features work together to describe the distribution as a whole.

What Is Distribution Shape?

The shape of a distribution describes the broad pattern formed by its observations.

Important shape features include:

Symmetric Distributions

A distribution is approximately symmetric when its left and right sides have broadly similar shapes around a central region.

In a perfectly symmetric distribution, reflecting the distribution across its center would leave the shape unchanged.

Real datasets are rarely perfectly symmetric, so the term is usually used approximately.

Center in a Symmetric Distribution

In a roughly symmetric, unimodal distribution, the mean and median are often close.

If the distribution is also concentrated around one dominant value, the mode may be near them as well.

This makes the mean and standard deviation a natural summary pair when strong outliers are absent.

Right-Skewed Distributions

A distribution is right-skewed when its longer tail extends toward larger numerical values.

Most observations may be concentrated at lower values, while a smaller number stretch far to the right.

Examples can include:

Mean and Median in Right-Skewed Data

Large values in the right tail pull the mean upward more strongly than they affect the median.

A common pattern is

\[ \operatorname{median}<\operatorname{mean}. \]

This is a useful tendency, not a universal rule for every right-skewed dataset.

Left-Skewed Distributions

A distribution is left-skewed when its longer tail extends toward smaller numerical values.

A smaller number of unusually low observations may stretch the distribution to the left.

Mean and Median in Left-Skewed Data

Low values in the left tail pull the mean downward.

A common pattern is

\[ \operatorname{mean}<\operatorname{median}. \]

Again, this is a common tendency rather than an absolute rule.

The Direction of Skewness Is Named for the Tail

A frequent mistake is to name skewness according to where most of the data are concentrated.

Instead:

Unimodal Distributions

A distribution with one major concentration or peak is called unimodal.

A single peak often suggests one dominant cluster of observations.

Bimodal Distributions

A distribution with two distinct peaks is called bimodal.

Two peaks can indicate that the data combine two underlying groups.

For example, commute times might be bimodal if one group travels locally while another group commutes from distant locations.

Multimodal Distributions

A distribution with several substantial peaks may be described as multimodal.

Multiple modes can suggest:

Clusters

A cluster is a region where observations are concentrated.

Clusters can reveal structure that a single center statistic may hide.

If two clusters are far apart, reporting only one mean may create a value that represents neither cluster well.

Gaps

A gap is an interval containing few or no observations.

Gaps may separate clusters or indicate:

Tails

A tail is a region where the distribution thins out toward unusually low or high values.

Tail length and direction are central to identifying skewness.

Describing Center

Two common measures of center are:

The best choice depends on distribution shape and sensitivity to extreme observations.

Mean as Center

The sample mean is

\[ \bar{x} = \frac{1}{n}\sum_{i=1}^{n}x_i. \]

Because every value contributes directly, the mean responds strongly to extreme observations.

Median as Center

The median identifies the middle position of the ordered data.

It is relatively resistant to extreme values because changing a value far out in a tail often does not change the middle position.

Describing Spread

Common spread measures include:

These statistics emphasize different aspects of variability.

Standard Deviation as Spread

Standard deviation measures the scale of variation around the mean.

For a sample,

\[ s = \sqrt{ \frac{1}{n-1} \sum_{i=1}^{n}(x_i-\bar{x})^2 }. \]

Like the mean, standard deviation is sensitive to extreme values.

IQR as Spread

The interquartile range is

\[ \operatorname{IQR}=Q_3-Q_1. \]

It measures the width of the middle half of the data and is relatively resistant to outliers.

Natural Summary Pairs

Two common descriptive pairings are:

\[ \boxed{\text{mean and standard deviation}} \]

and

\[ \boxed{\text{median and IQR}}. \]

The first pair is often appropriate for roughly symmetric data without strong outliers. The second pair is often better for skewed data or data containing extreme values.

Why Center and Spread Should Be Reported Together

Consider:

\[ A:\quad 9,\ 10,\ 10,\ 10,\ 11 \] \[ B:\quad 0,\ 5,\ 10,\ 15,\ 20. \]

Both have mean \(10\), but Dataset B is much more spread out.

Center without spread gives an incomplete description.

What Is an Outlier?

An outlier is an observation unusually far from the main body of the data.

Outliers may be important because they can:

Visual Identification of Possible Outliers

Dot plots, histograms, and other displays may reveal observations separated from the main cluster.

Visual evidence is useful for investigation, but a formal rule can provide a more systematic criterion.

The 1.5-IQR Rule

A common introductory outlier rule uses the interquartile range.

Lower fence:

\[ \boxed{ Q_1-1.5(\operatorname{IQR}) }. \]

Upper fence:

\[ \boxed{ Q_3+1.5(\operatorname{IQR}) }. \]

Values beyond these fences are flagged as potential outliers.

Example: Applying the IQR Rule

Suppose

\[ Q_1=18,\qquad Q_3=30. \]

Then

\[ \operatorname{IQR} = 30-18 = 12. \]

Lower fence:

\[ 18-1.5(12) = 18-18 = \boxed{0}. \]

Upper fence:

\[ 30+1.5(12) = 30+18 = \boxed{48}. \]

Values below \(0\) or above \(48\) are flagged as potential outliers.

Potential Outlier Does Not Mean Error

A value beyond an outlier fence is not automatically incorrect.

It may represent:

The correct response is investigation, not automatic deletion.

Outliers and the Mean

Consider

\[ 5,\ 6,\ 6,\ 7,\ 8. \]

The mean is

\[ \bar{x} = \frac{32}{5} = 6.4. \]

Replace \(8\) with \(80\):

\[ 5,\ 6,\ 6,\ 7,\ 80. \]

The new mean becomes

\[ \bar{x} = \frac{104}{5} = 20.8. \]

The extreme value dramatically changes the mean.

Outliers and the Median

For both

\[ 5,\ 6,\ 6,\ 7,\ 8 \]

and

\[ 5,\ 6,\ 6,\ 7,\ 80, \]

the median remains

\[ \boxed{6}. \]

This illustrates the median's resistance.

Outliers and Standard Deviation

Standard deviation is based on squared deviations from the mean.

Large deviations contribute disproportionately because

\[ (x_i-\bar{x})^2 \]

grows rapidly as the observation moves farther from the mean.

Extreme values can therefore increase standard deviation substantially.

Outliers and the IQR

The IQR is based on \(Q_1\) and \(Q_3\), which depend on ordered positions.

A single very large or very small observation usually affects the IQR much less than it affects the range or standard deviation.

Shape Affects the Meaning of "Typical"

In a symmetric distribution, the mean can provide a strong description of a typical observation.

In a strongly skewed distribution, the mean may be pulled toward a tail.

In that setting, the median may better describe the typical central position.

Example: Income Distribution

Suppose most households in a region earn between \(\$40{,}000\) and \(\$90{,}000\), while a small number earn several million dollars.

The distribution is likely right-skewed.

The high-income tail may pull the mean well above the income of a typical household.

Median income and IQR can therefore provide a more resistant summary.

Example: Controlled Manufacturing Process

Suppose component lengths cluster tightly and symmetrically around the target dimension, with no substantial outliers.

The mean and standard deviation can provide a useful summary because:

Describe Shape Before Choosing Summaries

A reliable descriptive analysis often proceeds in this order:

  1. inspect a graph;
  2. describe shape;
  3. identify possible outliers;
  4. choose appropriate measures of center and spread;
  5. interpret the numerical summaries.

A Useful Description Framework

One practical framework is:

Example: Full Distribution Description

Suppose a histogram shows one major peak near \(50\), roughly balanced tails, and no isolated observations. The sample statistics are

\[ \bar{x}=51.2,\qquad s=6.4. \]

A reasonable description is:

The distribution is approximately symmetric and unimodal, centered near \(51\), with a standard deviation of about \(6.4\), and no obvious outliers.

Example: Skewed Distribution Description

Suppose a distribution has a long right tail and several large values. Its median and quartiles are

\[ Q_1=20,\qquad \operatorname{median}=27,\qquad Q_3=36. \]

Then

\[ \operatorname{IQR} = 36-20 = 16. \]

A reasonable description is:

The distribution is right-skewed, centered around a median of \(27\), with the middle half spanning \(16\) units. Large upper-tail observations should be inspected for possible outliers.

Comparing Two Distributions

When comparing two groups, discuss the same structural features for both.

Compare:

Example: Comparing Centers

Suppose Group A has median \(42\) and Group B has median \(55\).

Group B has the higher central position according to the medians.

This statement does not imply that every value in Group B exceeds every value in Group A.

Example: Comparing Spread

Suppose Group A has

\[ \operatorname{IQR}=8 \]

while Group B has

\[ \operatorname{IQR}=20. \]

The middle half of Group B is more widely dispersed.

Overlapping Distributions Can Still Have Different Centers

Two distributions can overlap substantially while still having different means or medians.

Statistical comparison concerns overall distribution structure, not whether every observation from one group lies above every observation from the other.

Similar Centers Can Hide Different Shapes

Two datasets can have the same mean and median while having very different:

Numerical summaries should therefore be paired with visual inspection.

Common Error: Describing Only the Mean

Saying "the mean is \(25\)" does not describe the full distribution.

The distribution may be narrow or wide, symmetric or skewed, unimodal or multimodal, and may or may not contain outliers.

Common Error: Calling Every Extreme Value an Outlier

The minimum and maximum are always extreme in the literal sense of being endpoints.

They are not automatically statistical outliers.

Outlier status depends on the distribution and the rule or context being used.

Common Error: Choosing Mean and Standard Deviation for Strongly Skewed Data

Mean and standard deviation can be heavily influenced by a long tail or extreme values.

For strongly skewed data, median and IQR often provide a more resistant descriptive summary.

Common Error: Choosing Median and IQR Automatically

Resistant measures are useful, but they are not automatically superior in every context.

If arithmetic totals, expected values, or variation around the mean are central to the problem, mean and standard deviation may be operationally important.

Common Error: Ignoring Multimodality

A single center can be misleading when the distribution contains two or more distinct clusters.

In that situation, investigate whether the data combine different populations or processes.

Common Error: Deleting Outliers Without Investigation

Removing an unusual observation simply because it changes the mean or standard deviation can distort the analysis.

Outliers should be investigated and handled according to defensible analytical rules.

Common Error: Comparing Spread Without Considering Units

A standard deviation of \(5\) kilograms and one of \(5\) grams do not represent the same amount of variability.

Spread must be interpreted in the scale and units of the variable.

A Reliable Procedure for Describing One Distribution

  1. Identify the quantitative variable and its units.
  2. Inspect an appropriate graph.
  3. Describe the overall shape.
  4. Identify peaks, gaps, clusters, and tails.
  5. Inspect for possible outliers.
  6. Choose a center measure appropriate to the shape.
  7. Choose a spread measure appropriate to the shape.
  8. Report the numerical values in context.
  9. Combine the features into one coherent description.

A Reliable Procedure for Comparing Distributions

  1. Use comparable graphical scales.
  2. Compare shape.
  3. Compare centers.
  4. Compare spreads.
  5. Compare outliers and other unusual features.
  6. Use relative language such as higher, lower, more variable, or more skewed.
  7. Avoid claims stronger than the data support.

Practice 1: Identify the Shape

A distribution has one main peak near \(40\), with roughly equal tails on both sides.

How would you describe its shape?

Practice 2: Direction of Skewness

Most observations lie between \(10\) and \(30\), but a few values extend to \(80\).

Which direction is the distribution skewed?

Practice 3: Choose Center and Spread

A dataset is approximately symmetric with no strong outliers.

Which descriptive pair is generally natural?

Practice 4: Choose Resistant Summaries

A distribution is strongly right-skewed and contains several extreme high values.

Which descriptive pair is generally more resistant?

Practice 5: IQR

Suppose

\[ Q_1=22,\qquad Q_3=34. \]

Find the IQR.

Practice 6: Outlier Fences

Using

\[ Q_1=22,\qquad Q_3=34, \]

find the lower and upper \(1.5\)-IQR fences.

Practice 7: Identify the Better Summary

A city reports household income data with a small number of extremely high incomes.

Would mean income or median income usually better describe a typical household?

Practice 8: Compare Spread

Group A has \(s=4\), and Group B has \(s=11\), measured in the same units.

Which group has greater variability around its mean?

Practice 9: Identify the Structural Concern

A histogram has two strong peaks separated by a clear gap.

What feature should the analyst investigate?

Practice 10: Full Description

A distribution is right-skewed, has median \(18\), IQR \(7\), and one value far above the upper cluster.

Write a concise description using shape, center, spread, and unusual features.

Practice Answers

Practice 1

The distribution is approximately symmetric and unimodal.

Practice 2

The longer tail extends toward larger values, so the distribution is right-skewed.

Practice 3

The mean and standard deviation are generally a natural pair for an approximately symmetric distribution without strong outliers.

Practice 4

The median and IQR are generally more resistant to strong skewness and extreme values.

Practice 5

\[ \operatorname{IQR} = 34-22 = \boxed{12}. \]

Practice 6

Since

\[ \operatorname{IQR}=12, \]

the lower fence is

\[ 22-1.5(12) = 22-18 = \boxed{4}. \]

The upper fence is

\[ 34+1.5(12) = 34+18 = \boxed{52}. \]

Practice 7

Median income usually provides the more resistant description of a typical household when a small number of extremely high incomes create strong right skewness.

Practice 8

Group B has the larger standard deviation, so it has greater variability around its mean.

Practice 9

The analyst should investigate possible bimodality and determine whether the data combine two underlying groups or processes.

Practice 10

The distribution is right-skewed, centered around a median of \(18\), with an IQR of \(7\). One unusually large observation lies beyond the main upper cluster and should be investigated as a possible outlier.

What to Remember

Where We Go Next

Once a distribution's shape, center, spread, and unusual observations are understood, individual values can be compared more meaningfully with the distribution as a whole.

The next lesson, Standardization and Z-Scores, develops a unit-free measure of how far an observation lies above or below the mean in standard deviation units.