The Central Idea

Most statistical studies involve three basic questions:

  1. What group do we want to understand?
  2. Which members of that group do we actually observe?
  3. What characteristics do we record for each observed case?

These questions lead to the concepts of population, sample, and variable.

What Is a Population?

A population is the complete collection of individuals, objects, events, measurements, or cases about which a statistical question is being asked.

Examples include:

The population is determined by the question being investigated.

The Population Must Be Defined Precisely

A statement such as "we want to study customers" is incomplete.

We must ask:

A precise statistical population might be:

all customers who completed an online purchase from the company between January 1 and March 31.

What Is a Sample?

A sample is a subset of the population that is actually observed or measured.

If a university has \(18{,}000\) students and researchers survey \(600\) of them, then

\[ \text{population size}=18{,}000 \]

while

\[ \text{sample size}=600. \]

The purpose of the sample is usually to provide information about the larger population.

Why Use Samples?

Studying every member of a population may be impractical, expensive, destructive, or impossible.

Sampling can reduce:

A carefully selected sample can often provide useful information about the whole population without measuring every case.

What Is a Census?

A census attempts to collect information from every member of the population.

If every employee in a company is asked to complete a workplace survey, the intended design is a census of that company's employees.

A census does not automatically eliminate all error. Missing responses, inaccurate measurements, changing membership, or flawed questions can still affect the results.

Cases and Observational Units

A case, or observational unit, is one individual object, event, or unit about which data are recorded.

Depending on the study, a case might be:

Rows Usually Represent Cases

In a rectangular dataset, rows commonly represent cases and columns represent variables.

Customer Region Orders Annual Spending
001 West 8 $1,240
002 South 5 $860
003 West 11 $1,930

Each row describes one customer. Each column records one characteristic.

What Is a Variable?

A variable is a characteristic that can take different values across cases.

Examples include:

A variable tells us what is being recorded for each case.

Variables and Values

A variable is the characteristic being measured. A value is the particular recorded result for one case.

If the variable is number of purchases, possible observed values might be

\[ 0,\qquad 3,\qquad 7,\qquad 12. \]

The variable is the general attribute; the values are its observed realizations.

Several Variables Can Be Recorded for the Same Case

A study of employees might record:

Each employee is one case, while the dataset contains several variables describing that case.

Population Variables and Sample Variables

The same variable can be conceptually defined for every member of a population even when it is observed only for the sample.

Suppose we want to study annual household electricity use.

The variable exists conceptually for every household in the target population, but researchers may measure it for only a selected sample of households.

Parameters Describe Populations

A parameter is a numerical characteristic of a population.

Examples include:

Parameters are usually fixed for a clearly defined population, even when their values are unknown.

Statistics Describe Samples

A statistic is a numerical characteristic calculated from sample data.

Common sample statistics include:

Statistics are often used to estimate unknown population parameters.

Parameter Versus Statistic

Suppose a population contains \(N\) cases with values \(x_1,x_2,\ldots,x_N\).

The population mean is commonly written

\[ \mu=\frac{1}{N}\sum_{i=1}^{N}x_i. \]

If a sample contains \(n\) observed cases, its sample mean is commonly written

\[ \bar{x}=\frac{1}{n}\sum_{i=1}^{n}x_i. \]

The population quantity \(\mu\) is a parameter, while the sample quantity \(\bar{x}\) is a statistic.

Population Proportion and Sample Proportion

If a proportion in the full population is denoted by \(p\), then a sample proportion is often denoted by

\[ \hat{p}. \]

If \(84\) of \(120\) sampled customers report being satisfied, then

\[ \hat{p} = \frac{84}{120} = 0.70. \]

The sample statistic \(0.70\) may be used to estimate the unknown population proportion \(p\).

Descriptive and Inferential Roles

Statistics can play two broad roles.

Descriptive statistics organize and summarize the data actually observed.

Statistical inference uses sample information to reason about a broader population.

This chapter begins with descriptive methods, but the population-sample distinction prepares the foundation for later inference.

Target Population

The target population is the full group to which the study intends its conclusions to apply.

For example, a manufacturer may want conclusions about

all units produced on a particular assembly line during the next quarter.

The target population must match the scope of the claim being made.

Accessible Population

The accessible population is the portion of the target population that researchers can practically reach or identify.

The accessible population may differ from the target population because of:

This distinction can matter when assessing how broadly results should be generalized.

Sampling Frame

A sampling frame is the operational list, database, or mechanism used to identify members from which a sample is selected.

Examples include:

Ideally, the sampling frame closely matches the target population.

Coverage Problems

A sampling frame may fail to include some members of the target population or may include cases that do not belong.

These problems are forms of coverage error.

For example, an online-only survey may poorly cover members of a population who lack reliable internet access.

Sample Size

The number of cases in a sample is called the sample size and is commonly denoted by

\[ n. \]

If \(n=500\), then the sample contains \(500\) observed cases.

A larger sample can provide more information, but sample size alone does not guarantee quality.

A Large Biased Sample Can Still Be Misleading

Suppose a university wants to measure student satisfaction but surveys only students attending an optional honors reception.

Even if thousands of students respond, the sample may systematically differ from the full student population.

Representativeness depends on how the sample is obtained, not merely on how many observations are collected.

Representative Samples

A representative sample reflects relevant characteristics of the population well enough to support the intended analysis.

Representativeness does not mean that every sample characteristic must exactly equal the corresponding population characteristic.

Random variation is expected. The goal is to avoid systematic distortion that consistently favors some kinds of cases over others.

Sampling Variability

Different samples drawn from the same population will usually produce somewhat different statistics.

This natural sample-to-sample change is called sampling variability.

For example, two samples may produce

\[ \hat{p}_1=0.61 \]

and

\[ \hat{p}_2=0.64. \]

Neither difference automatically indicates an error. Sample statistics naturally vary.

Sampling Error

The difference between a sample statistic and its corresponding population parameter is often called sampling error.

For a sample mean,

\[ \text{sampling error}=\bar{x}-\mu. \]

This difference arises because only part of the population was observed.

Sampling error is distinct from mistakes in measurement, data entry, or study design.

Sampling Error Is Not the Same as Bias

Sampling error is ordinary variation caused by observing a sample rather than the entire population.

Bias is a systematic tendency for a method to favor some outcomes or misrepresent the population.

A well-designed random sample can still have sampling error, while a poorly designed sample can have both sampling error and bias.

Common Sources of Bias

Bias can arise from many sources, including:

Later statistical methods depend on understanding how the data were obtained.

Observational Studies and Experiments

In an observational study, researchers record variables without assigning treatments or interventions.

In an experiment, researchers deliberately assign treatments or conditions and observe the resulting outcomes.

Both designs contain populations, samples, cases, and variables, but the design affects what conclusions can reasonably be drawn.

Explanatory and Response Variables

When studying relationships between variables, one variable may be treated as an explanatory variable and another as a response variable.

The explanatory variable is used to help explain or predict changes in the response variable.

For example, a study might investigate whether hours of training help explain variation in task completion time.

Variables Do Not Automatically Establish Causation

If two variables are associated, that relationship does not by itself prove that one causes the other.

Statistical conclusions depend on:

The structure of the study matters as much as the numerical summaries.

Primary and Derived Variables

A primary variable is recorded directly from the case.

A derived variable is calculated from one or more recorded variables.

If a dataset records revenue and cost, then profit may be derived as

\[ \text{profit} = \text{revenue} - \text{cost}. \]

Derived variables can be useful, but their meaning depends on the quality and definitions of the variables from which they were constructed.

Units Matter

A quantitative variable should usually be recorded with its unit of measurement.

For example:

\[ 12 \]

is ambiguous, while

\[ 12\text{ minutes} \]

clearly identifies a duration.

Units help distinguish variables, interpret calculations, and prevent accidental comparisons of incompatible quantities.

Example: Customer Satisfaction Study

Suppose a retailer wants to estimate satisfaction among all customers who purchased during August.

The study might be organized as follows:

Example: Manufacturing Quality

A factory produces \(40{,}000\) components during one week. Inspectors randomly select \(400\) components and record whether each component passes a tolerance test.

Example: University Commute Times

Researchers want to understand commute times for all students at a university.

They survey \(750\) students and record each commute time in minutes.

Common Error: Confusing the Population with the Sample

If \(300\) voters are surveyed from a city with \(80{,}000\) registered voters, the \(300\) voters are not the population.

They are the sample.

The population is the full group about which the statistical claim is intended.

Common Error: Defining the Population Too Broadly

A survey conducted among customers of one store cannot automatically support conclusions about all consumers everywhere.

The target population must match the design and reach of the study.

Statistical conclusions should not extend beyond the population that the data collection process can reasonably represent.

Common Error: Treating the Sample Statistic as the Exact Parameter

Suppose

\[ \hat{p}=0.58. \]

This means \(58\%\) of the sampled cases had the characteristic.

It does not automatically mean that exactly \(58\%\) of the entire population has the characteristic.

The statistic is evidence about the parameter, not ordinarily an exact measurement of it.

Common Error: Assuming a Census Has No Problems

Even when every intended case is contacted, data quality can still be affected by:

Complete intended coverage does not guarantee perfect data.

Common Error: Calling Every Column a Measurement

A dataset column may be:

The statistical role of a variable depends on what the column represents.

A Reliable Study-Identification Procedure

  1. State the statistical question.
  2. Identify the full population relevant to that question.
  3. Identify the sample actually observed.
  4. Identify one observational unit or case.
  5. List the variables recorded for each case.
  6. Classify those variables by data type and measurement level when useful.
  7. Identify any sample statistics being calculated.
  8. Identify the corresponding population parameters when inference is intended.
  9. Check whether the sampling method reasonably connects the sample to the target population.

Practice 1: Population and Sample

A city wants to estimate the average monthly water use of its \(52{,}000\) households. It randomly selects \(800\) households and records their water use.

Identify the population and sample.

Practice 2: Cases and Variables

A researcher records the following information for \(250\) restaurants:

Identify the cases and variables.

Practice 3: Parameter or Statistic

Classify each quantity as a parameter or statistic.

  1. the mean age of all employees in a company;
  2. the mean age of \(120\) sampled employees;
  3. the proportion of all manufactured units that are defective;
  4. the proportion defective among \(500\) inspected units.

Practice 4: Identify the Sample Size

A poll contacts \(1{,}250\) adults selected from a national population.

What is the sample size?

Practice 5: Census or Sample?

Classify each data collection effort.

  1. Every employee in a 40-person company completes a survey.
  2. 200 customers are selected from a database of 25,000 customers.
  3. Every item in a shipment of 600 items is inspected.
  4. 50 students are selected from a school of 1,400 students.

Practice 6: Sampling Frame

A county wants to survey all households but selects addresses from a property-tax database.

What is the sampling frame? Give one possible coverage concern.

Practice 7: Population Definition

A business wants to study "customer spending."

Explain why this description is not yet a sufficiently precise population definition.

Practice 8: Statistic and Parameter

In a sample of \(300\) shipments, the mean delivery time is \(2.8\) days.

Identify the statistic and the corresponding population parameter.

Practice 9: Sampling Error

Suppose the true population mean is

\[ \mu=50 \]

and a sample produces

\[ \bar{x}=52. \]

Compute the sampling error using

\[ \bar{x}-\mu. \]

Practice 10: Full Study Description

A manufacturer wants to estimate the mean lifetime of all batteries produced during one production run. It randomly selects \(100\) batteries, measures each lifetime in hours, and computes a sample mean of \(1{,}240\) hours.

Identify:

Practice Answers

Practice 1

The population is all \(52{,}000\) households in the city. The sample is the \(800\) selected households.

Practice 2

Each restaurant is one case.

The variables are number of employees, average meal price, cuisine category, and weekly customer count.

Practice 3

  1. parameter;
  2. statistic;
  3. parameter;
  4. statistic.

Practice 4

The sample size is

\[ \boxed{n=1{,}250}. \]

Practice 5

  1. census;
  2. sample;
  3. census;
  4. sample.

Practice 6

The property-tax database is the sampling frame. One possible coverage concern is that households not represented correctly in the database may be omitted.

Practice 7

The description does not specify which customers, which business, what time period, or what eligibility conditions define the population.

Practice 8

The statistic is the sample mean

\[ \bar{x}=2.8\text{ days}. \]

The corresponding parameter is the true mean delivery time \(\mu\) for the target population of shipments.

Practice 9

\[ \bar{x}-\mu = 52-50 = \boxed{2}. \]

Practice 10

What to Remember

Where We Go Next

Once the population, sample, cases, and variables have been identified, the next task is to organize observed values so that patterns become visible.

The next lesson, Frequency Tables, develops methods for counting how often values or categories occur and organizing those counts into useful summaries.