What Is Inferential Statistics?
The word "infer" means to derive a conclusion from evidence. In statistics, that evidence is a sample — a subset of the population you actually measure. Because measuring every individual in a population is usually impossible (or prohibitively expensive), inferential statistics gives researchers a rigorous, probability-based method for making general claims from limited data.
Inferential statistics stands on two main legs: estimation (using a sample to estimate population parameters like the mean or proportion) and hypothesis testing (using a sample to decide whether a specific claim about the population is supported by the data). Both methods produce results that come with a quantified level of uncertainty — expressed as confidence levels, p-values, or margins of error.
The mathematical foundation comes from probability theory and the behavior of sampling distributions. Researchers at the Pew Research Center use these tools to generalize from a few thousand survey responses to the views of entire national populations. The same logic appears in clinical trials, A/B testing, quality control, and machine learning validation. For the underlying mathematical framework, the NIST Statistical Engineering Division maintains authoritative reference material.
- Population: The complete set of individuals or observations you want to draw conclusions about
- Sample: A subset of the population, actually measured or observed
- Parameter: A numerical characteristic of the population (e.g., population mean μ) — usually unknown
- Statistic: A numerical characteristic calculated from the sample (e.g., sample mean x̄) — used to estimate parameters
- Sampling error: The natural difference between a sample statistic and the population parameter it estimates
- Inference: A probability-based conclusion about the population drawn from sample data
Inferential vs. Descriptive Statistics
The distinction between these two branches is one of the most frequently tested concepts in introductory statistics. Both use the same data, but they answer different questions. The descriptive statistics section of Statistics Fundamentals covers summarizing data in detail; this page focuses on what comes next.
| Feature | Descriptive Statistics | Inferential Statistics |
|---|---|---|
| Purpose | Summarize the data you have | Generalize beyond the data you have |
| Scope | Describes only the sample (or population if fully measured) | Makes claims about the population from a sample |
| Key tools | Mean, median, mode, SD, charts, frequency tables | Confidence intervals, p-values, hypothesis tests |
| Uncertainty | None — it describes exactly what is in the data | Always present — expressed through probability |
| Question answered | "What does my data look like?" | "What does my data tell me about the population?" |
| Example | The average score in this class is 74.2 | The average score for all students nationwide is likely between 71 and 77 (95% CI) |
Descriptive and inferential statistics work together. You always start with description — compute the sample mean, check the distribution, identify outliers — and then use inferential methods to generalize. Skipping the descriptive step before running inferential tests is one of the most common mistakes in applied statistics.
Population, Sample, Parameters, and Statistics
Inferential statistics rests on a precise distinction between what you can measure and what you want to know. Understanding this four-way vocabulary is necessary before any inferential procedure makes sense.
Population vs. Sample
A population is the entire group you want to study — every adult in a country, every unit produced by a factory, every patient with a specific diagnosis. A sample is the subset you actually observe. The key requirement: the sample must be drawn randomly so that every member of the population has a known probability of being selected. Non-random samples produce biased estimates that inferential methods cannot correct. The full treatment of this distinction is covered on the population vs. sample page.
Parameters vs. Statistics
A parameter is a fixed (but usually unknown) numerical characteristic of the population. The population mean is written μ (mu); the population standard deviation is σ (sigma); the population proportion is π or p. A statistic is computed from the sample and used to estimate the corresponding parameter. Sample mean: x̄; sample standard deviation: s; sample proportion: p̂.
| Concept | Population (Parameter) | Sample (Statistic) |
|---|---|---|
| Mean | μ (mu) | x̄ (x-bar) |
| Standard deviation | σ (sigma) | s |
| Proportion | π or p | p̂ (p-hat) |
| Variance | σ² | s² |
| Correlation | ρ (rho) | r |
| Regression slope | β (beta) | b |
This notation matters because statistics are calculated from data (they are known), while parameters are what the statistics estimate (they are unknown). All inferential methods are ultimately about using statistics to draw conclusions about parameters. For a full breakdown of this distinction, see the statistic vs. parameter page.
Sampling Distributions and the Central Limit Theorem
The mathematical bridge between a sample and a population is the sampling distribution — the probability distribution of a statistic (like the sample mean) across all possible samples of the same size from the same population. You never actually collect all possible samples; the sampling distribution is a theoretical construct that describes how sample statistics would vary if you did.
Standard Error
The standard deviation of the sampling distribution of the mean is called the standard error (SE). It measures how much sample means typically vary from the population mean:
σ = population standard deviation
n = sample size
SE = standard error of the mean
When σ is unknown (the typical case), we estimate SE using the sample standard deviation: SE = s / √n. A larger sample produces a smaller standard error — meaning sample means cluster closer to the true population mean, which is why larger samples yield more precise estimates. The full derivation and examples are on the sampling distributions page.
The Central Limit Theorem (CLT)
The Central Limit Theorem is arguably the most important result in applied statistics. It states: regardless of the shape of the population distribution, the sampling distribution of the sample mean approaches a normal distribution as sample size n increases, with mean μ and standard deviation σ/√n.
For most populations, n ≥ 30 is sufficient for the sampling distribution of x̄ to be approximately normal. For strongly skewed populations or those with heavy tails, n ≥ 50 or more may be needed. For normally distributed populations, the CLT applies at any sample size.
Why does this matter? Because virtually all classical inferential procedures — z-tests, t-tests, confidence intervals — assume the sampling distribution of the statistic is approximately normal. The CLT is what makes those procedures valid even when the raw data are not normally distributed. For deeper coverage, see the Central Limit Theorem page.
Estimation: Point Estimates and Confidence Intervals
Estimation uses sample data to assign values to unknown population parameters. There are two forms: a point estimate (a single number) and an interval estimate (a range of plausible values).
Point Estimates
A point estimate is a single value computed from the sample that serves as the best single guess for the population parameter. The sample mean x̄ is the point estimate for μ; the sample proportion p̂ estimates the population proportion π. Point estimates are useful but incomplete — they give no indication of how precise the estimate is. That's where confidence intervals come in.
Confidence Intervals
A confidence interval (CI) is an interval computed from sample data that is likely to contain the true population parameter. A 95% CI means: if you repeated the sampling process many times and built a CI each time, 95% of those intervals would contain the true parameter.
x̄ = sample mean
z* = critical z-value for confidence level
σ = population SD (use s when unknown)
n = sample size
The critical value z* depends on the confidence level: 1.645 for 90%, 1.960 for 95%, and 2.576 for 99%. When σ is unknown and n is small, replace z* with the appropriate t* from the t-distribution table.
A hospital samples 64 patients and records a mean recovery time of x̄ = 8.4 days, with a sample standard deviation of s = 2.1 days. Construct a 95% confidence interval for the population mean recovery time.
Identify values: x̄ = 8.4, s = 2.1, n = 64, confidence level = 95% → z* = 1.960
Calculate SE: SE = s / √n = 2.1 / √64 = 2.1 / 8 = 0.2625
Calculate margin of error: ME = z* × SE = 1.960 × 0.2625 = 0.515
Build the interval: CI = x̄ ± ME = 8.4 ± 0.515 → (7.885, 8.915)
✅ Conclusion: We are 95% confident that the true mean recovery time for the population lies between 7.89 and 8.92 days. The margin of error is ±0.52 days.
For a more detailed treatment — including intervals for proportions, differences between means, and the relationship between confidence intervals and hypothesis tests — see the confidence intervals guide and the confidence interval for the mean page.
Hypothesis Testing: The Core Framework
Hypothesis testing is the other major branch of inferential statistics. Where estimation asks "what is the population parameter?", hypothesis testing asks "is a specific claim about the population supported by the data?" The answer is always probabilistic — never certain.
Hypothesis testing is a formal procedure that uses sample data to decide whether there is enough evidence to reject a default assumption (the null hypothesis) in favor of an alternative claim.
The 5-Step Procedure
State the Hypotheses
Write the null hypothesis (H₀) — the default claim, typically "no effect" or "equals a specific value" — and the alternative hypothesis (H₁ or Hₐ) — what you're trying to show. Example: H₀: μ = 100 vs. H₁: μ ≠ 100 (two-tailed) or H₁: μ > 100 (one-tailed right).
Set the Significance Level (α)
α is the maximum probability of rejecting H₀ when it is actually true (Type I error rate). The conventional choice is α = 0.05 (5%). Medical and pharmaceutical research often uses α = 0.01; exploratory research may use α = 0.10. Set α before collecting data.
Calculate the Test Statistic
Convert the sample data into a single number (z, t, F, or χ²) that measures how far the observed result is from what H₀ predicts, measured in units of standard error. A larger absolute value means the data is further from the null hypothesis prediction.
Find the p-value
The p-value is the probability of observing a test statistic as extreme as the one calculated, assuming H₀ is true. Use statistical tables or software. For a z-test, use the z-table; for a t-test, use the t-distribution table.
Make a Decision and State the Conclusion
If p < α: reject H₀ — the result is statistically significant. If p ≥ α: fail to reject H₀ — insufficient evidence. Always write the conclusion in plain language referencing the original research question. Never write "we accept H₀."
p-values, Significance, and What They Mean
The p-value is one of the most misunderstood numbers in statistics. What it is: the probability of getting your sample result (or a more extreme one) if the null hypothesis were true. What it is not: the probability that H₀ is true, the probability that your result occurred by chance, or a measure of how important the effect is. Statistical significance only means the result is unlikely under H₀ — not that it is practically meaningful. For a dedicated treatment, see the p-values page.
Type I and Type II Errors
| Decision | H₀ Is Actually True | H₀ Is Actually False |
|---|---|---|
| Reject H₀ | Type I Error (α) | Correct Decision (Power) |
| Fail to Reject H₀ | Correct Decision (1 − α) | Type II Error (β) |
A Type I error is rejecting H₀ when it is true — a false positive. Its rate is α. A Type II error is failing to reject H₀ when it is actually false — a false negative. Its rate is β. The power of a test (1 − β) is the probability of correctly detecting a real effect. Power increases with larger sample sizes, larger effect sizes, and higher α values. For more, see the Type I and Type II errors page and the statistical power guide.
Common Inferential Statistical Tests
Different research questions and data types require different inferential tests. The table below summarizes the most commonly used tests. Use the decision guide in the next section to select the right one for your situation. For the full methodology behind selecting tests, see the statistical test selector.
| Test | What It Tests | When to Use | Key Statistic |
|---|---|---|---|
| One-Sample Z-Test | Whether a population mean equals a specified value | σ known; n ≥ 30 | z = (x̄ − μ₀) / (σ/√n) |
| One-Sample T-Test | Whether a population mean equals a specified value | σ unknown; any n | t = (x̄ − μ₀) / (s/√n); df = n−1 |
| Two-Sample T-Test | Whether two population means differ | Two independent groups; σ unknown | t = (x̄₁ − x̄₂) / SE_pooled |
| Paired T-Test | Whether means differ across matched pairs | Before/after; matched pairs | t = d̄ / (s_d/√n) |
| Chi-Square Test | Whether observed and expected frequencies differ | Categorical data; counts in cells | χ² = Σ (O−E)² / E |
| One-Way ANOVA | Whether 3+ group means are equal | One categorical predictor; continuous outcome | F = MS_between / MS_within |
| Pearson Correlation | Strength of linear relationship between two continuous variables | Both variables continuous; linear relationship | r ranges from −1 to +1 |
| Simple Linear Regression | Whether one continuous variable predicts another | One predictor; continuous outcome | ŷ = b₀ + b₁x |
| Mann-Whitney U | Whether two groups differ in rank distribution | Non-parametric alternative to independent t-test | U statistic |
| Wilcoxon Signed-Rank | Whether paired differences are symmetric around zero | Non-parametric alternative to paired t-test | W statistic |
Z-Test
The one-sample z-test is used when you want to know whether a sample mean differs from a hypothesized population mean and when the population standard deviation σ is known. In practice, σ is rarely known, so the z-test is most common when n > 30 and the sample standard deviation is a reliable estimate of σ. Detailed instructions and tables: one-sample z-test guide.
T-Tests
T-tests are the workhorse of inferential statistics. Use the one-sample t-test when testing whether a sample mean equals a hypothesized value and σ is unknown. Use the two-sample t-test (independent samples) to compare the means of two separate groups. Use the paired t-test when the same subjects are measured twice (before/after designs or matched pairs). The key difference from the z-test is that t-tests use the t-distribution with n−1 degrees of freedom, which has heavier tails to account for the additional uncertainty of estimating σ from s. See: one-sample t-test, two-sample t-test, paired t-test.
A school tests two teaching methods. Group A (n=25) scores x̄=78, s=10; Group B (n=25) scores x̄=83, s=11. Do the groups differ at α = 0.05?
Hypotheses: H₀: μ_A = μ_B | H₁: μ_A ≠ μ_B (two-tailed)
Pooled SE: SE = √(s₁²/n₁ + s₂²/n₂) = √(100/25 + 121/25) = √(4 + 4.84) = √8.84 ≈ 2.973
Test statistic: t = (78 − 83) / 2.973 = −5 / 2.973 ≈ −1.682; df ≈ 48
p-value: For t = −1.682, df = 48, two-tailed: p ≈ 0.099. The t-table gives the critical value t* ≈ ±2.011.
Decision: p = 0.099 > α = 0.05 → Fail to reject H₀. |t| = 1.682 < 2.011.
✅ Conclusion: At α = 0.05, there is insufficient evidence that the two teaching methods produce different mean scores. The 5-point difference is not statistically significant at this sample size.
Chi-Square Test
The chi-square (χ²) test applies to categorical data. The chi-square goodness-of-fit test checks whether observed category frequencies match expected frequencies. The chi-square test of independence checks whether two categorical variables are related in a contingency table. Unlike t-tests, chi-square tests use counts, not means — making them the right tool for survey data with categorical responses, genetics studies, and quality control checks. For full coverage: chi-square test guide and chi-square table.
ANOVA (Analysis of Variance)
When the research question involves three or more group means, the one-way ANOVA is the appropriate test. Running multiple t-tests between every pair of groups would inflate the Type I error rate (a problem called multiple comparisons). ANOVA tests the null hypothesis that all group means are equal using a single F-statistic that compares between-group variance to within-group variance. If ANOVA rejects H₀, a post-hoc test like Tukey's HSD identifies which specific groups differ. See: ANOVA guide and Tukey HSD.
Correlation and Regression
Pearson correlation (r) measures the direction and strength of the linear relationship between two continuous variables. Inferential statistics tests whether r is significantly different from zero — that is, whether there is a real relationship in the population, not just a coincidental pattern in the sample. Simple linear regression goes further: it estimates a linear equation (ŷ = b₀ + b₁x) that predicts the outcome variable from the predictor, and tests whether the slope b₁ is non-zero. For details, see the Pearson correlation and simple linear regression pages. The t-test vs. ANOVA comparison and ANOVA vs. regression pages cover how these methods relate.
Choosing the Right Inferential Test
Selecting the wrong statistical test is one of the most consequential errors in applied research — it can produce invalid p-values and wrong conclusions. The decision depends on your research question, data type, number of groups, and whether the data meet parametric assumptions. Use the guide below, then verify with the interactive test selector.
Statistical Test Selection Guide
Additional comparisons: t-test vs. z-test, chi-square vs. t-test, parametric vs. nonparametric tests, and one-tailed vs. two-tailed tests.
Assumptions of Inferential Statistics
Every inferential test rests on a set of assumptions. Violating them does not always invalidate the analysis, but it does change how results should be interpreted. Checking assumptions before running any test is not optional — it is standard practice.
| Assumption | What It Means | How to Check |
|---|---|---|
| Random sampling | The sample was drawn randomly from the population | Study design review; examine sampling method |
| Independence | Each observation is independent of others | Study design; no repeated measures without accounting for them |
| Normality | The sampling distribution of the statistic is approximately normal | Shapiro-Wilk test, Q-Q plot, histogram; CLT covers this for large n |
| Homogeneity of variance | Groups have equal population variances (for t-tests, ANOVA) | Levene's test; if violated, use Welch's t-test or Welch's ANOVA |
| Adequate sample size | n is large enough for the CLT to apply (n ≥ 30 for most cases) | Power analysis prior to data collection |
| Scale of measurement | Data meets the measurement level required by the test (interval/ratio for t-tests; nominal/ordinal for chi-square) | Review measurement scale of each variable |
For normality testing, see the normality tests page. For variance assumptions, see the equal vs. unequal variance page. For overall assumption checking, see the statistical assumptions guide.
Real-World Applications of Inferential Statistics
Inferential statistics is not confined to academic textbooks. It drives decisions in every field that works with data — which is most of them.
Medicine & Clinical Trials
Drug efficacy is established through randomized controlled trials. A two-sample t-test or ANOVA determines whether a treatment group recovers faster than a control group. The FDA requires statistically significant evidence before approving a drug.
Political Polling
Election polls sample 1,000–2,000 voters and use confidence intervals to report results with a ±margin of error, generalizing to an electorate of millions. Sample size determines the precision of the estimate.
A/B Testing in Tech
Product teams test two versions of a feature (control vs. treatment) and use a two-proportion z-test to determine whether the difference in conversion rate is due to the change or random variation.
Manufacturing & Quality Control
A one-sample t-test checks whether the mean weight of sampled products meets specification. Control charts use inferential logic to flag processes that have shifted out of control.
Psychology & Education
Researchers use paired t-tests to measure whether an intervention changes test scores, ANOVA to compare multiple teaching methods, and regression to model how study time predicts GPA.
Finance & Economics
Economists test whether policy changes affect unemployment rates. Financial analysts use regression to model the relationship between interest rates and equity returns.
Confidence Interval Calculator
Enter your sample data below to compute a confidence interval for the population mean. The calculator uses the z-distribution when n ≥ 30 and the t-distribution for smaller samples. Results include the standard error, margin of error, and the interval itself.
📊 Confidence Interval for the Population Mean
Entity & Formula Glossary
The table below defines the core terms, symbols, and formulas used in inferential statistics. This glossary is structured for quick reference and is organized to be useful both as a learning resource and as a lookup guide during analysis.
| Term / Symbol | Definition | Formula / Notes |
|---|---|---|
| μ (mu) | Population mean — the true average of all values in the population | Unknown; estimated by x̄ |
| x̄ (x-bar) | Sample mean — the average of observed sample values | x̄ = (Σxᵢ) / n |
| σ (sigma) | Population standard deviation — spread of population values | Unknown; estimated by s |
| s | Sample standard deviation — estimated spread from sample | s = √[Σ(xᵢ−x̄)² / (n−1)] |
| SE | Standard error — standard deviation of the sampling distribution | SE = σ/√n ≈ s/√n |
| n | Sample size — number of observations in the sample | Larger n → smaller SE → more precise inference |
| N | Population size — total number of members in the population | Usually unknown or very large |
| H₀ | Null hypothesis — the default claim being tested | e.g., H₀: μ = 50 or H₀: μ₁ = μ₂ |
| H₁ / Hₐ | Alternative hypothesis — the claim you're testing for | Can be one-tailed or two-tailed |
| α (alpha) | Significance level — the pre-set Type I error rate | Conventionally 0.05, 0.01, or 0.10 |
| β (beta) | Probability of a Type II error — false negative rate | Power = 1 − β |
| p-value | Probability of the observed data (or more extreme) under H₀ | Reject H₀ when p < α |
| CI | Confidence interval — range of plausible values for a parameter | CI = x̄ ± z* × SE |
| ME | Margin of error — half-width of the confidence interval | ME = z* × SE |
| df | Degrees of freedom — free values in a calculation | One-sample t: df = n−1; chi-square: df = (r−1)(c−1) |
| z | Z-statistic — test statistic for z-test | z = (x̄ − μ₀) / (σ/√n) |
| t | T-statistic — test statistic for t-test | t = (x̄ − μ₀) / (s/√n) |
| F | F-statistic — ratio of variances; used in ANOVA | F = MS_between / MS_within |
| χ² | Chi-square statistic — used for categorical data tests | χ² = Σ(O−E)²/E |
| r | Pearson correlation coefficient | r ∈ [−1, +1]; r = 0 means no linear relationship |
| CLT | Central Limit Theorem — x̄ is approximately normal for large n | Applies when n ≥ 30 for most populations |
Common Mistakes in Inferential Statistics
Errors in interpreting inferential results are common even in published research. The table below addresses the most consequential ones, drawing on guidance from the American Statistical Association's statement on p-values.
| Common Mistake | Why It's Wrong | The Correct Interpretation |
|---|---|---|
| "p = 0.03 means there's a 3% chance H₀ is true" | p-values say nothing about the truth probability of H₀ | p = 0.03 means: if H₀ were true, you'd see this result only 3% of the time by chance |
| "We accept H₀" after a non-significant result | Failing to reject H₀ is not the same as proving it true | "Fail to reject H₀ — insufficient evidence against the null" |
| "Statistically significant = practically important" | With large n, trivially small effects become significant | Always report effect size (Cohen's d, η², r²) alongside the p-value |
| "p > 0.05 means no effect exists" | A non-significant result may reflect low power, not absence of effect | The test may lack power to detect the effect; check power and sample size |
| Running many tests without correction | Multiple comparisons inflate Type I error (false positive rate) | Apply Bonferroni correction or control the false discovery rate. See Bonferroni correction |
| Selecting α after seeing the data (p-hacking) | Invalidates the test; inflates Type I error | Set α before data collection; pre-register the analysis plan |
Frequently Asked Questions
p ≤ 0.05 is commonly considered statistically significant.
Confidence Interval = Point Estimate ± Margin of Error. Larger samples produce narrower and more precise confidence intervals.