The essential statistics for data science are descriptive statistics (mean, median, spread), distributions (especially the normal distribution), sampling and bias, correlation versus causation, hypothesis testing and p-values, confidence intervals, and regression. Understanding these helps you avoid misleading conclusions and evaluate models properly.
Why statistics matters
Tools can calculate anything. Statistics tells you whether the result means anything. Without it, analysts mistake noise for patterns, overclaim results and build models that fail in the real world.
1. Describing data
- Centre: mean, median and mode. The median is better when there are extreme values, such as salaries.
- Spread: range, interquartile range, variance and standard deviation.
- Shape: skewness and outliers. Always plot your data.
2. Distributions
The normal distribution appears often and underpins many methods. Others include binomial (counts of successes) and Poisson (events over time). See understanding the normal distribution.
3. Sampling and bias
Results from a sample only generalise if the sample represents the population. Online surveys, for example, exclude people without internet access. Biased data produces biased conclusions and biased AI models.
4. Correlation is not causation
Two variables moving together does not mean one causes the other. Ice-cream sales and drowning incidents both rise in summer because of heat, not because ice cream causes drowning. Controlled experiments and careful reasoning are needed to claim causation.
5. Hypothesis testing and p-values
A hypothesis test checks whether an observed effect is likely to be due to chance. A small p-value suggests the data would be unusual if there were no real effect. It does not measure how large or important the effect is. See statistical significance.
6. Confidence intervals
A range of plausible values for an estimate, which communicates uncertainty better than a single number.
7. Regression
Modelling the relationship between variables, the bridge between statistics and machine learning.
Common traps
| Trap | Example |
|---|---|
| Survivorship bias | Studying only successful startups |
| Simpson's paradox | A trend reverses when data is split into groups |
| P-hacking | Testing many things until something looks significant |
| Ignoring base rates | Misreading medical test accuracy |
Our statistics tutoring and machine learning course teach these concepts with real datasets.
Frequently asked questions
How much maths do I need for data science?
Solid statistics and algebra are essential; some linear algebra and calculus help for machine learning.
Is A-Level or FSc statistics enough to start?
It is a good foundation. You will extend it with applied practice.
Should I learn statistics before Python?
Learn them together. Coding examples make statistical ideas concrete.
