7 successes in 10
p̂ = 7/10
0.7.
The maximum likelihood estimate is the value of the parameter that makes the observed data most probable: , usually found from .
This page is easier if you are comfortable with:
For 7 heads in 10 tosses, and ; setting the derivative gives , and at the maximum. For Poisson counts : , so . Differentiating a logarithm is covered in the derivative of ln x, and the likelihood of independent data is a product, so taking logs turns it into a sum.
The principle gives the sample proportion for a binomial (the binomial distribution), the sample mean for a Poisson (the Poisson distribution), and closed forms for the exponential and normal cases in the exponential rate and the normal mean and variance. A second derivative test confirms a maximum (stationary points).
MLEs are consistent and asymptotically normal, with variance given by the inverse Fisher information (Fisher information). Competing models are compared by likelihood ratios (the likelihood ratio test statistic) or by penalised criteria (AIC and BIC). In Bayesian terms the MLE is the mode of the posterior with a flat prior (posterior ∝ likelihood × prior).
Maximum likelihood chooses the parameter value under which the observed data would be most probable.
The likelihood is largest at the observed proportion 0.7.
These examples are worked by hand, step by step, so you can compare your own working.
Find the MLE of for 7 heads in 10 tosses.
Find the MLE of for the data .
Find at .
A few situations come up again and again. Knowing them saves time and helps you spot answers that cannot be right.
p̂ = 7/10
0.7.
7 ln 0.7 + 3 ln 0.3
−6.1086.
λ̂ = x̄
3.
10 ln 0.5
−6.9315.
The MLE is the parameter value maximising L(θ), found by solving d(ln L)/dθ = 0. For binomial data p̂ = k/n; for Poisson data λ̂ = x̄.
7 successes in 10 trials. Find p̂.
Evaluate 7 ln p + 3 ln(1 − p) at p̂ = 0.7.
Data 2, 3, 4, 3. Find λ̂.
Log-likelihood at p = 0.5.
harder ✗
maximise ln L ✓
Same maximiser.
confusing ✗
probability of the data ✓
Function of θ.
assuming a maximum ✗
check concavity ✓
Could be a minimum.
always interior ✗
check the boundary ✓
e.g. uniform.
Try each one on paper, then open the answer. Use the solver above to see the full working.
0.25
0.75
2
-8.3178
-6.748
5
Unlimited fresh questions with instant marking. Choose a level, work it out on paper, then type your answer.
Solve: …
Choosing θ that makes the observed data most probable.
Products become sums.
k/n.
x̄.
MLE for the exponential rate.
MLE for the normal.
More in Advanced statistics and stochastic processes and the formula sheets.