Make learning comfortable
University Probability & Statistics / LEVEL 1 · DIFFICULTY 4/5
University Probability & Statistics
Read the prerequisite, study a worked example and justify each step in these selected university topics.
Choose a node to explore its lesson.
STAGE USTAT 1.1 · 8 PRACTICE PROBLEMS · 4 NEW-CONTEXT APPLICATIONS
Random Variables, PMFs, PDFs & CDFs
Useful preparation: Conditional Sample Spaces
Open this topic in the university library →
For a long equation, swipe sideways inside its formula box to see every term.
Meaning & notation
A random variable turns an uncertain outcome into a number. Its distribution assigns probabilities to sets of possible numbers. For isolated outcomes we add masses; for a variable with a density we integrate area. The cumulative distribution function unifies both descriptions by asking how much probability has accumulated at or below a chosen threshold.
- Probability mass function
- For a discrete random variable X, . Its values are nonnegative and sum to one over the possible values.
- Probability density function
- A density f is nonnegative and integrates to one. Integrating f over an interval gives its probability; f(x) itself is not the probability of one point.
- Cumulative distribution function
- (X at most x) is nondecreasing and right-continuous, approaching zero and one at the two infinite ends. It exists for every real-valued random variable.
Conditions before calculation
- A proposed mass or density must be nonnegative everywhere on its support and have total probability one. State the support and give zero mass or density outside it.
- A binomial count requires a fixed number n of independent trials, each with the same success probability p and two possible classifications. Sampling without replacement generally violates independence.
- For a variable with a density, each single point has probability zero. For any distribution, P( at most b)=; changing endpoint inclusion can matter for discrete distributions.
Why the method works
1. Choose the correct model
Countable outcome values suggest a mass function. Measurements modeled continuously may use a density. Mixed distributions can have both jumps and continuous portions, so do not force every distribution into one pure type.
2. Normalize before calculating
The total area or sum must equal one. A density may exceed one if its support is narrow enough; only integrated probabilities must remain between zero and one.
3. Use the CDF to subtract sets
Removing outcomes at or below a from outcomes at or below b leaves precisely the half-open interval.
Worked examples
EXAMPLE 1
Three independent sensors each signal with probability 0.2. Find the probability that exactly one signals.
Let X count signals. The fixed trial count, independence, and common probability give a binomial model.
There are three choices for the successful sensor. Each specific pattern has the same probability.
Multiply to get the mass; the four masses for counts zero through three also sum to one.
Conclusion: The probability is 0.384, provided the independence assumption is appropriate.
EXAMPLE 2
Let on [0,2] and zero elsewhere. Find c and P( at most 2).
Normalize the density by integrating over its entire support.
Integrate from zero to a threshold inside the support to get the CDF there.
Subtract the CDF values; the endpoints carry no mass.
Conclusion: The probability is . Complete the CDF with zero for and one for .
Pitfalls & counterexamples
Tempting claim: A probability density cannot exceed one.
Correction: Density is probability per unit length, so only its area is bounded by one.
Test the claim: The uniform density on [0,0.2] equals 5 but has total area 5 times .
Check your understanding
If X has a density, what is ?
Write a reason before opening the explanation. This reflection is not graded or saved.
Compare your reasoning
Zero.
A single point has zero interval length; a positive density value does not create a point mass.
Connect this idea
Distributions supply the weights for expectation and variance. Their CDFs support quantiles, simulation, and probability calculations used in statistical inference.
Reference reading
Use these texts to study the underlying definitions and theorems in greater depth. The explanations and examples above are written for Numerive.
Preview the eight practice prompts
A discrete variable has outcomes 0,1,2 with probabilities , , and p. Find p.
X is uniform on [0,6]. Find .
Two independent trials each succeed with probability . Find the probability both succeed.
A continuous variable has CDF values and . Find .
A reward variable has outcomes 0,1,2 with probabilities , , and p. Find p.
A waiting time X is uniform on [0,8]. Find .
Two independent quality checks each succeed with probability . Find the probability both succeed.
A continuous sensor value has CDF values and . Find .
STAGE USTAT 1.2 · 8 PRACTICE PROBLEMS · 4 NEW-CONTEXT APPLICATIONS
Expectation, Variance & the CLT
Useful preparation: Random Variables, PMFs, PDFs & CDFs
Open this topic in the university library →
For a long equation, swipe sideways inside its formula box to see every term.
Meaning & notation
Expectation is a probability-weighted balance point, not a promise about any single observation. Variance measures squared distance from that balance point. Averaging independent observations preserves their common expectation but reduces their variability. The central limit theorem adds a statement about the shape of the distribution of the standardized average, under specific assumptions.
- Expectation
- The mean mu=E[X] is the sum of x times its probability mass, or the integral of x times its density, when the expectation exists. E[g(X)] weights g(x) using the same distribution.
- Variance
- Variance is E[(X-mu) squared], equivalently E[X squared]-mu squared when the second moment is finite. Standard deviation is its square root and has the original measurement units.
- Standard error
- The standard error of an estimator is its sampling standard deviation. For the mean of n independent identically distributed observations with variance sigma squared, it is sigma divided by the square root of n.
Conditions before calculation
- Linearity of expectation does not require independence, but the relevant expectations must exist. Nonlinear functions generally cannot be moved outside expectation.
- Variances of independent variables add. For dependent variables, covariance terms must be included; multiplying a random variable by a constant multiplies its variance by that constant squared.
- The classical central limit theorem assumes independent identically distributed observations with finite positive variance. No fixed sample-size threshold guarantees a good normal approximation for every distribution.
Why the method works
1. Calculate moments with weights
First compute E[X], then E[X squared]. Squaring the mean after averaging is a different operation from averaging squared observations.
2. Track scaling
Adding a constant shifts every outcome equally, leaving spread unchanged. Multiplying distances by a multiplies squared distances by a squared.
3. Distinguish exact facts from approximation
The mean and variance of the sample mean are exact under the stated assumptions. Its approximate normal shape is the additional asymptotic conclusion.
Worked examples
EXAMPLE 1
X takes values 0, 2, and 5 with probabilities 0.2, 0.5, and 0.3. Find its mean and variance.
The probabilities sum to one. Compute the weighted mean.
Square outcomes before weighting to find the second moment.
Subtract the square of the mean.
Conclusion: The mean 2.5 need not be a possible observed value.
EXAMPLE 2
Independent repeated measurements have mean 40 and standard deviation 6. Find the spread of an average of 36 measurements, and describe a normal approximation.
The average retains expectation 40 by linearity.
Independence adds the 36 variances before division by 36 squared.
If the normal approximation is adequate, standardizing 38 and 42 gives -2 and 2.
Conclusion: The standard error is exactly 1; the probability approximation requires information about the underlying distribution and is exact in form if the measurements are normal.
Pitfalls & counterexamples
Tempting claim: The variance of 3X is three times the variance of X.
Correction: Variance scales by the square of the multiplier.
Test the claim: If X is equally likely to be -1 or 1, its variance is 1, whereas 3X has variance 9.
Check your understanding
Does increasing sample size make the original observations normally distributed?
Write a reason before opening the explanation. This reflection is not graded or saved.
Compare your reasoning
No.
The central limit theorem concerns the standardized mean, not a change in the population distribution.
Connect this idea
Standard errors quantify sampling uncertainty in confidence intervals and tests. Dependence, heavy tails, and biased sampling can prevent familiar averaging formulas from answering the intended question.
Reference reading
Use these texts to study the underlying definitions and theorems in greater depth. The explanations and examples above are written for Numerive.
Preview the eight practice prompts
X equals 1 or 5, each with probability . Find E[X].
A random variable X has variance 2. Find Var().
A population has standard deviation 6. For an independent random sample of size 4, what is the standard error of the sample mean?
X is binomial and . Find Var(X).
A fair reward X equals 2 or 6, each with probability . Find E[X].
A measurement variable X has variance 3. Find Var().
A process population has standard deviation 8. For an independent random sample of size 4, what is the standard error of the sample mean?
A binomial trial count X uses and . Find Var(X).
STAGE USTAT 1.3 · 8 PRACTICE PROBLEMS · 4 NEW-CONTEXT APPLICATIONS
Estimation, Tests & Regression
Useful preparation: Expectation, Variance & the CLT
Open this topic in the university library →
For a long equation, swipe sideways inside its formula box to see every term.
Meaning & notation
Inference connects observed data to a population or process through an explicit sampling model. An estimate identifies a plausible parameter value; an interval describes uncertainty from repeated sampling; a test measures incompatibility with a specified null model. A fitted regression line summarizes an association, while causal interpretation requires evidence about how the data were generated.
- Confidence interval
- A frequentist interval procedure covers the fixed population parameter in of repeated samples under its assumptions. The realized interval either contains that parameter or does not.
- P-value
- A p-value is the probability, assuming the null model and its assumptions, of a test statistic at least as incompatible with that model as the observed statistic, using the prespecified test direction.
- Least-squares regression
- A fitted line predicts the response from an explanatory variable by minimizing the sum of squared vertical residuals. A residual is observed response minus fitted response.
Conditions before calculation
- The one-sample t interval is exact for independent observations from a normal population with unknown positive variance. Large-sample approximations require suitable conditions and can be poor with heavy tails or severe skewness.
- Random sampling supports population generalization; random treatment assignment supports causal comparisons. A larger sample does not automatically remove selection bias or confounding.
- Classical regression t inference assumes a correct linear conditional mean, independent errors, constant error variance, and normal errors for exact small-sample results. Fitting a line alone does not establish these assumptions.
Why the method works
1. Name the parameter and design
State the target population, parameter, and sampling process before selecting a formula. Distinguish the standard deviation of observations from the standard error of an estimator.
2. Match the reference distribution
When estimating a normal-population mean using sample standard deviation s, uncertainty in s leads to a t reference with degrees of freedom.
3. Interpret limited evidence
A small p-value challenges the specified null model; it is not the probability that the null is true. Failure to reject does not prove equality. Report effect size and uncertainty alongside the decision.
Worked examples
EXAMPLE 1
An independent normal sample has , mean 12, and sample standard deviation 4. Construct mean interval and test mean 10 against a two-sided alternative.
The estimated standard error is 1. Use t with 15 degrees of freedom and critical value approximately 2.131.
Form the interval around the sample mean.
The statistic for mean 10 is 2, below the two-sided cutoff in magnitude; 10 also lies inside the matching interval.
Conclusion: Do not reject mean 10 at the level. This does not establish that the mean equals 10 or assign it probability of lying in this realized interval.
EXAMPLE 2
Fit a least-squares line to points (0,1), (1,2), and (2,2).
Compute the coordinate means, then centered sums.
The slope divides the cross-product sum by the predictor squared-deviation sum.
Check the residuals; they sum to zero because the model includes an intercept.
Conclusion: The fitted response is . These three observations support a descriptive fit, not a causal conclusion or verified error assumptions.
Pitfalls & counterexamples
Tempting claim: A p-value of 0.03 means there is probability the null hypothesis is true.
Correction: The probability is calculated conditional on the null model; it is not a posterior probability for that model.
Test the claim: Different prior beliefs about a rare effect can yield different posterior probabilities even when a test gives the same p-value.
Check your understanding
Does confidence interval contain of individual observations?
Write a reason before opening the explanation. This reflection is not graded or saved.
Compare your reasoning
No.
A mean confidence interval targets the population mean. Prediction and tolerance intervals answer different questions about observations.
Connect this idea
Inference builds on sampling distributions and standard errors. Regression also connects to orthogonal projection; diagnostics and study design determine whether the fitted mathematics answers the scientific question.
Reference reading
Use these texts to study the underlying definitions and theorems in greater depth. The explanations and examples above are written for Numerive.
Preview the eight practice prompts
A normal-mean interval uses estimate 50, known , and multiplier . Find its upper endpoint.
A z test compares mean 22 to null mean 20, with known and . Find the z statistic.
A fitted line predicts y-hat=. At the observed y is 14. Find the residual.
A significance test uses level and reports . Is ? Enter 1 for yes (reject at this level), 0 for no.
A normally modeled sample mean interval uses estimate 51, known , and multiplier . Find its upper endpoint.
A one-sample z test compares mean 23 to null mean 21, with known and . Find the z statistic.
A demand model predicts y-hat=. At the observed y is 15. Find the residual.
A pre-specified statistical test uses level and reports . Is ? Enter 1 for yes (reject at this level), 0 for no.

