Skip to content

All posts

Page 66 of 129

How Do Matching and Weighting Make Observational Data More Experiment-Like?

Matching and weighting do not turn observational data into a true experiment. They try to make treatment and control comparable on observed variables.

Why Does MLE Ask Which Parameter Most Likely Generated the Data?

MLE fixes the observed data and compares which parameter values make that data most plausible; log likelihood turns products into sums and connects directly to negative log loss.

Why Does the Method of Moments Match Sample Moments to Population Moments?

Method of Moments matches sample moments to theoretical population moments, then solves for parameters. It is not always the most efficient method, but it builds the first intuition for parameter estimation.

Missing Data Is Not Just Blank Cells: How Does It Distort Statistics and Models?

Missing data can change representativeness, bias estimates, and mislead ML systems. The first question is why the data are missing.

How Do You Write an ML/AI Evaluation Report That Is More Than a Leaderboard Score?

A useful ML/AI evaluation report turns statistical evidence into a decision: ship, stage, roll back, or run more experiments.

What Do Residuals, Outliers, and Leverage Reveal About Model Failure?

Model diagnostics turn fitted errors into evidence: residual patterns, outliers, leverage, and influential points reveal how a model fails.

How Does Multivariate Analysis Organize Features That Move Together?

Multivariate analysis looks at features together. Covariance, correlation, and PCA reveal shared directions that univariate summaries miss.

What Kind of Optimal Test Is the Neyman-Pearson View About?

The Neyman-Pearson view treats a test as a decision rule: under a fixed Type I error rate alpha, choose the rejection region with the highest power.

What Assumptions Do Nonparametric Methods Relax, and What Do They Cost?

Nonparametric methods are not assumption-free. They relax fixed distributional forms, often gaining flexibility while paying in efficiency, interpretation, or overfitting risk.

How Should You Analyze NTU IM 114-115 Statistics Papers Without Memorizing Answers?

Past papers train question-analysis discipline, not fortune-telling. Each problem should return to data type, unknown quantity, statistical tool, calculation path, and contextual conclusion.

How Do You Avoid Missing Cells in Joint Distribution and PMF Transformations?

Joint PMF problems require listing every cell. Marginalization, conditional probability, and variable transformations are all sums or regroupings of the original cells.

Conditional Probability, Independence, and Bayes: What Viewpoint Is the Problem Switching?

Probability problems are often hard because the viewpoint changes. Define events first, then distinguish conditioning, independence, mutual exclusivity, and Bayes' rule.

How Do Samples, Statistics, and Sampling Distributions Differ?

A sample is the data, a statistic is a function of the sample, and a sampling distribution is the distribution of that statistic under repeated sampling.

How Do PMF, PDF, and CDF Turn Probability Into Computation?

Random variables turn uncertain outcomes into numbers. PMF, PDF, and CDF then let you compute discrete probabilities, continuous interval probabilities, thresholds, and model-score distributions.

How Should coef, SE, t, F, and R-Squared Be Read Together?

A regression table is not a p-value list: coef, SE, t, F, and R-squared answer effect size, uncertainty, single-coefficient tests, overall model signal, and in-sample explanation.

Why Do Ridge, Lasso, and Weight Decay Make Models More Stable?

Regularization adds a preference against extreme parameters. Ridge, Lasso, and weight decay trade some training fit for a model that generalizes more reliably.

How Can Statistics and ML Evaluation Be Rerun to Reach the Same Conclusion?

A reproducible workflow preserves the evidence chain from data to conclusion. Results need data versions, code, seeds, environment, metrics, and raw outputs.

Why Can a Sample Say Something About a Population or Model?

Sampling makes sample statistics fluctuate, and standard error describes that fluctuation. This post separates SD, SE, sampling distributions, and CLT, then connects them to benchmark uncertainty.

How Do Sampling Distributions Become Exam-Ready Reasoning?

A sampling distribution describes how a statistic fluctuates under repeated sampling. Means, proportions, and variances each connect to common distributions used in intervals and tests.

After 53 Posts, How Do You Connect Statistics to ML, Causality, and Mathematical Statistics?

The series does not finish all of statistics. It gives beginners a working map for exams, ML/AI evaluation, causality, Bayesian thinking, time series, and mathematical statistics.