How Does the Likelihood Ratio Test Compare Nested Models?
The likelihood-ratio test compares the log likelihood of a restricted model with a full model; the usual chi-square reference only makes sense under nested-model and approximation conditions.
learning
345 postsWhen OLS Assumptions Fail, How Can the Regression Line Still Be Used?
OLS is a useful baseline, but coefficient interpretation, inference, prediction, and diagnosis depend on assumptions about linearity, errors, independence, and variance.
How Does Logistic Regression Move From Probability to Thresholds and Error Costs?
Logistic regression estimates probabilities first. Classification decisions come later, when thresholds turn those probabilities into actions under real error costs.
Why Should Classification Start With Log Odds?
Logistic regression connects a linear score to a probability between 0 and 1. Understanding odds, log odds, and odds ratios prevents wrong coefficient interpretations.
Why Does MAP Turn Priors Into Regularization?
MAP maximizes the posterior. After taking logs, the prior becomes a penalty term, which connects Bayesian estimation to L1, L2, and regularized ML objectives.
How Do Matching and Weighting Make Observational Data More Experiment-Like?
Matching and weighting do not turn observational data into a true experiment. They try to make treatment and control comparable on observed variables.
Why Does MLE Ask Which Parameter Most Likely Generated the Data?
MLE fixes the observed data and compares which parameter values make that data most plausible; log likelihood turns products into sums and connects directly to negative log loss.
Why Does the Method of Moments Match Sample Moments to Population Moments?
Method of Moments matches sample moments to theoretical population moments, then solves for parameters. It is not always the most efficient method, but it builds the first intuition for parameter estimation.
Missing Data Is Not Just Blank Cells: How Does It Distort Statistics and Models?
Missing data can change representativeness, bias estimates, and mislead ML systems. The first question is why the data are missing.
How Do You Write an ML/AI Evaluation Report That Is More Than a Leaderboard Score?
A useful ML/AI evaluation report turns statistical evidence into a decision: ship, stage, roll back, or run more experiments.
What Do Residuals, Outliers, and Leverage Reveal About Model Failure?
Model diagnostics turn fitted errors into evidence: residual patterns, outliers, leverage, and influential points reveal how a model fails.
How Does Multivariate Analysis Organize Features That Move Together?
Multivariate analysis looks at features together. Covariance, correlation, and PCA reveal shared directions that univariate summaries miss.
What Kind of Optimal Test Is the Neyman-Pearson View About?
The Neyman-Pearson view treats a test as a decision rule: under a fixed Type I error rate alpha, choose the rejection region with the highest power.
What Assumptions Do Nonparametric Methods Relax, and What Do They Cost?
Nonparametric methods are not assumption-free. They relax fixed distributional forms, often gaining flexibility while paying in efficiency, interpretation, or overfitting risk.
How Should You Analyze NTU IM 114-115 Statistics Papers Without Memorizing Answers?
Past papers train question-analysis discipline, not fortune-telling. Each problem should return to data type, unknown quantity, statistical tool, calculation path, and contextual conclusion.
How Do You Avoid Missing Cells in Joint Distribution and PMF Transformations?
Joint PMF problems require listing every cell. Marginalization, conditional probability, and variable transformations are all sums or regroupings of the original cells.
Conditional Probability, Independence, and Bayes: What Viewpoint Is the Problem Switching?
Probability problems are often hard because the viewpoint changes. Define events first, then distinguish conditioning, independence, mutual exclusivity, and Bayes' rule.
How Do Samples, Statistics, and Sampling Distributions Differ?
A sample is the data, a statistic is a function of the sample, and a sampling distribution is the distribution of that statistic under repeated sampling.
How Do PMF, PDF, and CDF Turn Probability Into Computation?
Random variables turn uncertain outcomes into numbers. PMF, PDF, and CDF then let you compute discrete probabilities, continuous interval probabilities, thresholds, and model-score distributions.
How Should coef, SE, t, F, and R-Squared Be Read Together?
A regression table is not a p-value list: coef, SE, t, F, and R-squared answer effect size, uncertainty, single-coefficient tests, overall model signal, and in-sample explanation.