I knew the textbook definition but stumbled when they pushed on when it fails.
Start by defining the Central Limit Theorem (CLT) in simple terms, emphasizing its role in statistical inference. Then outline the conditions for its applicability, and finally discuss scenarios where it fails, using concrete examples. Throughout, connect the explanation to practical data science applications, especially in A/B testing and metrics analysis at Amazon.
Pro tip: Mention that while the CLT is robust, in practice with large-scale data, you often rely on it for confidence intervals and hypothesis tests, but you should always check for skewness and outliers that can violate assumptions. Also, note that Amazon's massive datasets often make the CLT applicable, but for rare events or heavy-tailed metrics, alternative methods like bootstrapping are used.
State that the CLT says the sampling distribution of the sample mean approaches a normal distribution as sample size increases, regardless of the population's distribution, provided certain conditions hold.
List the key conditions: independent observations, identically distributed variables (or at least no extreme dependence), finite variance, and a sufficiently large sample size (often n ≥ 30, but depends on skewness).
Highlight its importance in constructing confidence intervals, hypothesis testing, and enabling parametric methods when the population distribution is unknown.
Discuss situations where CLT fails: heavy-tailed distributions (e.g., Cauchy) with infinite variance, strong dependence (e.g., time series with autocorrelation), small sample sizes with highly skewed data, and non-identically distributed data.
Give examples from A/B testing, where CLT underpins t-tests, but caution about metrics like revenue per user (heavy-tailed) where bootstrap or non-parametric methods are preferred.
AI-generated suggestions, not part of the candidate's original notes. May be inaccurate — verify before relying on them.
Start by defining Bayesian inference clearly, emphasizing its foundation in Bayes' theorem and the updating of prior beliefs with data. Then, discuss why practitioners prefer it, focusing on advantages like uncertainty quantification, incorporation of prior knowledge, and flexibility in complex models. Finally, connect these benefits to practical data science scenarios, especially in product analytics and decision-making under uncertainty.
Pro tip: Highlight that Bayesian methods naturally provide full posterior distributions, which are invaluable for quantifying uncertainty in business metrics and making risk-aware decisions—a key aspect in Amazon's data-driven culture.
Explain that Bayesian inference is a statistical method that updates the probability of a hypothesis as more evidence or information becomes available, based on Bayes' theorem.
Briefly contrast Bayesian inference with frequentist statistics, noting that Bayesian treats parameters as random variables and provides probability distributions for them.
Discuss why practitioners prefer Bayesian methods: incorporation of prior knowledge, natural uncertainty quantification, and ability to handle small sample sizes and complex hierarchical models.
Connect Bayesian inference to real-world data science tasks, such as A/B testing, customer lifetime value prediction, and personalization, where uncertainty estimates are crucial.
Mention computational challenges and the need for prior specification, showing a balanced understanding of when Bayesian methods are most appropriate.
AI-generated suggestions, not part of the candidate's original notes. May be inaccurate — verify before relying on them.
Recognize this as a classic Bayesian probability problem and apply Bayes' theorem to compute the posterior probability. Clearly define the events, calculate the components (true positive rate, false positive rate, base rate), and then combine them to find the probability of disease given a positive test.
Pro tip: Always sanity-check your result: the posterior probability should be much lower than the test's sensitivity because the disease is rare. Mentioning this intuition shows you understand the base rate fallacy, a common pitfall in data science.
Let D be the event that a person has the disease, and + be the event of a positive test. Write down P(D) = 0.001, P(+|D) = 0.95, and P(-|no D) = 0.98, so P(+|no D) = 0.02.
Use the law of total probability: P(+) = P(+|D)P(D) + P(+|no D)P(no D). Calculate P(no D) = 0.999, then P(+) = 0.95*0.001 + 0.02*0.999 = 0.00095 + 0.01998 = 0.02093.
Compute P(D|+) = P(+|D)P(D) / P(+) = (0.95*0.001) / 0.02093 ≈ 0.00095 / 0.02093 ≈ 0.0454, or about 4.54%.
Explain that despite the high test accuracy, the low base rate means a positive result only implies a ~4.5% chance of having the disease. Highlight the importance of prior probability in Bayesian reasoning.
AI-generated suggestions, not part of the candidate's original notes. May be inaccurate — verify before relying on them.