This question is basically five questions stapled together and the interviewer will notice if you skip one.
Use a STAR-based narrative that quantifies the risk of the flawed request, shows how you built a data-driven case and aligned allies to influence without authority, and transparently discusses the trade-offs you accepted. End with measurable outcomes and a reflection on what you'd change, plus the process improvements you institutionalized.
Pro tip: Frame your pushback as protecting the stakeholder's goals and the company's decision quality, not as being right—senior stakeholders respond better to 'here's how we get to a trustworthy answer faster' than to 'you're wrong.'
Briefly describe the stakeholder, the rushed request, and the specific flaw (e.g., underpowered test, biased metric, peeking). Quantify the risk: false positive rate, expected decision cost, or misleading lift.
Explain how you built credibility and alignment: 1:1s with the stakeholder, a written one-pager with simulations/power analysis, and enlisting a neutral ally (e.g., analytics lead or PM) to validate concerns.
Offer 2–3 paths (e.g., delay for proper power, run a holdout, use a proxy metric) with explicit trade-offs in time, cost, and risk. Let the stakeholder choose, but make the recommended path clear.
Report what happened: e.g., the flawed test would have shown a 5% lift but was actually flat; the corrected test saved $X or prevented a bad launch. Include the final decision and its impact.
State what you'd do differently (e.g., involve the stakeholder earlier, automate power checks) and the process changes you drove (e.g., pre-registration, guardrail metrics, review checklist).
AI-generated suggestions, not part of the candidate's original notes. May be inaccurate — verify before relying on them.