Meta·Data Scientist·Technical Phone Screen
- What value does a B2C chatbot product provide to retailers and to the platform, and is it worth launching?
- What metrics would you track for this chatbot from user, business, and model performance perspectives? Justify your choices.
- Since A/B testing isn't possible here, how would you size the opportunity and identify signals that the launch is working?
- You're given a visualization related to the chatbot's performance. What are its strengths and weaknesses?
“I started with the retailer side since that felt more concrete: faster response times, lower support costs, maybe better conversion if customers get answers quickly.”