Product Analytics Practice Cases

9 practice cases

• Investigating Contradictory Streaming Engagement Metrics

  After launching a revamped 'Recommended for You' section on a streaming service like Hulu, overall daily watch time increased by 5%. However, you also observe a 3% drop in the completion rate for the first episode of *new* series. How would you investigate this seemingly contradictory outcome?

• Conflicting A/B Test Results: Engagement Up, Conversion Down

  You've just launched a new recommendation algorithm for an e-commerce platform. Initial A/B test results show a statistically significant 5% *increase* in users adding items to their cart, but a 2% *decrease* in overall purchase conversion rate. How would you analyze this situation?

• Analyzing Impact of New Recommendation Feature on Food Delivery App

  A food delivery app just launched a new 'Recommended for You' section on its homepage. How would you analyze its impact on user engagement and order value?

• Investigating low adoption for a new feature on a music streaming app

  Your music streaming app recently launched a 'curated playlist sharing' feature, but weekly usage data indicates only 5% of daily active users are engaging with it. How would you approach understanding the reasons behind this low adoption?

• Conflicting Feature Impact: Engagement vs. Revenue

  Our new 'Personalized Recommendations' feature on a premium music streaming app led to a 10% increase in *daily track plays per user* but a 5% *decrease in revenue from premium subscription upsells* for free-tier users. How would you investigate this conflicting data and form a recommendation?

• Investigating a DAU Drop Post-App Update for Spotify's Music Discovery

  How would you investigate a sudden 5% drop in daily active users (DAU) for the mobile version of Spotify's music discovery features, observed right after a recent app update?

• Investigating a Drop in Under-18 Session Duration Post-Algorithm Update

  A recent algorithm update on the 'For You Page' of a short-form video app (like TikTok) led to a 15% decrease in the average session duration for users under 18. How would you investigate this decline?

• Analyze conflicting engagement metrics for a new feature

  For a social media platform like Instagram, a recent launch of a new 'Stories' feature saw daily story views increase by 25%. However, daily active users remained flat and overall app session duration decreased by 5%. How would you analyze this discrepancy to understand the true impact of the featur

• Analyze Conflicting Metrics Post-Algorithm Launch in Short-Form Video

  Our short-form video app recently launched a new content recommendation algorithm. While we've seen a 15% increase in daily unique creators uploading, the average view duration for newly uploaded content has decreased by 10%. How would you analyze this seemingly contradictory outcome to understand t