Not everything needs an LLM: A framework for evaluating when AI makes sense
Question: What product should use machine learning (ML)? Project manager answer: Yes.
Is your AI product actually working? How to develop the right metric system
In my first stint as a machine learning (ML) product manager, a simple question inspired passionate debates across functions and leaders: How do we know if this product is actually working? The product in question that I managed catered to both internal and external customers. The model enabled internal teams to identify the top issues faced by our customers so that they could prioritize the right set of experiences to fix customer issues. With such a complex web of interdependencies among internal and external customers, choosing the right metrics to capture the impact of the product was critical to steer it towards success.