Is AI really the problem in your product development?

[EricZ]

@ben and I had a great convo about Intelligence metrics yesterday! I’ve articulated that thinking in our post here:

Intelligence Metrics: The User vs. Product Framework

Last week, @Bryan had posted a framework of UX Metrics, revealing the need for Intelligence metrics to address user interactions in AI product space. [image] So we took a stab at how we’re thinking about Intelligence metrics broadly. When developing intelligence metrics, we must address the multifaceted ways users engage with LLMs. By mapping the lifecycle of a prompt (Input and Output) against two distinct perspectives (User and Product), we identify four necessary quadrants for measurement…