Excited to introduce our new member of the forum Nivi Singh (@nivi_singh-frenger):
“I am a UX researcher. I am helping creating metrices and filling in the gaps in user needs. I would benefit from the discussions and contribute with sharing my experiences.”
What’s the hardest part about measuring design impact in your work?
“The main challenge that we are struggling with is defining the right metrics. Some decision makers are pushing to show example such as – we brought down the steps/clicks in a task from 5 to 3. Not really understanding the nuances of why or why not reducing the number of clicks might make a difference (good or bad) to the user. They think in hard numbers, cause that’s what they measure for their business metrices. We mostly run qualitative research, a big portion of which is exploratory research. And of course, with qualitative research, they are unable to see the impact that exploratory& qualitative research bring to them in hard numbers except when we are able to show them before and after data gathered from our analytics tools. There is also no alignment between user-centered metrics and business metrices, business stakeholders prioritize and think in terms of revenue or efficiency.
The other big challenge is the time lag between design and impact. There are usually 6 months to a year before a feature is launched after research, and it becomes difficult to track. Additionally, stakeholders often expect short-term proof, while design impact may be cumulative and slow-burning.”
Appreciate the thoughtful response Nivi, looking forward to seeing what else you have to share!
A big welcome to our new member of the community Udhay Padmanabhan (@udhaya_kumar_padmana)!
“Sharing my 3 decade journey in product design, product management, scaling multi-billion dollar tech and creative firms. Mentor, coach and learn from others.”
What’s the hardest part about measuring design impact in your work?
“To me, the hardest part (probably a trillion dollar solution) of measuring design impact is isolating the actual impact of design - this is invisible and can’t be spreadsheeted ( I invented this word).
You ever try to prove that design made something better? It’s like trying to convince my friends the party was great because I picked the playlist — not because someone brought free beers and pizzas. “
Hey everyone! Thanks for adding me, @Bryan . I’m late to introduce myself, but here goes I’m Hanna, a multidisciplinary design leader based in Warsaw. I focus on design strategy & ops and on building and scaling design teams. Happy to be here and excited to meet everyone.
I’m just gonna say, “Led transportation system redesign for US healthcare providers.” …is a fascinating overlap, having worked on transportation systems and health systems. I’ve never seen this!
Thanks! Same here: I was super intrigued going in, with a background in both transportation and healthcare That mix helped a ton. In practice, we built something like an “Uber for NEMT (Non-Emergency Medical Transportation)”: a platform for private providers serving seniors and riders with special needs.
@Hanna This is so cool! Not only does it sound like an interesting product to build, but it also provides an innovative service that communities actually need. Can’t wait to hear more
A warm welcome to the community for Steven Seal (@steven_seal):
“I come from a Service Design and CX background and have been trying, as we all do, to align business goals with user needs. I’d like to think and discuss bigger pictures beyond (but including!) product and consider how we think about associated systems KPIs and metrics also. It’s something I’m working on and have found Helio content increasingly useful.”
What’s the hardest part about measuring design impact in your work?
“So there are probably 2 things. 1st: The data split we actually need to understand the complete user journey isn’t there yet, ie: Where a customer has come, the journey of the product they bought (or returned) right across the ecosystem, from start to finish.
2nd, CX has many ’soft’ long term metrics that I feel are impossible to measures accurately, and definitely not strong enough to ’stand up in court’.
However, I feel the rise of agents AI dictates a better approach to data analysis and data set up which I hope will treat to give us the next generation of data to drive better design and impact!”
Excited to connect with everyone in the group. I am the head of advisory for Network Science - an AI consulting firm. Happy to discuss about AI product design. The part that interests me most now is the consumption layer for AI in enterprises. You can connect with me here: https://www.linkedin.com/in/nikhil-mahen/. Looking forward to hearing from everyone.
“I am a CX expert, can contribute to the community, Certified CCXP, XMP”
What’s the hardest part about measuring design impact in your work?
“The hardest part about measuring design impact is quantifying the perception and behavioral changes we achieve through design and, subsequently, how those changes directly impact ROI. It’s crucial to understand the business context to effectively connect design efforts with tangible business outcomes.”
Great to have you Praveen, looking forward to hearing more from you!
Praveen, welcome! “It’s crucial to understand the business context to effectively connect design efforts with tangible business outcomes.” - I think @Bryan has a few cool ideas around making this idea more tangible.
Snaps and claps for @ed_orozco who joined us today
Ed has 11 years of expertise working with B2B startups and navigating product-market fit. (Kudos) woot!
What’s the hardest part about measuring design impact in your work?
The hardest part about measuring design impact is connecting discrete outcomes to lagging indicators such as churn or customer retention or even growth.
Especially in the case of startups, where usage numbers are not always statistically significant, and you have to rely on qualitative feedback.
What’s the hardest part about measuring design impact in your work?
I’m Hanna, a multidisciplinary design leader based in Warsaw. I focus on design strategy & ops and on building and scaling design teams. Happy to be here and excited to meet everyone.
That mix helped a ton. In practice, we built something like an “Uber for NEMT (Non-Emergency Medical Transportation)”: a platform for private providers serving seniors and riders with special needs.
