# Research Flaws and the Hard Truth About Testing (Glaringly Obvious)

**URL:** https://forum.zurb.com/t/research-flaws-and-the-hard-truth-about-testing-glaringly-obvious/65
**Category:** Measuring design
**Tags:** design-maturity, research-democratiza, evidence-based-desig, ux-metrics, ux-research
**Created:** [July 4, 2025, 3:31pm UTC](https://forum.zurb.com/t/research-flaws-and-the-hard-truth-about-testing-glaringly-obvious/65 "2025-07-04T15:31:45Z")
**Posts on this page:** 3
**Page:** 1

<div class="post-metadata">

### Author: ![Bryan](https://yyz2.discourse-cdn.com/flex034/user_avatar/forum.zurb.com/bryan/32/448_2.png) [@Bryan](https://forum.zurb.com/u/Bryan)
#### Post date: [July 4, 2025, 3:31pm UTC](https://forum.zurb.com/t/research-flaws-and-the-hard-truth-about-testing-glaringly-obvious/65/1 "2025-07-04T15:31:45Z")

</div>

I dropped a video clip from my conversation with [Max Speicher](https://www.linkedin.com/in/maximilianspeicher/), who’s been challenging the way teams think about UX metrics, research quality, and what democratization really means.

His honest take on research done wrong, and what to do instead, has sparked plenty of thinking across our team.

> **[Glaringly Obvious with Max Speicher](https://glare.helio.app/interviews/max-speicher#good-research-builds-confident-decisions)**
>
> Podcast Interview: Good research builds confident decisions.

> **“That’s where A/B testing falls short—because you only get behavioral data. You only see what happens. You never know why.”**  
> Max Speicher

### Max Speicher on the Real Cost of Bad Research

In our conversation, Max breaks down what happens when teams rush research or skip the fundamentals. Instead of helping, research can actually hurt product decisions, especially if it gives false confidence.

 ![research-democratization](https://canada1.discourse-cdn.com/flex034/uploads/helio/original/1X/642367f912c7372dd9a7c2a414aac82768851c9e.png)

Research democratization doesn’t mean handing tools to everyone. It means giving people the right training, guidance, and structure so their findings actually lead to better decisions.

* * *

### 💬 Discussion

- Where have you seen UX metrics steer a team away from gut feel and toward clarity?
- Have you experienced the downside of sloppy or rushed research?
- How do you balance fast testing with meaningful insight?

Would love to hear your thoughts.

---

<div class="post-metadata">

### Author: ![EricZ](https://yyz2.discourse-cdn.com/flex034/user_avatar/forum.zurb.com/ericz/32/692_2.png) [@EricZ](https://forum.zurb.com/u/EricZ)
#### Post date: [July 11, 2025, 1:28am UTC](https://forum.zurb.com/t/research-flaws-and-the-hard-truth-about-testing-glaringly-obvious/65/2 "2025-07-11T01:28:11Z")

</div>

The lack of attitudinal research creates big problems in A/B testing, particularly from a brand perspective. Often-times the brand and business goals are tied to comprehension and sentiment in the short-term, and recall in the long-term.

Behavioral or performance metrics give you near-term decision-making power, but we’ve seen teams optimize themselves into a corner.

---

<div class="post-metadata">

### Author: ![Bryan](https://yyz2.discourse-cdn.com/flex034/user_avatar/forum.zurb.com/bryan/32/448_2.png) [@Bryan](https://forum.zurb.com/u/Bryan)
#### Post date: [July 14, 2025, 10:58pm UTC](https://forum.zurb.com/t/research-flaws-and-the-hard-truth-about-testing-glaringly-obvious/65/3 "2025-07-14T22:58:50Z")

</div>

> [@EricZ](#):
>
> Behavioral or performance metrics give you near-term decision-making power, but we’ve seen teams optimize themselves into a corner.

**Behavioral metrics are the linchpin.** They reveal whether you’re solving the right problem… or just getting better at solving the wrong one.

They can crack things open or steer you into a dead end.
