Measuring Feelings - is this how we should be doing it?

Measuring how people feel about a product or design can be tricky. We’ve been using a method based on Plutchik’s wheel of emotions to calculate our Feelings metric, which gives users eight options like joy, anger, and surprise to capture their reactions. It works, but we’ve heard that the limited range of emotions sometimes makes it hard for our participants to really express how they feel.

Source: Glare Framework - Feelings UX Metric

Recently, we came across another approach called PrEmo. Instead of words, it uses 14 illustrated emotions to help users express how they feel. It’s a more visual and perhaps more intuitive way to capture reactions, especially for feelings that might be hard to put into words.

Both methods have their strengths, but they also raise a bigger question: What’s the best way to measure feelings in UX research? Is it more useful to give participants a tight, simple set of emotions like Plutchik’s wheel, or a broader, more visual approach like PrEmo?

:backhand_index_pointing_right: We’d love to hear your take—how do you think we should be measuring feelings in design?

3 Likes

I think we should make our own ink blot language and asses feelings like Arrival

2 Likes

I loooove these faces @MoData , so fun. I kinda like the idea of measuring sentiment over time, because I think it allows for that measurement.

Track emotional changes before → during → after interaction (anticipation, experience, reflection).

This image weirdly made my stomach turn. Maybe, we avoid the creepy images?

come on…

Disappointed World Cup GIF by Goldmaster

Very cool @MoData

The illustrations remind me of the blob-figures used by sensemaker where people are asked to identify with the figure they feel represents them best.

Once the respondent chooses a “blob” then they are asked to articulate why this blob relation to the situation they are in,

It works remarkably well.

3 Likes

Haha, this one is fun. Might have to steal this one to see if I can use it in a conversation!

1 Like

This is a fun example @Helge! I wonder how the position of the blob around the tree impacts participants’ willingness to identify as one of them. The falling blob is pretty intense :sweat_smile:

2 Likes

I like this one @Helge.

I think the difference in the Blob tree is that it represents emotions, but also scenarios that people can identify with.

Got me thinking, what else is out there that is visual in this realm? Here are two interesting ones:

The Mood Meter (Yale RULER)

The Social Atom

2 Likes

There’s many different Blob-scenarios. Search for it on Google Images and different ones will show up :slight_smile:

The interesting thing about the sensemaker approach is that it starts with the blobs.

Then asks the respondent to retell a situation relevant to what the researcher is looking for. Note they are not asking for people’s opinions, but to retell experiences.

This is because when you ask people for their opinions they usually start lying to you… e.g. when I ask people what they eat for dinner in a week they would tell me fish two times, pasta, chicken, salad and maybe one day with red meat (welcome to Scandinavia), but when I ask them what they ate yesterday they would say: “I promise, we never usually do this .. but we went to McDonalds”..

The last thing the sensemaker people do is that they say: every analyst has a bias, so the respondent could just as well be their own analyst. They then ask the respondent to rate their experience on a triangle scale (as this creates more friction and thinking than a linear e.g. 1 to 10 scale).

It’s all pretty clever and I’ve used it plenty of times to improve on my own ideas and measurements.

ihttps://www.youtube.com/watch?v=LEPt0o7yTXY

2 Likes

Completely agree with the focus on experiences over opinions. You can tell a lot about someone’s opinions through their experiences.

What triangle scale did you have respondents rate their experience on? I haven’t used that method before.

1 Like

Love this. Feels like a technique that complements needfinding, by trying to go deeper than people’s expressed wants or ideas of how something “should” be.

Captured a comparison table.

Area Sensemaking Needfinding
Core goal Capture real moments and let people interpret their own experience Uncover unmet needs through stories, patterns, and real behavior
What you ask A short retelling of a specific situation A deeper look at tasks, pains, workarounds, and motivations
What you avoid Opinions, predictions, and surface claims Leading questions and abstract problem statements
How meaning is created The respondent tags and places their own story on a triangle scale The researcher synthesizes patterns across many lived stories
Type of data Small stories plus structured self-interpretation Context-rich stories that reveal hidden needs
Strength Reduces analyst bias and surfaces grounded signals fast Reveals deeper user needs and systemic gaps
Where it fits Early sensemaking, pattern spotting, quick cultural insight Early product discovery, concept framing, and opportunity finding
What you learn How people interpret their own behavior Why people behave the way they do and what they are trying to solve
1 Like

Another thing to keep in mind is that no system for gathering information can remove every form of bias.

In our own system with more than one million people, there are a few factors people should keep in mind.

  • Up to 5% of people will directly lie for their own perceived benefit. We remove these people, as they ultimately influence a system in a negative way. It’s an ongoing cycle.

  • Up to 20% of people will white lie, so they are influenced based on how the system directs them. You lean incentives towards

  • Up to 20-50% will simply not remember correctly. No fault of their own, people are just bad at this. Having multiple points of failure can exclude people from a group.

So in many of our tests, we ask people to react or do something, then comment on that thing the just did to reduce the bias towards recollections, or wants.

1 Like

Saving this table for a rainy day! Some good stuff in here.

For some reason why I really don’t think this is what normal people save for a rainy day :sweat_smile: :laughing:

1 Like