A Practical Guide to Measuring User Experience

What do helicopters, HAL9000 and parrots have in common? None of them have anything to do with Vanguard but all appear in the presentation I gave recently at Adaptive Path’s MX conference and the IA Summit. I highlighted some of the techniques we’ve been using at Vanguard to measure our user experience and some of the cultural challenges we face when using data to inform our decision-making. I gave out copies of an example Capability Strategy Sheet, here is the PDF.

And although I hate seeing myself on video, if you really must see it, here it is from MX 2011.


6 Responses to “A Practical Guide to Measuring User Experience”

  1. 1 Dan Zollman March 23, 2011 at 8:11 pm

    Thanks for posting this!

    As far as measurement goes, do you do anything differently in situations where two tasks conflict with each other? For example, “telling a friend” is good marketing but it could distract users from other tasks, and it would be difficult to measure the overall effects. (In that example, it’s probably negligible, but I wonder if there are more significant cases.)

    • 2 Richard March 23, 2011 at 8:47 pm

      We don’t do anything differently, but the prioritization of tasks within a capability sheet certainly helps us understand which tasks and measures take priority. At the end of the day its all about balancing the tasks and measures to achieve the desired outcome.

  2. 3 Dave Harper May 13, 2011 at 8:18 am

    Hi Rich.

    Great talk, glad to see you managed to sneak some Python references in there too..! I’d forgotten about the David Gunson anecdotes, hilarious stuff, haven’t thought about them for years…

    On a side note, Happy Birthday mate, have a great day..!!!!

    Best wishes to your and your family,


  3. 4 AgileCoachJacque January 12, 2015 at 2:49 pm

    Hey Richard – almost 4 years later, and I have found another application for the capabilities model you taught at MX2011 … I’m glad that at least one of the .pdf files is still available here. Thanks for sharing your thoughts and experiences!

  1. 1 Ten Guidelines for Quantitative Measurement of UX « UXPulse Trackback on January 18, 2012 at 2:41 pm
  2. 2 How to get from strategy to measurement: the capability strategy sheet | Perpendicular Angel Design Trackback on March 31, 2014 at 9:15 pm

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: