The Evaluator Effect, or What You Get is What YOU See (CUE-9)

CUE-9 was a unique opportunity for usability professionals to assess and improve their usability testing skills.

CUE-9 was about the Evaluator Effect or Rashomon Effect, which names the observation that usability evaluators who analyze the same usability test sessions often identify substantially different sets of usability problems.

CUE-9 assembled experienced usability professionals to discuss the state-of-the-art in usability evaluation based on a common experience in evaluating the website for the US moving company U-Haul:

• Watch five 30-minute videos from usability test sessions,

• Write a short, anonymous report about your findings,

• Submit your report,

• Read similar reports written by other experienced professionals,

• Meet experienced colleagues at the CUE-9 workshop. Compare and discuss findings. Learn from the similarities and differences.

Available Downloads

·       CUE-9 Overview (2 pages)

·       CUE-9 Detailed Description (7 pages)

Workshops

CUE-9 workshops were held on 20 June 2011 in Atlanta, GA, USA, and on 11 September 2011 in Chemnitz, Germany. Thirty-four leading usability professionals participated in CUE-9, including Steve Krug, Chauncey Wilson, Carol Barnum, Tom Tullis and Nigel Bevan. The Atlanta workshop attracted 19 participants while the Chemnitz workshop attracted 15.