Co-discovery as a method of UX-research

On November 13, World Usability Day - WUD'10 was held in Moscow, where Mail.Ru UX-research specialist spoke on co-discovery .

Today we want to tell you about this user research method.
')
Recently, in addition to usability testing, the think aloud method is often used when a user is asked to comment on their actions during the execution of a task.

But, you see, such a model of behavior is unusual for a person: “I will now stroke the shirt, first go around the button, then the right sleeve, and the iron must smooth it well the first time ...”. To circumvent this drawback, you can use the co-discovery method.

The essence of the co-discovery method is that the task is jointly solved by two people, simultaneously clarifying everything to each other. One of them uses only the mouse, the other only the keyboard. In this case, "poking a finger at the screen" is impossible.

To make the communication process more comfortable, it is best to pair well-known people in pairs. It is desirable that their models of thinking are as different as possible. For example, you can invite a woman and a man, a techie and a humanist, people of different ages.

We decided to try out this method, conducted several pilot tests, and then the main one. We selected 5 pairs of respondents (some of them were employees of Mail.Ru, not from the IT department) and set them a series of diverse tasks.

What are the benefits of co-discovery revealed?

1. Natural communication - respondents are making efforts to verbalize their own solution.
   What you can find out:
   • Visual perception: I see / do not see (one respondent notices some parts of the interface, the other - other parts or does not notice at all)
   • Understanding what is happening in the respondent’s words
   • Expectations (“Somewhere here you could add a postcard”)
   • The strategy of solving the problem ("Come on in the search for pictures, there definitely should be")
   • Differences in the thinking patterns of the two respondents.
     - “Enter the site address!”
     - "Maybe better through the search?"
     
2. Respondents with different strategies explain them to each other.
   What you can find out:
   
   • How do they explain which terms they use, which clues (geometric shape, color, side):
     “On the blue on this is written. In the same place where you did. From above, over the white field. Blue big square! Well no!"
   • Reaction to explanations
   • Where is the point of mutual understanding
3. It is possible to identify difficulties faster - solutions and problems of two respondents are immediately visible
4. There is no mentor who knows everything - the moderator almost does not participate in the process.
5. All interesting, more relaxed atmosphere.

Found and possible shortcomings of the method:

1. May not cover some of the problems (therefore it is not a substitute for usability testing)
2. Real environment is not constructed (task solution context)
3. A person cannot fully immerse himself in the solution of the problem, since distracted by clarification
4. More difficult to quantify
   
   • Number of errors - they push each other to the method of solving the problem
   • Time-to-task - part of the time spent on explanations
5. It is more difficult to express your personal interests at the moment of solving the problem (choose a film)
6. ± One dominates for a while: either a man or a man with a mouse

In our opinion, the co-discovery method can be successfully used for testing:

• Mass services (search or mail);
• Services that are used jointly (choice of film, planning a trip, buying an apartment and equipment);
• When it is important to understand the perception and strategies of user behavior;
• When it is important to understand the language in which the user thinks.

What to read?

• J. Nielsen "Usability Engineering" p.198, Academic Press, 1993.
• Dumas and Redish, A Practical Guide to Usability Testing, Ablex Publishing. p. 31, Co-discovery.
• Rubin, J. Handbook of Usability Testing. John Wiley & Sons. p. 240, "Testing two participants at a time."
• Co-discovery learning
• AMBUSH USABILITY (part 3) - Co-Discovery Method