How important is it to test users in their natural context and without a moderator?

Well, we find it very important. It’s something that anyone would agree helps things seem closer to reality, right? But let’s analyze it in more detail. Here are 4 reasons why:

How important is it to test users in their natural context and without a moderator?

  1. Having users interact with an application at home, or at work, with their own PCs and their real settings is obviously where and how you’d want users to give you feedback. They’re interacting with the system with their laptops, with a specific monitor resolution, processor speed, mouse, etc.
  2. When a user does not have a stranger in front of him, he may be more direct (and honest?) about what’s good or bad, what he’s missing, etc. This is specially true (or valuable) when the topics are considered private, or when we’re dealing with the kind of issues you just don’t feel comfortable discussing openly in a Lab environment.
  3. In remote testing, you can test users at home. However, there are two types of remote testing methods: Moderated and un-moderated. With un-moderated (which is what we do at UserZoom), the fact that you can test users at home and they participate simultanously without a moderator also gives researchers another huge advantage: cost-efficiencies. Obviously you save time and money on moderation time, but also you can perform international testing for a relatively lower investment.
  4. Furthermore, it’s all about ‘quantifying usability’. In unmoderated testing you normally use large samples of users, allowing you to actually quantify (not just identify) usability issues. Sometimes companies need metadata to make strategic decisions. Sometimes it’s very useful to combine qualitative with quantitative data.

Related posts:

Comments are closed.