Evaluating UX research methods and types for your product

By UserTesting | December 18, 2020
Image
What is UX research?

How we think of and practice UX (user experience) research has evolved rapidly in recent years. What was once a specialized discipline is now viewed as something everyone in an organization can (and should) participate in. As a result, the definition of UX research is also changing. Whether you’re a UX veteran or newly introduced to the concept, user experience research is evolving and branching out.

What is UX research and why is it important?

As UX research becomes more commonplace in organizations big and small, its definitions and applications have naturally evolved. Traditionally, user experience research is the practice of studying user interactions to help with the design of people-first products and experiences.

UX research definition

Nonetheless, the meaning of UX can vary depending on who you’re talking to. For product teams, UX research might mean validating prototypes and concepts, and for marketing teams, it may mean testing brand designs and messaging before a launch. Each team's UX research deliverables will vary, too. In other words, UX research is no longer a practice held in one corner of the business. The most successful organizations empower all teams to collect user and customer insights in order to make better business decisions.

Types of UX research and when to use them

Before we jump into individual research methods, or the tactics used for conducting UX research, there are big-picture questions that need to be addressed first. And that’s: what types of UX research are there?

Qualitative vs. quantitative research

When it comes to understanding your users, you may find yourself wondering if your UX research approach should be qualitative or quantitative. And it’s important to figure that out because the two types uncover very different insights.

To get a full picture of your user experience, you need to understand both what’s happening and why. If you only have quantitative data, you may be missing out on key insights that could make a difference in your understanding of the user experience. And if you only do qualitative research, you won’t be able to tell whether your findings are representative of a larger population.

Attitudinal vs. behavioral research

Though sometimes misconstrued as being the same thing, attitudinal and behavioral research are not synonymous. However, as with quantitative and qualitative research, the two can be useful when assessed concurrently. 

Attitudinal research involves the assessment of users’ preconceived attitudes or feelings toward an experience. For example, this could involve asking a user why they like or dislike a feature on your site prior to using it. In contrast, behavioral research is focused on what the user does. 

Drawing another parallel to the distinction between quantitative and qualitative methods, behavioral research will tell you what’s happening, while attitudinal research helps to provide the reason why it’s happening. Always keep in mind that what users say and what users do are often different

Generative vs evaluation research

The goals of generative and evaluation research (sometimes referred to as evaluative research) are very different. Generative research helps you define the problem you’d like to design a solution for. Evaluation research, on the other hand, helps you evaluate an existing design (in prototype, final, or some other form).

UX research methods

UX needs to be a strategic initiative that drives a culture of user-centric design and thinking—informing everything from the product itself to marketing campaigns and messaging to brand design and social media. There's a variety of UX research tools and user research techniques that help teams collect the insights needed specific for every role.

Let’s take a look at some of the more common methods now.

Remote usability testing

It might be obvious that remote usability testing is a great method for conducting UX research—if only by its name alone. This method of remote research uses an insight platform to record the screen (and voice, depending on the software you choose) of test participants as they interact with your product or experience in their natural environment—at home, in their office, or a specific location.

Through usability testing, designers, product managers, and researchers alike can uncover and understand how real people respond to products and experiences. From what they like and dislike, to where they get stuck and confused, to areas of improvement, the valuable insights gathered from these tests are eye-opening.

Diary studies

Diary studies are a form of longitudinal research (research that takes place over a long period with the same participants). Typically, users self-report their activities at regular intervals to create a log of their activities, thoughts, and frustrations. It’s a useful approach for capturing organic feedback on activities that are repetitive, long, or unpredictable.

Card sorting

Card sorting is a qualitative research method used to group, label, and describe information more effectively—based on feedback from customers or users.  Card sorting requires you to create a set of cards—sometimes literally—to represent a concept or item. These cards will then be grouped or categorized by your users in ways that make the most sense to them. Most commonly, it’s used when designing (or redesigning) the navigation of a website or the organization of content within it, because it helps to evaluate information architecture.

UX research method: card sorting

Surveys

It may seem obvious, but through a series of expertly-phrased and positioned questions, surveys allow you to empathize with your users in order to gain quantitative insights that aren’t as visible to developers, managers, and marketers. Listening to your customer can help you find new problems to solve or devise new ideas, and collecting customer feedback through surveys is an active, receptive, and honest way to do it.

Interviews

Live interviews are a great way to collect qualitative insights. By having dynamic discussions, interviewees are able to observe verbal as well as non-verbal cues and ask open-ended questions to uncover those details that surveys and usability testing cannot. Interviewing is an especially useful UX research method for understanding complex feelings and experiences because it allows you to ask follow-up questions.

UX research method: interviews

When should UX research be conducted?

Early on, UX research was most commonly used to solve a problem that was already known. For example, if a company noticed that visitors were dropping off their site at an unusually high rate on a particular page, researchers would look into how to solve that specific problem. As a result, research wasn’t necessarily something that was done for discovery or as a regular part of the development process.

But that’s a thing of the past. The value teams are getting from fast human insights is driving UX research best practices to become embedded in everyday processes for teams across the business. What was once just a problem-solving mindset has evolved to combine the perspective of finding what problems to solve, as well. 

This is where researchers flex their strategic skills, and companies are getting creative with user experience research to provide valuable insights. As any consumer will tell you, there are countless experiences that leave us underwhelmed, if not disappointed, that might not be so obvious to spot.

For example, if you visit an e-commerce site, find a product, and purchase it, there isn’t a lot of information that would trigger anyone to wonder if the purchasing experience needed any attention. After all, a purchase was made, right? Discovering what problems need solving, in addition to solving the ones you know need attention, is a big shift in UX research mentality.

A final word on UX research

UX, CX, usability, user testing. No matter what you call it, putting your customers at the center of your company’s mission and culture has become a competitive advantage that not only attracts new customers but keeps them coming back.

This expanded view and access to user experience research mean that not only are companies better equipped than ever to create and improve great experiences for their customers, it also means that customers will be expecting better and better experiences in the future.

Insights that drive innovation

Get our best human insight resources delivered right to your inbox every month. As a bonus, we'll send you our latest industry report: When business is human, insights drive innovation.

About the author(s)
UserTesting

With UserTesting’s on-demand platform, you uncover ‘the why’ behind customer interactions. In just a few hours, you can capture the critical human insights you need to confidently deliver what your customers want and expect.