The Competitive UX Benchmark Study

UserZoom ran a quick competitive UX benchmark study between Sprint and T-Mobile, some of the largest telecommunications companies, to see how users experienced navigational and core tasks, as well as how they rated their overall experience on these websites.

The Study

We ran an unmoderated remote benchmark study with 60 in-the-wild users on their own devices over the course of a single day, and collected both quantitative and qualitative feedback.

Participants were equally divided so that 30 went to each site, and completed several tasks in order to test and measure the design of the homepage, the website’s structure, and gather usability metrics for each site.

We also measured users feelings about the brand before and after their experience with the site, as well as their likelihood to recommend the site to friends, family and colleagues.

Here is a sample of the benchmark:

First impressions are lasting impressions

We showed all 60 participants static images of the homepage of Sprint and T-Mobile and asked them to choose which site they associated with several UX attributes.

Sprint was seen as being Informational (56%) but also Overwhelming (61%). The category they fared the least well in was being seen as Lively (31%).

T-Mobile was the site that participants felt was the most Lively (69%) as well as Welcoming (68%) and Easy (68%). They fared the least well in was the Informational (44%) category.

Want to see the rest? Download the battle to find out who won!

 

Show me who won!