Skip to content

Contact us

Sydney

Phone (02) 9261 4624 Fax (03) 9684 3434 Level 1, 26-28
Wentworth Ave
Surry Hills
NSW 2010
Sydney map

Melbourne

Phone (03) 9684 3470 Fax (03) 9684 3434 Ground Floor
119 Ferrars St
South Melbourne
VIC 3205
Melbourne map

Get in touch

At U1, we love hearing from people. So whether you have a query about the work we do, who's on our team or when's the next training event, contact us via email or phone.

Generative and Evaluative Research in Experience Design

Sean Owner 20th Mar, 2017
image of research participants

At U1 Group, we are continually working with our clients to assist them in making informed decisions about the experience design of their products and services, from the initial discovery phase right through to delivery. With the progressive maturation of the UX industry we have observed an increased appreciation and understanding of the value delivered by user and customer experience research. One of the biggest challenges we see individuals and teams grappling with is understanding how they can make the best use of research to make experience design decisions. Particularly in regard to the best time to engage in research and the type of research they should be conducting.

We want to share our experience on this topic to hopefully assist in making decisions about the type of user and customer research to engage and when, whether you are conducting the research yourself or engaging a third party.

Research Definitions

Let’s start by defining two types of research most relevant to the experience design of products and services, Generative and Evaluative.

Generative research should occur at the beginning of the product or service design journey. This discovery phase is where generative research techniques can assist you in defining the product or service and leads to a strong understanding of your intended audience and their relationship to your organization/brand and the product or service you intend to deliver. As opposed to market research which explores potential markets to push into, generative research is exploratory in nature and pulls from participants in order to inspire the design of a new product or solution. With generative research, you are not always sure what the answers or outcomes will be. However, as the insights typically identify the needs and motivations of your intended audience, they provide a strong foundation for making experience design decisions.

Evaluative research should occur once the experience design has taken shape in some form. That is, there is something that can actually be evaluated by your intended audience. The fidelity of this experience can vary greatly, within a digital context this could be from some sketch drawings of an app through to a live version of an app that is already in market. Outside of the digital context it might be a journey map outlining the intended touch points of a planned service through to direct observation of customers’ interactions (online and off-line) with an existing service or product. In a nutshell, you are seeking feedback on something that already exists, whether it is in the form of a prototype or “live”.  Through conducting Evaluative research are you seeking insight that will help to refine and improve your experience design.

Generative or Evaluative Research?

So, broadly speaking we can say that Generative research applies to the definition of a product or service whereas Evaluative research applies to its refinement and improvement. The time to apply Generative research is before you have committed to the experience design, whereas Evaluative research is best used once the experience design has taken form. Generative research tends to be one-off and in-depth, whereas Evaluative research should be applied regularly through the design, development and delivery of a product or service and can be light touch if required.

Where we see people getting into difficulty is where due to a lack of understanding or budget constraints they attempt to combine both types of research. Evaluative research should be applied when you understand the problem you are trying to address and/or the experience you want to create and are striving to achieve the best implementation. Evaluative research will not help you to build the “right” product or service, but it will help you to ensure what you build is built “right”, or whether you are actually building the “right” thing.

You should not be thinking in terms of Generative vs Evaluative research, as they are equally important in delivering the best possible products and service, but rather when to engage in each type of research. It is also important to recognise that there are a number of research techniques and tools that are common to both types of research. Qualitative and quantitative research can be used for both research types, something we will address in a future post.

Hopefully the above has been informative, please don’t hesitate to get in touch if you’d like to discuss this topic further. Next week, the Head of our Discovery and Design Practice, Kristy Blazo, will expand on Generative research and share examples of how clients have engaged in this type of research to make experience design decisions.

Tag


About The Author

Sean Owner

Sean joined U1 Group back in 2010 as a Senior Consultant and since then his role has evolved going on to become Managing Director and now Owner of the business. Sean has been involved in experience research and strategy for over 20 years. With a background in Psychology and a keen interest in technology, Sean is passionate about the use of research to inform experience design decisions. He firmly believes that the best experiences are those which recognise the human that resides at the centre of all interactions.

Related

Visit our website if you'd like to learn more about U1 Group     U1 Group