Module 5: Validate: Finding the right solution

Question 1

Validation 1

What is validation?

Answer 1

Validation is the process of gathering evidence and verifying whether an idea for a product or feature meets the desired objectives and fulfils users’ needs.

The closer you get to being right the first time, the less developer resources you waste and the faster you achieve your business outcome.

Question 2

Validation 2:

Questions to consider in the Validate phase:

Answer 2

1. What outcomes are resonating most with customers?
2. How can we best solve for our customers’ pain?
3. What don’t we know about customers’ workflows that may help in building the solution?
4. How do we curate a diverse set of customers for interviews
5. What pain is so deep that customers would pay for a solution?

Question 3

Validation 3:

Why is validation crucial to effective product development ?

Answer 3

1. Helps you prioritise which solutions to build
2. Helps teams invest resources in the right areas of the product
3. Helps you better manage stakeholders

Question 4

Validate 4:

How to validate your product ideas?

Answer 4

One of the best ways is to get first-hand feedback from users. But this can be very time-consuming so supplement using:

Product usage data: get granular insights - understanding which feature

Question 5

Validate 5:

The role of experimentation and testing.

Answer 5

The Validate Phase is important prior to going into the build phase. Are we solving the problem we were aiming to solve?

Evaluative testing & Live experimentation are two key approaches.

Question 6

Validate 6:

Evaluative testing:

Answer 6

• Happens up front before building anything (e.g. prototypes or usability testing for multiple feature ideas)
• Fake door test: Invite customers to use a feature that hasn’t been released yet to gauge customer interest

Question 7

Validate 7:

Live experimentation:

Answer 7

Release things into the product to see how they work in production

Can make features available to a subset of customers to test before going into a deeper build

A/B test: Putting out two versions of a feature and seeing which performs better

Question 8

Validate 8:

Three best practices to consider in the Validate Phase:

Answer 8

1. Consider what experiment is best for our learning and testing. What information do we need?
2. Target the right users! The solution to be tested may only be relevant for a subset of customers.
3. Use data to evaluate success. Monitor our metrics to see if we are impacting.

Question 9

Validate 9:

What happens if the solution tested is not working well enough or has low customer interest?

Answer 9

This is perfectly normal in the product management lifecycle and may mean going back to discovery, and that is okay! We need to stay nimble.

Question 10

Validate 10:

Exercise: Validating a product idea with data. Step 1: Think through which data sources you can leverage. Can we track product usage? Do we have….?

Answer 10

• A way to measure product usage (insights dashboards provide a way - we should review these)
• A way to create in-app surveys and polls (GripAble do not have this functionality in the app yet).
• Access to a feedback management system (GripAble have SF feedback from customers and our ongoing customer interviews and insights dashboards)
• Resources like market research and a willingness to pay surveys

Question 11

Validate 11:

Step 2: Determine if you need to do evaluative testing or live experimentation

Answer 11

Evaluative testing
* Are we testing a feature’s usability?
* Do we have a prototype?
* Do we need to do a fake door test?

Live experimentaiton
* Do you need to test out a single feature or A/B test with two versions?
* Where in the product do you want the experiment to live?

Question 12

VAlidate 12:

Step 3: For both categories of experimentation what must you do?

Answer 12

Identify the users you want to target.

Are they a subgroup of your overall custoemrs?