Switched from A/B testing everything to user interviews after a frustrating launch

I spent last year running A/B tests on every button color and headline, then launched a feature that failed anyway. Three months ago I sat down with 5 users from our mailing list and they told me things no test could show. Has anyone else found that talking to people beats testing numbers?

3 comments

3 Comments

uma_johnson21d ago

Five users taught me more than 10,000 data points.

parkerp8021d ago

Wait, five users told you more than thousands of data points? That's wild.

joseph_adams6621d ago

Did you notice @uma_johnson's point about five users beating 10,000 data points too?