My User Research Stack

May 9, 2018 ·productresearch

“Talk to your users” is pretty standard advice for startups of almost any size.¹ Having heard this from many startup elders, I was clear on the why but not on the how. A few hundred user interviews later and I think I have a better understanding of the process. I found that the goal isn’t so much to talk to your users about your product but to understand how you can empower them to reach their goals.²

My general aim when trying to understand a product’s viability is to start with a broad domain, like academic publishing, and then find 10 people who have experience in that space. I usually email about 5X as many people as I need to account for funnel effects. From there I set up Skype calls, record the conversations, transcribe them and then annotate the text.

In the conversation I try to optimize for open ended exploratory questions then whittle my way down to specifics. I go in with a script and return to it when I’ve exhausted a tangent. Questions like “Would you use this?” almost never return good signal.³ By focusing on questions of process and motive I can better understand what the user is trying to do and how the product can help her. An example would be

Adnan: What do you do with your paper after it’s published?

Ayesha: We usually send out the link and PDF to our department’s mailing list.

Adnan: Why’s that?

Ayesha: Well, it’s important to show your colleagues and people in the field that you’re doing cool things.

Adnan: Is it important to get replies to your emails?

Ayesha: Yeah, it’s very helpful to hear how it was received.

To me it sounds like Ayesha is interested in the impact her research has in the field. She’s trying to get the word out about her work and she’s also looking for feedback. These are all user goals that we try to turn into features.

So here’s the stack I use for all this:

• MixMax (mixmax.com) to send emails and coordinate scheduling. MixMax makes it easy to send up to 300 emails in one go and has great scheduling features.
• Skype for calls. Everyone has Skype, it sucks but it’s the easiest thing to use when you’re trying to connect with a stranger and talk face to face.
• Ecamm’s call recorder (ecamm.com). Does what it says on the tin. It integrates with Skype so you can just record the entirety of your Skype chat. Make sure to ask users before recording them.
• Jotengine (jotengine.com). Send them an audio clip, get a word for word transcription within 4 hours. This part is magical because it means I can focus on the interview without worrying about taking notes or asking someone else to take notes.
• Quip/Google Docs. I like both of these for reviewing and commenting on the transcript. Quip is more geared towards annotating (it has a separate section for annotations) but everyone has Google Docs.