Hello! Welcome back to our course.
In our last session, we established a framework for evaluating a qualitative research proposal, ensuring its strategic alignment with your market access goals. We focused on the big picture: the research question, the methodology, and the sampling strategy. Now, we're going to zoom in on a critical deliverable that an agency will produce based on that proposal: the patient interview guide.
This lesson will equip you to review an interview guide with a critical eye. By the end of our time, you will be able to evaluate the guide's questions for clarity and neutrality, and assess its overall structure for logical flow and comprehensive coverage of key oncology patient experience domains. A well-designed guide is the linchpin of high-quality data collection; mastering its review is a key competency in your oversight role.
1. The Anatomy of an Effective Interview Guide
An interview guide, sometimes called a topic or discussion guide, is not a rigid script. For semi-structured interviews—the type most common in patient experience research—it serves as a roadmap for the interviewer, outlining the key topics to cover and suggesting questions to ask. Its purpose is to ensure all critical areas are explored while still allowing the flexibility to follow the participant's own narrative.
A good guide typically has three parts:
- The Opening: This section includes introductions, rapport-building, and "warm-up" questions that are easy to answer. The goal is to make the participant feel comfortable.
- The Main Body: This is the core of the interview, containing thematic blocks of questions that delve into the research topics.
- The Closing: This section includes a final "catch-all" question, thanks the participant, and explains the next steps.
The main body is usually structured to follow a logical narrative. For patient experience research, this narrative is often the patient journey. This chronological approach—from pre-diagnosis, through diagnosis and treatment, to living with the condition—is intuitive for participants and ensures a comprehensive story is captured.
The National Health Council's "Patient Experience Mapping Toolbox" provides an excellent public-domain example of a well-structured guide. Let's examine its components to understand what a high-quality guide looks like.
[PDF] Patient experience mapping toolbox interview guide
This guide is a template designed to capture patient experiences with chronic health conditions. It's a fantastic model for understanding structure and flow.
First, read the introductory section, "A note to researchers" (page 1), which explains the guide's purpose and flexibility. Next, study the Table of Contents on pages 2-3. Notice how it's structured chronologically around the patient journey: "before getting a diagnosis," "getting a diagnosis," and "living with a diagnosis." This is a best practice for logical flow. Finally, read the section "Introduce the ‘Map My Experience’ tool" (pages 8-11). Pay attention to how a visual aid is used to structure the conversation and the different domains it covers, such as 'life factors' and 'personal goals.'
As you can see from the toolbox, a comprehensive guide tailored to oncology should cover several key domains. When you review a guide from an agency, you should check for coverage of areas such as:
- Diagnostic Journey: The path to diagnosis, including initial symptoms, healthcare interactions, and any misdiagnoses.
- Treatment Experience: Perceptions of efficacy, management of side effects, and the practical burden of administration (e.g., travel for infusions, complex medication schedules).
- Symptom Burden: The physical and cognitive impact of the disease and its treatment.
- Impact on Life: How the condition affects daily activities, work, family life, social relationships, and emotional wellbeing. This is a critical area for demonstrating the humanistic burden of disease to payers.
- Unmet Needs: Gaps in current care, support, or treatment that represent opportunities for a new therapy to provide value.
- Care Coordination: Experiences navigating the healthcare system and interacting with various providers.
Your role is to ensure the guide is designed to explore the domains most relevant to your drug's value proposition and your market access strategy.
2. Critiquing Questions: The Art of Eliciting Rich Data
The quality of your insights is directly determined by the quality of the questions asked. A poorly phrased question can lead to a confusing answer, a biased response, or a dead end. When reviewing an agency's interview guide, you should scrutinize every question against three core principles: being open-ended, neutral, and clear.
Open-Ended vs. Closed Questions
The goal of a qualitative interview is to get the participant to tell their story in their own words. To achieve this, questions must be open-ended.
Questions for Semi-structured Interviews // three principles for asking good questions
This video by Kirstine, a social design researcher, offers a concise and clear explanation of the core principles for asking good qualitative questions.
Watch the segment on the first principle, where she explains open-ended questions. Notice her simple test: if a question can be answered with "yes," "no," or a single word, it's probably not a good open-ended question. Then, watch the third principle on starting with easy questions. This highlights the importance of sequencing questions to build rapport, starting with factual questions before moving to more emotional topics.
An agency's guide should be dominated by open-ended questions. If you see a long list of questions that can be answered with "yes" or "no," it's a major red flag. The guide might look more like a survey, which is not the goal.
Neutrality and Avoiding Leading Questions
Questions must be neutral. They should not suggest a "correct" answer or betray the interviewer's own biases or assumptions. A leading question gently (or not so gently) pushes the respondent towards a specific answer, contaminating the data.
Questions for Semi-structured Interviews // three principles for asking good questions
Let's return to the video on asking good questions to focus on the principle of neutrality.
Watch the section where the presenter discusses the second principle: questions should be non-biased and non-leading. The example she gives about diversity in the workplace clearly shows how a poorly framed question can signal a "right" answer to the interviewee.
When reviewing a guide, look for subtle biases. For example, instead of asking "How burdensome is your current chemotherapy regimen?", a more neutral question would be "Could you walk me through a typical week of your current treatment?" The first question assumes the regimen is burdensome; the second allows the patient to describe the experience in their own terms, whether they find it burdensome or not.
Clarity and Probing
Finally, questions must be simple and clear, using language the patient will understand. Avoid clinical jargon or complex, multi-part questions.
[PDF] Some Strategies for Developing Interview Guides
This guide from Harvard's Sociology department offers excellent, practical advice on question development.
Please read the section titled "Guidelines for Developing Interview Questions". Focus on the core principles listed, such as keeping questions simple, asking one thing at a time, and the crucial distinction between "how" and "why" questions. "How" questions tend to elicit stories and processes, which are rich in qualitative data.
A good interview guide also anticipates the need for probing. The main questions open a topic, and probes are follow-up questions that ask for more detail, clarification, or examples. A well-prepared guide will often list potential probes under the main questions. One of the most powerful probes is also the simplest.
How to Develop an Interview Guide for Qualitative Research (Real Examples) 🎤📄
This video from shribe! provides a detailed walkthrough of developing an interview guide. It contains a highly effective tip for probing.
Watch the short segment on follow-up questions, particularly the simple yet powerful question recommended from "The easiest and most effective".
When you see "Can you give me an example of that?" or similar probes in a guide, it's a sign the agency understands how to elicit the rich, detailed data you need.
3. A Practical Checklist for Your Review
When an agency sends you a draft interview guide, you need a systematic way to evaluate it. Drawing on what we've discussed, here is a checklist you can use to structure your feedback.
| Category | Key Evaluation Questions | What to Look For (Green Flags) | What to Avoid (Red Flags) |
|---|---|---|---|
| 1. Structure & Flow | Does the guide have a logical flow (e.g., chronological)? Is there a clear opening, main body, and closing? | Follows the patient journey; starts with broad "grand tour" questions before narrowing down. | Jumps between unrelated topics; lacks a clear narrative arc. |
| 2. Domain Coverage | Does the guide cover all the key domains relevant to the research objectives (e.g., symptom burden, QoL, unmet needs)? Are there any obvious gaps? | Comprehensive coverage of topics relevant to your value story (e.g., treatment burden, impact on work, emotional wellbeing). | Misses key areas of the patient experience; over-focuses on clinical aspects and ignores psychosocial ones. |
| 3. Question Quality | Are the questions open-ended, neutral, and clear? Do they use patient-friendly language? | Questions starting with "How...", "What...", "Describe...", "Tell me about...". | Questions that can be answered with "yes/no"; leading questions ("Don't you agree that..."); jargon-filled or multi-part questions. |
| 4. Probes & Flexibility | Does the guide include prompts for follow-up questions (probes)? Does it feel like a flexible guide rather than a rigid script? | Includes suggested probes like "Can you tell me more?", "What was that like?", "Can you give me an example?". Notes for the interviewer on flexibility. | Only contains main questions with no prompts for digging deeper. A rigid, survey-like format. |
By using this framework, you can provide specific, constructive, and evidence-based feedback to the agency, ensuring the final interview guide is a high-performance tool for data collection.
Conclusion
In this lesson, we have dissected the patient interview guide, transforming it from a simple list of questions into a strategic tool you can critically evaluate. You are now equipped to assess a guide's structure, flow, and domain coverage, and, most importantly, to scrutinize its questions for the clarity, neutrality, and open-endedness required to generate rich patient insights.
Key takeaways include:
- Structure follows the story: A good guide often follows the patient's journey chronologically.
- Coverage is key: The guide must be designed to explore all the domains of experience relevant to your market access strategy.
- Questions shape answers: The quality of your data depends on asking open, neutral, and clear questions.
- A guide is not a script: The best guides provide a solid framework while allowing the interviewer the flexibility to probe and follow the participant's lead.
In our next module, we will move from reviewing the inputs of research to evaluating its outputs. You will learn how to assess the credibility of the findings presented by an agency and begin translating them into the actionable insights that will strengthen your value proposition to payers.