Choosing the Right Interviewing Methodology for Your Survey

How you collect data matters just as much as what data you collect. In survey research, the interviewing methodology – the channel through which questions reach respondents – shapes everything from response rates and data quality to the kinds of topics you can realistically explore. Whether you’re a psychology researcher, a student designing your first study, or simply trying to understand how public opinion polls work, knowing the strengths and trade-offs of each survey method is essential to making sound research decisions.

What is interviewing methodology in survey research? 🔗

Survey research is built on self-report – asking people directly about their thoughts, behaviors, and experiences. The method used to deliver those questions is the interviewing methodology. Interviews differ from questionnaires in one key way: they involve live social interaction, either in person, by phone, or through a digital medium. That interaction affects not just whether people respond, but how honestly and thoroughly they do so. The main methodologies in use today are personal interviews, telephone surveys, mail surveys, computer-assisted interviews, email surveys, and internet/intranet surveys – each suited to different research goals and populations.

Personal interviews 🔗

Personal interviews – conducted face-to-face between a researcher and a respondent – are the most resource-intensive method available, but they consistently deliver the strongest results. According to research methods literature, in-person interviews yield the highest response rates of any survey format. The personal contact they establish is difficult to replicate digitally, and that contact matters in specific research contexts – for instance, when interviewers must directly observe respondents or assess clinical indicators during a mental health evaluation.

The flexibility of the face-to-face setting also allows researchers to probe deeply into sensitive or complex topics. An interviewer can clarify confusing questions, follow up on unexpected answers, and pick up on non-verbal cues that a phone or online survey would miss entirely. This personal interaction can yield rich qualitative data that no other format matches.

The trade-offs, however, are significant. Personal interviews are expensive, time-consuming to set up, and geographically restricted. Hiring and training interviewers adds cost, and traveling to respondents – especially in rural or dispersed settings – multiplies the burden. For large-scale studies on a tight budget, this method is often impractical.

Telephone surveys 🔗

Telephone surveys sit between the personal interview and purely self-administered methods in terms of cost, reach, and response rate. They offer several clear advantages: higher response rates than mail or online surveys, broad geographic coverage without travel costs, and the ability for interviewers to clarify questions and adapt to respondents’ answers in real time. A live interviewer on the phone can also reduce dropout rates mid-survey compared to an unguided self-administered format.

But telephone surveys have real limitations. They cost more than online or mail options because trained interviewers must be hired. They may also exclude lower-income populations without reliable phone access, and declining landline use means traditional telephone directories no longer provide comprehensive sampling frames. Gallup researchers have noted that telephone survey response rates have dropped significantly across the industry, prompting researchers to explore supplementary methods. Additionally, Pew Research Center has documented a phenomenon called “mode effects” – respondents sometimes answer the exact same question differently depending on whether they’re speaking to an interviewer by phone or filling out an anonymous online form.

Mail surveys 🔗

Mail surveys involve sending printed questionnaires directly to respondents, who complete them at their own pace and return them by post. Their primary appeal is cost-effectiveness: printing and postage are relatively inexpensive compared to hiring interviewers, and they can reach broad geographic populations without logistical complexity. Mail surveys are also useful for reaching people without internet access, and respondents can take their time to carefully consider their answers before submitting.

The downsides are well-established. Mail surveys have historically suffered from low response rates, and there’s no way to verify that the intended respondent – rather than someone else in the household – actually completed the form. They also depend on respondents having the language skills and literacy level to understand the questionnaire without assistance. Data entry from paper returns is slow and prone to human error. To offset low response rates, researchers often send follow-up reminders or include pre-paid return envelopes, which adds cost.

Computer-assisted interviews (CAPI and CATI) 🔗

Computer-assisted interviewing represents a technological upgrade on both personal and telephone methods. The two most widely used forms are Computer-Assisted Personal Interviewing (CAPI) and Computer-Assisted Telephone Interviewing (CATI).

CAPI: face-to-face with digital support 🔗

CAPI involves an in-person interviewer using a tablet or laptop to administer a questionnaire and record responses directly. This approach retains the high response rates and depth of traditional face-to-face interviewing while reducing the chance of interviewer error. The software handles complex routing logic automatically – if a respondent’s answer means certain follow-up questions are irrelevant, the system skips them, ensuring a cleaner and more efficient interview. Researchers have found CAPI particularly valuable for complex questionnaires with intricate branching structures, where paper-based administration would be prone to routing mistakes. It is especially well-suited for sensitive topics where researcher oversight improves data quality. The main drawbacks remain cost and time: trained interviewers still need to travel to respondents, which limits scale.

CATI: telephone interviewing with software precision 🔗

CATI works by pairing a telephone interview with software that guides the interviewer through the questionnaire in real time, applying branching logic and recording responses directly into a database. This eliminates transcription errors and enables more complex survey structures than a paper script would allow. CATI is generally faster and less costly than CAPI because interviewers work from a central call center rather than traveling to respondents. It is well-suited to large-scale quantitative studies where efficiency and accuracy are priorities, though it shares the broader limitations of telephone surveying – declining response rates and difficulty reaching populations without reliable phone access.

Email surveys 🔗

Email surveys deliver questionnaires directly to respondents’ inboxes. They are fast, inexpensive, and easy to distribute to large samples – particularly useful when researchers already have a defined list of participants, such as members of an organization or customers in a database. Unlike postal mail, email surveys allow for quick follow-up reminders and near-instant data collection.

The challenges are meaningful, however. Email open rates vary widely, and many recipients will simply ignore or delete survey invitations. There is also no guarantee that the targeted individual – rather than a colleague or family member – actually completes the survey. Surveys sent by email may also end up in spam filters, further reducing reach. Research comparing email delivery methods has found that the mechanism matters: surveys embedded directly in an email produce different engagement than those delivered via a hyperlink requiring a separate login, with the latter demanding more effort from respondents and often resulting in lower completion rates.

Internet and intranet surveys 🔗

Online surveys – delivered through web browsers or dedicated survey platforms – have grown to become the dominant data collection format in many research contexts. Their advantages are substantial: they are accessible to anyone with an internet connection, can reach global audiences at minimal cost, enable real-time data collection, and can incorporate multimedia elements like images and interactive response formats. For researchers with limited budgets and large sample-size goals, online surveys are difficult to beat on efficiency alone.

Intranet surveys – distributed within a closed organizational network – serve a related but distinct purpose. They are commonly used for employee research, internal feedback, and organizational assessments, where the sampling frame is already defined and access can be controlled.

The limitations of internet-based surveys are equally important to understand. Research published in BMC Medical Research Methodology found that internet surveys currently tend to be less effective for community-based studies compared to telephone or postal methods, though combining multiple modes can improve overall response rates. Online surveys also risk excluding populations with limited internet access or low digital literacy, which can introduce sampling bias. Without a live interviewer to guide respondents, complex or ambiguous questions may be misunderstood, leading to lower data quality. Demographic fit matters here too: younger, tech-savvy populations are more reliably reached online, while older or less digitally engaged groups may be systematically underrepresented.

How to choose the right methodology 🔗

No single method is universally superior. The right choice depends on a combination of factors that researchers must weigh carefully against their specific study goals.

Research objectives: Personal and computer-assisted interviews are strongest when depth, nuance, and complex question structures are priorities. Online and email methods work well for broad, descriptive surveys where speed and scale matter more than depth.

Target population: Consider who your respondents are and how they can be realistically reached. An elderly population may be better served by telephone or mail surveys; a digitally active sample of university students may respond well to an online format.

Sensitivity of the topic: Research comparing survey modes on sensitive behavioral topics – including sexual behaviors – found that self-administered formats, particularly audio-assisted computer self-interviews, encouraged more candid responses than interviewer-administered methods. When privacy matters, removing the human intermediary can improve honesty.

Budget and timeline: Personal and CAPI interviews demand the most investment; online surveys cost the least. Mail surveys occupy a middle ground. Telephone and CATI fall between personal and online methods in both cost and speed.

Response rates and non-response bias: Research consistently shows that in-person interviews yield the highest response rates, followed by telephone, then mail and internet methods. Lower response rates risk non-response bias – where those who don’t respond differ systematically from those who do, skewing your findings. Pre-notification messages and follow-up reminders can help, regardless of the method chosen.

Many researchers now opt for mixed-mode designs – combining methods to reach different segments of a population more effectively. For example, starting with an online survey and following up with telephone interviews for non-responders can significantly improve both response rates and representativeness.

What do you think? If you were designing a study on a sensitive psychological topic – such as mental health experiences or substance use – which interviewing methodology would you choose, and why? And do you think the growing dominance of internet surveys risks systematically excluding certain populations from research, and what might that mean for the findings we rely on?

References

1. https://opentext.wsu.edu/carriecuttler/chapter/7-1-overview-of-survey-research/
2. https://www.simplypsychology.org/interviews.html
3. https://opentext.wsu.edu/carriecuttler/chapter/7-3-conducting-surveys/
4. https://www.resonio.com/blog/offline-vs-online-surveys/
5. https://wallacefoundation.org/sites/default/files/2023-09/Workbook-F-Telephone-Surveys.pdf
6. https://news.gallup.com/opinion/methodology/233291/why-phone-web-survey-results-aren.aspx
7. https://www.pewresearch.org/short-reads/2019/02/07/phone-vs-online-surveys-why-do-respondents-answers-sometimes-differ-by-mode/
8. https://www.sciencedirect.com/topics/social-sciences/mail-survey
9. https://www.geopoll.com/blog/capi-cati-cawi-research-methods/
10. https://sru.soc.surrey.ac.uk/SRU3.html
11. https://www.idsurvey.com/en/cati-methodology/
12. https://www.werkinsight.com/blog/cati/
13. https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/1471-2288-12-132
14. https://www.driveresearch.com/market-research-company-blog/online-surveys-vs-phone-surveys-which-is-better-for-your-business/
15. https://iassistquarterly.com/index.php/iassist/article/view/727/719
16. https://opentextbc.ca/researchmethods/chapter/conducting-surveys/