{"slug":"ai-conversational-interviewing-2026-study","title":"Can AI Conduct Research Interviews? A 2026 Field Study","description":"Wuttke et al. (2026) ran AI-led interviews with 571 respondents on migration attitudes: richer reasoning than surveys, and ratings at or above the survey. Delivery mode matters.","keywords":"Can AI Conduct Research Interviews? A 2026 Field Study","date":"2026-07-31","author":"Qualitati Research Team","category":"Guides","readTime":"8 min read","content":"<p><strong>Can AI conduct real research interviews?</strong> A 2026 study by Wuttke and colleagues ran AI-led conversational interviews with 571 respondents on migration attitudes and found that AI interviews surfaced reasoning that standardized surveys miss — and that participants rated the AI interview at or above the survey. AI interviewing works, but the delivery mode matters a lot.</p>\n\n<h2>What did the study test?</h2>\n<p>The researchers tested whether a large language model can run open-ended, semi-structured interviews at survey scale. In their paper <em>AI Conversational Interviewing: Scaling Up Semi-Structured and In-depth Interviews</em> (Wuttke, Lang, Klamm, Würschinger &amp; Kreuter, 2026), respondents from the Prolific and Payback panels were interviewed about migration policy by an AI moderator, then completed a matching standardized survey so the two data-collection methods could be compared head to head.</p>\n<p>Crucially, the study was designed around a long-standing tension in research: the <strong>trade-off between depth and scale</strong>. In-depth human interviews are rich but slow and expensive; surveys scale but flatten nuance. The question was whether an AI interviewer could deliver some of the depth of a qualitative interview while keeping the reach of a survey.</p>\n\n<h2>How was the AI interviewer built?</h2>\n<p>According to Wuttke et al. (2026), the text-based interviewer ran on OpenAI's <strong>GPT-4o</strong> (model <code>gpt-4o-2024-11-20</code>, temperature 0.8), and the voice-based interviewer used OpenAI's <strong>GPT Realtime</strong> model (<code>gpt-realtime-2025-08-28</code>, temperature 0.7). Notably, the team reported that switching the text interviewer to GPT-5 caused a \"marked deterioration in interviewer performance\" — a useful reminder that a newer model is not automatically a better interviewer.</p>\n<p>Respondents were randomly assigned across three conditions:</p>\n<ol>\n  <li><strong>Voice</strong> — spoken conversation with the AI.</li>\n  <li><strong>Text/chat</strong> — typed conversation.</li>\n  <li><strong>Free choice</strong> — respondents picked their preferred mode.</li>\n</ol>\n<p>Of 1,039 respondents initially assigned (with no significant imbalance across conditions, χ²(2)=3.67, p=0.159), the final analytic sample was <strong>N=571</strong> with complete interviews linked to survey records.</p>\n\n<h2>Voice vs. text: which produces richer interviews?</h2>\n<p>Voice interviews produced substantially more content. According to Wuttke et al. (2026), the numbers break down as follows:</p>\n<table border=\"1\" cellpadding=\"6\" cellspacing=\"0\">\n  <thead>\n    <tr><th>Metric</th><th>Voice interview</th><th>Text interview</th></tr>\n  </thead>\n  <tbody>\n    <tr><td>Mean words per respondent</td><td>608.8</td><td>299.8</td></tr>\n    <tr><td>Mean session length</td><td>8.3 min</td><td>11.5 min</td></tr>\n    <tr><td>Speaking/typing rate</td><td>52.5 words/min</td><td>21.1 words/min</td></tr>\n  </tbody>\n</table>\n<p>In short, voice interviews generated roughly <strong>twice as many words</strong> as text interviews and did so faster, because speaking is quicker than typing. But there is a catch: attrition was concentrated in the voice-only condition, and when respondents were free to choose, they \"overwhelmingly selected the chat modality.\" The authors attribute the voice drop-off to \"addressable imperfections\" in their implementation rather than a fundamental limit of voice interviewing — a signal that voice UX, not the concept, is the bottleneck.</p>\n\n<h2>How did participants rate the AI interview?</h2>\n<p>Positively. Among respondents who completed the interview, evaluations of the AI interview were <strong>at or above those of the standardized survey across all modes</strong> (Wuttke et al., 2026). That matters because a common objection to AI interviewing is that it will feel cold or frustrating; here, the completers preferred it to the familiar survey format. The open question the study leaves is completion, not satisfaction: getting people to finish — especially in voice — is where the design work remains.</p>\n\n<h2>What did AI interviews reveal that surveys did not?</h2>\n<p>The headline methodological finding: conversational transcripts exposed \"considerations and reasoning that a comprehensive standardized battery does not capture.\" The AI interviews surfaced <strong>markedly different mental models of migration among respondents who had similar attitude scores on the survey</strong>. Two people can click the same point on a 7-point scale for completely different reasons — and only the open-ended conversation makes that visible. This is the core argument for AI interviewing: it recovers the \"why\" behind the number without abandoning scale.</p>\n\n<h2>What this means for researchers</h2>\n<p>For academic, UX, and market researchers, three practical takeaways stand out:</p>\n<ul>\n  <li><strong>AI interviewing is a real method now, not a demo.</strong> A 571-person study with linked survey data is a serious validation of the approach for opinion and experience research.</li>\n  <li><strong>Mode is a design decision.</strong> Voice yields richer, longer answers but higher drop-off; chat is what people default to when given the choice. Offering both — and investing in voice UX — is the pragmatic path.</li>\n  <li><strong>Use interviews to explain your survey, not just replace it.</strong> The biggest payoff was uncovering divergent reasoning behind identical survey scores. Pair a short survey with an AI interview to get both the distribution and the mechanism.</li>\n</ul>\n<p>If you want to run this kind of study, QualiTaTi's <a href=\"https://qualitati.com\">AI Interviewer</a> conducts voice or text interviews at scale and transcribes them automatically, and <a href=\"https://qualitati.com\">ThemeLens</a> can then code the resulting transcripts for themes — turning the \"why\" the study describes into structured analysis.</p>\n\n<h2>Frequently asked questions</h2>\n<h3>Can AI replace human interviewers in qualitative research?</h3>\n<p>Not wholesale, but it can scale interviewing dramatically. The 2026 study shows AI-led interviews capture reasoning surveys miss and are rated favorably by participants, making them a strong fit for large-N opinion and experience research where recruiting human interviewers would be impractical.</p>\n<h3>Are voice or text AI interviews better?</h3>\n<p>They serve different goals. Voice produced about twice the word count (608.8 vs. 299.8 words) and faster responses, but had higher attrition; text is what most respondents chose when free to decide. For maximum richness, use voice with strong UX; for completion and comfort, offer chat.</p>\n<h3>Which AI model did the study use?</h3>\n<p>The text interviewer used OpenAI's GPT-4o and the voice interviewer used OpenAI's GPT Realtime model. The authors found GPT-4o outperformed GPT-5 for the interviewing task, showing that model choice should be validated, not assumed.</p>\n<h3>Do AI interviews really add value over surveys?</h3>\n<p>Yes — the study found respondents with identical survey attitude scores held substantively different underlying mental models that only the conversational data revealed. AI interviews recover the reasoning behind the numbers.</p>\n\n<p><em>Primary source: Wuttke, A., Lang, M. M., Klamm, C., Würschinger, Q., &amp; Kreuter, F. (2026). <a href=\"https://arxiv.org/abs/2606.20064\">AI Conversational Interviewing: Scaling Up Semi-Structured and In-depth Interviews</a>. arXiv:2606.20064.</em></p>\n<p><em>Last updated: July 31, 2026. This article is an independent editorial summary of third-party research and is not affiliated with or endorsed by the study's authors.</em></p>\n","related":[{"slug":"digital-twins-survey-respondents-2026-study","title":"Can Digital Twins Replace Survey Respondents? A 2026 Study","description":"A 2026 Columbia Business School study found LLM digital twins correlate with real survey answers at only r = 0.20 across 164 outcomes: funhouse mirrors, not substitutes.","category":"Guides","date":"2026-07-29","readTime":"8 min read","author":"Qualitati Research Team"},{"slug":"is-ai-qualitative-coding-biased-2025","title":"Is AI Qualitative Coding Biased? What a 2025 Study Found","description":"A 2025 Sociological Methods & Research study found ChatGPT and Llama 2 coding errors correlated with respondent traits; a small supervised model was more accurate and less biased.","category":"Guides","date":"2026-07-28","readTime":"8 min read","author":"Qualitati Research Team"},{"slug":"best-llm-thematic-analysis-reliability-study","title":"Which LLM Is Best at Thematic Analysis? A 2026 Study","description":"A December 2025 study ran Gemini 2.5 Pro, GPT-4o and Claude 3.5 Sonnet on an interview transcript: all passed kappa 0.80 for inter-rater reliability, with Gemini highest.","category":"Guides","date":"2026-07-27","readTime":"8 min read","author":"Qualitati Research Team"}]}