---
title: "Held-Out Interviews: When Participant Memory Helps | Minds"
canonical_url: "https://getminds.ai/research/held-out-interview-response-validation"
last_updated: "2026-09-09T10:01:03.375Z"
meta:
  description: "Two public interview corpora test whether compact profiles and retrieved earlier evidence improve fidelity to 66 later answers from 22 real participants."
  "og:description": "Two public interview corpora test whether compact profiles and retrieved earlier evidence improve fidelity to 66 later answers from 22 real participants."
  "og:title": "Held-Out Interviews: When Participant Memory Helps | Minds"
  "twitter:description": "Two public interview corpora test whether compact profiles and retrieved earlier evidence improve fidelity to 66 later answers from 22 real participants."
  "twitter:title": "Held-Out Interviews: When Participant Memory Helps | Minds"
---

Minds

September 5, 2026·Validation·Minds Team # **Held-Out Interviews: When Participant Memory Helps** Two public interview corpora test whether compact profiles and retrieved earlier evidence improve fidelity to 66 later answers from 22 real participants. A compact profile with relevant retrieved evidence improved participant-fit scores over generic prompting in a confirmation using 22 people and 66 held-out interview answers. The registered participant-clustered lift was 24.37 composite points, with positive average advantages in both evaluated corpora. The question was specific: can a grounded synthetic respondent better reflect what a particular person later said, rather than merely produce a plausible answer to an interview question? ## Earlier evidence, later answers The study used two public interview corpora concerning laser-dentistry practitioners and refugee food insecurity. Earlier interview material supplied compact participant profiles and retrievable evidence. Three later answers per person remained held out for scoring. The same-model conditions distinguished generic prompting, role context, profile context, and profile plus retrieval. These comparisons help separate the value of a broad role description from the value of participant-specific evidence. There were 66 target answers, but only 22 people. Multiple answers from one person are related observations; uncertainty therefore needs to respect the participant as a cluster. ## The observed fidelity advantage_### **Composite result** Reported results for this study. The table and discussion retain the study scope, baselines and uncertainty._- Compact profile plus retrieval, mean**60.33**