·Updated ·Research·Jerry Miller, Product at Minds

What Is Synthetic Market Research? Definition and Limits

Synthetic market research uses AI-generated respondents to answer research questions. Grounding, named validation studies and Audience-level checks help you judge whether the evidence fits your decision.

Synthetic market research is market research in which AI-generated respondents answer the questions instead of recruited people. A language model is conditioned on a description of the audience you want to study (age, region, role, habits, attitudes, sometimes real survey or interview data), and each conditioned instance answers survey items, reacts to a concept or holds an interview. The answers are then aggregated like survey results or read like qualitative transcripts.

The method is useful because it is fast and cheap enough to run before any fieldwork: you can screen many concepts, messages or questionnaire drafts in a day. It is limited because the respondents are simulations. Their answers are estimates of how a group might respond, shaped by the model and the data it was given, and they need to be checked against real people before they carry a decision that is expensive to reverse.

This page covers the market research use of the method. For the wider practice, including UX research and policy work, see synthetic research.

Definition: what counts as synthetic market research

Three elements make a study synthetic market research rather than a chat with an AI tool:

  1. A defined audience. The study names who is being simulated, for example "UK grocery shoppers aged 25 to 40 who buy plant-based milk at least weekly", and each synthetic respondent is built from that definition.
  2. A research instrument. The respondents answer the same structured questions, rate the same stimuli or go through the same interview guide, so answers can be compared and aggregated.
  3. An analysis and validation step. Results are summarised as distributions, rankings or themes, and someone checks how far they can be trusted, ideally against real survey data for the same audience.

Many vendors use different names for the same idea: synthetic respondents, synthetic panels, AI personas, digital twins of customers, silicon samples. The academic term "silicon sampling" comes from political science work that conditioned a language model on the backstories of real survey participants. The terms overlap; what matters is the three elements above. For a closer look at the respondent unit itself, read synthetic respondents and synthetic panels.

"Synthetic data market research": a common mix-up

People often search for "synthetic data market research", and the phrase blurs two different things.

Synthetic data is any artificially generated dataset. In analytics it usually means a statistical copy of a real table, such as transactions or customer records, created so that analysts can work without exposing individuals. Its job is to preserve the patterns of data you already have.

Synthetic market research generates new answers to questions that have not yet been asked of anyone: how would this audience react to a price change, which of these three claims is most believable, what would stop them switching brands. Its job is to estimate opinions and reactions you do not yet have.

The answers a synthetic study produces are a kind of synthetic data, but the hard part of the method is not generating rows. It is defining the audience well, asking neutral questions and knowing how far the answers can be trusted.

How synthetic market research works

A typical study runs in five steps.

  1. Frame the decision. Write down what will change depending on the result, for example "we launch claim A or claim B", and what level of confidence you need.
  2. Build the audience. Describe the segment, then generate respondents that vary within it. Better systems ground each respondent in evidence: published statistics, public sources, your own customer research or survey files. A respondent built only from a demographic label tends to answer like a stereotype.
  3. Run the instrument. Ask closed questions (single choice, multiselect, scales, rankings, forced-choice designs such as MaxDiff) and open questions, or show stimuli such as concepts, ads, packaging images, landing pages or prototypes.
  4. Analyse. Aggregate closed answers into distributions and compare segments; code open answers into themes; look for contradictions and for answers that sound generic.
  5. Validate and decide. Compare a sample of results with real data where it exists, label the output as directional, and decide which findings go forward to a human study.

How answers are collected matters more than it looks. In Minds' published survey replications, asking synthetic respondents for probabilities across answer options instead of forcing one choice each reduced distribution error by 12.47 to 19.72 percentage points across four public datasets (Minds research). Forcing one answer per respondent throws away uncertainty that real populations have.

Worked example: checking synthetic research against a real survey

A synthetic market research result should show the population, the questions, the human reference and the error. Here is an already-published product validation, rather than an illustrative dataset.

In the August 18, 2026 Food and You 2 replication, 301 persistent Minds aged 16–24 answered the same three meal-frequency questions as the published UK Food Standards Agency survey. The synthetic cohort covered England, Wales and Northern Ireland. The human reference base was 257 per question. Each question had seven answer options; all 903 planned Mind-question responses completed.

One original question was: “How often do you eat out or buy food to take out for dinner?” The comparison scored the share assigned to each answer option, not whether a particular person’s answer was predicted correctly. Human percentages were withheld from the runtime; the public source means earlier exposure through pretraining or stored knowledge cannot be excluded.

QuestionMean absolute difference from human answer shares (percentage points)
Breakfast frequency2.98
Lunch frequency6.48
Dinner frequency8.56
All 21 answer-option cells6.01

The overall mean error was 6.01 percentage points; lower is better. The published “93.99% approximation” is 100 minus that error, not 93.99% individual accuracy. Dinner had the largest average gap, so the aggregate score should not hide the variation between questions.

For context, the frozen generic-prompt baseline recorded 6.68-point error and an equal-probability baseline 7.00 points. Those baselines were historical, not rerun concurrently. This is a repeat on one existing cohort and three related questions, not a new independent population study or an error guarantee for your next survey. No human sampling-uncertainty interval was estimated, and the Food Standards Agency did not sponsor, endorse or review the Minds study.

Inspect the published questionnaire, audience and per-question results, the baseline comparison and study context, and the original Food and You 2, Wave 10 dataset. For your own decision, repeat this check with a relevant audience and questionnaire before relying on the result.

What the accuracy evidence shows

There is no single accuracy figure for synthetic market research, and a vendor quoting one without naming the dataset, the questions and the comparison method is not giving you usable information. The published evidence points in both directions.

Evidence that it can work:

  • Argyle and colleagues conditioned GPT-3 on thousands of socio-demographic backstories from real US survey participants and found it could emulate response distributions of many subgroups. They called this property "algorithmic fidelity" and the resulting samples "silicon samples" (Political Analysis, 2023).
  • A Stanford-led team built agents for 1,052 Americans from two-hour interviews, surveys or both. On held-out General Social Survey items, the agents reached 83%, 82% and 86% of the participants' own two-week test-retest consistency, against 74% for agents given demographics only (arXiv, 2024). Grounding in real self-reports beat demographic labels.

Evidence of the limits:

  • Bisbee and colleagues asked ChatGPT, prompted with personas, for feeling-thermometer scores that they compared with the American National Election Study. Averages matched closely, but the synthetic answers had less variation than real ones, regression coefficients often differed, results shifted with small wording changes and the same prompt gave different results three months apart (Political Analysis, 2024).
  • Santurkar and colleagues found substantial misalignment between the opinions language models express and those of 60 US demographic groups, persisting even when the model was steered towards a group; some groups, such as people over 65, were reflected poorly (ICML 2023).
  • In consumer research specifically, Brand, Israeli and Ngwe found that willingness-to-pay estimates from language-model responses were sometimes comparable to human studies but often inaccurate and in some cases had the wrong sign. Fine-tuning on earlier survey data from the same category improved alignment for new features within that category, but not for new product categories (HBS working paper, SSRN).

The pattern across these studies: synthetic answers are most reliable for well-documented attitudes in populations that are well represented in data, and when respondents are grounded in real evidence about the people they stand for. They are least reliable for variance, subgroup differences, new categories, price sensitivity and anything that depends on lived physical experience.

How Minds approaches validation

Minds connects research grounding, published benchmarks and validation of your own Audience. Each answers a different buyer question: what evidence grounds the population, what has the system demonstrated, and how closely does this Audience match a suitable reference?

Study Bank grounding. The Study Bank contains real reference studies, surveys, official statistics and respondent datasets with their populations, questions, dates and provenance. Verified findings are selected for their relevance to your target population and research task to help ground Audience composition. A stored source is not automatically usable, and evidence used for grounding is not by itself a validation of the generated answers.

Published evaluations. Minds has forecast YouGov, Reuters/Ipsos, Marist and Emerson survey results before release, and European Commission and Japanese consumer-confidence results. Its portfolio also includes the partner-approved SINUS case and comparisons with GSS, ANES, the Canadian Election Study, OECD PISA and Food and You 2. The Mosaic benchmark explains the prospective tests and the comparison on Artificial Societies' public tasks; the live ledger records resolved forecasts and misses. The SINUS case and earlier survey comparisons report their own designs and limits. These are named reference studies, not endorsements by their publishers or one pooled accuracy score.

Audience Validation. Compare your Audience's answers with suitable published surveys or your own uploaded questionnaire and results. Minds checks population and question fit, reports sources, differences and the score's range, and lists excluded questions with their reasons. Read the validation guide for availability and how to read a result. A survey-share error measures the gap between distributions, not how often an individual person was predicted correctly. Use the evidence that matches the decision; published platform benchmarks do not automatically validate every Audience. Minds' validation history includes 7,500+ survey-question comparisons (verified 6 November 2026). This counts scored question comparisons, including repeat checks and historical scoring methods; published benchmarks report their own test designs separately.

Synthetic market research compared with other methods

MethodTypical speedRelative costRepresentativenessBest forMain risk
Synthetic market researchMinutes to hoursLow per studyNot representative by itself; depends on grounding and validationScreening concepts and messages, pre-testing questionnaires, exploring segments that are hard to recruitPlausible but wrong answers, too little variance, model bias
Online panel surveyDays to weeksMediumCan approximate a population with good sampling and weightingSizing, tracking, representative estimatesLow-quality or fraudulent respondents, panel fatigue
Focus groups and interviewsWeeksHigh per participantNot representative; small samplesDepth, language, emotional reactions, unexpected reasonsModerator and group effects, small n
A/B or in-market testWeeks, needs live trafficMedium to highReal behaviour of your actual usersFinal choice between live variantsOnly tests what you can ship; slow for many options

These methods work best in sequence. Synthetic research narrows the options, a survey or qualitative study confirms the shortlist, and a live test settles what can only be settled by behaviour.

When synthetic market research works

It earns its place when speed or reach matters more than precision:

  • Early concept and message screening, when there are more options than the budget allows to field.
  • Questionnaire development: finding confusing questions, missing answer options and leading wording before paying for fieldwork.
  • Exploring hard-to-recruit or expensive audiences, such as specialist B2B buyers, as a first read before targeted interviews.
  • Iterating on positioning, packaging copy or onboarding text where each round would otherwise take weeks.
  • Preparing for human research: forming hypotheses, choosing which segments to sample and drafting the discussion guide.

For concept work in particular, see AI concept testing.

Limits: when not to use synthetic market research

Use recruited people, observed behaviour or established measurement instead when:

  • You need a representative estimate: market size, penetration, share, or the exact percentage who would buy.
  • You need price elasticity or willingness to pay at specific price points to set a price.
  • The claim will be published, regulated or audited, including advertising claims that need substantiation, clinical or health claims and election forecasting.
  • The product must be touched, tasted, smelled or used physically.
  • The audience, category or behaviour is new, so little reliable data describes it, or the audience is poorly represented in public text (the misalignment studies above point to older people and other under-represented groups).
  • The decision is expensive to reverse and you have not validated the synthetic Audience against real data for this kind of question.

Synthetic results also carry correlated error: every respondent comes from the same underlying model, so they can be wrong in the same direction at once. Real respondents make independent mistakes; simulated ones may not.

How to evaluate a synthetic market research tool

Ask vendors for evidence, not adjectives:

  1. Which public datasets have you replicated, with which questions, and what was the error? Is a baseline reported?
  2. Can I validate my own Audience against real survey data, and do I see which questions were excluded and why?
  3. How are respondents grounded: demographic labels only, or sources, statistics and my own research files?
  4. Which question types are supported (open, single choice, multiselect, scales, MaxDiff) and how are closed answers collected?
  5. What do you say the tool should not be used for?

A vendor comparison is in our synthetic market research tools guide, and a broader method comparison is in synthetic research vs traditional market research.

Where Minds fits

Minds is a platform for running synthetic market research end to end: build an Audience of Minds grounded in sources and your own files, run Studies with open and closed questions or MaxDiff, test stimuli such as concepts, images, websites and copy, analyse and export the results, and validate the Audience against real surveys. Minds is built for directional decisions. It does not make a synthetic study statistically representative, and for representative estimates, regulated evidence or physical product tests you will still need recruited people.

Sources

Frequently asked questions

What is synthetic market research in simple terms?

It is market research where AI-generated respondents answer your questions instead of recruited people. Each synthetic respondent is conditioned on a profile of the audience you want to study, and the answers are aggregated like a survey or read like interviews. The result is a fast, directional read, not a measurement of the real population.

How accurate is synthetic market research?

It depends on the audience, the question and how answers are collected, so no single accuracy number applies. Published studies show close matches on some survey distributions and clear failures on others, including too little variation and sensitivity to prompt wording. Check results against real survey data for your audience before relying on them.

Is synthetic market research the same as synthetic data?

Not quite. Synthetic data is any artificially generated dataset, for example a privacy-preserving copy of a customer table. Synthetic market research is a research workflow: define an audience, ask simulated respondents questions or show them stimuli, analyse the answers and validate them. The answers are one kind of synthetic data.

When should I not use synthetic market research?

Do not use it as the final evidence for representative estimates such as market size or exact willingness to pay, for regulated or clinical claims, for physical or sensory product tests, or for audiences and behaviours that are new and poorly described in available data. Use recruited people or observed behaviour for those.

Can synthetic market research replace surveys and focus groups?

It can replace some early rounds, such as screening ten concepts down to three or pre-testing a questionnaire. It should not replace the human study that confirms a high-stakes decision. Most teams use it to make the human study smaller and better targeted.

How does Minds check synthetic answers against real people?

Minds Audience Validation asks an Audience the questions of real published surveys, or of survey files you upload, and compares the answer distributions. Each survey gets a score out of 100 with a 95% range, its source and who it asked, and questions that are not a fair target for that Audience are listed with the reason they were left out.