Evidence

Validation Studies

Side-by-side comparisons of Simsurveys synthetic output against published live panel data. 9 studies across healthcare, consumer, patient, and retail domains.

9

Published studies

4

Research domains

0.05–0.10

KL divergence range

Healthcare

Validation Study

AMA Prior Authorization Survey

Validation of synthetic physician responses against the American Medical Association's prior authorization survey. Compares synthetic and live panel data on physician attitudes, administrative burden, and care delay metrics.

Healthcare Download PDF →
Validation Study

Commonwealth Fund / Kaiser 2015

Synthetic replication of the Commonwealth Fund/Kaiser Family Foundation 2015 health insurance survey. Benchmarks synthetic respondent output against national survey data on insurance coverage, access, and affordability.

Healthcare Download PDF →
Validation Study

Physician Sarcopenia Knowledge

Validation of synthetic physician responses on sarcopenia awareness, diagnostic practices, and treatment approaches. Tests the healthcare model's accuracy in replicating specialized clinical knowledge and practice patterns.

Healthcare Download PDF →

Consumer & Retail

Validation Study

Consumer Returns in Retail

Validation study comparing synthetic and live consumer data on retail return behaviors, motivations, and satisfaction. Tests the consumer model's ability to replicate purchase and post-purchase decision patterns.

Consumer / Retail Download PDF →
Validation Study

IFIC Food & Health Survey

Synthetic replication of the International Food Information Council's annual Food and Health Survey. Validates the consumer model against nationally representative data on food attitudes, nutrition knowledge, and dietary behaviors.

Consumer / Food Download PDF →
Validation Study

Walmart Retail Rewired 2025

Synthetic replication of Walmart's Retail Rewired 2025 consumer study. Benchmarks the consumer model against large-scale retail data on shopping behaviors, channel preferences, and emerging retail technology adoption.

Consumer / Retail Download PDF →

Patient

Validation Study

KFF GLP-1 Weight Loss Drug Survey

Validation of the patient model against the Kaiser Family Foundation's 2023 survey on GLP-1 weight loss drug awareness, usage, and attitudes. Tests patient model accuracy across demographic segments on a rapidly evolving healthcare topic.

Patient / Healthcare Download PDF →
Validation Study

HCAHPS Hospital Patient Experience

Validation against CMS Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) survey data. Benchmarks the patient model on hospital experience metrics including communication, responsiveness, and discharge information.

Patient / Healthcare Download PDF →
Validation Study

US Pain Foundation 2022 Survey

Validation against the US Pain Foundation's 2022 national survey on chronic pain experiences. Tests patient model accuracy on pain management, treatment satisfaction, provider communication, and quality-of-life impact.

Patient / Healthcare Download PDF →

How we validate: Every study follows a paired-comparison design using KL-Divergence, Spearman Rank Correlation, Top-K Overlap, and BERTScore. For full methodology details, thresholds, and metric explanations, see our Validation Framework & Benchmarks.

Run your own validation.

Generate synthetic data from your survey and compare against your live benchmarks.