Summary information

Study title

Replication data and code: Invitation Messages for Business Surveys: A Multi-Armed Bandit Experiment

Creator

Gaul, Johannes J. ( ZEW, University of Mannheim, NeSt)
Keusch, Florian ( University of Mannheim)
Rostam-Afschar, Davud ( University of Mannheim, IZA, GLO, NeSt)
Simon, Thomas ( University of Mannheim)

Study number / PID

10.7802/2836 (GESIS)

10.7802/2836 (DOI)

Data access

Information not available

Series

Not available

Abstract

This replication package contains the experimental data and code from a study investigating how elements of a survey invitation message targeted to businesses influence their participation in a self-administered web survey. The experiment was conducted in collaboration with the German Business Panel (GBP) during its fifth survey wave, spanning from August 16, 2022, to November 25, 2022. A full factorial design was implemented, varying five key components of the email invitation. Unlike conventional experimental setups with static group assignments, the study employed adaptive randomization, wherein a Bayesian learning algorithm sequentially allocated more observations to invitation messages exhibiting higher survey starting rates. Over the 15-week experimental period, 738,598 invitation messages were distributed to business contacts, of which 176,000 were opened within one week. A total of 7,833 recipients initiated the survey, and 3,733 completed it. The dataset includes detailed records of message distribution, survey engagement metrics, and adaptive randomization adjustments, providing a comprehensive basis for analyzing the effectiveness of invitation design in business survey participation. Keywords: Adaptive Randomization, Reinforcement Learning, Nonresponse, Email Invitation, Web Survey, Firm Survey, Organizational Survey

Topics

Not available

Methodology

Data collection period

16/08/2022 - 25/11/2022

Country

Germany

Time dimension

Longitudinal (panel study)

Analysis unit

Not available

Universe

All legal entities active in Germany as defined by the Federal Statistical Office in the statistical business register

Sampling procedure

Probability Sample - Simple random Sample

Kind of data

Not available

Data collection mode

Web-based experiment
Self-administered questionnaire:CASI(Computer-assisted Self-interview)

Access

Publisher

GESIS Data Archive for the Social Sciences

Publication year

2025

Terms of data access

Free access (without registration) - The research data can be downloaded directly by anyone without further limitations.

Related publications

Not available