Can we get rid of bias? Mitigating systematic error in data donation studies through survey design strategies

for the study of individual behavior. However, data donation studies may be subject to bias. Researchers therefore need to quantify and address
systematic error in digital trace data. To complement a-posteriori error correction methods like statistical modeling, we tested how ex-ante
approaches, in particular survey design strategies, may help address bias in data donation studies. We conducted two preregistered experiments,
one with a convenience sample of students (NI = 345) and one with a convenience sample from an online access panel (NII = 2,039). In both
experiments, we analyzed the effects of survey design strategies – technical support during data donation, personalized incentives, and highlighting the societal relevance of participants' data – on nonresponse rates and nonresponse bias. Our results indicate that while data donation studies are prone to both, our ex-ante strategies could not effectively decrease nonresponse rates or nonresponse bias. Overall, our study underlines the need to (a) make bias in digital trace data more transparent and (b) advance research on error correction methods.

Hase, V. & Haim, M. (2024). Can we get rid of bias? Mitigating systematic error in data donation studies through survey design strategies. Computational Communication Research, 6(2). https://doi.org/10.5117/CCR2024.2.2.hase (content_copy)

This paper is available with open access. That means, you can just read/download it here.