Assessing the effects of a mixed-mode design in a longitudinal household travel survey

The German Mobility Panel (MOP) is a national household travel survey, which has been collecting data on travel behavior in Germany since 1994. One of the MOP’s central assets is its ability to provide time-series data on travel behavior. Thus, the comparability of survey results from different years is a major objective of the survey method used. Declining survey participation rates in the last decade in various socio-demographic groups resulted in the implementation of a mixed-mode design for the MOP in 2013, both for the sampling stage (landline and mobile phone recruitment) and the data collection stage (paper and web). In this study, we analyze whether the adaptations in the survey mode do indeed improve the results and, if so, why and to what degree. Ideally, the survey mode adaptions have increased the representativeness of the MOP. However, measurement biases due to the mixed-mode design are also conceivable. To decompose survey mode effects, we applied the propensity score weighting method. This method imputes the hypothetical responses participants would have given in different survey modes; disparities between actual responses and hypothetical responses under another mode are then traced back to the mixed-mode design. Our analysis indicates that trip-rate biases on shopping, leisure, and short trips are partly caused by the mixed-mode design; in contrast, quantities of time spent in the transportation system, trips made by car and public transportation, and commuting trips are hardly biased.