Estimating the robustness of questionnaire results: lessons from a mixed-mode survey of expectations for tele-working and road-based business travel |
| |
Authors: | Peter Bonsall Jeremy Shires |
| |
Institution: | (1) Institute for Transport Studies, University of Leeds, Leeds, LS2 9JT, UK |
| |
Abstract: | The robustness of questionnaire results to various forms of bias are explored in the context of a dual-mode (web and hardcopy)
survey of employers’ anticipations of levels of employee commuting and business travel activity under a range of future ICT
scenarios. The questionnaire incorporated several innovative features which, together with the dual-mode format, allowed an
unusually wide range of analyses. For example: the robustness of respondents’ opinions was tested by examining the effect
of incorporating alternative versions of a briefing text, one being very positive and one very negative, about the role of
ICT; instrument bias was identified via detailed comparison of the results from the two versions of the questionnaire; and
the impact of exogenous factors which are often ignored or taken as constant was assessed via special supplementary questions.
Analysis showed that the robustness of opinions and expectations varied and was influenced by respondent characteristics,
and that results from the two versions of the questionnaire differed significantly. It is concluded that opinions and expectations
are less robust, and questionnaire results are more subject to bias and myopic interpretation, than is generally recognised
and that web-based surveys seem particularly vulnerable to sampling bias. Methods are suggested for measuring robustness,
for reducing bias and for validating and contextualising results. The use of contrasting briefing texts is recommended as
a means of establishing the robustness of opinions and expectations while supplementary questions are recommended for validating
and contextualising SP and SE exercises.
Peter Bonsall
Professor of Transport Planning at the Institute for Transport Studies, University of Leeds. His research interests include:
use of innovative data sources, microsimulation, multi-criteria appraisal of policy interventions, travellers’ perception
of modal attributes, their ability to cope with uncertainty and complexity and their response to new information and charges.
Jeremy Shires
Senior Research Fellow at the Institute for Transport Studies, University of Leeds. His research interests include behavioural
modelling, the impact of “soft factors” on travel, stated preference design and public transport demand modelling. |
| |
Keywords: | Robustness Instrument bias Response bias Framing effects Contrasting briefings |
本文献已被 SpringerLink 等数据库收录! |
|