Not bored yet - Revisiting respondent fatigue in stated choice experiments

Stated choice surveys are used extensively in the study of choice behaviour across many different areas of research, notably in transport. One of their main characteristics in comparison with most types of revealed preference (RP) surveys is the ability to capture behaviour by the same respondent under varying choice scenarios. While this ability to capture multiple choices is generally seen as an advantage, there is a certain amount of unease about survey length. The precise definition about what constitutes a large number of choice tasks however varies across disciplines, and it is not uncommon to see surveys with up to twenty tasks per respondent in some areas. The argument against this practice has always been one of reducing respondent engagement, which could be interpreted as a result of fatigue or boredom, with frequent reference to the findings of Bradley and Daly (1994) who showed a significant drop in utility scale, i.e. an increase in error, as a respondent moved from one choice experiment to the next, an effect they related to respondent fatigue. While the work by Bradley and Daly has become a standard reference in this context, it should be recognised that not only was the fatigue part of the work based on a single dataset, but the state-of-the-art and the state-of-practice in stated choice survey design and implementation has moved on significantly since their study. In this paper, we review other literature and present a more comprehensive study investigating evidence of respondent fatigue across a larger number of different surveys. Using a comprehensive testing framework employing both Logit and mixed Logit structures, we provide strong evidence that the concerns about fatigue in the literature are possibly overstated, with no clear decreasing trend in scale across choice tasks in any of our studies. For the data sets tested, we find that accommodating any scale heterogeneity has little or no impact on substantive model results, that the role of constants generally decreases as the survey progresses, and that there is evidence of significant attribute level (as opposed to scale) heterogeneity across choice tasks.     

Extending stated choice analysis to recognise agent-specific attribute endogeneity in bilateral group negotiation and choice: a think piece

This paper is a think piece on variations in the structure of stated preference studies when modelling the joint preferences of interacting agents who have the power to influence the attribute levels on offer. The approach proposed is an extension of standard stated choice methods, known as ‘stated endogenous attribute level’ (SEAL) analysis. It allows for interactive agents to adjust attribute levels off a base stated choice specification that are within their control, in an effort to reach agreement in an experimental setting. This accomplishes three goals: (1) the ability to place respondents in an environment that more closely matches interactive settings in which some attribute levels are endogenous to a specific agent, should the modeller wish to capture such behaviour; (2) the improved ability of the modeller to capture the behaviour in such settings, including a greater wealth of information on the related interaction processes, rather than simply outcomes; and (3) the expansion of the set of situations that the modeller can investigate using experimental data.

A stated preference examination of time of travel choice for a recreational trip

A stated preference experiment was performed in Calgary in Canada to examine how people are influenced in the selection of a departure time for a hypothetical trip to see a movie. A total of 635 complete observations were obtained. In each observation the respondent was presented with a set of possible departure time scenarios and asked to indicate the order of preference for these scenarios. Each scenario was described by specifying the automobile travel time, the expected arrival time relative to the movie start time, the parking cost, the probability of being at least ten minutes late for the movie and the length of time the movie had been running. This forced the respondent to trade off between conditions regarding these attributes. Age, gender and frequency of movie attendance were also recorded. The observations thus obtained were used to estimate the parameter values for a range of alternative utility functions in logit models representing this choice behaviour. The results indicate that all of the attributes included have significant effects on departure time choice in the situation being considered. They also indicate that travellers are prepared to arrive roughly two minutes early for each minute of travel time saved; that the money value of driving time for trips to recreational activities is about half that for trips to work; that one additional percent in the probability of arriving late is equivalent to roughly 0.20 Canadian dollars or 1.93 minutes drive time; and that there is a preference for a non-zero expected early arrival time regardless of the associated probability of arriving late. Some of these results are novel and others are consistent with findings for work trips in work done by others, which is seen to add credence to the approach being used here.     

Estimating the willingness to pay and value of risk reduction for car occupants in the road environment

In recent years there has been a re-focus on the valuation of a statistical life from the ex post or human capital method to an ex ante willingness to pay (WTP) approach. This is in part a recognition that we may have been undervaluing the cost of fatalities and injuries to society associated with crashes, but also a strong belief in the need to focus on establishing the amount, ex ante, that individuals are willing to pay to reduce the risk of exposure to circumstances that might lead to death or degree of injury on the road network. This study has developed a framework in which to identify the degree of preference heterogeneity in willingness to pay by individuals who are drivers or passengers in cars to avoid being killed or injured. A stated choice experiment approach is developed. The empirical setting is a choice of route for a particular trip that a sample of individuals periodically undertakes in Australia. The particular trip is described in enough detail to provide the respondent with a familiar market environment, providing all the relevant background information required for making a decision. Mixed logit models are estimated to obtain the marginal (dis)utilities associated with each influence on the choice amongst the attribute packages offered in the stated choice scenarios. These estimates are used to obtain the WTP distributions for fatality and injury avoidance, which are then aggregated to obtain estimates of the value of risk reduction (VRR), of which the fatality class is also known as the value of a statistical life (VSL).