Modeling learning and adaptation processes in activity-travel choice A framework and numerical experiment

This paper develops a framework for modeling dynamic choice based on a theory of reinforcement learning and adaptation. According to this theory, individuals develop and continuously adapt choice rules while interacting with their environment. The proposed model framework specifies required components of learning systems including a reward function, incremental action value functions, and action selection methods. Furthermore, the system incorporates an incremental induction method that identifies relevant states based on reward distributions received in the past. The system assumes multi-stage decision making in potentially very large condition spaces and can deal with stochastic, non-stationary, and discontinuous reward functions. A hypothetical case is considered that combines route, destination, and mode choice for an activity under time-varying conditions of the activity schedule and road congestion probabilities. As it turns out, the system is quite robust for parameter settings and has good face validity. We therefore argue that it provides a useful and comprehensive framework for modeling learning and adaptation in the area of activity-travel choice.     

Social influences on household location, mobility and activity choice in integrated micro-simulation models

Agent-based approaches to simulating long-term location and mobility decisions and short-term activity and travel decisions of households and individuals are receiving increasing attention in land-use and transportation interaction (LUTI) models to predict land-use changes and travel behaviour in mutual interaction. Social interactions between households and between individuals potentially have an influence on a wide range of the long-term and short-term choices involved in these systems. In this paper we identify the areas in which social interactions play a role and address the question how these influences can be modelled in the context of agent-based LUTI models. We distinguish impacts on activity participation (joint activity participation, support-and-help activities) and impacts on decision making (information exchange, social adaptation of preferences and aspirations) as the two main areas of social influence. A prototype of a LUTI model is proposed that accounts for impacts of the social network on longer-term mobility decision making through information exchange and social adaptation of preferences and aspirations. The model is demonstrated in a numerical simulation.