Integrated driving behavior modeling

This paper develops, implements and tests a framework for driving behavior modeling that integrates the various decisions, such as acceleration, lane changing and gap acceptance. Furthermore, the proposed framework is based on the concepts of short-term goal and short-term plan. Drivers are assumed to conceive and perform short-term plans in order to accomplish short-term goals. This behavioral framework supports a more realistic representation of the driving task, since it captures drivers’ planning capabilities and allows decisions to be based on anticipated future conditions.An integrated driving behavior model, which utilizes these concepts, is developed. The model captures both lane changing and acceleration behaviors. The driver’s short-term goal is defined by the target lane. Drivers who wish to change lanes but cannot change lanes immediately, select a short-term plan to perform the desired lane change. Short-term plans are defined by the various gaps in traffic in the target lane. Drivers adapt their acceleration behavior to facilitate the lane change using the target gap. Hence, inter-dependencies between lane changing and acceleration behaviors are captured.     

Categorization of the lane change decision process on freeways

Traffic operations for new road layouts are often simulated using microscopic traffic simulation packages. These traffic simulation packages usually simulate traffic on freeways by a combination of a car-following model and a lane change model. The car-following models have gained attention of researchers and are well calibrated versus data. The proposed lane change models are often representations of assumed reasonable behavior, not necessarily corresponding to reality. The current simulation packages apply solely one specific type of model for car-following or lane changing for all vehicles during the simulation. This paper investigates the decision process of lane changing maneuvers for a variety of drivers based on a two-stage test-drive. Participants are asked to take a drive on a freeway in the Netherlands in a camera-equipped vehicle. Afterwards, the drivers are asked to comment on their choices related to lane and speed choice, while watching the video. This paper reveals that different drivers have completely different strategies to choose lanes, and the choices to change lane are related to their speed choice. Four distinct strategies are empirically found. These strategies differ not only in parameter values, as is currently being modeled in most simulation packages, but also in their reasoning. Most remarkably, all drivers perceive their strategy as an obvious behavior and expect all other drivers to drive in a similar way. In addition to the interviews of the participants in the test-drive, 11 people who did not take part in the experiment were interviewed and questioned on lane change decisions. Moreover, the findings of this study have been presented to various groups of audience with different backgrounds (about 150 people). Their comments and feedback on the derived driving strategies have added some value to this study. The findings in this paper form a starting point for developing a novel lane change model which considers four different driving strategies among the drivers on freeway. This is a significant contribution in the area of driving behavior modeling, since the existing microscopic simulators consider only one type of lane change models for all drivers during the simulation. This could lead to significant changes in the way lane changes on freeways are modeled.     

A two-dimensional simulation model for modelling turning vehicles at mixed-flow intersections

The turning behavior is one of the most challenging driving maneuvers under non-protected phase at mixed-flow intersections. Currently, one-dimensional simulation models focus on car-following and gap-acceptance behaviors in pre-defined lanes with few lane-changing behaviors, and they cannot model the lateral and longitudinal behaviors simultaneously, which has limitation in representing the realistic turning behavior. This paper proposes a three-layered “plan-decision-action” (PDA) framework to obtain acceleration and angular velocity in the turning process. The plan layer firstly calculates the two-dimensional optimal path and dynamically adjusts the trajectories according to interacting objects. The decision layer then uses the decision tree method to select a suitable behavior in three alternatives: car-following, turning and yielding. Finally, in the action layer, a set of corresponding operational models specify the decided behavior into control parameters. The proposed model is tested by reproducing 210 trajectories of left-turn vehicles at a two-phase mixed-flow intersection in Shanghai. As a result, the simulation reproduces the variation of trajectories, while the coverage rate of the trajectories is 88.8%. Meanwhile, both the travel time and post-encroachment time of simulation and empirical turning vehicles are similar and do not show statistically significant difference.     

Online calibration of an integrated framework for information‐based evacuation operations

This study seeks to online calibrate the parameters of aggregate evacuee behavior models used in a behavior‐consistent information‐based control module for determining information strategies for real‐time evacuation operations. It enables the deployment of an operational framework for mass evacuation that integrates three aspects underlying an evacuation operation: demand (evacuee behavior), supply (network management), and disaster characteristics. To attain behavior‐consistency, the control module factors evacuees' likely responses to the disseminated information in determining information‐based control strategies. Hence, the ability of the behavior models to predict evacuees' likely responses is critical to the effectiveness of traffic routing by information strategies. The mixed logit structure is used for the aggregate behavior models to accommodate the behavioral heterogeneity across the population. An online calibration problem is proposed to calibrate the random parameters in the behavior models by using the least square estimator to minimize the gap between the predicted network flows and unfolding traffic dynamics. Background traffic, an important but rarely studied issue for modeling evacuation traffic, is also accounted for in the proposed problem. Numerical experiments are conducted to illustrate the importance of the calibration problem for addressing the system consistency issues and integrating the demand, supply, and disaster characteristics for more efficient evacuation operations. Copyright © 2016 John Wiley & Sons, Ltd.     

Modeling car-following behavior on urban expressways in Shanghai: A naturalistic driving study

Although car-following behavior is the core component of microscopic traffic simulation, intelligent transportation systems, and advanced driver assistance systems, the adequacy of the existing car-following models for Chinese drivers has not been investigated with real-world data yet. To address this gap, five representative car-following models were calibrated and evaluated for Shanghai drivers, using 2100 urban-expressway car-following periods extracted from the 161,055 km of driving data collected in the Shanghai Naturalistic Driving Study (SH-NDS). The models were calibrated for each of the 42 subject drivers, and their capabilities of predicting the drivers’ car-following behavior were evaluated.The results show that the intelligent driver model (IDM) has good transferability to model traffic situations not presented in calibration, and it performs best among the evaluated models. Compared to the Wiedemann 99 model used by VISSIM®, the IDM is easier to calibrate and demonstrates a better and more stable performance. These advantages justify its suitability for microscopic traffic simulation tools in Shanghai and likely in other regions of China. Additionally, considerable behavioral differences among different drivers were found, which demonstrates a need for archetypes of a variety of drivers to build a traffic mix in simulation. By comparing calibrated and observed values of the IDM parameters, this study found that (1) interpretable calibrated model parameters are linked with corresponding observable parameters in real world, but they are not necessarily numerically equivalent; and (2) parameters that can be measured in reality also need to be calibrated if better trajectory reproducing capability are to be achieved.     

Predicting and planning airport acceptance rates in metroplex systems for improved traffic flow management decision support

Efficient planning of Airport Acceptance Rates (AARs) is key for the overall efficiency of Traffic Management Initiatives such as Ground Delay Programs (GDPs). Yet, precisely estimating future flow rates is a challenge for traffic managers during daily operations as capacity depends on a number of factors/decisions with very dynamic and uncertain profiles. This paper presents a data-driven framework for AAR prediction and planning towards improved traffic flow management decision support. A unique feature of this framework is to account for operational interdependency aspects that exist in metroplex systems and affect throughput performance. Gaussian Process regression is used to create an airport capacity prediction model capable of translating weather and metroplex configuration forecasts into probabilistic arrival capacity forecasts for strategic time horizons. To process the capacity forecasts and assist the design of traffic flow management strategies, an optimization model for capacity allocation is developed. The proposed models are found to outperform currently used methods in predicting throughput performance at the New York airports. Moreover, when used to prescribe optimal AARs in GDPs, an overall delay reduction of up to 9.7% is achieved. The results also reveal that incorporating robustness in the design of the traffic flow management plan can contribute to decrease delay costs while increasing predictability.     

Stochastic capacity expansion models for airport facilities

It is important and also challenging to plan airport facilities to meet future traffic needs in a rapidly changing environment, which is characterized by various uncertainties. One key issue in airport facility development is that facility performance functions (delay levels as functions of capacity utilization rates) are nonlinear, which complicates the solution method design. Potential demand fluctuations in a deregulated aviation market add another dimension to the decision making process. To solve this problem, a deterministic total cost minimization model is proposed and then extended into stochastic programs, by including uncertainties in traffic forecasts. After the exploration of properties of the delay cost function, an Outer-Approximation (OA) technique which is superior to the existing discrete approximation is designed. After model enhancements, an efficient solution framework based on the OA technique is used to solve the model to its global optimality by interactively generating upper and lower bounds to the objective. Computational tests demonstrate the validity of developed models and efficiency of proposed algorithms. The total cost is reduced by 18.8% with the stochastic program in the numerical example.     

Human-like autonomous car-following model with deep reinforcement learning

This study proposes a framework for human-like autonomous car-following planning based on deep reinforcement learning (deep RL). Historical driving data are fed into a simulation environment where an RL agent learns from trial and error interactions based on a reward function that signals how much the agent deviates from the empirical data. Through these interactions, an optimal policy, or car-following model that maps in a human-like way from speed, relative speed between a lead and following vehicle, and inter-vehicle spacing to acceleration of a following vehicle is finally obtained. The model can be continuously updated when more data are fed in. Two thousand car-following periods extracted from the 2015 Shanghai Naturalistic Driving Study were used to train the model and compare its performance with that of traditional and recent data-driven car-following models. As shown by this study’s results, a deep deterministic policy gradient car-following model that uses disparity between simulated and observed speed as the reward function and considers a reaction delay of 1 s, denoted as DDPGvRT, can reproduce human-like car-following behavior with higher accuracy than traditional and recent data-driven car-following models. Specifically, the DDPGvRT model has a spacing validation error of 18% and speed validation error of 5%, which are less than those of other models, including the intelligent driver model, models based on locally weighted regression, and conventional neural network-based models. Moreover, the DDPGvRT demonstrates good capability of generalization to various driving situations and can adapt to different drivers by continuously learning. This study demonstrates that reinforcement learning methodology can offer insight into driver behavior and can contribute to the development of human-like autonomous driving algorithms and traffic-flow models.     

A review on travel behaviour modelling in dynamic traffic simulation models for evacuations

Dynamic traffic simulation models are frequently used to support decisions when planning an evacuation. This contribution reviews the different (mathematical) model formulations underlying these traffic simulation models used in evacuation studies and the behavioural assumptions that are made. The appropriateness of these behavioural assumptions is elaborated on in light of the current consensus on evacuation travel behaviour, based on the view from the social sciences as well as empirical studies on evacuation behaviour. The focus lies on how travellers’ decisions are predicted through simulation regarding the choice to evacuate, departure time choice, destination choice, and route choice. For the evacuation participation and departure time choice we argue in favour of the simultaneous approach to dynamic evacuation demand prediction using the repeated binary logit model. For the destination choice we show how further research is needed to generalize the current preliminary findings on the location-type specific destination choice models. For the evacuation route choice we argue in favour of hybrid route choice models that enable both following instructed routes and en-route switches. Within each of these discussions, we point at current limitations and make corresponding suggestions on promising future research directions.     

Evaluation of the General Motors based car-following models and a proposed fuzzy inference model

This paper evaluates the properties of the General Motors (GM) based car-following models, identifies their characteristics, and proposes a fuzzy inference logic based model that can overcome some of the shortcomings of the GM based models. This process involves developing a framework for evaluating a car-following model and comparing the behavior predicted by the GM models with the behavior observed under the real world situation. For this purpose, an instrumented vehicle was used to collect data on the headway and speeds of two consecutive vehicles under actual traffic conditions. Shortcomings of the existing GM based models are identified, in particular, the stability conditions were analyzed in detail. A fuzzy-inference based model of car-following is developed to represent the approximate nature of stimulus–response process during driving. This model is evaluated using the same evaluation framework used for the GM models and the data obtained by the instrumented test vehicle. Comparison between the performance of the two models show that the proposed fuzzy inference model can overcome many shortcomings of the GM based car-following models, and can be useful for developing the algorithm for the adaptive cruise control for automated highway system (AHS).     

Behavior-consistent information-based network traffic control for evacuation operations

The evacuation operations problem aims to avoid or mitigate the potential loss of life in a region threatened or affected by a disaster. It is shaped to a large extent by the evolution of evacuation traffic resulting from the demand–supply interactions of the associated transportation network. Information-based control is a strategic tool for evacuation traffic operations as it can enable greater access to the affected population and more effective response. However, comparatively few studies have focused on the implementation of information-based control in evacuation operations. This study develops a control module for evacuation operations centered on addressing the demand–supply interactions by using behavior-consistent information strategies. These strategies incorporate the likely responses of evacuees to the information provided in the determination of route guidance information. The control module works as an iterative computational process involving an evacuee route choice model and a control model of information strategies to determine the route guidance information to direct evacuation traffic so as to approach a desired network traffic flow pattern. The problem is formulated as a fuzzy logic based optimization framework to explicitly incorporate practical concerns related to information dissemination characteristics and social equity in evacuation operations. Numerical experiments highlight the importance of accounting for the demand–supply interactions, as the use of behavior-consistent information strategies can lead evacuee route choices to approach the operator-desired proportions corresponding to the desired traffic pattern. The results also indicate that while a behavior-consistent information strategy can be effective, gaps with the desired route proportions can exist due to the discrete nature of the linguistic messages and the real-world difficulty in accurately modeling evacuees’ actual route choice behavior.     

Incorporating human-factors in car-following models: A review of recent developments and research needs

Over the past decades there has been a considerable development in the modeling of car-following (CF) behavior as a result of research undertaken by both traffic engineers and traffic psychologists. While traffic engineers seek to understand the behavior of a traffic stream, traffic psychologists seek to describe the human abilities and errors involved in the driving process. This paper provides a comprehensive review of these two research streams.It is necessary to consider human-factors in CF modeling for a more realistic representation of CF behavior in complex driving situations (for example, in traffic breakdowns, crash-prone situations, and adverse weather conditions) to improve traffic safety and to better understand widely-reported puzzling traffic flow phenomena, such as capacity drop, stop-and-go oscillations, and traffic hysteresis. While there are some excellent reviews of CF models available in the literature, none of these specifically focuses on the human factors in these models.This paper addresses this gap by reviewing the available literature with a specific focus on the latest advances in car-following models from both the engineering and human behavior points of view. In so doing, it analyses the benefits and limitations of various models and highlights future research needs in the area.     

EMBLEM2: An empirically based large scale evacuation time estimate model

This article describes a simple, rapid method for calculating evacuation time estimates (ETEs) that is compatible with research findings about evacuees’ behavior in hurricanes. This revision of an earlier version of the empirically based large scale evacuation time estimate method (EMBLEM) uses empirical data derived from behavioral surveys and allows local emergency managers to calculate ETEs by specifying four evacuation route system parameters, 16 behavioral parameters, and five evacuation scope/timing parameters. EMBLEM2 is implemented within a menu-driven evacuation management decision support system (EMDSS) that local emergency managers can use to calculate ETEs and conduct sensitivity analyses to examine the effects of plausible variation in the parameters. In addition, they can run EMDSS in real time (less than 10 min of run time) to recalculate ETEs while monitoring an approaching hurricane. The article provides an example using EMDSS to calculate ETEs for San Patricio County Texas and discusses directions for further improvements of the model.     

A marginal utility day-to-day traffic evolution model based on one-step strategic thinking

Most deterministic day-to-day traffic evolution models, either in continuous-time or discrete-time space, have been formulated based on a fundamental assumption on driver route choice rationality where a driver seeks to maximize her/his marginal benefit defined as the difference between the perceived route costs. The notion of rationality entails the exploration of the marginal decision rule from economic theory, which states that a rational individual evaluates his/her marginal utility, defined as the difference between the marginal benefit and the marginal cost, of each incremental decision. Seeking to analyze the marginal decision rule in the modeling of deterministic day-to-day traffic evolution, this paper proposes a modeling framework which introduces a term to capture the marginal cost to the driver induced by route switching. The proposed framework enables to capture both benefit and cost associated with route changes. The marginal cost is then formulated upon the assumption that drivers are able to predict other drivers’ responses to the current traffic conditions, which is adopted based on the notion of strategic thinking of rational players developed in behavior game theory. The marginal cost based on 1-step strategic thinking also describes the “shadow price” of shifting routes, which helps to explain the behavioral tendency of the driver perceiving the cost-sensitivity to link/route flows. After developing a formulation of the marginal utility day-to-day model, its theoretical properties are analyzed, including the invariance property, asymptotic stability, and relationship with the rational behavioral adjustment process.     

Dynamic travel mode searching and switching analysis considering hidden model preference and behavioral decision processes

This paper proposes a conceptual framework to model the travel mode searching and switching dynamics. The proposed approach is structurally different from existing mode choice models in the way that a non-homogeneous hidden Markov model (HMM) has been constructed and estimated to model the dynamic mode srching process. In the proposed model, each hidden state represents the latent modal preference of each traveler. The empirical application suggests that the states can be interpreted as car loving and carpool/transit loving, respectively. At each time period, transitions between the states are functions of time-varying covariates such as travel time and travel cost of the habitual modes. The level-of-service (LOS) changes are believed to have an enduring impact by shifting travelers to a different state. While longitudinal data is not readily available, the paper develops an easy-to-implement memory-recall survey to collect required process data for the empirical estimation. Bayesian estimation and Markov chain Monte Carlo method have been applied to implement full Bayesian inference. As demonstrated in the paper, the estimated HMM is reasonably sensitive to mode-specific LOS changes and can capture individual and system dynamics. Once applied with travel demand and/or traffic simulation models, the proposed model can describe time-dependent multimodal behavior responses to various planning/policy stimuli.     

A car-following model considering asymmetric driving behavior based on long short-term memory neural networks

Asymmetric driving behavior is a critical characteristic of human driving behaviors and has a significant impact on traffic flow. In consideration of the asymmetric driving behavior, this paper proposes a long short-term memory (LSTM) neural networks (NN) based car-following (CF) model to capture realistic traffic flow characteristics by incorporating the driving memory. The NGSIM data are used to calibrate and validate the proposed CF model. Meanwhile, three characteristics closely related to the asymmetric driving behavior are investigated: hysteresis, discrete driving, and intensity difference. The simulation results show the good performance of the proposed CF model on reproducing realistic traffic flow features. Moreover, to further demonstrate the superiority of the proposed CF model, two other CF models including recurrent neural network based CF model and asymmetric full velocity difference model, are compared with LSTM-NN model. The results reveal that LSTM-NN model can capture the asymmetric driving behavior well and outperforms other models.     

Validation of an agent based model using a participatory simulation gaming approach: The case of city logistics

Agent-based modeling is used for simulating the actions and interactions of autonomous entities aiming to assessing their effects on the system as a whole. At an abstract level, an agent-based model (ABM) is a representation of the many simple agents and interactions among them. The decision making of the agents is based on the rules given to them. In an ABM, the model output is the result of internal decision-making and may differ with alteration in the decision path. On the contrary, with the set of rules embedded in agents, their behavior is modeled to take a ‘certain action’ in a ‘certain situation’. It suggests that the internal decision making behavior of agents is truly responsible for the model output and thus it cannot be ignored while validating ABMs. This research article focuses on the validating agents’ behavior by evaluating decision-making processes of agents. For this purpose, we propose a validation framework based on a participatory simulation game. Using this framework we engage a human player (i.e. a domain stakeholder) to allow us to collect information about choices and validate the behavior of an individual agent. A proof-of-concept game is developed for a city logistics ABM to test the framework.     

Trajectory data reconstruction and simulation-based validation against macroscopic traffic patterns

This paper shows that the behavior of driver models, either individually or entangled in stochastic traffic simulation, is affected by the accuracy of empirical vehicle trajectories. To this aim, a “traffic-informed” methodology is proposed to restore physical and platoon integrity of trajectories in a finite time–space domain, and it is applied to one NGSIM I80 dataset. However, as the actual trajectories are unknown, it is not possible to verify directly whether the reconstructed trajectories are really “nearer” to the actual unknowns than the original measurements. Therefore, a simulation-based validation framework is proposed, that is also able to verify indirectly the efficacy of the reconstruction methodology. The framework exploits the main feature of NGSIM-like data that is the concurrent view of individual driving behaviors and emerging macroscopic traffic patterns. It allows showing that, at the scale of individual models, the accuracy of trajectories affects the distribution and the correlation structure of lane-changing model parameters (i.e. drivers heterogeneity), while it has very little impact on car-following calibration. At the scale of traffic simulation, when models interact in trace-driven simulation of the I80 scenario (multi-lane heterogeneous traffic), their ability to reproduce the observed macroscopic congested patterns is sensibly higher when model parameters from reconstructed trajectories are applied. These results are mainly due to lane changing, and are also the sought indirect validation of the proposed data reconstruction methodology.     

Modeling lane-changing behavior in a connected environment: A game theory approach

Vehicle-to-Vehicle communications provide the opportunity to create an internet of cars through the recent advances in communication technologies, processing power, and sensing technologies. A connected vehicle receives real-time information from surrounding vehicles; such information can improve drivers’ awareness about their surrounding traffic condition and lead to safer and more efficient driving maneuvers. Lane-changing behavior, as one of the most challenging driving maneuvers to understand and to predict, and a major source of congestion and collisions, can benefit from this additional information. This paper presents a lane-changing model based on a game-theoretical approach that endogenously accounts for the flow of information in a connected vehicular environment. A calibration approach based on the method of simulated moments is presented and a simplified version of the proposed framework is calibrated against NGSIM data. The prediction capability of the simplified model is validated. It is concluded the presented framework is capable of predicting lane-changing behavior with limitations that still need to be addressed. Finally, a simulation framework based on the fictitious play is proposed. The simulation results revealed that the presented lane-changing model provides a greater level of realism than a basic gap-acceptance model.