An algorithm for combining autonomous vehicles and controlled events in driving simulator experiments

Autonomous vehicles can be used to create realistic simulations of surrounding vehicles in driving simulators. However, the use of autonomous vehicles makes it difficult to ensure reproducibility between subjects. In this paper, an effort is made to solve the problem by combining autonomous vehicles and controlled events. A controlled event can be compared to a theatre play. The aim is to achieve the same initial play conditions for each subject, which can be problematic since the traffic situation around the subject will be dependent upon each subject’s actions while driving in autonomous traffic. This paper presents an algorithm that achieves the transition from autonomous traffic to a predefined start condition for a play. The algorithm has been tested in the Swedish National Road and Transport Research Institute (VTI) driving simulator III with promising results. In most of the cases we examined the algorithm could reconstruct the specified start condition and conduct the transition from autonomous to controlled mode in a inconspicuous way. Some problems were observed regarding moving unwanted vehicles away from the closest area around the simulator vehicle, and this part of the algorithm has to be enhanced. The experiment also showed that the subjects drove faster in the presence of controlled everyday life traffic normally used in the VTI driving simulator than in autonomous traffic.     

Development of simulated driving cycles for light,medium, and heavy duty trucks: Case of the Toronto Waterfront Area

Driving cycles are an important input for state-of-the-art vehicle emission models. Development of a driving cycle requires second-by-second vehicle speed for a representative set of vehicles. Current standard driving cycles cannot reflect or forecast changes in traffic conditions. This paper introduces a method to develop representative driving cycles using simulated data from a calibrated microscopic traffic simulation model of the Toronto Waterfront Area. The simulation model is calibrated to reflect road counts, link speeds, and accelerations using a multi-objective genetic algorithm. The simulation is validated by comparing simulated vs. observed passenger freeway cycles. The simulation method is applied to develop AM peak hour driving cycles for light, medium and heavy duty trucks. The demonstration reveals differences in speed, acceleration, and driver aggressiveness between driving cycles for different vehicle types. These driving cycles are compared against a range of available driving cycles, showing different traffic conditions and driving behaviors, and suggesting a need for city-specific driving cycles. Emissions from the simulated driving cycles are also compared with EPA’s Heavy Duty Urban Dynamometer Driving Schedule showing higher emission factors for the Toronto Waterfront cycles.     

Influence of connected and autonomous vehicles on traffic flow stability and throughput

The introduction of connected and autonomous vehicles will bring changes to the highway driving environment. Connected vehicle technology provides real-time information about the surrounding traffic condition and the traffic management center’s decisions. Such information is expected to improve drivers’ efficiency, response, and comfort while enhancing safety and mobility. Connected vehicle technology can also further increase efficiency and reliability of autonomous vehicles, though these vehicles could be operated solely with their on-board sensors, without communication. While several studies have examined the possible effects of connected and autonomous vehicles on the driving environment, most of the modeling approaches in the literature do not distinguish between connectivity and automation, leaving many questions unanswered regarding the implications of different contemplated deployment scenarios. There is need for a comprehensive acceleration framework that distinguishes between these two technologies while modeling the new connected environment. This study presents a framework that utilizes different models with technology-appropriate assumptions to simulate different vehicle types with distinct communication capabilities. The stability analysis of the resulting traffic stream behavior using this framework is presented for different market penetration rates of connected and autonomous vehicles. The analysis reveals that connected and autonomous vehicles can improve string stability. Moreover, automation is found to be more effective in preventing shockwave formation and propagation under the model’s assumptions. In addition to stability, the effects of these technologies on throughput are explored, suggesting substantial potential throughput increases under certain penetration scenarios.     

A hybrid controller for autonomous vehicles driving on automated highways

This paper addresses the problem of the hybrid control of autonomous vehicles driving on automated highways. Vehicles are autonomous, so they do not communicate with each other nor with the infrastructure. Two problems have to be dealt with: a vehicle driving in a single-lane highway must never collide with its leading vehicle; and a vehicle entering the highway at a designated entry junction must be able to merge from the merging lane to the main lane, again without any collision. To solve these problems, we equip each vehicle with a hybrid controller, consisting of several continuous control laws embedded inside a finite state automaton. The automaton specifies when a given vehicle must enter the highway, merge into the main lane, yield to other vehicles, exit from the highway, and so on. The continuous control laws specify what acceleration the vehicle must have in order to avoid collisions with nearby vehicles. By carefully designing these control laws and the conditions guarding the automaton transitions, we are able to demonstrate three important results. First, we state the initial conditions guaranteeing that a following vehicle never collides with its leading vehicle. Second, we extend this first result to a lane of autonomous vehicles. Third, we prove that if all the vehicles are equipped with our hybrid controller, then no collision can ever occur, and all vehicles either merge successfully or are forced to drop out when they reach the end of their merging lane. Finally, we show the outcome of a highway microsimulation modelled after the Katy Corridor near Houston, Texas: our single-lane highway can accommodate 4000 vehicles per hour with neither drop-outs nor traffic congestion. It is entirely programmed in SHIFT, a hybrid systems simulation language developed at UC Berkeley by the PATH group. This shows that SHIFT is a well suited language for designing safe control laws for autonomous highway systems, among others.     

Adaptive cruise control design for active congestion avoidance

We present an adaptive cruise control (ACC) strategy where the acceleration characteristics, that is, the driving style automatically adapts to different traffic situations. The three components of the concept are the ACC itself, implemented in the form of a car-following model, an algorithm for the automatic real-time detection of the traffic situation based on local information, and a strategy matrix to adapt the driving characteristics (that is, the parameters of the ACC controller) to the traffic conditions. Optionally, inter-vehicle and infrastructure-to-car communication can be used to improve the accuracy of determining the traffic states. Within a microscopic simulation framework, we have simulated the complete concept on a road section with an on-ramp bottleneck, using empirical loop-detector data for an afternoon rush-hour as input for the upstream boundary. We found that the ACC vehicles improve the traffic stability and the dynamic road capacity. While traffic congestion in the reference scenario was completely eliminated when simulating a proportion of 25% ACC vehicles, travel times were already significantly reduced for much lower penetration rates. The efficiency of the proposed driving strategy even for low market penetrations is a promising result for a successful application in future driver assistance systems.     

Modeling lane-changing behavior in a connected environment: A game theory approach

Vehicle-to-Vehicle communications provide the opportunity to create an internet of cars through the recent advances in communication technologies, processing power, and sensing technologies. A connected vehicle receives real-time information from surrounding vehicles; such information can improve drivers’ awareness about their surrounding traffic condition and lead to safer and more efficient driving maneuvers. Lane-changing behavior, as one of the most challenging driving maneuvers to understand and to predict, and a major source of congestion and collisions, can benefit from this additional information. This paper presents a lane-changing model based on a game-theoretical approach that endogenously accounts for the flow of information in a connected vehicular environment. A calibration approach based on the method of simulated moments is presented and a simplified version of the proposed framework is calibrated against NGSIM data. The prediction capability of the simplified model is validated. It is concluded the presented framework is capable of predicting lane-changing behavior with limitations that still need to be addressed. Finally, a simulation framework based on the fictitious play is proposed. The simulation results revealed that the presented lane-changing model provides a greater level of realism than a basic gap-acceptance model.     

Dissipation of stop-and-go waves via control of autonomous vehicles: Field experiments

Traffic waves are phenomena that emerge when the vehicular density exceeds a critical threshold. Considering the presence of increasingly automated vehicles in the traffic stream, a number of research activities have focused on the influence of automated vehicles on the bulk traffic flow. In the present article, we demonstrate experimentally that intelligent control of an autonomous vehicle is able to dampen stop-and-go waves that can arise even in the absence of geometric or lane changing triggers. Precisely, our experiments on a circular track with more than 20 vehicles show that traffic waves emerge consistently, and that they can be dampened by controlling the velocity of a single vehicle in the flow. We compare metrics for velocity, braking events, and fuel economy across experiments. These experimental findings suggest a paradigm shift in traffic management: flow control will be possible via a few mobile actuators (less than 5%) long before a majority of vehicles have autonomous capabilities.     

Exploring the impact of connected and autonomous vehicles on freeway capacity using a revised Intelligent Driver Model

ABSTRACT

Connected and autonomous vehicle (CAV) technologies are expected to change driving/vehicle behavior on freeways. This study investigates the impact of CAVs on freeway capacity using a microsimulation tool. A four-lane basic freeway segment is selected as the case study through the Caltrans Performance Measurement System (PeMS). To obtain valid results, various driving behavior parameters are calibrated to the real traffic conditions for human-driven vehicles. In particular, the calibration is conducted using genetic algorithm. A revised Intelligent Driver Model (IDM) is developed and used as the car-following model for CAVs. The simulation is conducted on the basic freeway segment under different penetration rates of CAVs and different freeway speed limits. The results show that with an increase in the market penetration rate, freeway capacity increases, and will increase significantly as the speed limit increases.     

Human-like autonomous car-following model with deep reinforcement learning

This study proposes a framework for human-like autonomous car-following planning based on deep reinforcement learning (deep RL). Historical driving data are fed into a simulation environment where an RL agent learns from trial and error interactions based on a reward function that signals how much the agent deviates from the empirical data. Through these interactions, an optimal policy, or car-following model that maps in a human-like way from speed, relative speed between a lead and following vehicle, and inter-vehicle spacing to acceleration of a following vehicle is finally obtained. The model can be continuously updated when more data are fed in. Two thousand car-following periods extracted from the 2015 Shanghai Naturalistic Driving Study were used to train the model and compare its performance with that of traditional and recent data-driven car-following models. As shown by this study’s results, a deep deterministic policy gradient car-following model that uses disparity between simulated and observed speed as the reward function and considers a reaction delay of 1 s, denoted as DDPGvRT, can reproduce human-like car-following behavior with higher accuracy than traditional and recent data-driven car-following models. Specifically, the DDPGvRT model has a spacing validation error of 18% and speed validation error of 5%, which are less than those of other models, including the intelligent driver model, models based on locally weighted regression, and conventional neural network-based models. Moreover, the DDPGvRT demonstrates good capability of generalization to various driving situations and can adapt to different drivers by continuously learning. This study demonstrates that reinforcement learning methodology can offer insight into driver behavior and can contribute to the development of human-like autonomous driving algorithms and traffic-flow models.     

A trajectory smoothing method at signalized intersection based on individualized variable speed limits with location optimization

Traffic signals on urban highways force vehicles to stop frequently and thus causes excessive travel delay, extra fuel consumption and emissions, and increased safety hazards. To address these issues, this paper proposes a trajectory smoothing method based on Individual Variable Speed Limits with Location Optimization (IVSL-LC) in coordination with pre-fixed traffic signals. This method dynamically imposes speed limits on some identified Target Controlled Vehicles (TCVs) with Vehicle to Infrastructures (V2I) communication ability at two IVSL points along an approaching lane. According to real-time traffic demand and signal timing information, the trajectories of each approaching vehicle are made to run smoothly without any full stop. Essentially, only TCVs’ trajectories need to be controlled and the other vehicles just follow TCVs with Gipps’ car-following model. The Dividing RECTangles (DIRECT) algorithm is used to optimize the locations of the IVSLs. Numerical simulation is conducted to compare the benchmark case without vehicle control, the individual advisory speed limits (IASL) and the proposed IVSL-LC. The result shows that compared with the benchmark, the IVSL-LC method can greatly increase traffic efficiency and reduce fuel consumption. Compared with IASL, IVSL-LC has better performance across all traffic demand levels, and the improvements are the most under high traffic demand. Finally, the results of compliance analysis show that the effect of IVSL-LC improves as the compliance rate increases.     

Customizing driving cycles to support vehicle purchase and use decisions: Fuel economy estimation for alternative fuel vehicle users

Wider deployment of alternative fuel vehicles (AFVs) can help with increasing energy security and transitioning to clean vehicles. Ideally, adopters of AFVs are able to maintain the same level of mobility as users of conventional vehicles while reducing energy use and emissions. Greater knowledge of AFV benefits can support consumers’ vehicle purchase and use choices. The Environmental Protection Agency’s fuel economy ratings are a key source of potential benefits of using AFVs. However, the ratings are based on pre-designed and fixed driving cycles applied in laboratory conditions, neglecting the attributes of drivers and vehicle types. While the EPA ratings using pre-designed and fixed driving cycles may be unbiased they are not necessarily precise, owning to large variations in real-life driving. Thus, to better predict fuel economy for individual consumers targeting specific types of vehicles, it is important to find driving cycles that can better represent consumers’ real-world driving practices instead of using pre-designed standard driving cycles. This paper presents a methodology for customizing driving cycles to provide convincing fuel economy predictions that are based on drivers’ characteristics and contemporary real-world driving, along with validation efforts. The methodology takes into account current micro-driving practices in terms of maintaining speed, acceleration, braking, idling, etc., on trips. Specifically, using a large-scale driving data collected by in-vehicle Global Positioning System as part of a travel survey, a micro-trips (building block) library for California drivers is created using 54 million seconds of vehicle trajectories on more than 60,000 trips, made by 3000 drivers. To generate customized driving cycles, a new tool, known as Case Based System for Driving Cycle Design, is developed. These customized cycles can predict fuel economy more precisely for conventional vehicles vis-à-vis AFVs. This is based on a consumer’s similarity in terms of their own and geographical characteristics, with a sample of micro-trips from the case library. The AFV driving cycles, created from real-world driving data, show significant differences from conventional driving cycles currently in use. This further highlights the need to enhance current fuel economy estimations by using customized driving cycles, helping consumers make more informed vehicle purchase and use decisions.     

Dynamic charging-while-driving systems for freight delivery services with electric vehicles: Traffic and energy modelling

This paper presents a research on traffic modelling developed for assessing traffic and energy performance of electric systems installed along roads for dynamic charging-while-driving (CWD) of fully electric vehicles (FEVs).The logic adopted by the developed traffic model is derived from a particular simulation scenario of electric charging: a freight distribution service operated using medium-sized vans. In this case, the CWD service is used to recover the state of charge of the FEV batteries to shortly start with further activities after arrival at the depot.The CWD system is assumed to be implemented in a multilane ring road with several intermediate on-ramp entrances, where the slowest lane is reserved for the dynamic charging of authorized electric vehicles. A specific traffic model is developed and implemented based on a mesoscopic approach, where energy requirements and charging opportunities affect driving and traffic behaviours. Overtaking manoeuvres as well as new entries in the CWD lane of vehicles that need to charge are modelled according to a cooperative driving system, which manages adequate time gaps between consecutive vehicles. Finally, a speed control strategy is simulated at a defined node to create an empty time-space slot in the CWD lane, by delaying the arriving vehicles. This simulated control, implemented to allow maintenance operations for CWD that may require clearing a charging zone for a short time slot, could also be applied to facilitate on-ramp merging manoeuvres.     

A control theoretic formulation of green driving strategies based on inter-vehicle communications

Various green driving strategies have been proposed to smooth traffic flow and lower pollutant emissions and fuel consumption in stop-and-go traffic. In this paper, we present a control theoretic formulation of distributed, cooperative green driving strategies based on inter-vehicle communications (IVCs). The control variable is the advisory speed limit, which is designed to smooth a following vehicle’s speed profile without changing its average speed. We theoretically analyze the performance of a constant independent and three simple cooperative green driving strategies and present three rules for effective and robust strategies. We then develop a distributed cooperative green driving strategy, in which the advisory speed limit is first independently calculated by each individual vehicle and then averaged among green driving vehicles through IVC. By simulations with Newell’s car-following model and the Comprehensive Modal Emissions Model (CMEM), we demonstrate that such a strategy is effective and robust independently as well as cooperatively for different market penetration rates of IVC-equipped vehicles and communication delays. In particular, even when 5% of the vehicles implement the green driving strategy and the IVC communication delay is 60 s, the fuel consumption can be reduced by up to 15%. Finally we discuss some future extensions.     

Towards an understanding of adaptive cruise control

Adaptive cruise control (ACC) provides assistance to the driver in the task of longitudinal control of their vehicle during motorway driving. The system controls the accelerator, engine powertrain and vehicle brakes to maintain a desired time-gap to the vehicle ahead. This research describes the results of a detailed microscopic simulation investigation into the potential impacts of ACC on motorway driving. In addition to simulation, real vehicle driving profiles, obtained from instrumented vehicle experiments in three European countries, have been used to compare real following behaviour with that of a simulated ACC equipped vehicle. This new approach has shown that following with an ACC system can provide considerable reductions in the variation of acceleration compared to manual driving. This indicates a potential comfort gain for the driver and environmental benefits. A number of critical situations in which ACC does not perform well have also been identified. The research also highlights the limitations of microscopic simulation in modelling the impacts of ACC because of the lack of understanding of the interaction between the driver and the ACC system relative to the traffic conditions.     

Length-based vehicle classification using event-based loop detector data

Length-based vehicle classification is an important topic in traffic engineering, because estimation of traffic speed from single loop detectors usually requires the knowledge of vehicle length. In this paper, we present an algorithm that can classify vehicles passing by a loop detector into two categories: long vehicles and regular cars. The proposed algorithm takes advantage of event-based loop detector data that contains every vehicle detector actuation and de-actuation “event”, therefore time gaps between consecutive vehicles and detector occupation time for each vehicle can be easily derived. The proposed algorithm is based on an intuitive observation that, for a vehicle platoon, longer vehicles in the platoon will have relatively longer detector occupation time. Therefore, we can identify longer vehicles by examining the changes of occupation time in a vehicle platoon. The method was tested using the event-based data collected from Trunk Highway 55 in Minnesota, which is a high speed arterial corridor controlled by semi-actuated coordinated traffic signals. The result shows that the proposed method can correctly classify most of the vehicles passing by a single loop detector.     

Connectivity-based optimization of vehicle route and speed for improved fuel economy

Traditionally, vehicle route planning problem focuses on route optimization based on traffic data and surrounding environment. This paper proposes a novel extended vehicle route planning problem, called vehicle macroscopic motion planning (VMMP) problem, to optimize vehicle route and speed simultaneously using both traffic data and vehicle characteristics to improve fuel economy for a given expected trip time. The required traffic data and neighbouring vehicle dynamic parameters can be collected through the vehicle connectivity (e.g. vehicle-to-vehicle, vehicle-to-infrastructure, vehicle-to-cloud, etc.) developed rapidly in recent years. A genetic algorithm based co-optimization method, along with an adaptive real-time optimization strategy, is proposed to solve the proposed VMMP problem. It is able to provide the fuel economic route and reference speed for drivers or automated vehicles to improve the vehicle fuel economy. A co-simulation model, combining a traffic model based on SUMO (Simulation of Urban MObility) with a Simulink powertrain model, is developed to validate the proposed VMMP method. Four simulation studies, based on a real traffic network, are conducted for validating the proposed VMMP: (1) ideal traffic environment without traffic light and jam for studying the fuel economy improvement, (2) traffic environment with traffic light for validating the proposed traffic light penalty model, (3) traffic environment with traffic light and jam for validating the proposed adaptive real-time optimization strategy, and (4) investigating the effect of different powertrain platforms to fuel economy using two different vehicle platforms. Simulation results show that the proposed VMMP method is able to improve vehicle fuel economy significantly. For instance, comparing with the fastest route, the fuel economy using the proposed VMMP method is improved by up to 15%.     

User preferences regarding autonomous vehicles

This study gains insight into individual motivations for choosing to own and use autonomous vehicles and develops a model for autonomous vehicle long-term choice decisions. A stated preference questionnaire is distributed to 721 individuals living across Israel and North America. Based on the characteristics of their current commutes, individuals are presented with various scenarios and asked to choose the car they would use for their commute. A vehicle choice model which includes three options is estimated:

• (1)Continue to commute using a regular car that you have in your possession.
• (2)Buy and shift to commuting using a privately-owned autonomous vehicle (PAV).
• (3)Shift to using a shared-autonomous vehicle (SAV), from a fleet of on-demand cars for your commute.

A factor analysis determined five relevant latent variables describing the individuals’ attitudes: technology interest, environmental concern, enjoy driving, public transit attitude, and pro-AV sentiments. The effects that the characteristics of the individual and the autonomous vehicle have on use and acceptance are quantified through random utility models including logit kernel model taking into account panel effects.Currently, large overall hesitations towards autonomous vehicle adoption exist, with 44% of choice decisions remaining regular vehicles. Early AV adopters will likely be young, students, more educated, and spend more time in vehicles. Even if the SAV service were to be completely free, only 75% of individuals would currently be willing to use SAVs. The study also found various differences regarding the preferences of individuals in Israel and North America, namely that Israelis are overall more likely to shift to autonomous vehicles.Methods to encourage SAV use include increasing the costs for regular cars as well as educating the public about the benefits of shared autonomous vehicles.     

Fine-tuning ADAS algorithm parameters for optimizing traffic safety and mobility in connected vehicle environment

Under the Connected Vehicle environment where vehicles and road-side infrastructure can communicate wirelessly, the Advanced Driver Assistance Systems (ADAS) can be adopted as an actuator for achieving traffic safety and mobility optimization at highway facilities. In this regard, the traffic management centers need to identify the optimal ADAS algorithm parameter set that leads to the optimization of the traffic safety and mobility performance, and broadcast the optimal parameter set wirelessly to individual ADAS-equipped vehicles. Once the ADAS-equipped drivers implement the optimal parameter set, they become active agents that work cooperatively to prevent traffic conflicts, and suppress the development of traffic oscillations into heavy traffic jams. Measuring systematic effectiveness of this traffic management requires am analytic capability to capture the quantified impact of the ADAS on individual drivers’ behaviors and the aggregated traffic safety and mobility improvement due to such an impact. To this end, this research proposes a synthetic methodology that incorporates the ADAS-affected driving behavior modeling and state-of-the-art microscopic traffic flow modeling into a virtually simulated environment. Building on such an environment, the optimal ADAS algorithm parameter set is identified through a multi-objective optimization approach that uses the Genetic Algorithm. The developed methodology is tested at a freeway facility under low, medium and high ADAS market penetration rate scenarios. The case study reveals that fine-tuning the ADAS algorithm parameter can significantly improve the throughput and reduce the traffic delay and conflicts at the study site in the medium and high penetration scenarios. In these scenarios, the ADAS algorithm parameter optimization is necessary. Otherwise the ADAS will intensify the behavior heterogeneity among drivers, resulting in little traffic safety improvement and negative mobility impact. In the high penetration rate scenario, the identified optimal ADAS algorithm parameter set can be used to support different control objectives (e.g., safety improvement has priority vs. mobility improvement has priority).     

Connected cruise control among human-driven vehicles: Experiment-based parameter estimation and optimal control design

In this paper, we consider connected cruise control design in mixed traffic flow where most vehicles are human-driven. We first propose a sweeping least square method to estimate in real time feedback gains and driver reaction time of human-driven vehicles around the connected automated vehicle. Then we propose an optimal connected cruise controller based on the mean dynamics of human driving behavior. We test the performance of both the estimation algorithm and the connected cruise control algorithm using experimental data. We demonstrate that by combining the proposed estimation algorithm and the optimal controller, the connected automated vehicle has significantly improved performance compared to a human-driven vehicle.     

Fuel economy improvements for urban driving: Hybrid vs. intelligent vehicles

The quest for more fuel-efficient vehicles is being driven by the increasing price of oil. Hybrid electric powertrains have established a presence in the marketplace primarily based on the promise of fuel savings through the use of an electric motor in place of the internal combustion engine during different stages of driving. However, these fuel savings associated with hybrid vehicle operation come at the tradeoff of a significantly increased initial vehicle cost due to the increased complexity of the powertrain. On the other hand, telematics-enabled vehicles may use a relatively cheap sensor network to develop information about the traffic environment in which they are operating, and subsequently adjust their drive cycle to improve fuel economy based on this information – thereby representing ‘intelligent’ use of existing powertrain technology to reduce fuel consumption. In this paper, hybrid and intelligent technologies using different amounts of traffic flow information are compared in terms of fuel economy over common urban drive cycles. In order to develop a fair comparison between the technologies, an optimal (for urban driving) hybrid vehicle that matches the performance characteristics of the baseline intelligent vehicle is used. The fuel economy of the optimal hybrid is found to have an average of 20% improvement relative to the baseline vehicle across three different urban drive cycles. Feedforward information about traffic flow supplied by telematics capability is then used to develop alternative driving cycles firstly under the assumption there are no constraints on the intelligent vehicle’s path, and then taking into account in the presence of ‘un-intelligent’ vehicles on the road. It is observed that with telematic capability, the fuel economy improvements equal that achievable with a hybrid configuration with as little as 7 s traffic look-ahead capability, and can be as great as 33% improvement relative to the un-intelligent baseline drivetrain. As a final investigation, the two technologies are combined and the potential for using feedforward information from a sensor network with a hybrid drivetrain is discussed.