Nonlinear gating control for urban road traffic network using the network fundamental diagram

This work proposes a nonlinear model predictive controller for the urban gating problem. The system model is formalized based on a research on existing models of the network fundamental diagram and the perimeter control systems. For the existing models, modifications are suggested: additional state variables are allocated to describe the queue dynamics at the network gates. Using the extended model, a nonlinear model predictive controller is designed offering a ‘non‐greedy’ policy compared with previous, ‘greedy’ gating control designs. The greedy and non‐greedy nonlinear model predictive control (NMPC) controllers are compared with a greedy linear feedback proportional‐integral‐derivative (PID) controller in different traffic situations. The proposed non‐greedy NMPC controller outperforms the other two approaches in terms of travel distance performance and queue lengths. The performance results justify the consideration of queue lengths in dynamic modeling, and the use of NMPC approach for controller design. Copyright © 2014 John Wiley & Sons, Ltd.     

Adaptive traffic signal control with actor-critic methods in a real-world traffic network with different traffic disruption events

The transportation demand is rapidly growing in metropolises, resulting in chronic traffic congestions in dense downtown areas. Adaptive traffic signal control as the principle part of intelligent transportation systems has a primary role to effectively reduce traffic congestion by making a real-time adaptation in response to the changing traffic network dynamics. Reinforcement learning (RL) is an effective approach in machine learning that has been applied for designing adaptive traffic signal controllers. One of the most efficient and robust type of RL algorithms are continuous state actor-critic algorithms that have the advantage of fast learning and the ability to generalize to new and unseen traffic conditions. These algorithms are utilized in this paper to design adaptive traffic signal controllers called actor-critic adaptive traffic signal controllers (A-CATs controllers).The contribution of the present work rests on the integration of three threads: (a) showing performance comparisons of both discrete and continuous A-CATs controllers in a traffic network with recurring congestion (24-h traffic demand) in the upper downtown core of Tehran city, (b) analyzing the effects of different traffic disruptions including opportunistic pedestrians crossing, parking lane, non-recurring congestion, and different levels of sensor noise on the performance of A-CATS controllers, and (c) comparing the performance of different function approximators (tile coding and radial basis function) on the learning of A-CATs controllers. To this end, first an agent-based traffic simulation of the study area is carried out. Then six different scenarios are conducted to find the best A-CATs controller that is robust enough against different traffic disruptions. We observe that the A-CATs controller based on radial basis function networks (RBF (5)) outperforms others. This controller is benchmarked against controllers of discrete state Q-learning, Bayesian Q-learning, fixed time and actuated controllers; and the results reveal that it consistently outperforms them.     

Model based urban traffic control,part I: Local model and local model predictive controllers

This paper is the first in a series of reports presenting a framework for the hierarchical design of feedback controllers for traffic lights in urban networks. The goal of the research is to develop an easy to understand methodology for designing model based feedback controllers that use the current state estimate in order to select the next switching times of traffic lights. In this paper we introduce an extension of the cell transmission model that describes with sufficient accuracy the major causes of delay for urban traffic. We show that this model is computationally fast enough such that it can be used in a model predictive controller that decides for each intersection, taking into account the vehicle density as estimated along all links connected to the intersection, what switching time minimizes the local delay for all vehicles over a prediction horizon of a few minutes. The implementation of this local MPC only requires local online measurements and local model information (unlike the coordinated MPC, to be introduced in the next paper in this series, that takes into account interactions between neighbouring intersections). We study the performance of the proposed local MPC via simulation on a simple 4 by 4 Manhattan grid, comparing its delay with an efficiently tuned pretimed control for the traffic lights, and with traffic lights controlled according to the max pressure rule. These simulations show that the proposed local MPC controller achieves a significant reduction in delay for various traffic conditions.     

Multi-scale perimeter control approach in a connected-vehicle environment

This paper proposes a novel approach to integrate optimal control of perimeter intersections (i.e. to minimize local delay) into the perimeter control scheme (i.e. to optimize traffic performance at the network level). This is a complex control problem rarely explored in the literature. In particular, modeling the interaction between the network level control and the local level control has not been fully considered. Utilizing the Macroscopic Fundamental Diagram (MFD) as the traffic performance indicator, we formulate a dynamic system model, and design a Model Predictive Control (MPC) based controller coupling two competing control objectives and optimizing the performance at the local and the network level as a whole. To solve this highly non-linear optimization problem, we employ an approximation framework, enabling the optimal solution of this large-scale problem to be feasible and efficient. Numerical analysis shows that by applying the proposed controller, the protected network can operate around the desired state as expressed by the MFD, while the total delay at the perimeter is minimized as well. Moreover, the paper sheds light on the robustness of the proposed controller. This multi-scale hybrid controller is further extended to a stochastic MPC scheme, where connected vehicles (CV) serve as the only data source. Hence, low penetration rates of CVs lead to strong noises in the controller. This is a first attempt to develop a network-level traffic control methodology by using the emerging CV technology. We consider the stochasticity in traffic state estimation and the shape of the MFD. Simulation analysis demonstrates the robustness of the proposed stochastic controller, showing that efficient controllers can indeed be designed with this newly-spread vehicle technology even in the absence of other data collection schemes (e.g. loop detectors).     

Robust constrained control of uncertain macroscopic fundamental diagram networks

This paper considers modeling and control of uncertain Macroscopic Fundamental Diagram (MFD) systems for multiple-region networks. First, the nonlinear vehicle conservation equations based on MFD dynamics, presented in earlier publications, are transformed to linear equations with parameter uncertainties. The parameter uncertainties include the destination decomposition fractions, that are difficult to estimate in reality. Then, the uncertain linear model is utilized to design a robust feedback controller by an interpolation-based approach. This approach (i) guarantees robustness against all parameter uncertainties, (ii) handle control and state constraints, and (iii) present a computationally cheap solution. The main idea is to interpolate between (i) a stabilizing outer controller that respects the control and state constraints and (ii) an inner robustly stable controller designed by any method. The robust control is further challenged to deal with different relative locations of reference accumulation points on the MFD diagrams. Numerical results for a two-region system show that the uncertain linear model can replace the nonlinear model for modeling and control. Moreover, the robust control law is presented as implicit and explicit solutions, where in the implicit case one linear programming (LP) problem is solved at each time instant, while in the explicit case, the control law is shown as a piecewise affine function of state. Finally, a comparison between the interpolating controller and other controllers in the literature is carried out. The results demonstrate the performance advantages from applying the robust interpolating controller.     

Validation of an extended discrete first-order model with variable speed limits

This paper validates the prediction model embedded in a model predictive controller (MPC) of variable speed limits (VSLs). The MPC controller was designed based on an extended discrete first-order model with a triangular fundamental diagram. In our previous work, the extended discrete first-order model was designed to reproduce the capacity drop and the propagation of jam waves, and it was validated with reasonable accuracy without the presence of VSLs. As VSLs influence traffic dynamics, the dynamics including VSLs needs to be validated, before it can be applied as a prediction model in MPC. For conceptual illustrations, we use two synthetic examples to show how the model reproduces the key mechanisms of VSLs that are applied by existing VSL control approaches. Furthermore, the model is calibrated by use of real traffic data from Dutch freeway A12, where the field test of a speed limit control algorithm (SPECIALIST) was conducted. In the calibration, the original model is extended by using a quadrangular fundamental diagram which keeps the linear feature of the model and represents traffic states at the under-critical branch more accurately. The resulting model is validated using various traffic data sets. The accuracy of the model is compared with a second-order traffic flow model. The performance of two models is comparable: both models reproduce accurate results matching with real data. Flow errors of the calibration and validation are around 10%. The extended discrete first-order model-based MPC controller has been demonstrated to resolve freeway jam waves efficiently by synthetic cases. It has a higher computation speed comparing to the second-order model-based MPC.     

基于半车模型的ABS滑模变结构控制仿真研究

由于汽车轮胎动力学的非线性,对防抱死制动系统采用了滑模变结构控制方法进行控制,滑模控制能较好地解决非线性系统的控制问题,但其固有的抖动会影响控制效果。文章介绍采用一种基于指数趋近律的滑模控制方法,针对两轮车辆的防抱死制动系统设计了滑模控制器,并在Matlab/Simulink里进行了仿真。仿真结果表明了该策略的可行性和有效性,并且能较好的抑制控制系统的抖动现象。     

Simultaneous control of traffic lights and bus departure for priority operation

This article presents a bus priority method for traffic light control based on two modes of operation: immediate and controlled departure. The immediate departure mode is a standard procedure in which the intersection controller grants priority upon request of the bus. Controlled departure acts to avoid a second stop of the bus at the end of the queue formed during red by holding the bus at the bus stop, while still granting priority to the bus lane. Selection of one of the two modes is based on intersection cost that includes bus delay and the impact on the overall traffic near the intersection. The method is applied in a constant cycle scenario where green recall and green extension can only be granted within certain limits. Numerical examples illustrate the application of the approach.     

Airport congestion and near-midair collisions

This paper presents a model that systematically integrates, for the first time, the association between a region's aviation near-midair collision risk and its traffic levels, its type and amount of air traffic control, and the complexity of its airspace. The model incorporates the tight interrelatedness (and correlation) between traffic, airspace complexity, and air traffic controller staffing. An estimation of the model using cross-sectional data on 143 U.S. airports in 1985 indicates that the frequency of reported near-midair collisions (NMACs) is positively associated with regional traffic and airspace complexity, despite the fact that busier, more complex regions generally have more air traffic controllers. Also, in regions governed by “terminal radar service areas” (TRSAs), the reported near-midair collisions are positively associated with the presence of more satellite airports than would be expected on the basis of traffic alone. Finally, deviations from controller staffing levels that would be expected on the basis of traffic and airspace complexity alone are significantly associated with variations in reported NMACs in terminal control areas but not in terminal radar service areas.     

Air holding problem solving with reinforcement learning to reduce airspace congestion

The Air Holding Problem Module is proposed as a decision support system to help air traffic controllers in their daily air traffic flow management. This system is developed using an Artificial Intelligence technique known as multiagent systems to organize and optimize the solutions for controllers to handle traffic flow in Brazilian airspace. In this research, the air holding problem is modeled with reinforcement learning, and a solution is proposed and applied in two case studies of the Brazilian airspace. The system can suggest more precise and realistic actions based upon past situations and knowledge of the professionals and forecast the impact of restrictive measures at the local and/or overall level. The first case study shows performance improvements in traffic flows between 8 and 47% at the local level up to 49% at the overall level. In the second case study, performance improvements were between 15 and 57% at the local level and between 41 and 48% at the overall level. Copyright © 2014 John Wiley & Sons, Ltd.     

Designing a sliding mode controller for slip control of antilock brake systems

Antilock brake system (ABS) has been designed to achieve maximum negative acceleration by preventing the wheels from locking. Research shows that the friction between road and tire is a nonlinear function of wheel slip. Therefore, maximum negative acceleration can be achieved by designing a suitable control system for wheel slip regulation at its optimum value. Since there is a lot of nonlinearity and uncertainty (uncertainty in mass and center of gravity of the vehicle and road condition) in vehicle dynamics, a robust control method should be used. In this research, a sliding mode controller for wheel slip control has been designed based on a two-axle vehicle model. Important considered parameters for vehicle dynamic include two separated brake torques for front and rear wheels as well as longitudinal weight transfer caused by the acceleration or deceleration. One of the common problems in sliding mode control is chattering phenomenon. In this paper, primary controller design has been improved using integral switching surface to reduce chattering effects. Simulation results show the success of integral switching surface in elimination of chattering side effects and by high performance of this controller. At the end, the performance of the designed controller has been compared with three of the prevalent papers results to determine the performance of sliding mode control integrated with integral switching surface.     

A model‐based demand‐balancing control for dynamically divided multiple urban subnetworks

Traffic control is an effective and efficient method for the problem of traffic congestion. It is necessary to design a high‐level controller to regulate the network traffic demands, because traffic congestion is not only caused by the improper management of the traffic network but also to a great extent caused by excessive network traffic demands. Therefore, we design a demand‐balance model predictive controller based on the macroscopic fundamental diagram‐based multi‐subnetwork model, which can optimize the network traffic mobility and the network traffic throughput by regulating the input traffic flows of the subnetworks. Because the transferring traffic flows among subnetworks are indirectly controlled and coordinated by the demand‐balance model predictive controller, the subnetwork division can variate dynamically according to real traffic states, and a global optimality can be achieved for the entire traffic network. The simulation results show the effectiveness of the proposed controller in improving the network traffic throughput. Copyright © 2016 John Wiley & Sons, Ltd.     

A multi-class model-based control scheme for reducing congestion and emissions in freeway networks by combining ramp metering and route guidance

The paper proposes a multi-class control scheme for freeway traffic networks. This control scheme combines two control strategies, i.e. ramp metering and route guidance, in order to reduce the total time spent and the total emissions in a balanced way. In particular, the ramp metering and route guidance controllers are feedback predictive controllers, i.e. they compute the control actions not only on the basis of the measured system state, but also on the basis of the prediction of the system evolution, in terms of traffic conditions and traffic emissions. Another important feature of the controllers is that they have a multi-class nature: different classes of vehicles are considered and specific control actions are computed for each class. Since the controllers are based on a set of parameters that need to be tuned, the overall control framework also includes a module to properly determine the gains of the controllers. The simulation analysis reported in the paper shows the effectiveness of the proposed control framework and, in particular, the possibility of implementing control policies that are specific for each vehicle type.     

On the distribution of urban road space for multimodal congested networks

Transport systems in real cities are complex with many modes of transport sharing and competing for limited road space. This work intends to understand how space distributions for modes and interactions among modes affect network traffic performance. While the connection between performance of transport systems and general land allocation is the subject of extensive research, space allocation for interacting modes of transport is an open research question. Quantifying the impact of road space distribution on the performance of a congested multimodal transport system with a dynamic aggregated model remains a challenge. In this paper, a multimodal macroscopic fundamental diagram (MFD) is developed to represent the traffic dynamics of a multimodal transport system. Optimization is performed with the objective of minimizing the total passenger hours traveled (PHT) to serve the total demand by redistributing road space among modes. Pricing strategies are also investigated to provide a higher demand shift to more efficient modes. We find by an application to a bi-modal two-region city that (i) the proposed model captures the operational characteristics of each mode, and (ii) optimal dynamic space distribution strategies can be developed. In practice, the approach can serve as a physical dynamic model to inform space distribution strategies for policy makers with different goals of mobility.     

A sensitivity-based approach for adaptive decomposition of anticipatory network traffic control

Anticipatory optimal network control is defined as the problem of determining the set of control actions that minimizes a network-wide objective function. This not only takes into account local consequences on the propagation of flows, but also the global network-wide routing behavior of the users. Such an objective function is, in general, defined in a centralized setting, as knowledge regarding the whole network is needed to correctly compute it. Reaching a level of centralization sufficient to attain network-wide control objectives is however rarely realistic in practice. Multiple authorities are influencing different portions the network, separated either hierarchically or geographically. The distributed nature of networks and traffic directly influences the complexity of the anticipatory control problem.This is our motivation for this work, in which we introduce a decomposition mechanism for the global anticipatory network traffic control problem, based on dynamic clustering of traffic controllers. Rather than solving the full centralized problem, or blindly performing a full controller-wise decomposition, this technique allows recognizing when and which controllers should be grouped in clusters, and when, instead, these can be optimized separately.The practical relevance with respect to our motivation is that our approach allows identification of those network traffic conditions in which multiple actors need to actively coordinate their actions, or when unilateral action suffices for still approximating global optimality.This clustering procedure is based on well-known algebraic and statistical tools that exploit the network’s sensitivity to control and its structure to deduce coupling behavior. We devise several case studies in order to assess our newly introduced procedure’s performances, in comparison with fully decomposed and fully centralized anticipatory optimal network control, and show that our approach is able to outperform both centralized and decomposed procedures.     

Accounting for dynamic speed limit control in a stochastic traffic environment: A reinforcement learning approach

This paper proposes a novel dynamic speed limit control model accounting for uncertain traffic demand and supply in a stochastic traffic network. First, a link based dynamic network loading model is developed to simulate the traffic flow propagation allowing the change of speed limits. Shockwave propagation is well defined and captured by checking the difference between the queue forming end and the dissipation end. Second, the dynamic speed limit problem is formulated as a Markov Decision Process (MDP) problem and solved by a real time control mechanism. The speed limit controller is modeled as an intelligent agent interacting with the stochastic network environment stochastic network environment to assign time dependent link based speed limits. Based on different metrics, e.g. total network throughput, delay time, vehicular emissions are optimized in the modeling framework, the optimal speed limit scheme is obtained by applying the R-Markov Average Reward Technique (R-MART) based reinforcement learning algorithm. A case study of the Sioux Falls network is constructed to test the performance of the model. Results show that the total travel time and emissions (in terms of CO) are reduced by around 18% and 20% compared with the base case of non-speed limit control.     

Hierarchical network-based equilibrium model and algorithm for a mixed-traffic urban transport system

Abstract

Many equilibrium models and algorithms based on homogeneous motorized traffic have been devised to model urban transport systems in developed countries, but they are inadequate when it comes to represent mixed-traffic urban transport systems, including automobiles, transit, bicycles, and pedestrians, in developing countries such as China or India. In these cases, traffic flow on a road segment is an aggregated result of travellers' combined mode/route choices and corresponding interactions. Therefore, a special assignment model and algorithm are needed for modeling these distinct behaviors. In this article, the structure of a mixed-traffic urban transport system is analyzed and then expanded and represented using a hierarchical network model based on graph theory. Based on the analysis of travelers' combined mode/route choices, generalized travel cost functions and link impedance functions for different modes are formulated, where the interferences between different modes on the same road segments are taken into account. Due to the ‘asymmetric’ nature of these functions, a variational inequality model is proposed to represent the equilibrium assignment problem in a mixed-traffic urban transport system. The corresponding solution algorithm is also presented. Finally, a numerical example is provided to illustrate the practicality of the proposed model and algorithm.     

Creating complex congestion patterns via multi-objective optimal freeway traffic control with application to cyber-security

This article presents a study on freeway networks instrumented with coordinated ramp metering and the ability of such control systems to produce arbitrarily complex congestion patterns within the dynamical limits of the traffic system. The developed method is used to evaluate the potential for an adversary with access to control infrastructure to enact high-level attacks on the underlying freeway system. The attacks are executed using a predictive, coordinated ramp metering controller based on finite-horizon optimal control and multi-objective optimization techniques. The efficacy of the control schemes in carrying out the prescribed attacks is determined via simulations of traffic network models based on the cell transmission model with onramps modeled as queue buffers. Freeway attacks with high-level objectives are presented on two illustrative examples: congestion-on-demand, which aims to create precise, user-specified pockets of congestion, and catch-me-if-you-can, which attempts to aid a fleeing vehicle from pursuant vehicles.     

Stochastic cell transmission model (SCTM): A stochastic dynamic traffic model for traffic state surveillance and assignment

The paper proposes a first-order macroscopic stochastic dynamic traffic model, namely the stochastic cell transmission model (SCTM), to model traffic flow density on freeway segments with stochastic demand and supply. The SCTM consists of five operational modes corresponding to different congestion levels of the freeway segment. Each mode is formulated as a discrete time bilinear stochastic system. A set of probabilistic conditions is proposed to characterize the probability of occurrence of each mode. The overall effect of the five modes is estimated by the joint traffic density which is derived from the theory of finite mixture distribution. The SCTM captures not only the mean and standard deviation (SD) of density of the traffic flow, but also the propagation of SD over time and space. The SCTM is tested with a hypothetical freeway corridor simulation and an empirical study. The simulation results are compared against the means and SDs of traffic densities obtained from the Monte Carlo Simulation (MCS) of the modified cell transmission model (MCTM). An approximately two-miles freeway segment of Interstate 210 West (I-210W) in Los Ageles, Southern California, is chosen for the empirical study. Traffic data is obtained from the Performance Measurement System (PeMS). The stochastic parameters of the SCTM are calibrated against the flow-density empirical data of I-210W. Both the SCTM and the MCS of the MCTM are tested. A discussion of the computational efficiency and the accuracy issues of the two methods is provided based on the empirical results. Both the numerical simulation results and the empirical results confirm that the SCTM is capable of accurately estimating the means and SDs of the freeway densities as compared to the MCS.     

A specialized equilibrium assignment algorithm for air quality modeling

A multiple user class equilibrium assignment algorithm is formulated to determine vehicle trips and the vehicle miles of travel (VMT) in various operating modes on highway links. A heuristic solution algorithm based on the Frank–Wolfe decomposition of the equilibrium assignment problem is presented. The treatment of intrazonal trips, which are very important for emission studies is also discussed. The solution algorithm is implemented in a traffic assignment program for emission studies, referred to as TAPES. The use of the algorithm is demonstrated through a TAPES model case study on a Charlotte, NC network database for 1990 AM peak period. The operating mode mix of VMT in cold transient, hot transient and hot stabilized modes, also known as the mix of cold-starts, hot-starts and stabilized mode trips, is derived on a link by link basis. The results are aggregated by facility type and the location of link segments. It is observed that the operating mode fractions in transient and stabilized modes could vary widely across different facility types geographic locations. The aggregated operating mode fractions derived from the assignment analysis indicates that a lesser proportion of VMT operates in cold and hot transient modes when compared to the operating mode mix derived from the Federal Test Procedure (FTP).