Evaluation of ramp control algorithms using microscopic traffic simulation

Ramp metering has emerged as an effective freeway control measure to ensure efficient freeway operations. A number of algorithms have been developed in recent years to ensure an effective use of ramp metering. As the performance of ramp metering depends on various factors (e.g. traffic volume, downstream traffic conditions, queue override policy etc), these algorithms should be evaluated under a wide range of traffic conditions to check their applicability and performance and to ensure their successful implementation. In view of the expenses of and confounding effects in field testing, simulation plays an important role in the evaluation of such algorithms. This paper presents an evaluation study of two ramp metering algorithms: ALINEA and FLOW. ALINEA is a local control algorithm and FLOW is an area wide coordinated algorithm. The purpose of the study is to use microscopic simulation to evaluate systematically how the level of traffic demand, queue spillback handling policy and downstream bottleneck conditions affect the performance of the algorithms. It is believed that these variables have complex interactions with ramp metering. MITSIM microscopic traffic simulator is used to perform the empirical study. The study consists of two stages. In the first stage, key input parameters for the algorithms were identified and calibrated. The calibrated parameters were then used for the second stage, where the performance of the algorithms were compared with respect to three traffic variables mentioned above using an orthogonal fraction of experiments. Regression analysis was used to identify the impacts of some of the interactions among experimental factors on the algorithms' performance, which is not otherwise possible with a tabular analysis. These results provide insights which may be helpful for design and calibration of more efficient ramp control algorithms.     

Will a higher free-flow speed lead us to a less congested freeway?

An approach based on cell transmission model (CTM) is proposed to estimate the impact of variable free-flow speeds (FFS) on the performance of a freeway system. Based on the basic CTM, four typical freeway control strategies consisting of non control, local ramp metering, coordinated ramp metering and global control are first formulated. Then the method of adjusting model parameters to the changed free-flow speeds is presented. Among the adjustments, an experimental function based on Fan and Seibold (2014) is proposed to change the jam density. Several useful measures are defined to estimate and compare the performances of different freeways. The following three main observations are obtained from numerical experiments. (a) With the gradually increasing FFS, the throughput of freeway will increase at the beginning and then change to decrease. (b) With the increasing FFS, the average delay of vehicles will decrease at the beginning and then change to increase. (c) A series of free-flow speeds associate with the best performance of freeway. These observations are theoretically analyzed through investigating the location and capacity of bottleneck. Study shows that in general the actual bottleneck capacity will increase at the beginning and then change to decrease with the continually increasing FFS. In view of the positive correlation between traffic delay and bottleneck capacity, the theoretical analysis confirms the numerical observations. The findings of this study can deepen the understanding of freeway systems and help management agents adopt proper measures to improve the performance of the whole system.     

Queue length estimation at metered freeway‐to‐freeway connectors

Freeway‐to‐freeway connector metering is a cost‐effective and proven freeway management strategy for relieving recurrent congestion. However, one of the critical challenges in design and operation of freeway‐to‐freeway connector metering is the lack of up‐to‐date queue storage length design guidance. In this study, it was found that ramp queue is dynamically related to the metering rate, on‐ramp demand, and traffic flow arrival pattern. Hence, simply using an average demand cannot provide accurate queue length estimation and is also not suitable for queue storage design where the maximum or a percentile queue length is generally used. A mesoscopic queue length simulation model was developed based on the input–output method for estimating queue lengths under various demand‐to‐capacity ratio scenarios. Simulation results indicate that for under‐saturated situations, the ramp queue may exist temporally due to the random short‐term surge of traffic arrivals, and the exponential function could best capture the relationship between queue length and demand‐to‐capacity ratio. For over‐saturated situations, the ramp queue tends to prolong linearly with the demand‐to‐capacity ratio. Based on the simulation, it was recommended that queue storage length be designed as 4.3% of on‐ramp demand when demand is lower than 1200 vph or 2.3% when demand is between 1200 and 2400 vph. Copyright © 2016 John Wiley & Sons, Ltd.     

Ramp metering and freeway bottleneck capacity

This study aims to determine whether ramp meters increase the capacity of active freeway bottlenecks. The traffic flow characteristics at 27 active bottlenecks in the Twin Cities have been studied for seven weeks without ramp metering and seven weeks with ramp metering. A methodology for systematically identifying active freeway bottlenecks in a metropolitan area is proposed, which relies on two occupancy threshold values and is compared to an established diagnostic method – transformed cumulative count curves. A series of hypotheses regarding the relationships between ramp metering and the capacity of active bottlenecks are developed and tested against empirical traffic data. It is found that meters increase the bottleneck capacity by postponing and sometimes eliminating bottleneck activations, accommodating higher flows during the pre-queue transition period, and increasing queue discharge flow rates after breakdown. Results also suggest that flow drops after breakdown and the percentage flow drops at various bottlenecks follow a normal distribution. The implications of these findings on the design of efficient ramp control strategies, as well as future research directions, are discussed.     

Genetic algorithm-based simulation optimization of the ALINEA ramp metering system: a case study in Atlanta

ABSTRACT

This paper presents a case study of the optimal ALINEA ramp metering system model of a corridor of the metro Atlanta freeway. Based on real-world traffic data, this study estimates the origin-destination matrix for the corridor. Using a stochastic simulation-based optimization framework that combines a micro-simulation model and a genetic algorithm-based optimization module, we determine the optimal parameter values of a combined ALINEA ramp metering system with a queue flush system that minimizes total vehicle travel time. We found that the performance of ramp metering with optimized parameters, which is very sensitive possibly because bottlenecks are correlated, outperforms the no control model with its optimized parameters in terms of reducing total travel time.     

Pareto-improving ramp metering strategies for reducing congestion in the morning commute

This paper presents an alternative approach to internalize congestion externality during the morning commute. We consider a linear freeway with multiple on-ramps and a downstream bottleneck and commuters accessing the freeway via different on-ramps try to arrive at work on time. Rather than charging congestion tolls as widely suggested by economists, we show that the old-fashioned engineering approach – ramp metering – can be a powerful tool to affect travelers’ departure time choice and thereby alter the congestion externality distribution among travelers. With carefully designed time-dependent metering plans, travelers from different origins can be channelized and will access the freeway bottleneck in different time periods, resulting in less total cost for the system compared to the no-metering case. The metering strategies are Pareto-improving, with travelers from the on-ramp with the highest priority having the smallest individual costs and travelers from the on-ramp with the lowest priority having their costs equal to those in the no-metering scenario. By changing the priority order of the ramps periodically, the benefit of the Pareto-improving metering strategies can be distributed evenly among all travelers. Numerical experiments show that the total user cost can be reduced by up to 40% with the proposed metering strategies. This study offers researchers and policy makers a different angle of looking at congestion externality, and the results provide an overview of the potential long term benefits that dynamic ramp metering strategies can achieve.     

Machine learning for multi-jurisdictional optimal traffic corridor control

Urban traffic corridors are often controlled by more than one agency. Typically in North America, a state of provincial transportation department controls freeways while another agency at the municipal or city level controls the nearby arterials. While the different segments of the corridor fall under different jurisdictions, traffic and users know no boundaries and expect seamless service. Common lack of coordination amongst those authorities due to lack of means for information exchange and/or possible bureaucratic ‘institutional grid-lock’ could hinder the full potential of technically-possible integrated control. Such institutional gridlock and related lack of timely coordination amongst the different agencies involved can have a direct impact on traffic gridlock. One potential solution to this problem is through integrated automatic control under intelligent transportation systems (ITS). Advancements in ITS and communication technology have the potential to considerably reduce delay and congestion through an array of network-wide traffic control and management strategies that can seamlessly cross-jurisdictional boundaries. Perhaps two of the most promising such control tools for freeway corridors are traffic-responsive ramp metering and/or dynamic traffic diversion possibly using variable message signs (VMS). Technically, the use of these control methods separately might limit their potential usefulness. Therefore, integrated corridor control using ramp metering and VMS diversion simultaneously might be synergetic and beneficial. Motivated by the above problem and potential solution approach, the aim of the research presented in this paper is to develop a self-learning adaptive integrated freeway-arterial corridor control for both recurring and non-recurring congestion. The paper introduces the use of reinforcement learning, an Artificial Intelligence method for machine learning, to provide optimal control using ramp metering and VMS routing in an integrated agent for a freeway-arterial corridor. Reinforcement learning is an approach whereby the control agent directly learns optimal strategies via feedback reward signals from its environment. A simple but powerful reinforcement learning method known as Q-learning is used. Results from an elaborate simulation study on a key corridor in Toronto are very encouraging and discussed in the paper.     

A multi-class model-based control scheme for reducing congestion and emissions in freeway networks by combining ramp metering and route guidance

The paper proposes a multi-class control scheme for freeway traffic networks. This control scheme combines two control strategies, i.e. ramp metering and route guidance, in order to reduce the total time spent and the total emissions in a balanced way. In particular, the ramp metering and route guidance controllers are feedback predictive controllers, i.e. they compute the control actions not only on the basis of the measured system state, but also on the basis of the prediction of the system evolution, in terms of traffic conditions and traffic emissions. Another important feature of the controllers is that they have a multi-class nature: different classes of vehicles are considered and specific control actions are computed for each class. Since the controllers are based on a set of parameters that need to be tuned, the overall control framework also includes a module to properly determine the gains of the controllers. The simulation analysis reported in the paper shows the effectiveness of the proposed control framework and, in particular, the possibility of implementing control policies that are specific for each vehicle type.     

Coordinated ramp metering for freeway networks – A model-predictive hierarchical control approach

A nonlinear model-predictive hierarchical control approach is presented for coordinated ramp metering of freeway networks. The utilized hierarchical structure consists of three layers: the estimation/prediction layer, the optimization layer and the direct control layer. The previously designed optimal control tool AMOC (Advanced Motorway Optimal Control) is incorporated in the second layer while the local feedback control strategy ALINEA is used in the third layer. Simulation results are presented for the Amsterdam ring-road. The proposed approach outperforms uncoordinated local ramp metering and its efficiency approaches the one obtained by an optimal open-loop solution. It is demonstrated that metering of all on-ramps, including freeway-to-freeway intersections, with sufficient ramp storage space leads to the optimal utilization of the available infrastructure.     

Convexity and robustness of dynamic traffic assignment and freeway network control

We study the use of the System Optimum (SO) Dynamic Traffic Assignment (DTA) problem to design optimal traffic flow controls for freeway networks as modeled by the Cell Transmission Model, using variable speed limit, ramp metering, and routing. We consider two optimal control problems: the DTA problem, where turning ratios are part of the control inputs, and the Freeway Network Control (FNC), where turning ratios are instead assigned exogenous parameters. It is known that relaxation of the supply and demand constraints in the cell-based formulations of the DTA problem results in a linear program. However, solutions to the relaxed problem can be infeasible with respect to traffic dynamics. Previous work has shown that such solutions can be made feasible by proper choice of ramp metering and variable speed limit control for specific traffic networks. We extend this procedure to arbitrary networks and provide insight into the structure and robustness of the proposed optimal controllers. For a network consisting only of ordinary, merge, and diverge junctions, where the cells have linear demand functions and affine supply functions with identical slopes, and the cost is the total traffic volume, we show, using the Pontryagin maximum principle, that variable speed limits are not needed in order to achieve optimality in the FNC problem, and ramp metering is sufficient. We also prove bounds on perturbation of the controlled system trajectory in terms of perturbations in initial traffic volume and exogenous inflows. These bounds, which leverage monotonicity properties of the controlled trajectory, are shown to be in close agreement with numerical simulation results.     

Considering various ALINEA ramp metering strategies for crash risk mitigation on freeways under congested regime

This study evaluates the expected benefits of using the ALINEA ramp metering algorithm as a method for real-time safety improvement on an urban freeway. The objective of this research is to use ramp metering to produce a significant decrease in the risk of crashes on the freeway while avoiding any significant adverse effects on operation. This is achieved by simulating the freeway during the congested period in micro-simulation and testing various ramp metering configurations to determine which provides the best results. Statistical measures developed for the same stretch of freeway using loop detector data are used to quantify the risk of crashes as well as the benefits in each of the alternative strategies. The study concludes that there are significant benefits in metering multiple ramps when the feedback ramp metering algorithm is implemented at multiple locations. It was found that increasing the number of metered on-ramps produces increasing safety benefits. Also, a shorter cycle length for each of the meters and a higher critical occupancy value leads to better results.     

Stochasticity of freeway operational capacity and chance-constrained ramp metering

The notion of capacity is essential to the planning, design, and operations of freeway systems. However, in the practice freeway capacity is commonly referred as a theoretical/design value without consideration of operational characteristics of freeways. This is evident from the Highway Capacity Manual (HCM) 2000 in that no influence from downstream traffic is considered in the definition of freeway capacity. In contrast to this definition, in this paper, we consider the impact of downstream traffic and define freeway operational capacity as the maximum hourly rate at which vehicles can be expected to traverse a point or a uniform section of a roadway under prevailing traffic flow conditions. Therefore freeway operational capacity is not a single value with theoretical notion. Rather, it changes under different traffic flow conditions. Specifically, this concept addresses the capacity loss during congested traffic conditions. We further study the stochasticity of freeway operational capacity by examining loop detector data at three specifically selected detector stations in the Twin Cities’ area. It is found that values of freeway operational capacity under different traffic flow conditions generally fit normal distributions. In recognition of the stochastic nature of freeway capacity, we propose a new chance-constrained ramp metering strategy, in which, constant capacity value is replaced by a probabilistic one that changes dynamically depending on real-time traffic conditions and acceptable probability of risk determined by traffic engineers. We then improve the Minnesota ZONE metering algorithm by applying the stochastic chance constraints and test the improved algorithm through microscopic traffic simulation. The evaluation results demonstrate varying degrees of system improvement depending on the acceptable level of risk defined.     

A new approach to time-of-day control based on a dynamic freeway traffic model

This paper presents a new approach to time-of-day control. While time-of-day control strategies presented up-to-now are only optimal under steady-state conditions, the control algorithm derived in this paper takes into account the evolution of traffic flow according to the time delay between a volume change at a ramp and its subsequent disturbance at a freeway point downstream. The new control strategy is based on the solution of a linear programming optimization problem and makes freeway volume hold the capacity constraints for the total time of control operation. In order to reduce the computational effort a simplified version of the new algorithm is also discussed. Simulation results obtained by use of two different traffic flow models show that control derived through the new algorithm can avoid congestion and ensure operation with peak performance even if a steady-state condition is never attained.     

Optimal mainstream traffic flow control of large-scale motorway networks

The continuously increasing daily traffic congestions on motorway networks around the world call for innovative control measures that would drastically improve the current traffic conditions. Mainstream traffic flow control (MTFC) is proposed as a novel and efficient motorway traffic management tool, and its possible implementation and principal impact on traffic flow efficiency is analysed. Variable speed limits, suitably operated and enforced, is considered as one (out of several possible) way(s) for MTFC realisation, either as a stand-alone measure or in combination with ramp metering. A previously developed, computationally efficient software tool for optimal integrated motorway network traffic control including MTFC is applied to a large-scale motorway ring-road. It is demonstrated via several investigated control scenarios that traffic flow can be substantially improved via MTFC with or without integration with coordinated ramp metering actions.     

Optimization of mainline traffic via an adaptive co-ordinated ramp-metering control model with dynamic OD estimation

Frequently implemented at freeway accesses to streamline traffic, ramp-metering control strategy is often implemented during rush hours in heavily congested areas. This paper presents a novel ramp-metering control model capable of optimizing mainline traffic by providing metering rates for accesses within the control segments. Based on Payne's continuum traffic stream model, a linear dynamic model with a quadratic objective function is constructed for integrated-responsive ramp-metering control. Incorporating on-line origin–destination (OD) estimation of co-ordinated interchanges into the proposed model increases efficiency of the control. In addition, an iterative algorithm is proposed to obtain the optimal solution. Simulation results demonstrate the robustness of the proposed model and its ability to streamline freeway traffic while avoiding traffic congestion.     

Observing freeway ramp merging phenomena in congested traffic

This work conducts a comprehensive investigation of traffic behavior and characteristics during freeway ramp merging under congested traffic conditions. On the Tokyo Metropolitan Expressway, traffic congestion frequently occurs at merging bottleneck sections, especially during heavy traffic demand. The Tokyo Metropolitan Expressway public corporation, generally applies different empirical strategies to increase the flow rate and decrease the accident rate at the merging sections. However, these strategies do not rely either on any behavioral characteristics of the merging traffic or on the geometric design of the merging segments. There have been only a few research publications concerned with traffic behavior and characteristics in these situations. Therefore, a three‐year study is undertaken to investigate traffic behavior and characteristics during the merging process under congested situations. Extensive traffic data capturing a wide range of traffic and geometric information were collected using detectors, videotaping, and surveys at eight interchanges in Tokyo Metropolitan Expressway. Maximum discharged flow rate from the head of the queue at merging sections in conjunction with traffic and geometric characteristics were analyzed. In addition, lane changing maneuver with respect to the freeway and ramp traffic behaviors were examined. It is believed that this study provides a thorough understanding of the freeway ramp merging dynamics. In addition, it forms a comprehensive database for the development and implementation of congestion management techniques at merging sections utilizing Intelligent Transportation System.     

Cooperative traffic control of a mixed network with two urban regions and a freeway

Currently most optimization methods for urban transport networks (i) are suited for networks with simplified dynamics that are far from real-sized networks or (ii) apply decentralized control, which is not appropriate for heterogeneously loaded networks or (iii) investigate good-quality solutions through micro-simulation models and scenario analysis, which make the problem intractable in real time. In principle, traffic management decisions for different sub-systems of a transport network (urban, freeway) are controlled by operational rules that are network specific and independent from one traffic authority to another. In this paper, the macroscopic traffic modeling and control of a large-scale mixed transportation network consisting of a freeway and an urban network is tackled. The urban network is partitioned into two regions, each one with a well-defined Macroscopic Fundamental Diagram (MFD), i.e. a unimodal and low-scatter relationship between region density and outflow. The freeway is regarded as one alternative commuting route which has one on-ramp and one off-ramp within each urban region. The urban and freeway flow dynamics are formulated with the tool of MFD and asymmetric cell transmission model, respectively. Perimeter controllers on the border of the urban regions operating to manipulate the perimeter interflow between the two regions, and controllers at the on-ramps for ramp metering are considered to control the flow distribution in the mixed network. The optimal traffic control problem is solved by a Model Predictive Control (MPC) approach in order to minimize total delay in the entire network. Several control policies with different levels of urban-freeway control coordination are introduced and tested to scrutinize the characteristics of the proposed controllers. Numerical results demonstrate how different levels of coordination improve the performance once compared with independent control for freeway and urban network. The approach presented in this paper can be extended to implement efficient real-world control strategies for large-scale mixed traffic networks.     

Freeway ramp control using fuzzy set theory for inexact reasoning

This paper presents a fuzzy controller for freeway ramp metering, which uses rules of the form: IF “freeway condition” THEN “control action.” The controller has been designed to consider varied levels of congestion, a downstream control area, changing occupancy levels, upstream flows, and a distributed detector array in its rule base. Through fuzzy implication, the inference of each rule is used to the degree to which the condition is true. Using a dynamic simulation model of conditions0fj at the San Francisco-Oakland Bay Bridge, the action of the fuzzy controller is compared to the existing “crisp” control scheme, and an idealized controller. Tests under a variety of scenarios with different incident locations and capacity reductions show that the fuzzy controller is able to extract 40 to 100% of the possible savings in passenger-hours. In general, the fuzzy algorithm displays smooth and rapid response to incidents, and significantly reduces the minute-miles of congestion.     

Developing control strategies for freeway merging points under congested traffic situations using modeling and a simulation approach

This work focuses on developing a variety of strategies for alleviating congestion at freeway merging points as well as improving the safety of these points. On the Tokyo Metropolitan Expressway, traffic congestion frequently occurs at merging bottleneck sections, especially during heavy traffic demand. The Tokyo Metropolitan Expressway public corporation, generally applies different empirical strategies to increase the flow rate and decrease the accident rate at the merging sections. However, these strategies do not rely either on any behavioral characteristic of the merging traffic or on the geometric design of the merging segments. There have been only a few research publications concerned with traffic behavior and characteristics in these situations. Therefore, a three‐year extensive study has been undertaken to investigate traffic behavior and characteristics during the merging process under congested situations in order to design safer and less congested merging points as well as to apply more efficient control at these bottleneck sections. Two groups of strategies were investigated in this study. The First group was related to the traffic characteristics, and the second group to the geometric characteristics. In the first group, the control strategies related to closure of freeway and ramp lanes as well as lane‐changing maneuver restriction were investigated through a simulation program, detector data, and field experiment. In the second group, the angle of convergence of the ramp with the freeway in relation to merging capacity was analyzed using a simulation program. Results suggested the potential benefits of using proposed strategies developed in this work and can serve as initial guidance for the reduction of delay and improvement of safety under congested traffic conditions.     

Local ramp metering with distant downstream bottlenecks: A comparative study

The well-known feedback ramp metering algorithm ALINEA can be applied for local ramp metering or included as a key component in a coordinated ramp metering system. ALINEA uses real-time occupancy measurements from the ramp flow merging area that may be at most a few hundred meters downstream of the metered on-ramp nose. In many practical cases, however, bottlenecks with smaller capacities than the merging area may exist further downstream, which suggests using measurements from those downstream bottlenecks. Recent theoretical and simulation studies indicate that ALINEA may lead to poorly damped closed-loop behavior in this case, but PI-ALINEA, a suitable Proportional-Integral (PI) extension of ALINEA, can lead to satisfactory control performance. This paper addresses the same local ramp-metering problem in the presence of far-downstream bottlenecks, with a particular focus on the employment of PI-ALINEA to tackle three distinct cases of bottleneck that may often be encountered in practice: (1) an uphill case; (2) a lane-drop case; and (3) an un-controlled downstream on-ramp case. Extensive simulation studies are conducted on the basis of a macroscopic traffic flow model to show that ALINEA is not capable of carrying out ramp metering in these bottleneck cases, while PI-ALINEA operates satisfactorily in all cases. A field application example of PI-ALINEA is also reported with regard to a real case of far downstream bottlenecks. With its control parameters appropriately tuned beforehand, PI-ALINEA is found to be universally applicable, with little fine-tuning required for field applications.