A real-time system for monitoring driver fatigue

ABSTRACT

This paper presents a nonintrusive prototype computer vision system for real-time fatigue driving detection. First, we use Haar-like features to detect a driver’s face and conduct tracking by introducing an improved Camshift algorithm. Second, we propose a new eye-detection algorithm that combines the Adaboost algorithm with template matching to reduce computational costs and add an eye-validation process to increase the accuracy of the detection rate. Third, and different from other methods focusing on detecting eyes using the ‘bright pupil’ effect, which only works well only for certain constrained lighting conditions, our method detects and estimates the iris center in the hue (H) channel of the hue, saturation, value color space and fits the iris with an ellipse. After extracting the eye fatigue features, we calculate the PERCLOS measurement for fatigue evaluation. This system has been tested on the IMM Face Database, which contains more than 200 faces, and in a real-time test. The experimental results show that the system possesses good accuracy and robustness.     

A NEW URBAN FORM AND ITS INNOVATIVE TRANSPORTATION STRATEGY TO ACCOMMODATE URBAN GROWTH

If we are to accommodate the rate of urban growth which North America will face in the first half of the twenty-first century, it is the contention of this paper that we must build new cities, not new towns, beyond commuting distance of existing cities. These can be located in open countryside on virgin land, or they can grow around existing small towns, all in conjunction with the construction of an innovative personal transportation system. In this paper a hexagonal modular structure, in which self-contained urban units can be combined and added to over time, is proposed as a new urban form and AVCS maglev — which will serve the new cities efficiently — is proposed as a key transportation strategy.     

Battery capacity design for electric vehicles considering the diversity of daily vehicles miles traveled

In this paper, we study battery capacity design for battery electric vehicles (BEVs). The core of such design problems is to find a good tradeoff between minimizing the capacity to reduce financial costs of drivers and increasing the capacity to satisfy daily travel demands. The major difficulty of such design problems lies in modeling the diversity of daily travel demands. Based on massive trip records of taxi drivers in Beijing, we find that the daily vehicle miles traveled (DVMT) of a driver (e.g., a taxi driver) may change significantly in different days. This investigation triggers us to propose a mixture distribution model to describe the diversity in DVMT for various driver in different days, rather than the widely employed single distribution model. To demonstrate the merit of this new model, we consider value-at-risk and mean-variance battery capacity design problems for BEV, with respect to conventional single and new mixture distribution models of DVMT. Testing results indicate that the mixture distribution model better leads to better solutions to satisfy various drivers.     

Formal characterization of an efficient driving evaluation process for companies of the transport sector

Public institutions and private companies all around the world agree that road transport is one of the main sectors responsible for global warming. With this in mind, all of them have designed actions to increase efficiency and reduce fuel consumption and emissions. A favorite for the companies is eco-driving because it can improve the fleet performance without a great investment. However, although these programs have achieved promising results in the majority of the experiences, the figures are not so encouraging in the long term. In many cases this decrease is produced by fuzzy reward programs or the total lack of them. Nevertheless, any coherent reward program, in order to be effective, must be associated with a complete and fair evaluation process which takes into account all the different aspects and complexities related with driving. In this paper, we propose a formal characterization of an efficient driving evaluation process which starts with a review of many different driving recommendation systems. These recommendations are used as seeds to build a set of formal competences that any eco driver must have, as well as the learning outcomes associated with each competence. A set of patterns of driving behaviors are defined, that allow confirming any of the learning outcomes. The definition also comprises a set of Key Performance Indicators (KPIs) for each learning outcome. These KPIs allow measuring the progress associated with each competence. Finally, we also propose some relevant differences that must be taken into account for the goals associated with each KPI, depending on the domain of application: type and road geometry, vehicle type (automatic or manual, passengers, cargo or not, public or private), amount of traffic, weather. Some examples of this driver characterization have been included to demonstrate the process.     

Vehicular event sharing with a mobile peer-to-peer architecture

In vehicular ad hoc networks (VANETs), different types of information can be useful to drivers. Such networks are highly dynamic due to both the movements of the vehicles and the short range of the wireless communications. Thus, the information exchanges between vehicles about relevant information can only rely on short interactions. Therefore, an efficient mechanism to manage and disseminate the relevant information is required. Specifically, we present in this paper a system for data sharing in vehicular networks, which we call Vehicular Event Sharing with a mobile Peer-to-peer Architecture (VESPA). In this system, a new technique based on the concept of Encounter Probability is proposed for vehicles to share information using vehicle-to-vehicle communications. The objective is to facilitate the dissemination of information between vehicles when they meet each other, taking into account the relevance of the data to the drivers. Besides, the relevance must also be considered to inform a driver about the interesting events. Moreover, our proposal takes into account any type of event (e.g., available parking spaces, obstacles in the road, information relative to the coordination of vehicles in emergency situations, etc.) in the network. An experimental evaluation and the implemented prototype show the interest of the system.     

On the existence of pricing strategies in the discrete time heterogeneous single bottleneck model

In this paper, we study the pricing strategies in the discrete time single bottleneck model with general heterogeneous commuters. We first prove that in the system optimal assignment, the queue time must be zero for all the departures. Based on this result, the system optimal problem is formulated as a linear program. The solution existence and uniqueness are discussed. Applying linear programming duality, we then prove that the optimal dual variable values provide an optimal toll with which the system optimal solution is also an equilibrium solution. Extensive computational results are reported to demonstrate the insights gained from the formulations in this paper. These results confirm that a system optimal equilibrium can be found using the proposed approach.     

Freeway traffic oscillations: Microscopic analysis of formations and propagations using Wavelet Transform

In this paper we identify the origins of stop-and-go (or slow-and-go) driving and measure microscopic features of their propagations by analyzing vehicle trajectories via Wavelet Transform. Based on 53 oscillation cases analyzed, we find that oscillations can be originated by either lane-changing maneuvers (LCMs) or car-following (CF) behavior. LCMs were predominantly responsible for oscillation formations in the absence of considerable horizontal or vertical curves, whereas oscillations formed spontaneously near roadside work on an uphill segment. Regardless of the trigger, the features of oscillation propagations were similar in terms of propagation speed, oscillation duration, and amplitude. All observed cases initially exhibited a precursor phase, in which slow-and-go motions were localized. Some of them eventually transitioned into a well-developed phase, in which oscillations propagated upstream in queue. LCMs were primarily responsible for the transition, although some transitions occurred without LCMs. Our findings also suggest that an oscillation has a regressive effect on car-following behavior: a deceleration wave of an oscillation affects a timid driver (characterized by larger response time and/or minimum spacing) to become less timid and an aggressive driver less aggressive, although this change may be short-lived. An extended framework of Newell’s CF model is able to describe the regressive effect with two additional parameters with reasonable accuracy, as verified using vehicle trajectory data.     

Utilizing naturalistic driving data for in-depth analysis of driver lane-keeping behavior in rain: Non-parametric MARS and parametric logistic regression modeling approaches

It is known that adverse weather conditions can affect driver performance due to reduction in visibility and slippery surface conditions. Lane keeping is one of the main factors that might be affected by weather conditions. Most of the previous studies on lane keeping have investigated driver lane-keeping performance from driver inattention perspective. In addition, the majority of previous lane-keeping studies have been conducted in controlled environments such as driving simulators. Therefore, there is a lack of studies that investigate driver lane-keeping ability considering adverse weather conditions in naturalistic settings. In this study, the relationship between weather conditions and driver lane-keeping performance was investigated using the SHRP2 naturalistic driving data for 141 drivers between 19 and 89 years of age. Moreover, a threshold was introduced to differentiate lane keeping and lane changing in naturalistic driving data. Two lane-keeping models were developed using the logistic regression and multivariate adaptive regression splines (MARS) to better understand factors affecting driver lane-keeping ability considering adverse weather conditions. The results revealed that heavy rain can significantly increase the standard deviation of lane position (SDLP), which is a very widely used method for analyzing lane-keeping ability. It was also found that traffic conditions, driver age and experience, and posted speed limits have significant effects on driver lane-keeping ability. An interesting finding of this study is that drivers have a better lane-keeping ability in roadways with higher posted speed limits. The results from this study might provide better insights into understanding the complex effect of adverse weather conditions on driver behavior.     

A column generation algorithm for the bus driver scheduling problem

Bus driver scheduling aims to find the minimum number of bus drivers to cover a published timetable of a bus company. When scheduling bus drivers, contractual working rules must be enforced, thus complicating the problem. In this research, we develop a column generation algorithm that decomposes this complicated problem into a master problem and a series of pricing subproblems. The master problem selects optimal duties from a set of known feasible duties, and the pricing subproblem augments the feasible duty set to improve the solution obtained in the master problem. The proposed algorithm is empirically applied to the realistic problems of several bus companies. The numerical results show that the proposed column generation algorithm can solve real‐world problems and obtain bus driver schedules that are better than those developed and used by the bus companies. Copyright © 2016 John Wiley & Sons, Ltd.     

Relaxation approaches to large scale bus driver scheduling problems

The bus driver scheduling (BDS) problem in a transit company consists of establishing, at minimum cost, a list of work-days in which a driver is assigned to each bus in the given time-table and all clauses of the union contract are respected. In this paper we present a general mathematical programming formulation for the BDS problem. Because, in general, the problem is too large to be solved directly, we introduce a relation of the problem and three different solution approaches. Computational results obtained on real life problems indicate that mathematical programming techniques can solve the BDS problem efficiently.     

Safety in the road environment: a driver behavioural response perspective

The existing literature on road safety suggests that a driver's perception of safety is an important influence on their driving behaviour. A challenging research question is how to measure the perception of safety given the complex interactions among drivers, vehicles and the road setting. In this paper, we investigate a sample of driver evaluations of the perception of safety associated with a set of typical road environments. A roundabout was selected as the context for the empirical study. Data was obtained by a computerised survey using the video-captured road and traffic situations. A controlled experiment elicited driver responses when faced with a mixture of attributes that describe the roundabout environment. An ordered probit model identified the contribution of each attribute to the overall determination of the perception of safety. An indicator of perceived safety was developed for a number of typical road and traffic situations and for different driver segments.     

Development and testing of a fully Adaptive Cruise Control system

Adaptive Cruise Control systems have been developed and introduced into the consumer market for over a decade. Among these systems, fully-adaptive ones are required to adapt their behaviour not only to traffic conditions but also to drivers’ preferences and attitudes, as well as to the way such preferences change for the same driver in different driving sessions. This would ideally lead towards a system where an on-board electronic control unit can be asked by the driver to calibrate its own parameters while he/she manually drives for a few minutes (learning mode). After calibration, the control unit switches to the running mode where the learned driving style is applied. The learning mode can be activated by any driver of the car, for any driving session and each time he/she wishes to change the current driving behaviour of the cruise control system.The modelling framework which we propose to implement comprises four layers (sampler, profiler, tutor, performer). The sampler is responsible for human likeness and can be calibrated while in learning mode. Then, while in running mode, it works together with the other modelling layers to implement the logic. This paper presents the overall framework, with particular emphasis on the sampler and the profiler that are explained in full mathematical detail. Specification and calibration of the proposed framework are supported by the observed data, collected by means of an instrumented vehicle. The data are also used to assess the proposed framework, confirming human-like and fully-adaptive characteristics.     

Electric vehicles’ energy consumption measurement and estimation

Use of electric vehicles (EVs) has been viewed by many as a way to significantly reduce oil dependence, operate vehicles more efficiently, and reduce carbon emissions. Due to the potential benefits of EVs, the federal and local governments have allocated considerable funding and taken a number of legislative and regulatory steps to promote EV deployment and adoption. With this momentum, it is not difficult to see that in the near future EVs could gain a significant market penetration, particularly in densely populated urban areas with systemic air quality problems. We will soon face one of the biggest challenges: how to improve efficiency for EV transportation system? This research takes the first step in tackling this challenge by addressing a fundamental issue, i.e. how to measure and estimate EVs’ energy consumption. In detail, this paper first presents a system which can collect in-use EV data and vehicle driving data. This system then has been installed in an EV conversion vehicle built in this research as a test vehicle. Approximately 5 months of EV data have been collected and these data have been used to analyze both EV performance and driver behaviors. The analysis shows that the EV is more efficient when driving on in-city routes than driving on freeway routes. Further investigation of this particular EV driver’s route choice behavior indicates that the EV user tries to balance the trade-off between travel time and energy consumption. Although more data are needed in order to generalize this finding, this observation could be important and might bring changes to the traffic assignment for future transportation system with a significant share of EVs. Additionally, this research analyzes the relationships among the EV’s power, the vehicle’s velocity, acceleration, and the roadway grade. Based on the analysis results, this paper further proposes an analytical EV power estimation model. The evaluation results using the test vehicle show that the proposed model can successfully estimate EV’s instantaneous power and trip energy consumption. Future research will focus on applying the proposed EV power estimation model to improve EVs’ energy efficiency.     

Method for investigating intradriver heterogeneity using vehicle trajectory data: A Dynamic Time Warping approach

After first extending Newell’s car-following model to incorporate time-dependent parameters, this paper describes the Dynamic Time Warping (DTW) algorithm and its application for calibrating this microscopic simulation model by synthesizing driver trajectory data. Using the unique capabilities of the DTW algorithm, this paper attempts to examine driver heterogeneity in car-following behavior, as well as the driver’s heterogeneous situation-dependent behavior within a trip, based on the calibrated time-varying response times and critical jam spacing. The standard DTW algorithm is enhanced to address a number of estimation challenges in this specific application, and a numerical experiment is presented with vehicle trajectory data extracted from the Next Generation Simulation (NGSIM) project for demonstration purposes. The DTW algorithm is shown to be a reasonable method for processing large vehicle trajectory datasets, but requires significant data reduction to produce reasonable results when working with high resolution vehicle trajectory data. Additionally, singularities present an interesting match solution set to potentially help identify changing driver behavior; however, they must be avoided to reduce analysis complexity.     

Proposed collision warning system for right-turning vehicles at two-way stop-controlled rural intersections

At two-way stop-controlled (TWSC) rural intersections, a right-turning driver who is departing the minor road may select an improper gap and subsequently may be involved in a rear-end collision with another vehicle approaching on the rightmost lane on the major road. This paper provides perceptual framework and algorithm design of a proposed infrastructure-based collision warning system that has the potential to aid unprotected right-turning drivers at TWSC rural intersections. The proposed system utilizes a radar sensor that measures the location, speed, and acceleration of the approaching vehicle on the major road. Based on these measurements, the system’s algorithm determines if there will be any potential conflict between the approaching and the turning vehicles and warns the driver of the latter vehicle if such a conflict is found. The algorithm is based on realistic acceleration profile of the turning vehicle to estimate its acceleration rates at different times so that the system can accurately estimate the time and distance needed for the departing vehicle to accelerate to the same speed as for the approaching vehicle. That realistic acceleration profile is established using actual experimental data collected by a Global Positioning System (GPS) data logger device that was used to record the positions and instantaneous speeds of different right-turning vehicles at 1-s intervals. The algorithm also gives consideration to the time needed by the driver of the departing vehicle to perceive the message displayed by the system and react to it (to start departure) where it was found that 95% of drivers have a perception–reaction time of 1.89 s or less. A methodology is also illustrated to select the maximum measurement errors suggested for the detectors in measuring the locations of the approaching vehicle on the major road where it was found that the accuracy of the system significantly deteriorates if the errors in measuring the distance and the azimuth angle exceed 0.1 m and 0.2°, respectively. An application example is provided to illustrate the algorithm used by the proposed system.     

Optimal speed detector density for the network with travel time information

In the expressway network, detectors are installed on the links for detecting the travel time information while the predicted travel time can be provided by the route guidance system (RGS). The speed detector density can be determined to influence flow distributions in such a way that the precision of the travel time information and the social cost of the speed detectors are optimized, provided that each driver chooses the minimum perceived travel time path in response to the predicted travel time information. In this paper, a bilevel programming model is proposed for the network with travel time information provided by the RGS. The lower-level problem is a probit-based traffic assignment model, while the upper-level problem is to determine the speed detector density that minimizes the measured travel time error variance as well as the social cost of the speed detectors. The sensitivity analysis based algorithm is proposed for the bilevel programming problem. Numerical examples are provided to illustrate the applications of the proposed model and of the solution algorithm.     

Evaluation of the effectiveness of accident information on freeway changeable message signs: A comparison of empirical methodologies

In this paper, we study the effectiveness of accident messages that are displayed on freeway changeable message signs (CMS). Motivated by the lack of empirical studies and the mixed results reported in the limited empirical studies, this paper focuses on the comparison of different aggregate analysis methodologies and their corresponding results, using the same empirical data set. We have two major findings. First, we find that the CMS accident messages do not seem to have any significant immediate effect on driver diversion based on our empirical data. Visible congestion, on the other hand, seems to be an important factor for driver diversion. Second, we show how the conclusion could have been if wrong methodologies were to be adopted. Methods that rely on correlation alone but not the timing of events (what we call correlation method) yield high correlation between CMS accident messages and driver diversion, which is typically and incorrectly interpreted as CMS accident messages being effective.     

Safety-based path finding in urban areas for older drivers and bicyclists

This paper presents a safety-based path finding methodology for older drivers and bicyclists in an urban area. The paths are estimated based on costs consisting of both safety and travel time. Safety is evaluated against potential risk of a crash involving an older driver (or a bicyclist) with other vehicles present on the road. To accomplish this, simple formulations are developed for safety indicators of streets and intersections, which are actually generic irrespective of the type of road user. Traffic attributes such as speed and density, driver attributes such as perception-reaction time and street attributes of length and tire-to-road friction coefficient are taken into account in building the safety indicators. Thus, the safety indicators do not necessarily require historical crash data which may or may not be available during path finding. Subsequently, a multi-objective shortest path algorithm is presented that identifies the best path (the non-inferior path) from amongst a set of selected safest paths with due considerations to travel time incurred on each. A simple application example of the proposed methodology is demonstrated on an existing street network system from the City of College Station, Texas. The contributions of this research are twofold – first, the safety indicators can be used by planners in determining high crash potential sites – streets and/or intersections – and second, the safety-based path finding methodology developed in this paper can be integrated with modern day route planning devices and tools in guiding older drivers and bicyclists within an Intelligent Transportation Systems framework.     

Modeling isoexposure to transit users for market potential analysis

Transit operators face a difficult fiscal environment and an imperative to contribute to urban sustainability. Under these circumstances, operators must find innovative ways to make public transportation attractive to broader segments of the public, while simultaneously trying to raise revenue to reduce reliance on public subsidies. Development of commercial partnerships is seen as a promising way to achieve these goals. Previous research has examined the potential of using geodemographics to assist transit agencies in the task of identifying potential partners for developing mutually beneficial commercial agreements. In this paper we describe an approach to model isoexposure to transit users as a tool to assess market potential. The approach is based on the analysis of walking behavior of transit users, and specifically distance walked at the end of their transit trip. Spatial modeling is used to geographically project estimates of walking distance for a desired demographic profile at a specific transit facility. After expanding the estimates using sample weights, overlays of these estimates can be used to generate variations in exposure to transit travelers at different locations in space. The approach is demonstrated using the case of Metro users in Montreal, Canada. The case study demonstrates the use of isoexposure profiles as a novel approach to generate marketing intelligence. This should be of interest to transit agencies and businesses interested in developing partnerships.