基于深度强化学习的智能船舶航迹跟踪控制

[目的]智能船舶的航迹跟踪控制问题往往面临着控制环境复杂、控制器稳定性不高以及大量的算法计算等问题。为实现对航迹跟踪的精准控制,提出一种引入深度强化学习技术的航向控制器。[方法]首先,结合视线(LOS)算法制导,以船舶的操纵特性和控制要求为基础,将航迹跟踪问题建模成马尔可夫决策过程,设计其状态空间、动作空间、奖励函数;然后,使用深度确定性策略梯度(DDPG)算法作为控制器的实现,采用离线学习方法对控制器进行训练;最后,将训练完成的控制器与BP-PID控制器进行对比研究,分析控制效果。[结果]仿真结果表明,设计的深度强化学习控制器可以从训练学习过程中快速收敛达到控制要求,训练后的网络与BP-PID控制器相比跟踪迅速,具有偏航误差小、舵角变化频率小等优点。[结论]研究成果可为智能船舶航迹跟踪控制提供参考。     

How to Use Driving Simulators Properly: Impacts of Human Sensory and Perceptual Capabilities on Visual Fidelity

Fidelity has been a critical concern of researchers throughout the history of driving simulation. Understanding the limits of a driving simulation system is a prerequisite for conducting valid driving simulator studies. This paper proposes a novel and interdisciplinary methodology to ensure validity of studies using driving simulators (primarily for traffic control devices and other object detection tasks) based on the visual limits of human sensory and perceptual capabilities, and the characteristics of raster graphics. This methodology decomposes the perceptual issues of a stimulus into perceptual issues of different visual properties like luminance, hue, or text of the stimulus. By systematically analyzing the mechanism of human vision in driving simulators, the perceptual principle is proposed to ensure perceivable visual details in human-in-the-loop driving simulation systems. Additionally, the graphic principle is proposed to ensure perceivable features of a target object in the virtual driving environment. Both principles quantify the minimum requirements of visual fidelity with two measurements: angular resolution and matrix dimensions. The enriched results from existing pertinent studies are analyzed and organized to yield support of both principles. This research focuses on the minimum requirements for four factors; namely the visual acuity of drivers, the specifications of display systems, the configurations of graphics systems, and the design of virtual scenarios, as well as the relationship among all these factors to assess the visual fidelity in driving simulation systems. Within the realm of human perception, this work can provide criteria for proper design, calibration, and usage of driving simulators.     

Dynamic traffic metering in urban street networks: Formulation and solution algorithm

Traffic metering offers great potential to reduce congestion and enhance network performance in oversaturated urban street networks. This paper presents an optimization program for dynamic traffic metering in urban street networks based on the Cell Transmission Model (CTM). We have formulated the problem as a Mixed-Integer Linear Program (MILP) capable of metering traffic at network gates with given signal timing parameters at signalized intersections. Due to the complexities of the MILP model, we have developed a novel and efficient solution approach that solves the problem by converting the MILP to a linear program and several CTM simulation runs. The solution algorithm is applied to two case studies under different conditions. The proposed solution technique finds solutions that have a maximum gap of 1% of the true optimal solution and guarantee the maximum throughput by keeping some vehicles at network gates and only allowing enough vehicles to enter the network to prevent gridlocks. This is confirmed by comparing the case studies with and without traffic metering. The results in an adapted real-world case study network show that traffic metering can increase network throughput by 4.9–38.9% and enhance network performance.     

Nonlinear pricing in linear cities with elastic demands

Nonlinear road pricing charges each traveler based on his/her trip’s corresponding particular attribute level. In order to help authorities in designing road pricing systems at a strategic level, this paper attempts to address two fundamental questions: (i) what is the value of pricing’s nonlinearity for mitigating traffic congestion? (ii) if a nonlinear toll function is implemented, should it be convex, concave or other shape? Specifically, we consider distance-based pricing in linear cities. For linear monocentric cities with heterogeneous travelers, we show that the system optimal distance-based pricing indeed exhibits nonlinearity. It is proved that: (i) the cost-based system optimal toll function is monotonically increasing and concave with respect to the traveled distance; (ii) the time-based system optimal toll function always exists and is unique. If the initial proportion of each traveler group is invariant along a corridor and the demand function is of exponential type, then the time-based system optimal toll function enables the travelers, living further away from a city center, to face a lower toll level per unit distance. For a linear polycentric city, we demonstrate: (i) there always exists the system optimal differentiated (in terms of city centers) toll functions; (ii) it is highly possible that the system optimal non-differentiated toll function does not exist. Hence, we further propose an optimal toll design model, prove the Lipschitz continuity of its objective and adopt a global-optimization algorithm to solve it.     

Hydroelastic analysis of oblique irregular waves with a pontoon-type VLFS edged with dual inclined perforated plates

The fluid-structure interaction of oblique irregular waves with a pontoon-type very large floating structure (VLFS) edged with dual horizontal/inclined perforated plates has been investigated in the context of the direct time domain modal expansion theory. For the hydroelastic analysis, the boundary element method (BEM) based on time domain Kelvin sources is implemented to establish water wave model including the viscous effect of the perforated plates through the Darcy’s law, and the finite element method (FEM) is adopted for solving the deflections of the VLFS modeled as an equivalent Mindlin thick plate. In order to enhance the computing efficiency, the interpolation-tabulation scheme is applied to assess rapidly and accurately the free-surface Green function and its partial derivatives in finite water depth, and the boundary integral equation of a half or quarter VLFS model is further established taking advantage of symmetry of flow field and structure. Also, the numerical solutions are validated against a series of experimental tests. In the comparison, the empirical relationship between the actual porosity and porous parameter is successfully applied. Numerical solutions and model tests are executed to determine the hydroelastic response characteristics of VLFS with an attached anti-motion device. This study examines the effects of porosity, submerged depth, inclined angle and gap distance of such dual perforated anti-motion plates on the hydroelastic response to provide information regarding the optimal design. The effects of oblique wave angle on the performance of anti-motion and hydroelastic behavior of VLFS are also emphatically examined.     

Socially optimal electric driving range of plug-in hybrid electric vehicles

This study determines the optimal electric driving range of plug-in hybrid electric vehicles (PHEVs) that minimizes the daily cost borne by the society when using this technology. An optimization framework is developed and applied to datasets representing the US market. Results indicate that the optimal range is 16 miles with an average social cost of $3.19 per day when exclusively charging at home, compared to $3.27 per day of driving a conventional vehicle. The optimal range is found to be sensitive to the cost of battery packs and the price of gasoline. When workplace charging is available, the optimal electric driving range surprisingly increases from 16 to 22 miles, as larger batteries would allow drivers to better take advantage of the charging opportunities to achieve longer electrified travel distances, yielding social cost savings. If workplace charging is available, the optimal density is to deploy a workplace charger for every 3.66 vehicles. Moreover, the diversification of the battery size, i.e., introducing a pair and triple of electric driving ranges to the market, could further decrease the average societal cost per PHEV by 7.45% and 11.5% respectively.     

基于时延特性建模的多断面短时交通流预测

针对现有交通流预测方法未充分考虑多断面车流演变规律，提出基于时延特性建模的时空相关性计算方法. 该方法采用对不同断面、不同时刻交通流的分布相似性度量，对输入的车辆到达数据序列进行切割构建时空相似度矩阵，得到相邻断面之间的时延参数. 基于时延特性建模，将多断面之间的流量信息进行融合，使用长短时记忆(LSTM)网络进行流量预测. 通过对实际路段数据的预测和结果分析，验证所提方法的有效性和实用性.     

Local joint flexibility of tubular X-joints stiffened with external ring or external plates

In the present paper, the Local Joint Flexibility (LJF) of the ring-stiffened X-joints and plate-stiffened X-joints under compressive load is investigated. In the first phase, a finite element (FE) model was generated and verified with the results of available experimental tests and equations. In the next phase, a set number of 234 FE models were created to evaluate the role of the external ring size (β_r and τ_r), the external plate size (β_p and τ_p), and the connection geometry (γ, τ, and β) on the LJF factor (f_LJF). In these FE models, the weld connecting the chord and brace members was generated. The results indicated that the f_LJF of a plate stiffened joint can be down to 76% of the f_LJF of the corresponding un-stiffened joint. Also, the effect of the ring size on the f_LJF was more than the effect of the plate size on the f_LJF, because of the stiffener position. Despite the notable effect of the ring and the plate on the f_LJF, there is not any study or formula on tubular connections stiffened with ring or plate. Therefore, the FE results were used to propose two parametric formulas for determining the f_LJF in X-joints with external ring or external plate under brace compressive load. Moreover, the derived formulas were checked based on the UK DoE acceptance criteria.     

Generalized Maximum Benefit Multiple Chinese Postman Problem

This research is focused on a generalization on the Max Benefit Chinese Postman Problem and the multiple vehicle variant of the Chinese Postman Problem. We call this generalization, the Generalized Maximum Benefit k-Chinese Postman Problem (GB k-CPP). We present a novel Mixed Integer Programming (MIP) formulation for the GB k-CPP. Four different cases of the model are discussed. The first case, performs arc-routing with profits and assumes that the origin and destination for each vehicle is the same for each cycle and is given by the user. The next case relaxes the assumption that the origin and destination for each vehicle should be the same and allows the users to select possible origins/destinations for vehicles. Case three gets the origin for each vehicle as input and produces a solution based on finding the best destination for each vehicle. The last case, that is very general, allows the optimization model to select possibly different locations for vehicle origin and destination, during each cycle. The different cases are applied to a security patrolling case conducted on the network of University of Maryland at College Park campus and the results are compared.     

Heterogeneous hazard model of PEV users charging intervals: Analysis of four year charging transactions data

Public charging infrastructure represents a key success factor in the promotion of plug-in electric vehicles (PEV). Given that a large initial investment is required for the widespread adoption of PEV, many studies have addressed the location choice problem for charging infrastructure using a priori simple assumptions. Ideally, however, identifying optimal locations of charging stations necessitates an understanding of charging behavior. Limited market penetration of PEV makes it difficult to grasp any regularities in charging behavior. Using a Dutch data set about four-years of charging transactions, this study presents a detailed analysis of inter-charging times. Recognizing that PEV users may exhibit different charging behavior, this study estimates a latent class hazard duration model, which accommodates duration dependence, unobserved heterogeneity and the effects of time-varying covariates. PEV users are endogenously classified into regular and random users by treating charging regularity as a latent variable. The paper provides valuable insights into the dynamics of charging behavior at public charging stations, and which strategies can be successfully used to improve the performance of public charging infrastructure.