基于深度强化学习的智能船舶航迹跟踪控制

[目的]智能船舶的航迹跟踪控制问题往往面临着控制环境复杂、控制器稳定性不高以及大量的算法计算等问题。为实现对航迹跟踪的精准控制,提出一种引入深度强化学习技术的航向控制器。[方法]首先,结合视线(LOS)算法制导,以船舶的操纵特性和控制要求为基础,将航迹跟踪问题建模成马尔可夫决策过程,设计其状态空间、动作空间、奖励函数;然后,使用深度确定性策略梯度(DDPG)算法作为控制器的实现,采用离线学习方法对控制器进行训练;最后,将训练完成的控制器与BP-PID控制器进行对比研究,分析控制效果。[结果]仿真结果表明,设计的深度强化学习控制器可以从训练学习过程中快速收敛达到控制要求,训练后的网络与BP-PID控制器相比跟踪迅速,具有偏航误差小、舵角变化频率小等优点。[结论]研究成果可为智能船舶航迹跟踪控制提供参考。     

Achieving transport modal split targets at intermodal freight hubs using a model predictive approach

The increase of international freight commerce is creating pressure on the existing transport network. Cooperation between the different transport parties (e.g., terminal managers, forwarders and transport providers) is required to increase the network throughput using the same infrastructure. The intermodal hubs are locations where cargo is stored and can switch transport modality while approaching the final destination. Decisions regarding cargo assignment are based on cargo properties. Cargo properties can be fixed (e.g., destination, volume, weight) or time varying (remaining time until due time or goods expiration date). The intermodal hub manager, with access to certain cargo information, can promote cooperation with and among different transport providers that pick up and deliver cargo at the hub. In this paper, cargo evolution at intermodal hubs is modeled based on a mass balance, taking into account hub cargo inflows and outflows, plus an update of the remaining time until cargo due time. Using this model, written in a state-space representation, we propose a model predictive approach to address the Modal Split Aware – Cargo Assignment Problem (MSA–CAP). The MSA–CAP concerns the cargo assignment to the available transport capacity such that the final destination can be reached on time while taking into consideration the transport modality used. The model predictive approach can anticipate cargo peaks at the hub and assigns cargo in advance, following a push of cargo towards the final destination approach. Through the addition of a modal split constraint it is possible to guide the daily cargo assignment to achieve a transport modal split target over a defined period of time. Numerical experiments illustrate the validity of these statements.     

Dynamic traffic metering in urban street networks: Formulation and solution algorithm

Traffic metering offers great potential to reduce congestion and enhance network performance in oversaturated urban street networks. This paper presents an optimization program for dynamic traffic metering in urban street networks based on the Cell Transmission Model (CTM). We have formulated the problem as a Mixed-Integer Linear Program (MILP) capable of metering traffic at network gates with given signal timing parameters at signalized intersections. Due to the complexities of the MILP model, we have developed a novel and efficient solution approach that solves the problem by converting the MILP to a linear program and several CTM simulation runs. The solution algorithm is applied to two case studies under different conditions. The proposed solution technique finds solutions that have a maximum gap of 1% of the true optimal solution and guarantee the maximum throughput by keeping some vehicles at network gates and only allowing enough vehicles to enter the network to prevent gridlocks. This is confirmed by comparing the case studies with and without traffic metering. The results in an adapted real-world case study network show that traffic metering can increase network throughput by 4.9–38.9% and enhance network performance.     

Vegetation cover at right of way locations

This research evaluated the status of vegetation cover at right of way locations. Site factors that contributed to low and high ground cover along roadsides and medians were identified. Twenty-nine roadside and median study sites incorporated variability in soil type, elevation, vegetation establishment and cover, seed mixture, slope, aspect, time since planting, and climate. Vegetation cover was measured, and species distribution was identified. Slopes, aspects of the sloping face, and elevations were recorded. Soil samples were tested for nutrients, minerals, texture, and pH. Approximately 50% of the test sites met the 70% cover criteria. Locations of the worst cover (<50%) had soils with high soluble salt content (0.36–1.54 mmhos/cm) or low organic matter values (<1.7%). Vegetation cover was dominated by tall fescue (Festuca arundinacea) and crownvetch (Coronilla varia L.), two species that were included in the current seeding mixture and are considered invasive. To further promote revegetation success and persistence, both maintenance and site specific seed mixtures are needed.     

船舶电缆自动化敷设系统设计与实现

在船舶电缆敷设过程中,很难借助有效的工装提高劳动效率,低空间的高强度作业存在严重的安全风险。以船舶电缆自动化敷设系统为分析对象,介绍系统组成和系统接口,采用比例积分微分(Proportion Integration Differentiation,PID)算法计算系统行程,通过PROFINET总线完成数据传输,以人机界面(Human Machine Interface,HMI)实现系统性能要求。在风电安装平台上的实际运用表明,该系统可解决造船行业劳动力成本高和安全风险大的问题。     

A real-time adaptive signal control in a connected vehicle environment

The state of the practice traffic signal control strategies mainly rely on infrastructure based vehicle detector data as the input for the control logic. The infrastructure based detectors are generally point detectors which cannot directly provide measurement of vehicle location and speed. With the advances in wireless communication technology, vehicles are able to communicate with each other and with the infrastructure in the emerging connected vehicle system. Data collected from connected vehicles provides a much more complete picture of the traffic states near an intersection and can be utilized for signal control. This paper presents a real-time adaptive signal phase allocation algorithm using connected vehicle data. The proposed algorithm optimizes the phase sequence and duration by solving a two-level optimization problem. Two objective functions are considered: minimization of total vehicle delay and minimization of queue length. Due to the low penetration rate of the connected vehicles, an algorithm that estimates the states of unequipped vehicle based on connected vehicle data is developed to construct a complete arrival table for the phase allocation algorithm. A real-world intersection is modeled in VISSIM to validate the algorithms. Results with a variety of connected vehicle market penetration rates and demand levels are compared to well-tuned fully actuated control. In general, the proposed control algorithm outperforms actuated control by reducing total delay by as much as 16.33% in a high penetration rate case and similar delay in a low penetration rate case. Different objective functions result in different behaviors of signal timing. The minimization of total vehicle delay usually generates lower total vehicle delay, while minimization of queue length serves all phases in a more balanced way.     

青岛地铁线网无线统一调度系统互联互通实施方案

简要阐述青岛地铁线网无线统一调度系统互联互通实施方案的系统架构、核心设备功能、纵向统一调度方案、横向集群业务互联互通方案以及相应的业务流程等。该方案实现了青岛地铁不同品牌TETRA系统的线网纵向统一调度和线网横向集群业务的互联互通功能,解决了青岛地铁线路多品牌系统跨线运营的问题。     

鱼雷定深航行稳定性的分叉分析

鱼雷定深运动方程含有诸多的非线性项，用传统的分析方法对其稳定性进行研究有较大难度。运用非线性科学中的分叉理论，选定鱼雷定深运动方程中的某一流体动力系数扰动值为分叉参数，系统地分析在经典比例微分深度控制系统作用下，鱼雷在退化平衡点处的航行稳定性。利用中心流形定理，推导出系统状态变量解析表达式，对系统 Hopf分叉进行分析，并进行仿真验证。结果表明，流体动力系数变化使定深航行产生 Hopf分叉，并给出了确保鱼雷稳定航行的流体动力参数取值范围。     

Fractional-order-based ACC/CACC algorithm for improving string stability

Traffic flow optimization and driver comfort enhancement are the main contributions of an Adaptive Cruise Control (ACC) system. If communication links are added, more safety and shorter gaps can be reached performing a Cooperative-ACC (CACC). Although shortening the inter-vehicular distances directly improves traffic flow, it can cause string unstable behavior. This paper presents fractional-order-based control algorithms to enhance the car-following and string stability performance for both ACC and CACC vehicle strings, including communication temporal delay effects. The proposed controller is compared with state-of-the-art implementations, exhibiting better performance. Simulation and real experiments have been conducted for validating the approach.     

Distributed MPC for cooperative highway driving and energy-economy validation via microscopic simulations

Traffic congestion and energy issues have set a high bar for current ground transportation systems. With advances in vehicular communication technologies, collaborations of connected vehicles have becoming a fundamental block to build automated highway transportation systems of high efficiency. This paper presents a distributed optimal control scheme that takes into account macroscopic traffic management and microscopic vehicle dynamics to achieve efficiently cooperative highway driving. Critical traffic information beyond the scope of human perception is obtained from connected vehicles downstream to establish necessary traffic management mitigating congestion. With backpropagating traffic management advice, a connected vehicle having an adjustment intention exchanges control-oriented information with immediately connected neighbors to establish potential cooperation consensus, and to generate cooperative control actions. To achieve this goal, a distributed model predictive control (DMPC) scheme is developed accounting for driving safety and efficiency. By coupling the states of collaborators in the optimization index, connected vehicles achieve fundamental highway maneuvers cooperatively and optimally. The performance of the distributed control scheme and the energy-saving potential of conducting such cooperation are tested in a mixed highway traffic environment by the means of microscopic simulations.