Human-like autonomous car-following model with deep reinforcement learning

This study proposes a framework for human-like autonomous car-following planning based on deep reinforcement learning (deep RL). Historical driving data are fed into a simulation environment where an RL agent learns from trial and error interactions based on a reward function that signals how much the agent deviates from the empirical data. Through these interactions, an optimal policy, or car-following model that maps in a human-like way from speed, relative speed between a lead and following vehicle, and inter-vehicle spacing to acceleration of a following vehicle is finally obtained. The model can be continuously updated when more data are fed in. Two thousand car-following periods extracted from the 2015 Shanghai Naturalistic Driving Study were used to train the model and compare its performance with that of traditional and recent data-driven car-following models. As shown by this study’s results, a deep deterministic policy gradient car-following model that uses disparity between simulated and observed speed as the reward function and considers a reaction delay of 1 s, denoted as DDPGvRT, can reproduce human-like car-following behavior with higher accuracy than traditional and recent data-driven car-following models. Specifically, the DDPGvRT model has a spacing validation error of 18% and speed validation error of 5%, which are less than those of other models, including the intelligent driver model, models based on locally weighted regression, and conventional neural network-based models. Moreover, the DDPGvRT demonstrates good capability of generalization to various driving situations and can adapt to different drivers by continuously learning. This study demonstrates that reinforcement learning methodology can offer insight into driver behavior and can contribute to the development of human-like autonomous driving algorithms and traffic-flow models.     

The effects of planned and unplanned transfers on public transport users' perception of transfer routes

Many authorities are investing in new infrastructure to improve the quality of public transport (PT) services in the hope to increase mode switch from cars. The goal is to provide users with an integrated multimodal PT network by facilitating transfers. There exists a lack in the clarity of the attributes which defines a planned transfer and the effects of planned transfers on users' willingness to use routes with transfers. The present study provides approximate effects of ‘planned’ and ‘unplanned’ transfers on PT users' decisions to use transfer routes. The study focuses on two attributes of ‘planned’ transfers, integrated physical connection of transfers and information integration. A user preference survey was undertaken in Auckland, New Zealand. Analysis of the results shows that physical integration is more important than information integration for current PT users. Results also suggest that information integration has a greater influence on users of transfer services which are more closely aligned to being ‘unplanned’.     

Subjective-utility travel time budget modeling in the stochastic traffic network assignment

ABSTRACT

In this article, we propose a new model called subjective-utility travel time budget (SU-TTB) model to capture travelers' risk-averse route choices. In the travel time budget (TTB) and mean-excess travel time (METT) model, a predefined confidence level is needed to capture the risk-aversion in route choice. Due to the day-to-day route travel time variations, the exact confidence level is hard to be predicted. With the SU-TTB model, we assume travelers' confidence level belongs to an interval that they may comply with in the route choice. The two main components of SU-TTB are the utility function and the TTB model. We can show that the SU-TTB can be reduced to the TTB and METT model with proper utility function for the confidence levels. We can also prove its equivalence with our recently proposed nonlinear-expectation route travel time (NERTT) model in some cases and give some new interpretation on the NERTT with this equivalence. Finally, we formulate the SU-TTB model as a variational inequality (VI) problem to model the risk-averse user equilibrium (RAUE), termed as generalized RAUE (GRAUE). The GRAUE is solved via a heuristic gradient projection algorithm, and the model and solution algorithm are demonstrated with the Braess's traffic network and the Nguyen and Dupuis's traffic network.     

盾构下坡掘进对推进阻力的影响研究

以神华新街6°煤矿斜井盾构工程为背景,针对盾构下坡掘进工况,通过建立盾构上作用的水土压力载荷与坡度的数学关系模型,推导出推进阻力与坡度的数学公式。结合工程实例,计算水平掘进与6°下坡掘进各推进阻力值,并利用MATLAB软件绘制下坡掘进时推进阻力随坡度变化的曲线。结果表明:1)6°下坡掘进的总推进阻力相对于水平掘进仅减小了约8%,坡度小于13°时,可通过水平掘进时的推进阻力减去重力沿掘进轴线上的分量来近似求得,且偏差小于10%;2)总推进阻力会随坡角的不断增大而减小;3)当坡度大于50.4°后,盾构有自动向下滑移的趋势,刀盘将自动压紧开挖面,导致刀具自动嵌入开挖面,增加了启动扭矩与换刀的难度。     

圆形隧道施工对不同深度地层沉降影响的模型试验研究

为了预测圆形隧道施工引起地表以下不同埋深地层沉降特征,首先,通过理论推导不同地层最大沉降位移与沉降槽宽度系数的函数关系;然后,建立包括试验台架、地层模型、圆形隧道开挖模型以及测量地层变形装置的平面应变模型试验系统。通过理论解析和模型试验可知:1)地表以下地层的最大沉降位移与沉降槽宽度系数成反比;2)不同深度地层的沉降位移随着地层埋深的增加而增大,且地表以下地层沉降槽曲线仍然符合正态分布;3)通过对模型试验数据进行回归分析,得到黏土地表以下不同深度地层沉降槽宽度系数的计算公式,从而为预测圆形隧道施工地表以下不同深度地层竖向位移提供了一种可靠的计算方法。     

Power network parameter estimation method based on data mining technology

The parameter values which actually change with the circumstances, weather and load level etc.produce great effect to the result of state estimation. A new parameter estimation method based on data mining technology was proposed. The clustering method was used to classify the historical data in supervisory control and data acquisition (SCADA) database as several types. The data processing technology was impliedto treat the isolated point, missing data and yawp data in samples for classified groups. The measurement data which belong to each classification were introduced to the linear regression equation in order to gain the regression coefficient and actual parameters by the least square method. A practical system demonstrates the high correctness, reliability and strong practicability of the proposed method.     

基于支持向量机回归树的内燃机振动信号趋势预测

针对标准回归树建立在统计分析基础上所存在的缺陷,提出一种基于支持向量机的回归树预测模型。首先,根据原始振动信号趋势序列构建回归树;然后,针对回归树上包含样本数过少的节点,利用支持向量机,建立能够反映重要变量与响应变量之间映射关系的回归模型。仿真结果表明:即便由于设备出现异常,导致振动信号趋势序列出现非平稳、突变情况,该方法也能准确地预测,性能优于标准分析方法,具有一定的工程实用性。     

基于动态分频段FRA法的自耦变压器绕组轴向移位故障诊断

针对传统的频率响应分析(FRA)法无法识别自耦变压器绕组常见轴向移位故障的问题,提出基于动态分频段的FRA法:首先,搭建自耦变压器轴向移位故障模拟平台,获取不同轴向移位故障下绕组频响数据;其次,将幅频特性曲线波峰点与相频特性曲线C-L过零点频率相同的点作为预备分频点,同时将频响数据动态划分为多个频段,并绘制分频段极坐标图;然后,提取极坐标图的4个灰度梯度共生矩阵纹理特征和对应的归一化特征参数;最后,通过图形与特征的变化规律分析自耦变压器绕组的状态。试验验证结果表明:采用基于动态分频段的FRA法,生成的极坐标图数据点重叠情况得到改善,有利于图形分析和特征提取;不同绕组发生轴向移位故障时,各频段极坐标图变化趋势明显;同一绕组发生不同程度轴向故障时,极坐标图随故障程度增加差异呈变大的趋势;采用基于动态分频段的FRA法能准确区分自耦变压器轴向移位的故障绕组与故障程度,并能为自耦变压器现场故障诊断提供参考。     

45000吨化学品运输船主尺度数学模型建立

该文介绍了化学品运输船的发展历史和结构设计特点及安全规范。由统计资料回归出一套新的主尺度计算公式 ,该公式经实验证明效果较好。该结果可用于船型初步方案设计和新船的报价和合同设计。     

航道条件对船舶航行可靠性的影响

运用可靠性理论及回归分析来研究航道条件对船舶航行可靠性的影响,并建立其航道条件诸因素影响的可靠性模型,以提供驾驶员对航道条件影响船舶运行的直观认识,并为驾驶自动化提供数理模型。