为解决同构智能体在持续监控系统中缺乏灵活性问题,及探究传感器模型对系统的影响,提出了一种异构智能体的最优持续监控方案。首先建立了一个最优控制框架,采用极小值原理推导出最优控制策略的必要条件,将原问题转化为参数优化问题,之后运用无穷小扰动分析理论求解出目标函数关于参数的梯度,最终运用下降梯度法得到最优控制参数。结果表明,异构智能体具有比较好的容错性和灵活性,而不同的传感器模型虽然会对目标函数产生影响,但并未改变最优轨迹的特性。
To address the issue of limited flexibility in homogeneous agents within persistent monitoring systems and to investigate the impact of sensor models on system performance, this study proposes an optimal persistent monitoring scheme based on heterogeneous agents. First, an optimal control framework is established, and the necessary conditions for the optimal control strategy are derived using the minimum principle, transforming the original problem into a parameter optimization problem. Subsequently, the infinitesimal perturbation analysis method is applied to calculate the gradient of the objective function with respect to the parameters, and the optimal control parameters are obtained through the gradient descent method. The results demonstrate that heterogeneous agents exhibit superior fault tolerance and flexibility compared to homogeneous agents. Although different sensor models influence the objective function, they do not alter the fundamental characteristics of the optimal trajectory.
[1] 吴文君,王腾达,孙阳,等. 多智能体路径规划技术研究综述[J]. 北京工业大学学报,2024,50(10):1263-1272.
Wu W J, Wang T D, Sun Y, et al. Survey of multi-agent path finding technology[J]. Journal of Beijing University of Technology,2024,50(10):1263-1272.
[2] 姜玉涛,刘忠信,陈增强. 带扰动的多非完整移动机器人分布式有限时间一致性控制[J]. 控制理论与应用,2019,36(5):737-745.
Jiang Y T, Liu Z X, Chen Z Q. Distributed finite-time consensus algorithm for multiple nonholonomic mobile robots with disturbances[J]. Control Theory & Applications, 2019,36(5):737-745.
[3] 仉伟,纪志坚,渠继军.基于领导者对称的多智能体系统可控性研究[J].复杂系统与复杂性科学, 2019, 16(2):52-59.
Zhang W, Ji Z J, Qu J J.Controllability of multi-agent systems based on leader symmetry[J].Complex Systems and Complexity Science, 2019, 16(2):52-59.
[4] Yuan C, Zhang Y, Liu Z. A survey on technologies for automatic forest fire monitoring, detection, and fighting using unmanned aerial vehicles and remote sensing techniques[J]. Canadian Journal of Forest Research, 2015,45(7): 783-792.
[5] Shen Z, Andersson S B. Tracking nanometer-scale fluorescent particles in two dimensions with a confocal microscope[J].IEEE Transactions on Control Systems Technology, 2011, 19(5):1269-1278.
[6] Pasqualetti F. On cooperative patrolling: optimal trajectories, complexity analysis, and approximation algorithms[J].IEEE Transactions on Robotics, 2012, 28(3):592-606.
[7] Song C, Liu L, Feng G, et al. Optimal control for multi-agent persistent monitoring[J]. Automatica, 2014, 50(6):1663-1668.
[8] Cassandras C G, Lin X, Ding X. An optimal control approach to the multi-agent persistent monitoring problem[J]. IEEE Transactions on Automatic Control, 2013, 58(4): 947-961.
[9] Zhou N, Yu X, Andersson S B, et al. Optimal event-driven multi-agent persistent monitoring of a finite set of targets[J].IEEE Transactions on Automatic Control, 2018, 63(12): 4204-4217.
[10] Wang Y W, Wei Y W, Liu X K, et al. Optimal persistent monitoring using second-order agents with physical constraints[J].IEEE Transactions on Automatic Control, 2019, 64(8):3239-3252.
[11] Lan X, Schwager M. Rapidly exploring random cycles: persistent estimation of spatiotemporal fields with multiple sensing robots[J].IEEE Transactions on Robotics, 2017, 32(5):1230-1244.
[12] Pinto S C, Andersson S B, Hendrickx J M, et al. Optimal multi-agent persistent monitoring of the uncertain state of a finite set of targets[C]//IEEE 58th Conference on Decision and Control. Nice: IEEE,2019: 4280-4285.
[13] Welikalas, Cassandras C G. Greedy initialization for distributed persistent monitoring in network systems[J]. Automatica, 2021,134:1-16.
[14] Pinto S C, Andersson S B, Hendrickx J M, et al. Multiagent persistent monitoring of targets with uncertain states[J]. IEEE Transactions on Automatic Control, 2022, 67(8):3997-4012.
[15] friis h t. A note on a simple transmission formula[J].Proc Ire, 1946, 34(5):254-256.
[16] Athans M, Tse E. A direct derivation of the optimal linear filter using the maximum principle[J].IEEE Transactions on Automatic Control, 1968, 12(6):690-698.
[17] 胡寿松,王执铨,胡维礼.最优控制理论与系统[M]. 2版.北京:科学出版社,2005:49-72.
Hu S S, Wang Z Q, Hu W L. Optimal Control Theory and Systems[M]. 2rd.Beijing: Science Press,2005:49-72.
[18] Pinto S C, Andersson S B, Hendrickx J M, et al. Optimal periodic multi-agent persistent monitoring of a finite set of targets with uncertain states[C]//Annual American Control Conference. Denver: IEEE,2020:5207-5212.
[19] Cassandras C G, Wardi Y, Panayiotou C G, et al. Perturbation analysis and optimization of stochastic hybrid systems[J].European Journal of Control, 2010, 16(6):642-661.