| 摘要: |
| 基于视觉、激光等单一传感器的定位方法难以适应多样化的环境，围绕激光雷达、惯性测量单元和相机3种模态的传感器信息源，针对激光雷达(Light Detection and Ranging,LiDAR)与视觉测量没有充分关联的问题，提出了一种基于多状态颜色一致性约束的激光雷达-惯性-视觉里程计方法，以提高系统的鲁棒性和定位精度。该方法紧耦合了激光雷达-惯性里程计（LiDAR-Inertial Odometry，LIO）和视觉-惯性里程计（Visual-Inertial Odometry，VIO）两个子系统，并定义了带有颜色信息的全局地图表示形式。LIO子系统中点云经过运动补偿后，直接用于构建点到面的残差。VIO子系统利用全局地图中点的深度信息，根据滑动窗口中多个相机状态观测到同一地图点颜色的一致性，构建光度误差约束，并通过不变扩展卡尔曼滤波（Extended Kalman Filter,EKF）状态估计器进行系统状态更新。在南洋理工大学发布的公共数据集上进行了实验，所提方法在该数据集不同序列上的绝对轨迹误差平均值为0.402 m。 |
| 关键词: 多传感器融合定位 状态估计 视觉-惯性里程计 激光-惯性里程计 |
| DOI：10.20079/j.issn.1001-893x.240523005 |
|
| 基金项目:国家自然科学基金资助项目(62203438)；国网山东省电力公司科技项目(52060122000P) |
|
| A LiDAR-Inertial-Visual Odometry Based on Multi-state Color Consistency Constraints |
| LIU Chuming,YU Guangyuan,LI Cong,SHI Pengcheng,SUN Shiying,XU Yongjun |
| (1.Jinan Power Supply Company,State Grid Shandong Electric Power Company，Jinan 250022,China;2.State Key Laboratory of Multimodal Artificial Intelligence System,Beijing 100190,China;3.School of Communication and Information Engineering,Chongqing University of Posts and Telecommunications,Chongqing 400065,China) |
| Abstract: |
| The localization method based on a single sensor is difficult to adapt to diverse environments.Three sensor information sources of light detection and ranging(LiDAR),inertial measurement unit and camera are focused on.For the problem that LiDAR and visual measurement can not be fully correlated,a LiDAR-inertial-visual odometry method based on multi-state color consistency constraint is proposed to improve the robustness and localization accuracy of the system. |
| Key words: multi-sensor fusion localization state estimation LiDAR-inertial odometry(LIO) visual-inertial odometry(VIO) |
