A Smart Cane Based on 2D LiDAR and RGB-D Camera Sensor-Realizing Navigation and Obstacle Recognition

计算机视觉 激光雷达 障碍物 人工智能 全球定位系统 计算机科学 同时定位和映射 RGB颜色模型 全向照相机 遥感 机器人 全向天线 地理 移动机器人 电信 考古 天线(收音机)
作者
Chunming Mai,Huaze Chen,Lina Zeng,Zaijin Li,Guojun Liu,Zhongliang Qiao,Yi Qu,Lianhe Li,Lin Li
出处
期刊:Sensors [Multidisciplinary Digital Publishing Institute]
卷期号:24 (3): 870-870 被引量:48
标识
DOI:10.3390/s24030870
摘要

In this paper, an intelligent blind guide system based on 2D LiDAR and RGB-D camera sensing is proposed, and the system is mounted on a smart cane. The intelligent guide system relies on 2D LiDAR, an RGB-D camera, IMU, GPS, Jetson nano B01, STM32, and other hardware. The main advantage of the intelligent guide system proposed by us is that the distance between the smart cane and obstacles can be measured by 2D LiDAR based on the cartographer algorithm, thus achieving simultaneous localization and mapping (SLAM). At the same time, through the improved YOLOv5 algorithm, pedestrians, vehicles, pedestrian crosswalks, traffic lights, warning posts, stone piers, tactile paving, and other objects in front of the visually impaired can be quickly and effectively identified. Laser SLAM and improved YOLOv5 obstacle identification tests were carried out inside a teaching building on the campus of Hainan Normal University and on a pedestrian crossing on Longkun South Road in Haikou City, Hainan Province. The results show that the intelligent guide system developed by us can drive the omnidirectional wheels at the bottom of the smart cane and provide the smart cane with a self-leading blind guide function, like a "guide dog", which can effectively guide the visually impaired to avoid obstacles and reach their predetermined destination, and can quickly and effectively identify the obstacles on the way out. The mapping and positioning accuracy of the system's laser SLAM is 1 m ± 7 cm, and the laser SLAM speed of this system is 25~31 FPS, which can realize the short-distance obstacle avoidance and navigation function both in indoor and outdoor environments. The improved YOLOv5 helps to identify 86 types of objects. The recognition rates for pedestrian crosswalks and for vehicles are 84.6% and 71.8%, respectively; the overall recognition rate for 86 types of objects is 61.2%, and the obstacle recognition rate of the intelligent guide system is 25-26 FPS.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
Tina驳回了Jasper的应助
刚刚
刚刚
1秒前
2秒前
2秒前
2秒前
牧友桃发布了新的文献求助10
3秒前
求真科技完成签到,获得积分10
3秒前
4秒前
隐形太阳完成签到,获得积分10
4秒前
你好发布了新的文献求助10
4秒前
Ren关注了科研通微信公众号
5秒前
柳暗花明1302完成签到,获得积分10
7秒前
bkagyin的应助被houniao采纳,获得10
7秒前
莱十一发布了新的文献求助10
7秒前
xiaomiii完成签到,获得积分10
8秒前
从容的晓凡完成签到 ,获得积分10
8秒前
从容的迎松完成签到,获得积分10
9秒前
无花果的应助被牧百川采纳,获得10
9秒前
zd发布了新的文献求助10
9秒前
科目三的应助被selena采纳,获得10
9秒前
希望天下0贩的0的应助被Libra采纳,获得10
9秒前
在时光的秋千上完成签到,获得积分10
9秒前
lmy的应助被勤勤的新星采纳,获得10
10秒前
油条完成签到,获得积分10
10秒前
11秒前
12秒前
by完成签到 ,获得积分10
13秒前
充电宝的应助被其7采纳,获得10
14秒前
莱十一完成签到,获得积分10
14秒前
wyy发布了新的文献求助10
15秒前
tanjiabin完成签到,获得积分10
15秒前
Lionel_Art完成签到,获得积分10
18秒前
18秒前
18秒前
lsq发布了新的文献求助10
18秒前
科研通AI6.4的应助被chi采纳,获得10
19秒前
22秒前
TCM-DH发布了新的文献求助10
22秒前
顾矜的应助被现代的随阴采纳,获得10
24秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
八旗制度の研究 600
Improving the wear resistance of vehicle gear oil by oil soluble LaF3 nanoparticles and typical additives of gear oil 500
Boundaries and Bodhisattvas 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8183263
求助须知:如何正确求助?哪些是违规求助? 9572532
关于积分的说明 21826339
捐赠科研通 7780187
什么是DOI,文献DOI怎么找? 3433993
关于科研通互助平台的介绍 2558131
邀请新用户注册赠送积分活动 2480239