Pedestrian detection with lidar technology in smart-city deployments - challenges and recommendations

Torres, Pedro; Marques, Hugo; Marques, Paulo

http://hdl.handle.net/10400.11/8434

Use this identifier to reference this record.

Name:	Description:	Size:	Format:
computers-12-00065.pdf		6.28 MB	Adobe PDF	Download

Send Feedback

Authors

Torres, Pedro

Marques, Hugo

Marques, Paulo

Abstract(s)

Abstract: This paper describes a real case implementation of an automatic pedestrian-detection solution, implemented in the city of Aveiro, Portugal, using affordable LiDAR technology and open, publicly available, pedestrian-detection frameworks based on machine-learning algorithms. The presented solution makes it possible to anonymously identify pedestrians, and extract associated information such as position, walking velocity and direction in certain areas of interest such as pedestrian crossings or other points of interest in a smart-city context. All data computation (3D point-cloud processing) is performed at edge nodes, consisting of NVIDIA Jetson Nano and Xavier platforms, which ingest 3D point clouds from Velodyne VLP-16 LiDARs. High-performance real-time computation is possible at these edge nodes through CUDA-enabled GPU-accelerated computations. The MQTT protocol is used to interconnect publishers (edge nodes) with consumers (the smartcity platform). The results show that using currently affordable LiDAR sensors in a smart-city context, despite the advertising characteristics referring to having a range of up to 100 m, presents great challenges for the automatic detection of objects at these distances. The authors were able to efficiently detect pedestrians up to 15 m away, depending on the sensor height and tilt. Based on the implementation challenges, the authors present usage recommendations to get the most out of the used technologies.

Keywords

Pedestrian detection Lidar 3D point clouds ROS Smart cities Traffic mobility

URI

http://hdl.handle.net/10400.11/8434

Citation

TORRES, Pedro, MARQUES, Hugo, MARQUES, Paulo (2023) - Pedestrian detection with lidar technology in smart-city deployments - challenges and recommendations. ISSN 2073-431X. Vol.12, p.3-16.