Real-Time Memory Efficient Multitask Learning Model for Autonomous Driving

  • Miraliev, Shokhrukh
  • Abdigapporov, Shakhboz
  • Kakani, Vijay
  • Kim, Hakil
Citations

WEB OF SCIENCE

26
Citations

SCOPUS

26

초록

Developing a self-driving system is a challenging task that requires a high level of scene comprehension with real-time inference, and it is safety-critical. This study proposes a real-time memory efficient multitask learning-based model for joint object detection, drivable area segmentation, and lane detection tasks. To accomplish this research objective, the encoder-decoder architecture efficiently utilized to handle input frames through shared representation. Comprehensive experiments conducted on a challenging public Berkeley Deep Drive (BDD100 K) dataset. For further performance comparisons, a private dataset consisting of 30 K frames was collected and annotated for the three aforementioned tasks. Experimental results demonstrated the superiority of the proposed method's over existing baseline approaches in terms of computational efficiency, model power consumption and accuracy performance. The performance results for object detection, drivable area segmentation and lane detection tasks showed the highest 77.5 mAP50, 91.9 mIoU and 33.8 mIoU results on BDD100K dataset respectively. In addition, the model achieved 112.29 fps processing speed improving both performance and inference speed results of existing multi-tasking models.

키워드

Task analysisFeature extractionObject detectionPerformance evaluationLane detectionRoadsDecodingMultitask learningedge deviceautonomous drivingobject detectiondrivable area segmentationlane detectionconvolutional neural networks
제목
Real-Time Memory Efficient Multitask Learning Model for Autonomous Driving
저자
Miraliev, ShokhrukhAbdigapporov, ShakhbozKakani, VijayKim, Hakil
DOI
10.1109/TIV.2023.3270878
발행일
2024-01
유형
Article
저널명
IEEE Transactions on Intelligent Vehicles
9
1
페이지
247 ~ 258