Semantic Segmentation and Depth Estimation with RGB and DVS Sensor Fusion for Multi-view Driving Perception

• Main Authors: Natan, Oskar, Miura, Jun
• Format: Other NonPeerReviewed
• Published: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 2022
• Subjects: Artificial Intelligence and Image Processing not elsewhere classified
• Online Access: https://repository.ugm.ac.id/284221/; https://dl.acm.org/doi/10.1007/978-3-031-02375-0_26
• Institution: Universitas Gadjah Mada

In this research, we present a novel deep multi-task learning model to handle the perception stage of an autonomous driving system. The model leverages the fusion of RGB and dynamic vision sensor (DVS) images to perform semantic segmentation and depth estimation in four different perspectives of vie...