Authors - Vasavi Ravuri, S. Lalitha Geetanjali, T. Bhavana Sri, V. Praveen, M. Mokshgna Teja Abstract - Unstructured vehicle traffic (i.e. those containing multiple users such as automobile drivers, pedestrians, cyclists, and even animals) creates a significant challenge for road safety. This work presents the development of a real-time road risk assessment (RRA) system for analyzing dashcam video that combines several computer vision techniques: object detection, semantic segmentation, multi-object tracking, and alert classification, into a unified, integrated processing pipeline. Object detection and multi-object tracking are accomplished using the YOLOv8m and ByteTrack with Kalman Filter algorithms. Additionally, semantic segmentation of the road scene is achieved using a SegFormer-B2. Finally, a segmentation-assisted fusion filter and perspective-aware danger zone are applied (to define each point in the field of view as belonging to a zone with certain levels of risk). The Road Intrusion Risk Score (RIRS) is a composite score that quantifies the severity of intrusion accumulated over time, and provides graduated alert levels. Testing of the system on COCO val2017 and four dashcam videos produced reliable object detections with significantly fewer false positives and very close to real-time performance, demonstrating the potential of the system to improve driver assistance systems in unstructured road environments.
Open Zoom