AI machine vision for safety and mobility: an autonomous vehicle perspective

Machine vision plays a crucial role in the development process of automated mobility, such as enabling the perception abilities of autonomous vehicles (AVs). The precise determination of an AV's perception of its surroundings is necessary for navigating in a dynamic traffic environment, especially in a mixed traffic environment where an AV moves with human-driven vehicles and vulnerable road users such as pedestrians and cyclists. Machine vision enables an AV to detect and classify components of the surrounding environment and perceive itself inside that environment. This information further assists the AV controller in taking appropriate action, including recognizing potential hazards. Machine vision coupled with artificial intelligence (AI) enables an AV to perform natural intelligence tasks and is the basis for replacing a human driver. In addition, AI machine vision-assisted AV eliminates human drivers' potential errors by ensuring better perception of the surroundings. It also assists in quicker and unbiased decision making and the decision-implementation process, thus improving user safety as well as overall mobility. This chapter reviews the basics of machine vision components along with related AI algorithms that will improve road traffic safety and mobility while considering connected AVs and roadside infrastructure. Associated AI machine vision challenges that need to be addressed for robust intelligence are also presented. In addition, future research opportunities related to AI machine vision of automated mobility are discussed.