Hitachi Astemo, together with the Research and Development Division of Hitachi, Ltd., leveraged their strengths in stereo camera technology to develop a prototype of the 360-degree stereo vision system, using multi-camera 3D sensing that enables distance measurement with the stereo camera technology. Instead of the conventional module consisting of two cameras with the same view angle and being nearly parallel to each other, the camera layout has been made more flexible to use a combination of approximately 10 cameras with different angles of view, including non-parallel cameras to provide stereoscopic 3D vision. By integrating multi-camera 3D sensing into a single in-vehicle camera system, the system realizes 360-degree stereo vision, with a cost advantage, high accuracy and resolution.
By generating highly accurate distance information in stereo and all around the vehicle, the system can detect such elements as the distance of a vehicle traveling in the adjacent lane, or a two-wheeled vehicle slipping through a line of cars from behind in a traffic jam. It can estimate the relative speed and direction of movement and apply this information for vehicle control to avoid collisions and entanglement at intersections. In addition to basic object recognition of objects such as cars, motorcycles, pedestrians, and traffic lanes, the recognition function also includes turn signals, red lights, and brake lights to predict the behavior of other vehicles; as well as traffic signals, road signs, road edges, and free space areas available for driving—all of which are necessary to identify for while driving on ordinary roads.
Furthermore, Hitachi Astemo has improved reliability and environmental resistance in camera sensing such as features to resist water droplets and dirt adhering to the lens surface or shielding the entire lens in the snow. The AI has learned malfunction patterns caused by these factors and can identify malfunction factors that occur in each camera, thereby preventing malfunctions.
