Organisation

MathWorks

Problem Category

Software

Problem Description

Background: Navigating an intersection with traffic lights is a challenging but safety critical task for a self-driving car. Using perception to identify traffic light positions and states despite lighting conditions and occlusions is an interesting problem that a 3D simulation environment can safely and effectively provide a solution for. Automated Driving Toolbox™ provides a 3D simulation environment powered by Unreal Engine® from Epic Games® that can be used to visualize traffic lights and the motion of a vehicle in a 3D scene. Description: Use MATLAB® and Simulink® to load a pre-built Unreal scene, detect and identify the state of the traffic light nearest to the ego-vehicle, design a Stateflow® model to control traffic lights in the scene, and control the reaction of the ego-vehicle in accordance with the traffic lights and surrounding vehicles. The position and color state of the traffic light at an intersection can be obtained by using a combination of sensors and perception algorithms. Perception can be used to identify surrounding vehicles which can also be used to inform decisions. Identify distance between the traffic light nearest to the ego-vehicle and the ego-vehicle in a pre-built Unreal scene intersection. Identify the color of the traffic light using camera output and perception. Control the change of state of the traffic light using Stateflow. The ego-vehicle should react to the traffic light information. Build your own scenes with the following suggested requirements and perform a quantitative analysis of your algorithm: a. Traffic lights obstructed by trees b. Various types of traffic lights like hanging on a pole, multiple traffic lights in different orientations at an intersection c. Scenes with different weather conditions Work with Automated Driving Toolbox™ , Computer Vision Toolbox™ , Lidar Toolbox™ and Sensor Fusion and Tracking Toolbox™ https://www.mathworks.com/products/sensor-fusion-and-tracking.html for this project. Students can also take the opportunity of submitting the solution to the MathWorks Excellence in Innovation Projects and get recognized for their work. Deliverables Software (Models, Code, Simulation Data, 3D files) License: For students whose institutions/university already have access to MATLAB, SIMULINK and its toolboxes, please use of these licenses. To check if your campus has a MATLAB campus license? Check the following link For those whose institutions/university, do not have access to MATLAB, SIMULINK and its toolboxes. Please send a mail to [email protected] and we will provide you with the required license.