Exponenta Banner

Unreal Engine Scenario Simulation

Develop, test, and visualize the performance of driving algorithms in a simulated environment using the Unreal Engine® from Epic Games®

Automated Driving Toolbox™ provides a co-simulation framework for modeling and visualizing driving algorithms in Simulink® in a rich simulation environment. This simulation environment uses the Unreal Engine by Epic Games.

With this simulation environment, you can configure prebuilt scenes, place and move vehicles within the scene, and set up and simulate camera, radar, or lidar sensors on the vehicles. Use this environment to develop, test, and verify the performance of perception, path planning, and control algorithms, including closed-loop algorithms. To learn more, see Unreal Engine Simulation for Automated Driving.

Acknowledgements

Blocks

expand all

Simulation 3D Scene ConfigurationScene configuration for 3D simulation environment
Simulation 3D Vehicle with Ground FollowingImplement vehicle that follows ground in 3D environment
Cuboid To 3D SimulationConvert actor from cuboid coordinates to 3D simulation coordinates
Simulation 3D CameraCamera sensor model with lens in 3D simulation environment
Simulation 3D Fisheye CameraFisheye camera sensor model in 3D simulation environment
Simulation 3D LidarLidar sensor model in 3D simulation environment
Simulation 3D Probabilistic RadarProbabilistic radar sensor model in 3D simulation environment
Simulation 3D Probabilistic Radar ConfigurationConfigure probabilistic radar signatures in 3D simulation environment
Simulation 3D Vision Detection GeneratorDetect objects and lanes from measurements in 3D simulation environment

Scenes and Vehicle Dimensions

expand all

Straight RoadStraight road 3D environment
Curved RoadCurved road 3D environment
Parking LotParking lot 3D environment
Large Parking LotLarge parking lot 3D environment
Open SurfaceOpen surface 3D environment
Double Lane ChangeDouble lane change 3D environment
US City BlockUS city block 3D environment
US HighwayUS highway 3D environment
Virtual McityVirtual Mcity 3D environment
Box TruckBox truck vehicle dimensions
HatchbackHatchback vehicle dimensions
Muscle CarMuscle car vehicle dimensions
SedanSedan vehicle dimensions
Small Pickup TruckSmall pickup truck vehicle dimensions
Sport Utility VehicleSport utility vehicle dimensions

Apps

Bird's-Eye ScopeVisualize sensor coverages, detections, and tracks

Topics

Simulation Basics

Unreal Engine Simulation for Automated Driving

Learn how to model driving algorithms in Simulink and visualize their performance in a virtual environment using the Unreal Engine from Epic Games.

Unreal Engine Simulation Environment Requirements and Limitations

When simulating in the Unreal Engine environment, keep these software requirements, minimum hardware recommendations, and limitations in mind.

How Unreal Engine Simulation for Automated Driving Works

Learn about the co-simulation framework between Simulink and the Unreal Engine and how block execution order affects simulation.

Coordinate Systems for Unreal Engine Simulation in Automated Driving Toolbox

Understand the world and vehicle coordinate systems when simulating in the Unreal Engine environment.

Simulation with Sensors

Choose a Sensor for Unreal Engine Simulation

Decide which camera, lidar, or radar sensors to use during simulation with the Unreal Engine.

Simulate Simple Driving Scenario and Sensor in Unreal Engine Environment

Learn the basics of configuring and simulating scenes, vehicles, and sensors in a virtual environment rendered using the Unreal Engine from Epic Games.

Depth and Semantic Segmentation Visualization Using Unreal Engine Simulation

Visualize depth and semantic segmentation data captured from a camera sensor in the Unreal Engine simulation environment.

Visualize Sensor Data from Unreal Engine Simulation Environment

Visualize sensor coverage areas and detections obtained from high-fidelity radar and lidar sensors in the Unreal Engine simulation environment.

Scene Customization

Customize Unreal Engine Scenes for Automated Driving

Customize Unreal Engine scenes for automated driving applications.

Apply Semantic Segmentation Labels to Custom Scenes

Apply labels to objects in a scene so that you can obtain semantic segmentation data from a camera sensor.

Create Top-Down Map of Unreal Engine Scene

Create a 2-D, top-down map of a 3-D scene developed using the Unreal Engine from Epic Games. Use these maps to explore your scene and specify trajectory waypoints.

Place Cameras on Actors in the Unreal Editor

Place the Simulation 3D Camera GetSimulation 3D Camera block on static and custom actors.

Prepare Custom Vehicle Mesh for the Unreal Editor

Create custom vehicle mesh for the Simulation 3D Vehicle and Simulation 3D Vehicle with Ground Following blocks.

Featured Examples

Select Waypoints for Unreal Engine Simulation

Select Waypoints for Unreal Engine Simulation

Select waypoints from a scene and visualize the path of a vehicle following these waypoints in the Unreal Engine simulation environment.

Open Script
Design Lane Marker Detector Using Unreal Engine Simulation Environment

Design Lane Marker Detector Using Unreal Engine Simulation Environment

Use the Unreal Engine simulation environment to record synthetic sensor data and develop and test a lane marker detection system.

Open Script
Visualize Automated Parking Valet Using Unreal Engine Simulation

Visualize Automated Parking Valet Using Unreal Engine Simulation

Visualize vehicle motion in the Unreal Engine simulation environment using an automated parking valet system constructed in Simulink.

Open Script
Design Lidar SLAM Algorithm Using Unreal Engine Simulation Environment

Design Lidar SLAM Algorithm Using Unreal Engine Simulation Environment

Develop a simultaneous localization and mapping algorithm using synthetic lidar sensor data recorded from the Unreal Engine simulation environment.

Open Script
Simulate Vision and Radar Sensors in Unreal Engine Environment

Simulate Vision and Radar Sensors in Unreal Engine Environment

Implement a synthetic data simulation for tracking and sensor fusion using Simulink and the Unreal Engine simulation environment.

Open Script

Automated Driving Toolbox Documentation

Support