Future Vehicle Technology © VIRTUAL VEHICLE
ESR 1: Integrated design and simulation for active safety functions M. Sc. (Univ.) Michael Hartmann VIRTUAL VEHICLE Research Center
VIRTUAL VEHICLE Research Center is funded within the COMET – Competence Centers for Excellent Technologies – programme by the Austrian Federal Ministry for Transport, Innovation and Technology (BMVIT), the Federal Ministry of Science, Research and Economy (BMWFW), the Austrian Research Promotion Agency (FFG), the province of Styria and the Styrian Business Promotion Agency (SFG). The COMET programme is administrated by FFG.
© VIRTUAL VEHICLE
Short Biography
2006 - 2010 •
Diploma (FH) in Electrical Engineering; University of Applied Sciences Würzburg-Schweinfurt
2010 - 2013 • • •
Master of Science (M. Sc.) in Electrical Engineering and Information Technology; Technical University Munich Master Thesis: Probabilistic Movement Prediction in Soccer Student Research Assistant in Intelligent Autonomous Systems Lab (CoTeSys)
2013 – 2015 •
Bertrandt GmbH Munich, Virtual Validation and Software Testing for BMW Group
Research Interests: Motion Planning, Probabilistic Machine Learning, Movement Prediction and Optimal Control July 2016 / Hartmann
Integrated design and simulation for active safety functions
© VIRTUAL VEHICLE
3
Vision
Source: Volvo
Control in dynamic and uncertain environments Source of uncertainty: predictability of the nearby vehicles and pedestrians (future trajectories) July 2016 / Hartmann
Integrated design and simulation for active safety functions
© VIRTUAL VEHICLE
4
Psychological aspects in driving situations
July 2016 / Hartmann
Integrated design and simulation for active safety functions
© VIRTUAL VEHICLE
5
Environment Sensing Situation Recognition Movement Prediction Source: University of Central Florida
Situation Rating Path Planning
Tracking of the… -
… nearby vehicles and pedestrians
-
… form of obstacles
Optimal Control July 2016 / Hartmann
Integrated design and simulation for active safety functions
© VIRTUAL VEHICLE
6
Environment Sensing Situation Recognition Movement Prediction
Situation Rating Path Planning
Source: Kitani, Carnegie Mellon University
-
Semantic labeling of the environment
-
Machine Learning for situation assessment
-
Complexity (e.g. amount of situations)
Optimal Control July 2016 / Hartmann
Integrated design and simulation for active safety functions
© VIRTUAL VEHICLE
7
Source: Lefevre, University of California at Berkeley
Environment Sensing Situation Recognition Physics-based motion models:
Movement Prediction
Situation Rating
- Represent vehicles as dynamic entities governed by the laws of physics - Future motion is predicted using dynamic and kinematic models Limitations:
Path Planning
Optimal Control July 2016 / Hartmann
- Limited to short-term prediction - Unable to anticipate any change in the motion of the car caused by the execution of a maneuver external factors (e.g. front vehicle)
Integrated design and simulation for active safety functions
© VIRTUAL VEHICLE
8
Environment Sensing Situation Recognition Movement Prediction
Situation Rating
Source: Lefevre, University of California at Berkeley
Maneuver-based motion models: - Vehicles follow typical patterns (long-term intention) Limitations:
Path Planning
Optimal Control July 2016 / Hartmann
- Heavy computational burden - not incorporating physical limitations of a vehicle
Integrated design and simulation for active safety functions
© VIRTUAL VEHICLE
9
Environment Sensing Situation Recognition Movement Prediction
Source: Lefevre, University of California at Berkeley
Interaction-aware motion models: - Vehicles which interact with each other
Situation Rating
- Leads to a better interpretation (known dependencies) Limitations:
Path Planning
- Computationally expensive - Not compatible with real-time risk assessment
Optimal Control July 2016 / Hartmann
Integrated design and simulation for active safety functions
© VIRTUAL VEHICLE
10
Situation Rating for Safety Environment Sensing Situation Recognition Movement Prediction
Situation Rating Path Planning
Source: Streubel; TU Chemnitz
1. Risk of a (future) situation a) Binary Collision prediction b) Probabilistic Collision prediction 2. Uncertainty
3. Driving task demand a) Speed b) Road Geometry c) Unexpected behavior d) Other road users
Optimal Control July 2016 / Hartmann
Integrated design and simulation for active safety functions
© VIRTUAL VEHICLE
11
Environment Sensing
Based on the current state x(t):
Situation Recognition
• Choose optimal action sequence based on the situation rating (e.g. minimal collision risk) x(t)
Movement Prediction
Situation Rating Path Planning
Optimal Control Source: Maler, O.; CNRS Verimag, France
July 2016 / Hartmann
Integrated design and simulation for active safety functions
© VIRTUAL VEHICLE
12
Model Predictive Control Environment Sensing Situation Recognition Movement Prediction
Situation Rating Path Planning
Optimal Control Source: Lecture Slides Prof. Bemporad (http://cse.lab.imtlucca.it/) July 2016 / Hartmann
Integrated design and simulation for active safety functions
© VIRTUAL VEHICLE
13
Environment Sensing Situation Recognition Movement Prediction
Situation Rating Path Planning
Optimal Control July 2016 / Hartmann
Integrated design and simulation for active safety functions
© VIRTUAL VEHICLE
14
Challenge
- Movement prediction of pedestrians and vehicles - Reasoning about the situations (e.g. Causal Inference) - Motion planning for safe autonomous navigation in uncertain environments in combination with optimal control - Dynamic obstacle avoidance in real-time
July 2016 / Hartmann
Integrated design and simulation for active safety functions
© VIRTUAL VEHICLE
15
Recommended Literature
Lefèvre, S., Vasquez, D., & Laugier, C. (2014). A survey on motion prediction and risk assessment for intelligent vehicles. Robomech Journal, 1(1), 1.
Ziebart, B. D. (2010). Modeling purposeful adaptive behavior with the principle of maximum causal entropy. (Doctoral dissertation, Carnegie Mellon University. 2010)
Aoude, G. S. (2011). Threat assessment for safe navigation in environments with uncertainty in predictability (Doctoral dissertation, Massachusetts Institute of Technology).
July 2016 / Hartmann
Integrated design and simulation for active safety functions
© VIRTUAL VEHICLE
16
M.Sc. (Univ.) Michael Hartmann VIRTUAL VEHICLE Research Center
[email protected]
© VIRTUAL VEHICLE
MI1 "Integrated design and simulation for active safety functions"
•
Advanced control approaches in driver assistance and active safety systems for MAGV incl. relevant sensor and actuator systems.
•
Active safety controllers will be based on specified computational intelligence methods
•
Improvements in vehicle safety and performance according to the formulated assessment criteria
•
Validation of the controllers will be carried out on specially developed realtime co-simulation platform, where specified MAGV subsystems and ECU (as components of hardware-in-the-loop (HIL) experiment)
•
Controller models are integrated into one co-simulation environment.
•
New co-simulation platform will be also proposed for verification and validation tasks of other individual ESR projects.
July 2016 / Hartmann
Integrated design and simulation for active safety functions
© VIRTUAL VEHICLE
18
Integrated design and simulation for active safety functions
July 2016 / Hartmann
Integrated design and simulation for active safety functions
© VIRTUAL VEHICLE
19
July 2016 / Hartmann
Integrated design and simulation for active safety functions
© VIRTUAL VEHICLE
20