Test Cases for Automated Driving Systems
Validation test is one of the major challenges encountered in the development of automated driving systems in the world today. This challenge is primarily reflected in the integrity of the test cases used for automated driving system validation. Due to the complexity of such systems and the large number of various external influence factors affecting their functional safety, the existing test case generation methods are difficult to ensure the integrity and effectiveness of system-level validation.
Currently, there are three general test case generation methods for validating systems:
1) Interface-based test case generation;
2) Specification-based Test case generation;
3) Risk-based test case generation.
Each of these three generation methods has its own advantages and disadvantages. It can neither meet the requirements of the automated driving system validation, nor guarantee the test efficiency under the premise of meeting the functional safety test requirements of the automated driving functions. PilotD’s Hybrid Test Case Generation Method
PilotD offers a new application-oriented use case generation solution for automated driving system validation: a hybrid test case generation method. The method is based on and integrates the above three methods, and promotes the strengths and avoids shortcomings, so that the test cases for the validation test of the automated driving systems can be generated with the following advantages:
1) High test coverage
2) Test cases are well structured
3) High test efficiency
PilotD's test case generation method takes various external influence factors into consideration, models and analyzes specific applications in ADS, and obtains the application-oriented working conditions of each component of ADS system. Subsequently, based on the classification of the error of the various components of the system, the type of component error that is critical to each use case is identified. At the same time, according to the working principle of each component, the corresponding relationship between external influence factors and error types of each component is summarized. By combining these factors, test cases can be generated to test whether a particular type of error for a particular component that is critical to a usage condition is "stimulated." Thus, these test cases can be used for system validation purposes.
PilotD uses this structured test case generation method, as well as a test case simplification method, to help customers to quickly generate test case sets with high test coverage based on the functional specification of their systems or automated driving applications; The test cost by using the generated test cases can be controlled within an acceptable range as well. In this way, PilotD can help customers quickly complete the validation test process of a new automated driving system and speed up system release. References 1)Cao, P. and Huang, L., "Application Oriented Testcase Generation for Validation of Environment Perception Sensor in Automated Driving Systems," SAE Technical Paper 2018-01-1614, 2018, https://doi.org/10.4271/2018-01-1614.