{'fraction_non_alphanumeric': 0.021035598705501618, 'fraction_numerical': 0.006472491909385114, 'mean_word_length': 5.7967032967032965, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Validating Autonomous Behaviors against Partially Specified Ambiguous Requirements

We are concerned with analysis of Automated Driving Systems (ADS) behavior against formal specifications of desired guardrails. We present methods for determining whether observed behaviors are consistent with formal requirements. This paper is intended to be used as a component within, or otherwise inform, the development of a BigData system continuously monitoring a large fleet of diverse vehicles. Our results include: 1) Definition of behaviors and their relationships to scenarios. 2) Definition of guardrails to be validated and their relationship to ambiguity. 3) Reduce guardrail validation to simple fuzzy constraint satisfaction. 4) Determine degree of behavior compliance with guardrails. 5) Enable validation against partially specified guardrails and situations describing a small fraction of the world. 6) Enable support for uncertainty specifications. 7) Support decomposition into modules aligned with organizational structures. 8) Provide a low cost scalable solution for assessment of compliance, coverage and acceptable risk. The complexity of validation is linear in the number of requirements and situations extracted from logs.