{'fraction_non_alphanumeric': 0.010440835266821345, 'fraction_numerical': 0.0, 'mean_word_length': 5.587786259541985, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Evaluating the capability of text understanding based on cognitive principle

According to the human cognitive process of text understanding, text cognitive function is proposed to describe the capability of text understanding, which can be expressed by an addition of various extracted keywords and relations among keywords. Text energy and text information are defined as two characteristics in text understanding in order to measure the acquired textual information and the reader-consumed energy in text reading process, which can be expressed by coefficients of factors of text cognitive function. According to the cognitive economical principle, the ratio of text information to text energy is used as a criterion of evaluating the capability of text understanding. Experiments verify that results of the proposed method consist with cognitive experiences.