{'fraction_non_alphanumeric': 0.021363173957273652, 'fraction_numerical': 0.008138351983723296, 'mean_word_length': 5.739726027397261, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Estimation of morphological degradation parameters

We have discussed a morphologically based nonlinear document degradation model to characterize the perturbation process associated with the printing and scanning process [KHP93, KHP94]. In this paper we use the nonparametric estimation algorithm discussed in [KHP93, KHP94] for estimating the sizes of the structuring elements of the degradation model. Other parameters of the model can be estimated in a similar fashion. Thus, given a small sample of (real) scanned documents, we can estimate the parameters of the model using the nonparametric estimation algorithm, and use the estimated parameters to create a large sample of simulated documents with degradation characteristics similar to that of the real scanned documents. The large simulated sample can then be used for various purposes, for example, training classifiers, estimating performance of OCR algorithms, choosing parameter values in noise removal algorithms, etc.