{'fraction_non_alphanumeric': 0.010903426791277258, 'fraction_numerical': 0.0, 'mean_word_length': 5.425, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Workflow Editor for Definition and Execution of Parallelized Earth Data Processing Algorithms

The aim of this paper is to present a workflow editor application meant to facilitate the description of parallelizable Earth Data processing algorithms. The application was developed as part of the BigEarth project, whose overall aim was to improve the execution time of large Earth Observation data sets by spreading the processing effort over a distributed, high-performance computing network. To achieve a simple and flexible manner of partitioning the parallel parts of the algorithms between different processing nodes, we chose to represent them using a simple, workflow-based model. Since one of the main purposes of the project was to provide a simple and intuitive way of creating algorithms descriptions, we chose to implement a Domain Specific Language coupled with a visual workflow representation used for providing feedback. Throughout this paper, we will be demonstrating the use of the workflow editor together with the description language in order to define and execute distributed data processing algorithms. We will be highlighting the effectiveness of the application as a means of providing processing algorithms by analyzing its behavior under various stress tests.