{'fraction_non_alphanumeric': 0.014191106906338695, 'fraction_numerical': 0.001892147587511826, 'mean_word_length': 5.335329341317365, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
An Information Storage System for Large-Scale Knowledge Resources

To support for interdisciplinary research in the Titech 21COE LKR Program, we are developing an advanced information storage system to manage the large-scale knowledge resources. The flexibility and extensibility are key issues to provide the required services. To realize the flexibility, we take an approach to combine two types of systems by web-service APIs: an information storage system providing common functions for handling the variety of data formats and external systems dedicated for special applications based on the stored knowledge resources. We can add or modify the external systems to cope with the resource variety and requirement diversity. As a hardware configuration of the information storage system, we adopt a storage area network (SAN) with a number of servers and RAIDs to make the system extensible and reliable. This paper reports the functions and configurations of the advanced information storage system and some examples of the external application systems.