Added regex functionality to deny lists. Corrected tesseract to word level parsing. Improved review search regex capabilities. Updated documentation

Again revised spaCy language model load for different languages

Modified model load for custom languages with spaCy. Languages should load successfully now.

Corrected environment variable file references for log files and spacy/paddle folders for lambda_entrypoint

Enabled export of both review pdfs and redacted pdfs from same redaction run. Added config variables for user guide url and showing redaction settings. Moved config variables around a bit. Minor GUI improvements

Removed some extraneous test steps. Improved Example loading and feedback, and redaction feedback. Minor security updates. Fixed Adobe xfdf file parsing.

Fixed on deprecated Github workflow functions. Applied linter and formatter to code throughout. Added tests for GUI load.

Added example data files. Greatly revised CLI redaction for redaction, deduplication, and AWS Textract batch calls. Various minor fixes and package updates.

Updated documentation. Fix on ocr_output upload before pdf. Duplicate page fix

Fix for fuzzy matching

Corrected Tesseract data location

Improved language support functions and reporting

Added support for other languages. Improved DynamoDB download

Added PaddleOCR support

Major update. General code revision. Improved config variables. Dataframe based review frame now includes text, items can be searched and excluded. Costs now estimated. Option for adding cost codes added. Option to extract text only.

Added features to review dataframe to filter and exclude features based on text. Text should now appear consistently in review_df (for boxes not modified). Larger spacy model returned to use. Gradio upgrade.

Fixed issues with gradio version 5.16. Fixed fuzzy search error with pages with no data.

Fuzzy match implementation for deny list. Added option to merge multiple review files. Review files from redaction step should now include text.

Ensured the text ocr outputs have no line breaks at end. Multi-line custom text searches now possible. Files for review sent from redact button. Fixed image redaction (not review yet). Can get user pool details from headers. Gradio update.

Greatly improved regex for direct matching with custom entities

Uploaded pdfs with review files will now include all pages that don't have redactions. Slightly improved deny list matching.

Refactor redaction functionality and enhance UI components: Added support for custom recognizers and whole page redaction options. Updated file handling to include new dropdowns for entity selection and improved dataframes for entity management. Enhanced the annotator with better state management and UI responsiveness. Cleaned up redundant code and improved overall performance in the redaction process.

Updated packages. Reinstituted multithreading with page load, now with order protected. Smaller spacy model used for speed. Textract calls should now be faster

Started adding in support for custom deny list. Fixed textract call issue. Removed multithreading for now as it mixes up pages

Comprehend now uses custom spacy recognisers on top of defaults. Added zoom functionality to annotator. Fixed some pdf mediabox issues and redacted image output issues.

Allowed for time limits on redact to avoid timeouts. Improved review interface. Now accepts only one file at a time. Upgraded Gradio version

Redaction tool can now export pdfs with selectable text retained - redacted text is deleted and covered with a black box. Licence change for pymupdf use.

Generally improved OCR recognition of texts, corrected postcode regex

Optimised Textract and Tesseract workings

Improved allow list, handwriting/signature identification, logging

Version 0.1. Adapted code for pyinstaller local executable conversion (Windows)

Initial commit