Greatly improved regex for direct matching with custom entities

Uploaded pdfs with review files will now include all pages that don't have redactions. Slightly improved deny list matching.

Fixed bug where pages suggested for whole redaction are one lower than requested

Update app layout, user guide, and Gradio upgrade.

Adapted text join options to review file to be more resilient to changes in image size. Added possibility of using client secret with AWS login

Side review bar is mostly there. A couple of bugs fixed. Can now return identified text in initial review files. Still working on retaining found text throughout review process

Refactor redaction functionality and enhance UI components: Added support for custom recognizers and whole page redaction options. Updated file handling to include new dropdowns for entity selection and improved dataframes for entity management. Enhanced the annotator with better state management and UI responsiveness. Cleaned up redundant code and improved overall performance in the redaction process.

Enhance file handling and UI features: improved Gradio app layout with fill width option, and integrated new settings for deny, and fully redacted lists (placeholders so far). Updated file conversion functions to handle CSV inputs and added CSV review file generation for redactions. Now retains all original and merged redaction boxes.

Started adding in support for custom deny list. Fixed textract call issue. Removed multithreading for now as it mixes up pages

Multithreaded file preparation. Can call Textract without signature detection

Can now specify the root path that the app will run on with an environment variable

Can now define queue size, max file size, and server port in environment variables

Modified Dockerfile hopefully to not need Lambda overrides. Looking into custom headers from Cloudfront to try to get them to work

Created custom csvlogger to try to overcome AWS Lambda's incompatibility with multithread locks

Corrected references to max_queue_size and max_file_size

Added option for running redact function through CLI (i.e. not going through Gradio UI or API). Test functions for running this through AWS Lambda.

Only shows AWS options when AWS functions enabled. Can now upload previous review files to continue review later. Some review debugging.

Should now retain modified redactions on first use of zoom

Comprehend now uses custom spacy recognisers on top of defaults. Added zoom functionality to annotator. Fixed some pdf mediabox issues and redacted image output issues.

logs should only be updated once per file run now

Improved time taken reporting and readme

Consolidated AWS Comprehend redaction calls to reduce total number

When on AWS, now loads in a default allow_list to exclude common words from redaction. Improved checks on AWS Comprehend calls.

Changed default options for AWS.

Improved logging

Added support for AWS Comprehend for PII identification. OCR and detection results now written to main output

Allowed for time limits on redact to avoid timeouts. Improved review interface. Now accepts only one file at a time. Upgraded Gradio version

Added user guide and modified intro text

Upgraded packages. Fixed some issues with review process. Better progress reporting for user.

Added 'Review redactions' tab to the app. You can now visually inspect suggested redactions and modify/add with a point and click interface.

Redaction tool can now export pdfs with selectable text retained - redacted text is deleted and covered with a black box. Licence change for pymupdf use.

General improvement in quick image matching and merging

Optimised Textract and Tesseract workings

Improved allow list, handwriting/signature identification, logging

Added AWS Textract support. Allowed for OCR logs export.

Updated time sum function to sum correctly

Enhanced logging of usage. Small buffer added to redaction rectangles as it seems to miss the tops of text often.

Can now select only specific pages in document to redact. Image based redaction should work correctly now.

Handles multiple runs with multiple files correctly now. Logging and feedback improvements.

Updated decision making output files, log locations

Decision process now saved as log files. Other log files and feedback added

Added logging, anonymising all Excel sheets, simple redaction tags, some Dockerfile optimisation

Switched Document Redaction Cognito Auth flag to 1

Minor bug fix to connection parameter function

Added possibility to do authentication with AWS Cognito on load. Other minor changes.

Can now redaction text or csv/xlsx files. Can redact multiple files. Embeds redactions as image-based file by default

Better redaction output formatting. Custom output folders allowed. Upgraded Gradio version

Version 0.1. Adapted code for pyinstaller local executable conversion (Windows)

Added TLDExtract cache files so that internet connection is not required

Re-arranged image and text analysis to encourage text analysis (faster)