Fixed issue where redactions were sometimes not removing text underneath boxes. You can now redact in different colours from review page

Updated packages. Reinstituted multithreading with page load, now with order protected. Smaller spacy model used for speed. Textract calls should now be faster

Started adding in support for custom deny list. Fixed textract call issue. Removed multithreading for now as it mixes up pages

Multithreaded file preparation. Can call Textract without signature detection

Can now specify the root path that the app will run on with an environment variable

Can now define queue size, max file size, and server port in environment variables

Updated Dockerfile and entrypoint file to hopefully deal correctly with APP_MODE environment variable

Removed default custom header values so as not to cause errors

Moved chmod command to before user switch in Dockerfile

Ensure entrypoint.sh is copied

Included entrypoint.sh

Modified Dockerfile hopefully to not need Lambda overrides. Looking into custom headers from Cloudfront to try to get them to work

Allowed for overwriting of default output folder in choose_and_run_redactor function.

Updated output file creation variables for Lambda direct redaction runs

Removed need to write result.stdout in lambda entrypoint

Added a little more debugging code to lambda_entrypoint

Created custom csvlogger to try to overcome AWS Lambda's incompatibility with multithread locks

Changed app_mode arg position in dockerfile, changed default to gradio

Moved entrypoint.sh creation to before user switch to avoid permission errors

Updated Dockerfile and requirements to include relevant Lambda packages

Moved gradio run code to outside of lambda_handler function in lambda_entrypoint.py

Switched start py file through Dockerfile to lambda_entrypoint. Added gradio links from this .py

Some more debugging. Added aws-lambda-adapter just in case that's useful in AWS Lambda

Added some debugging statements for entrypoint_router and lambda_entrypoint.py

Removed test event from entrypoint_router.py

Added lambda_entrypoint.py to main folder

Correctly called authenticate user function in entrypoint router.py

Corrected references to max_queue_size and max_file_size

Added option for running redact function through CLI (i.e. not going through Gradio UI or API). Test functions for running this through AWS Lambda.

Only shows AWS options when AWS functions enabled. Can now upload previous review files to continue review later. Some review debugging.

Submitting modified redactions will no longer overwrite default labels

Should now retain modified redactions on first use of zoom

Comprehend now uses custom spacy recognisers on top of defaults. Added zoom functionality to annotator. Fixed some pdf mediabox issues and redacted image output issues.

AWS Comprehend query numbers in logs should now add up correctly

Returned file redaction timeout (before resending request) to 105 seconds default

logs should only be updated once per file run now

Improved time taken reporting and readme

Consolidated AWS Comprehend redaction calls to reduce total number

When on AWS, now loads in a default allow_list to exclude common words from redaction. Improved checks on AWS Comprehend calls.

Changed default options for AWS.

Improved logging

Added support for AWS Comprehend for PII identification. OCR and detection results now written to main output

Updated requirements for latest gradio-image-annotation version

Allowed for time limits on redact to avoid timeouts. Improved review interface. Now accepts only one file at a time. Upgraded Gradio version

Added user guide and modified intro text

App will now try to save modified redactions from user to json file.

Upgraded packages. Fixed some issues with review process. Better progress reporting for user.

Allowed for PIL to load truncated images to avoid some load errors

Added 'Review redactions' tab to the app. You can now visually inspect suggested redactions and modify/add with a point and click interface.

Adjusted outputs correctly for situations where the pdf mediabox size is different from the visible page size