Update the OCR app to use Celery, remove OCR config options OCR_REPLICATION_DELAY, OCR_NODE_CONCURRENT_EXECUTION, OCR_QUEUE_PROCESSING_INTERVAL

This commit is contained in:
Roberto Rosario
2014-10-03 01:19:59 -04:00
parent 7bec19848d
commit a613c65fde
19 changed files with 152 additions and 294 deletions

View File

@@ -4,15 +4,12 @@ OCR
To use: |Tools tab| |Right arrow| |OCR button|
Because OCR is an intensive operation, documents are queued for OCR for
later handling, the amount of documents processed in parallel is
controlled by the :setting:`OCR_NODE_CONCURRENT_EXECUTION` configuration
option. Ideally the machine serving **Mayan EDMS** should disable OCR
processing by settings this options to 0, with other machines or cloud
instances then connected to the same database doing the OCR processing.
The document is checked to see if there are text parsers available, is
no parser is available for that file type then the document is passed
later handling. Ideally the machine serving **Mayan EDMS** should not do OCR
processing, with other machines or cloud instances then connected to the same
database doing the OCR processing. The document is checked to see if there are
text parsers available, is no parser is available for that file type then the document is passed
to Tesseract_ page by page and the results stored per page, this is to
keep the page image in sync with the transcribed text. However when
keep the page image in sync with the transcribed text. However when
viewing the document in the details tab all the pages text are
concatenated and shown to the user. All newly uploaded documents will be
queued automatically for OCR, if this is not desired setting the :setting:`OCR_AUTOMATIC_OCR`

View File

@@ -288,25 +288,6 @@ Default: ``eng``
Language code passed to the ``tesseract`` executable.
.. setting:: OCR_REPLICATION_DELAY
**OCR_REPLICATION_DELAY**
Default: ``0``
Amount of seconds to delay OCR of documents to allow for the node's
storage replication overhead.
.. setting:: OCR_NODE_CONCURRENT_EXECUTION
**OCR_NODE_CONCURRENT_EXECUTION**
Default: ``1``
Maximum amount of concurrent document OCRs a node can perform.
.. setting:: OCR_AUTOMATIC_OCR
**OCR_AUTOMATIC_OCR**
@@ -317,13 +298,6 @@ Automatically queue newly created documents or newly uploaded versions
of existing documents for OCR.
.. setting:: OCR_QUEUE_PROCESSING_INTERVAL
**OCR_QUEUE_PROCESSING_INTERVAL**
Default: ``10``
.. setting:: OCR_UNPAPER_PATH
**OCR_UNPAPER_PATH**