matthias/mayan-edms
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
6,947 Commits 36 Branches 0 Tags
727d2ecd71af920ddb2f03a201014c8dd5a480e3
Commit Graph

49 Commits

Author SHA1 Message Date
Roberto Rosario
e699e39c37 Celery: Remove use of autoretry_for and retry_backoff 
These features were for Celery 4.2.1, since this version
has a regression, version 4.1.1 is used instead.
The version 4.2.1 features are removed also and implemented
in code.

Signed-off-by: Roberto Rosario <Roberto.Rosario@mayan-edms.com>
 2018-12-09 01:31:56 -04:00
Roberto Rosario
ef126d56b2 Documents: Allow version upload task stubs access 
Update which Document model manager the new version upload task
uses to fetch the document. Changing to the passthrough manager
allows the task to access document stubs which is the expected
behavior as new document with no versions are considered stubs.

Signed-off-by: Roberto Rosario <Roberto.Rosario@mayan-edms.com>
 2018-12-06 03:04:53 -04:00
Roberto Rosario
55cd928069 Documents: Add default filtering of stubs 
Add filter(is_stub) to the default Document model manager.

Now only the Passthrough manager can access document stubs.

Remove the explicit filtering of stubs from code that obtains
the queryset from the default document manager.

Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2018-12-05 03:05:39 -04:00
Roberto Rosario
8e69178e07 Project: Switch to full app paths 
Instead of inserting the path of the apps into the Python app,
the apps are now referenced by their full import path.

This app name claves with external or native Python libraries.
Example: Mayan statistics app vs. Python new statistics library.

Every app reference is now prepended with 'mayan.apps'.

Existing config.yml files need to be updated manually.

Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2018-12-05 02:04:20 -04:00
Roberto Rosario
89d3fb9922 Cache: Beta stage 
Add retry to race condition in intermediate image generation.

Remove DB index from cache file size field.

Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2018-12-03 04:26:00 -04:00
Roberto Rosario
6d39f3b716 Documents: Add missing import 
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2018-11-16 22:02:33 -04:00
Roberto Rosario
3b247bfb5f Documents: Document task transformations 
Add support to pass serialized transformation lists to the
document page generation task.

Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2018-11-16 21:51:57 -04:00
Roberto Rosario
57e7722f59 Don't show documents with 0 duplicates in the duplicated document list. 
Also clean up the duplicated document model after a document is deleted.
Fix queue name typo.

Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2018-04-02 01:45:30 -04:00
Roberto Rosario
829dcbf144 The trashed document deletion action is now a background task. 
Also, the trash can emptying view calls the trash can document celery task
for each document.

Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2017-07-07 02:42:20 -04:00
Roberto Rosario
d4e1a506ed Add duplicated document scan support. 
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2017-07-06 02:56:35 -04:00
Roberto Rosario
7adf3621b7 Remove ununsed task. 2016-11-14 02:36:05 -04:00
Roberto Rosario
c0194c63dc Refactor document page image generation and transformation classes 
to cache all transformed versions of a document page.
 2016-11-02 02:34:57 -04:00
Roberto Rosario
eae11a1b0c Fix remaining tests for Django 1.8. Closes GitLab issue #246. 2016-01-28 06:04:28 -04:00
Roberto Rosario
2ebb84f18f Remove remaining direct references to the User model. Closes GitLab issue #225. 2016-01-28 05:55:15 -04:00
Roberto Rosario
27d8644438 Silence 90% of remaining Django 1.8 model warnings. 2016-01-28 05:43:08 -04:00
Roberto Rosario
5f9c847239 Move stub deletion code from tasks.py to the manager of the Document model. 2015-10-21 01:34:03 -04:00
Roberto Rosario
94bebf90ca Remove TODO reminder, error are logged by Celery. 2015-10-19 02:10:12 -04:00
Roberto Rosario
86ff835839 PEP8 Cleanups. 2015-10-07 22:24:44 -04:00
Roberto Rosario
3e7cd0c1ea Move retention policies enforcement code to the DocumentType model manager. Add corresponding tests (test_auto_trashing and test_auto_delete). 2015-09-27 00:35:56 -04:00
Roberto Rosario
43e1ffbc24 Add scheduled task to delete stale document stubs. 2015-09-08 18:38:24 -04:00
Roberto Rosario
960d60c39d Refactor rest_api app and the method end points are registered. All apps API URL endpoints are now registered under the 'rest_api' namespace. 
Update DRF and DRF swagger versions. Update all apps API registration method.
 2015-08-06 02:56:17 -04:00
Roberto Rosario
1e746c700a PEP8 cleanups. 2015-07-27 23:53:14 -04:00
Roberto Rosario
fc9d7b1a8b Remove celery code execute from model. Allow for default at the model level. 2015-07-15 01:03:23 -04:00
Roberto Rosario
dbc08afd45 Catch operational errors in more critical places. 2015-07-14 02:21:55 -04:00
Roberto Rosario
7ba9410d70 Fix typo 2015-07-13 23:44:35 -04:00
Roberto Rosario
af654c9aa9 Fix variable name. 2015-07-11 17:19:51 -04:00
Roberto Rosario
0238be7a18 Add support for retrying upload queue and ocr queue tasks in the event of Database locking errors. 2015-07-11 16:19:04 -04:00
Roberto Rosario
133fcdc53c Assign tasks to specific queues. Add support for transient queues. gh-issue #222, gh-issue #230. 2015-07-10 21:25:20 -04:00
Roberto Rosario
e891fe9525 PEP8 cleanups and code style cleanups. 2015-07-10 17:19:36 -04:00
Roberto Rosario
d751a8bc2f Improve logging messages. 2015-07-08 01:14:55 -04:00
Roberto Rosario
a59234bb83 Use SharedUploadedFile's new open() method. 2015-07-07 01:28:06 -04:00
Roberto Rosario
8cc05bbefb Initial commit of new document upload workflow which allows for document promises to be returned after POST request, gh-issue #194. Add new signal when a document is uploaded and finally ready, gh-issue #193 and gh-issue #213. 2015-07-05 03:33:27 -04:00
Roberto Rosario
ee6bb866c9 Add support for document retention policies. Closes gh-issue #189. 2015-07-04 02:25:59 -04:00
Roberto Rosario
c8268b1a5b Move new document version blocking logic to the checkouts app. Remove PERMISSION_DOCUMENT_RESTRICTIONS_OVERRIDE, overriding checkout restrictions even for admin users has the potential to confuse or corrupt data, removing it. Even admins must now checkin a document before trying to perform a restricted operation. 2015-06-16 20:38:45 -04:00
Roberto Rosario
394a90458a Improve way to cache document page images and invalidate them. Update related code. 2015-06-16 16:20:17 -04:00
Roberto Rosario
f4752a3f3f Further converter refactor and initial move from document-centric to page-centric image generation. Issue #93. 2015-06-06 06:26:44 -04:00
Roberto Rosario
de6182aea0 Initial commit of the converter refactor 2015-06-05 03:35:07 -04:00
Roberto Rosario
8af55ccbef PEP8 cleanups 2015-03-30 15:21:53 -04:00
Roberto Rosario
dd73d33434 Don't retry failed converter tasks 2015-01-27 14:01:40 -04:00
Roberto Rosario
d59ea3ede2 Add from __future__ import unicode_literals, issue #37 2015-01-19 04:06:40 -04:00
Roberto Rosario
af51acebf5 Isse #56, Remove document versions major, minor and micro versioning fields 2014-12-09 03:15:23 -04:00
Roberto Rosario
0685a30193 Retry document convertion task up to 3 times, compress result using zlib 2014-11-18 04:48:16 -04:00
Roberto Rosario
9f2692d36a PEP8 cleanup, unused import removal 2014-11-02 21:20:29 -04:00
Roberto Rosario
7abf944e47 Use SharedUploadedFile model for background task, add task for creating versions of a document 2014-10-29 05:52:12 -04:00
Roberto Rosario
9c9632f920 Add proper document creation API endpoint 2014-10-27 04:49:29 -04:00
Roberto Rosario
6a8b183213 Add flag to ignore result for background task of queue 'tools' 2014-10-25 01:59:10 -04:00
Roberto Rosario
db2ca4fb58 Issue #85, Reset page count for a single or multiple documents. 
Issue #57, convert to celery task
 2014-10-22 19:33:20 -04:00
Roberto Rosario
f86be42dd0 Issue #57, conver the document image queue maintenance view into a celery task 2014-10-22 18:21:40 -04:00
Roberto Rosario
e4e6c2f5fb Move document image queueing up in process to avoid queueing serialization overhead 2014-10-03 14:58:55 -04:00