matthias/mayan-edms
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
7,672 Commits 36 Branches 0 Tags
d190dbca03d618763577610defeed63cff673759
Commit Graph
70 Commits
Author SHA1 Message Date
Roberto Rosario ad37228466 Add converter layers, redactions app 
Signed-off-by: Roberto Rosario <roberto.rosario@mayan-edms.com>
 2019-08-20 00:21:03 -04:00
Roberto Rosario 85b05dd6ec Add kwargs to fs_cleanup usage 
Signed-off-by: Roberto Rosario <roberto.rosario@mayan-edms.com>
 2019-07-26 15:16:37 -04:00
Roberto Rosario 030ddd68e0 PEP8 cleanups 
Signed-off-by: Roberto Rosario <roberto.rosario@mayan-edms.com>
 2019-07-17 01:13:00 -04:00
Roberto Rosario 4adeefc978 Merge remote-tracking branch 'origin/features/move_yaml_code' into merge_features 
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2019-07-11 01:21:23 -04:00
Roberto Rosario 8bc4b6a95e Move YAML code to its own module 
Code now resides in common.serialization in the form
of two new functions: yaml_load and yaml_dump.

Signed-off-by: Roberto Rosario <roberto.rosario@mayan-edms.com>
 2019-07-10 19:35:42 -04:00
Roberto Rosario 9564db398f Backport configuration file improvements 
Remove support for quoted entried. Support unquoted entries. Support
custom location for the config files.

Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2019-07-09 15:40:20 -04:00
Roberto Rosario 590c76bf64 Fix text typos 
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2019-06-12 00:51:21 -04:00
Roberto Rosario d338da5491 Fix merge typo 
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2019-05-14 02:36:29 -04:00
Roberto Rosario 2e2797bba5 Merge branch 'versions/minor' of gitlab.com:mayan-edms/mayan-edms into versions/minor 
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2019-05-14 02:34:57 -04:00
Roberto Rosario 3a623ee416 Initialize LibreOffice only on converter init 
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2019-05-14 02:29:01 -04:00
Roberto Rosario 4e5c513529 Remove converter.to_pdf iterator 
Remove the custom iterator to return the result of a conversion to PDF.
Instead returns a file object which can then be copied around
using shutil.copyfileobj.

Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2019-05-14 02:01:14 -04:00
Roberto Rosario 8b073c3151 Sort methods and fix method name typo 
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2019-05-14 01:06:10 -04:00
Roberto Rosario 60c0c131ae Sort methods and fix method name typo 
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2019-05-14 01:03:28 -04:00
Roberto Rosario ea3b513ae3 Add new app to handle all dependencies 
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2019-05-03 01:12:20 -04:00
Roberto Rosario e36eb5421d Use copyfileobj to copy the office file 
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2019-04-29 04:47:47 -04:00
Roberto Rosario 3fa08debe9 Initialize Pillow inside ConverterBase __init__ 
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2019-04-27 02:29:44 -04:00
Roberto Rosario 811a752efb Remove converter base64 support 
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2019-04-15 15:58:30 -04:00
Roberto Rosario 0d4ab4f2cf Move setting to the storage app 
The setting COMMON_TEMPORARY_DIRECTORY is now
STORAGE_TEMPORARY_DIRECTORY.

Move file related utilities to the storage app.

Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2019-04-12 22:26:43 -04:00
Roberto Rosario 40c9436071 Update PyYAML to version 5.1 
Update use of safe_load and safe_dump to load and dump using
the CSafeLoader with SafeLoader as a fallback.

Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2019-04-12 03:09:07 -04:00
Roberto Rosario 36a51eeb73 Switch to full app paths 
Instead of inserting the path of the apps into the Python app,
the apps are now referenced by their full import path.

This solves name clashes with external or native Python libraries.
Example: Mayan statistics app vs. Python new statistics library.

Every app reference is now prepended with 'mayan.apps'.

Existing config.yml files need to be updated manually.

Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2019-04-05 02:02:57 -04:00
Roberto Rosario c6e68515ed Handle office files in explicit binary mode for Python 3. 
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2018-10-06 05:07:05 -04:00
Roberto Rosario d8ade58472 Add explicit kwargs name. 
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2018-09-03 12:17:01 -04:00
Michael Price ee58303fbb Move transformations to the their own module. 
Signed-off-by: Michael Price <loneviking72@gmail.com>
 2018-04-01 20:18:54 -04:00
Roberto Rosario 9dba40a1d8 Use BytesIO instead of StringIO. Use text_type instead of unicode. 
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2017-08-29 02:12:18 -04:00
Roberto Rosario b6ffeaeb32 Allow changing the output format, DPI of the pdftoppm command, and 
the output format of the converter via the CONVERTER_GRAPHICS_BACKEND_CONFIG
setting sub options: pdftoppm_dpi: 300, pdftoppm_format: jpeg, pillow_format: jpeg
GitHub issues #256 #257 GitLab issue #416.

Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2017-08-03 01:10:39 -04:00
Roberto Rosario 32c53343f1 Fix converter bug introduced in previous commit merge. 
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2017-07-05 01:03:14 -04:00
Roberto Rosario b0912947fc Give every libreoffice instance its own separate $HOME directory. 
Additionally give every libreoffice its own UserInstallation
file in the $HOME directory. Works around Libre Office issue:
https://bugs.documentfoundation.org/show_bug.cgi?id=37531
Solves or affects GitLab issues #393 #258 #198 #175

Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2017-07-04 23:58:04 -04:00
Roberto Rosario 7343223f59 PDF compatibility improvements. Support simple encrypted PDF. 
Improve PDF page count detection. Improve PDF orientation
detection. Merge CONVERTER_LIBREOFFICE_PATH and
CONVERTER_PDFTOPPM_PATH config settings into
CONVERTER_GRAPHICS_BACKEND_CONFIG.
GitLab issue #384 #376 #377.

Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2017-07-04 04:02:29 -04:00
Roberto Rosario 6bad5e02d1 Add lineart transformation. 
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2017-07-03 14:05:13 -04:00
Roberto Rosario 4150fea2ad Add PDF orientation detection. Closes GitLab issue #387. 
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2017-06-16 22:30:07 -04:00
Roberto Rosario 7a0c2224bb Add model docstrings. 
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
 2017-04-25 14:21:30 -04:00
Roberto Rosario 92d2f9cbdd Add mirror, flip, gaussian blur and unsharpen masking transformations. 2017-01-18 03:01:27 -04:00
Roberto Rosario 9cb5758245 Add 3 new "prepared" transformations: Rotate 90, 180 and 270 degrees. 
Sort transformation list.
 2017-01-18 02:35:14 -04:00
Roberto Rosario ba11e63364 Improve transformation hashing algorithm. 2016-11-16 19:11:55 -04:00
Roberto Rosario aa2e8f3a11 Merge remote-tracking branch 'origin/master' into merge_test 2016-11-09 01:27:34 -04:00
Roberto Rosario 98327ae877 Return the same image when rotation degrees are 0. 2016-11-08 17:47:51 -04:00
Roberto Rosario 4222035cc1 Backport zoom transformation performance improvement, GitLab issue #334. Thanks to @startmat for the patch. 2016-11-08 02:03:10 -04:00
Roberto Rosario f98063835a Backport resize transformation math operation fix, GitLab issue #319. Thanks to @startmat for the find. 2016-11-08 01:51:27 -04:00
Roberto Rosario 19d20ff9d1 Prevent unnecessary image.resize in TransformationZoom. Thanks to @startmat for the suggestion. GitLab issue #334. 2016-11-05 02:56:43 -04:00
Roberto Rosario 621c988809 Simplify filter_by_access boilerplate code 2016-11-02 03:48:16 -04:00
Roberto Rosario c0194c63dc Refactor document page image generation and transformation classes 
to cache all transformed versions of a document page.
 2016-11-02 02:34:57 -04:00
Roberto Rosario de6564c264 Fix height calculation and remove disabled "fit" code. Thanks to @startmat for finding this one. Closes GitLab issue #319. 2016-10-31 15:08:43 -04:00
Roberto Rosario f3f5cff36e Add missing temporary cleanup for the office documents section. 2016-06-28 01:53:53 -04:00
Roberto Rosario 945158bd60 Normalize handling of temporary file and directory creation. 2016-06-23 20:54:10 -04:00
Roberto Rosario 28f3b7551d Consolidate document page image generation as binary or base64 to a single place at the converter class level. 2016-03-21 03:44:45 -04:00
Roberto Rosario 923ecc85d8 PEP8 Cleanups. 2015-10-28 02:22:10 -04:00
Roberto Rosario 86ff835839 PEP8 Cleanups. 2015-10-07 22:24:44 -04:00
Roberto Rosario 3d3abb6ad6 Use SH to call LibreOffice binary. Force LibreOffice input filter when converting text files. 2015-09-26 03:00:11 -04:00
Roberto Rosario dbd676646b Don't convert images blindly to RGB. Only convert to RGB or RGBA when saving to JPEG and mode is 'P'. documents.tests.test_models.MultiPageTiffTestCase passes again. 2015-09-16 15:56:10 -04:00
Roberto Rosario d6a3111d69 Make sure all images are converted to RGB before processing. 2015-09-15 02:01:56 -04:00