Commit Graph

7826 Commits

Author SHA1 Message Date
Roberto Rosario
55359c72cf Unify supervisor configuration files. Lower nice levels of most workers. Merge OCR and slow workers. Lower gunicorn workers to 2. Call all supervisor processes using a shell to expand the install and mayan binary locations and avoid hardcoding.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-05-04 00:48:03 -04:00
Roberto Rosario
9fad6c37bf Fix process name for the OCR worker.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-30 05:13:01 -04:00
Roberto Rosario
1693b36b2d Only try to return notifications for logged in users.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-30 05:12:37 -04:00
Roberto Rosario
55879d3488 Add default celery settings to docker's entrypoint script.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-30 05:00:02 -04:00
Roberto Rosario
d610f8d5f6 Use the errno library and not the literal error numbers.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-30 02:01:06 -04:00
Roberto Rosario
b4d1ce33e5 Don't enable or defile the logfile handler if the media folder doesn't exist.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-30 02:00:33 -04:00
Roberto Rosario
9cde4d7b04 Use double quotes since single quotes are used in the 500 string.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-30 01:47:31 -04:00
Roberto Rosario
4db641372d Test againg MySQL 8.0.3. Since 8.0.4 onwards the authentication system changed.
https://stackoverflow.com/questions/49963383/authentication-plugin-caching-sha2-password

Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-30 01:08:43 -04:00
Roberto Rosario
5c83cff767 Use django-environ for DEBUG and CELERY_ALWAYS_EAGER. Default CELERY_ALWAYS_EAGER to True.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-29 23:47:27 -04:00
Roberto Rosario
3689df4aac Better default for the testing error log file full path.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-29 23:32:22 -04:00
Roberto Rosario
cbad7ee504 Print the exception type on upgrade errors. This is used for celery errors which don't include a text message.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-29 23:30:05 -04:00
Roberto Rosario
441127ae45 Don't create the media folder in the common app if it doesn't exist. Instead disable logfile creation.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-29 23:19:12 -04:00
Roberto Rosario
a788a99d93 Set CELERY_ALWAYS_EAGER to True on the development setting file.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-29 23:14:55 -04:00
Roberto Rosario
430c7b8c14 Add verbose error reporting when the document upload task fails.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-29 23:12:24 -04:00
Roberto Rosario
83ca7a7476 Add missing migrations.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-29 03:59:39 -04:00
Roberto Rosario
2ef31d2ec3 Rename shared upload storage from sharedupload_storage to storage_sharedupload
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-29 03:58:56 -04:00
Roberto Rosario
018c641e8b Create the media folder if is doesn't exist.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-28 23:16:13 -04:00
Roberto Rosario
78961bec49 Remove sentry specifig code from the 500.html template.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-28 19:47:57 -04:00
Eric Riggs
8ee45162aa Revert workers to prefork method
Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-26 03:54:59 -04:00
Eric Riggs
a84568574f Replace ubuntu with debian
Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-26 03:54:40 -04:00
Eric Riggs
f3c86ada45 - Lower concurrency of workers to 1
- Change process type to gevent

Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-26 02:19:09 -04:00
Eric Riggs
3145cb4231 Add django-environ and use it to set ALLOWED_HOSTS.
Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-26 02:18:32 -04:00
Eric Riggs
d97b080586 Flanker is not thread safe, hide the import until it is actually needed.
Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-26 02:17:33 -04:00
Eric Riggs
4f801154aa Manually link libjpeg and libzlib on aarch64.
Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-25 20:57:12 -04:00
Eric Riggs
9fbedd244c - Put the log file in the /tmp folder.
- This is temporary and should be fixed. Create /media when not found?

Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-22 13:51:14 -04:00
Eric Riggs
8e3446c13e Add g++
Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-22 13:50:19 -04:00
Eric Riggs
27d84bea5a - Add missing build libraries.
- Clean up some files.

Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-22 12:58:47 -04:00
Eric Riggs
077910bf72 Add gunicorn, gevent and whitenoise as requirements
Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-22 04:18:09 -04:00
Eric Riggs
455fcef114 Move Docker environment overrides to main base.py module
Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-22 04:17:28 -04:00
Eric Riggs
bbc338120e Make all storage location explicit children of MEDIA_ROOT.
Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-22 04:16:19 -04:00
Eric Riggs
d8941ea810 - Add --force option to initialsetup
- Create the entire media structure

Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-22 04:14:46 -04:00
Eric Riggs
f1ed40adba Merge Docker files back into main repo.
Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-22 04:14:07 -04:00
Roberto Rosario
238595e1bc Don't error out if it is not possible to check for the latest current version.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-16 17:08:22 -04:00
Roberto Rosario
222037daa9 Add known issues section about flanker warnings.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-16 15:26:01 -04:00
Roberto Rosario
2a3b37cbf7 Update roadmap.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-16 15:25:45 -04:00
Roberto Rosario
2604a22772 Update roadmap.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-16 15:20:50 -04:00
Roberto Rosario
6a65544fb7 Remove some label argument from the apps module and move them to the model.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-16 15:20:45 -04:00
Roberto Rosario
6839f1b529 Make the 'label' argument of SourceColumn optional and introspect its value from the model meta if not specified.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-16 15:19:16 -04:00
Roberto Rosario
e2058f91c1 Move import to the top of the file.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-13 16:18:09 -04:00
Roberto Rosario
3e062a5517 New initialization command. Creates media/system and populates the SECRET_KEY and VERSION files.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-13 16:05:40 -04:00
Roberto Rosario
b165b9a5f2 New environment variables to configure the secret key, database, and celery options. The secret key can also be read from a file. Stricter defaults to increase security.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-13 16:02:16 -04:00
Roberto Rosario
aa13953326 Fix typo.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-13 15:54:37 -04:00
Roberto Rosario
c482bb604c Add better explanation when a .local.py setting import error occurs.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-13 15:53:00 -04:00
Roberto Rosario
a7f4dc2f10 Add flake8 step to the release checklist.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-12 18:59:19 -04:00
Roberto Rosario
6a3bb455b4 Update release notes.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-11 22:32:15 -04:00
Roberto Rosario
ad351a1368 Add test for the POP3 email source model.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-11 22:23:04 -04:00
Roberto Rosario
eb2c7c6f34 Sort email sources models.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-11 22:22:45 -04:00
Roberto Rosario
2a77078022 Capture menu resolution errors on invalid URLs. Closes GitLab issue #420.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-11 21:38:27 -04:00
Roberto Rosario
be73264341 Production ALLOWED_HOSTS settings now defaults to a safer ['127.0.0.1', 'localhost', '[::1]']
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-11 20:41:25 -04:00
Roberto Rosario
59d958982f Don't disable existing loggers.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-11 20:39:56 -04:00