Commit Graph

6231 Commits

Author SHA1 Message Date
Roberto Rosario
6c04e7dbd6 Call manage.py using python and not directly.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-05-07 01:52:54 -04:00
Roberto Rosario
f410ae40e7 Split test jobs into multiple jobs. Cache the APT cache folder. Only submit coverage report in the SQLite test jobs.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-05-07 01:45:35 -04:00
Roberto Rosario
b7b100b01a Fix docker build stage keys.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-05-07 01:31:53 -04:00
Roberto Rosario
ea4886dc2b Update the key names of the docker build stage.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-05-07 01:15:20 -04:00
Roberto Rosario
fc42849b00 Update gitlab-ci to build a docker image if the tests are successful.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-05-07 01:08:47 -04:00
Roberto Rosario
188b7559d2 Cache the PIP folder between builds.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-05-07 00:48:59 -04:00
Roberto Rosario
ae9a519263 Don't create an __init__.py file in the media folder. Replace error number literals with constant definitions.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-05-04 00:49:42 -04:00
Roberto Rosario
55359c72cf Unify supervisor configuration files. Lower nice levels of most workers. Merge OCR and slow workers. Lower gunicorn workers to 2. Call all supervisor processes using a shell to expand the install and mayan binary locations and avoid hardcoding.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-05-04 00:48:03 -04:00
Roberto Rosario
9fad6c37bf Fix process name for the OCR worker.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-30 05:13:01 -04:00
Roberto Rosario
1693b36b2d Only try to return notifications for logged in users.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-30 05:12:37 -04:00
Roberto Rosario
55879d3488 Add default celery settings to docker's entrypoint script.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-30 05:00:02 -04:00
Roberto Rosario
d610f8d5f6 Use the errno library and not the literal error numbers.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-30 02:01:06 -04:00
Roberto Rosario
b4d1ce33e5 Don't enable or defile the logfile handler if the media folder doesn't exist.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-30 02:00:33 -04:00
Roberto Rosario
9cde4d7b04 Use double quotes since single quotes are used in the 500 string.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-30 01:47:31 -04:00
Roberto Rosario
4db641372d Test againg MySQL 8.0.3. Since 8.0.4 onwards the authentication system changed.
https://stackoverflow.com/questions/49963383/authentication-plugin-caching-sha2-password

Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-30 01:08:43 -04:00
Roberto Rosario
5c83cff767 Use django-environ for DEBUG and CELERY_ALWAYS_EAGER. Default CELERY_ALWAYS_EAGER to True.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-29 23:47:27 -04:00
Roberto Rosario
3689df4aac Better default for the testing error log file full path.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-29 23:32:22 -04:00
Roberto Rosario
cbad7ee504 Print the exception type on upgrade errors. This is used for celery errors which don't include a text message.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-29 23:30:05 -04:00
Roberto Rosario
441127ae45 Don't create the media folder in the common app if it doesn't exist. Instead disable logfile creation.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-29 23:19:12 -04:00
Roberto Rosario
a788a99d93 Set CELERY_ALWAYS_EAGER to True on the development setting file.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-29 23:14:55 -04:00
Roberto Rosario
430c7b8c14 Add verbose error reporting when the document upload task fails.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-29 23:12:24 -04:00
Roberto Rosario
83ca7a7476 Add missing migrations.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-29 03:59:39 -04:00
Roberto Rosario
2ef31d2ec3 Rename shared upload storage from sharedupload_storage to storage_sharedupload
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-29 03:58:56 -04:00
Roberto Rosario
018c641e8b Create the media folder if is doesn't exist.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-28 23:16:13 -04:00
Roberto Rosario
78961bec49 Remove sentry specifig code from the 500.html template.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-28 19:47:57 -04:00
Eric Riggs
8ee45162aa Revert workers to prefork method
Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-26 03:54:59 -04:00
Eric Riggs
a84568574f Replace ubuntu with debian
Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-26 03:54:40 -04:00
Eric Riggs
f3c86ada45 - Lower concurrency of workers to 1
- Change process type to gevent

Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-26 02:19:09 -04:00
Eric Riggs
3145cb4231 Add django-environ and use it to set ALLOWED_HOSTS.
Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-26 02:18:32 -04:00
Eric Riggs
d97b080586 Flanker is not thread safe, hide the import until it is actually needed.
Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-26 02:17:33 -04:00
Eric Riggs
4f801154aa Manually link libjpeg and libzlib on aarch64.
Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-25 20:57:12 -04:00
Eric Riggs
9fbedd244c - Put the log file in the /tmp folder.
- This is temporary and should be fixed. Create /media when not found?

Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-22 13:51:14 -04:00
Eric Riggs
8e3446c13e Add g++
Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-22 13:50:19 -04:00
Eric Riggs
27d84bea5a - Add missing build libraries.
- Clean up some files.

Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-22 12:58:47 -04:00
Eric Riggs
077910bf72 Add gunicorn, gevent and whitenoise as requirements
Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-22 04:18:09 -04:00
Eric Riggs
455fcef114 Move Docker environment overrides to main base.py module
Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-22 04:17:28 -04:00
Eric Riggs
bbc338120e Make all storage location explicit children of MEDIA_ROOT.
Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-22 04:16:19 -04:00
Eric Riggs
d8941ea810 - Add --force option to initialsetup
- Create the entire media structure

Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-22 04:14:46 -04:00
Eric Riggs
f1ed40adba Merge Docker files back into main repo.
Signed-off-by: Eric Riggs <ericriggs42@gmail.com>
2018-04-22 04:14:07 -04:00
Roberto Rosario
238595e1bc Don't error out if it is not possible to check for the latest current version.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-16 17:08:22 -04:00
Roberto Rosario
222037daa9 Add known issues section about flanker warnings.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-16 15:26:01 -04:00
Roberto Rosario
2a3b37cbf7 Update roadmap.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-16 15:25:45 -04:00
Roberto Rosario
2604a22772 Update roadmap.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-16 15:20:50 -04:00
Roberto Rosario
6a65544fb7 Remove some label argument from the apps module and move them to the model.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-16 15:20:45 -04:00
Roberto Rosario
6839f1b529 Make the 'label' argument of SourceColumn optional and introspect its value from the model meta if not specified.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-16 15:19:16 -04:00
Roberto Rosario
e2058f91c1 Move import to the top of the file.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-13 16:18:09 -04:00
Roberto Rosario
3e062a5517 New initialization command. Creates media/system and populates the SECRET_KEY and VERSION files.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-13 16:05:40 -04:00
Roberto Rosario
b165b9a5f2 New environment variables to configure the secret key, database, and celery options. The secret key can also be read from a file. Stricter defaults to increase security.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-13 16:02:16 -04:00
Roberto Rosario
aa13953326 Fix typo.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-13 15:54:37 -04:00
Roberto Rosario
c482bb604c Add better explanation when a .local.py setting import error occurs.
Signed-off-by: Roberto Rosario <roberto.rosario.gonzalez@gmail.com>
2018-04-13 15:53:00 -04:00