Commit Graph

35 Commits

Author SHA1 Message Date
Roberto Rosario
91a5b5c7b3 Lower CPU MAX LOAD to avoid nodes launching too many workers and failing to send heartbeats or respond to web requests 2012-08-08 02:54:34 -04:00
Roberto Rosario
377032b92a Move old OCR queue handling code to job_processor app 2012-08-06 02:12:58 -04:00
Roberto Rosario
da8d9a4b88 Add job_processor app translation files 2012-08-05 22:44:14 -04:00
Roberto Rosario
a97a048d9c Add job queue priority support 2012-08-05 22:39:44 -04:00
Roberto Rosario
52419b8b73 Improve removal of dead workers 2012-08-04 00:56:13 -04:00
Roberto Rosario
6d8dc886ca Improve job transaction handling 2012-08-04 00:55:47 -04:00
Roberto Rosario
384209d2aa Add support for terminating local workers 2012-08-03 17:38:38 -04:00
Roberto Rosario
ac60654cc9 Implement dead job and dead worker cleanups, add discovered node subprocess as anonymous workers 2012-08-03 16:10:27 -04:00
Roberto Rosario
784aff8ded Terminate the current node's processes on exit 2012-08-03 14:54:14 -04:00
Roberto Rosario
b812a68777 Add initial support for deleting pending jobs and requeuing failed jobs 2012-08-03 13:35:06 -04:00
Roberto Rosario
8b4cf87368 Tweak db connection closing to ensure a fresh connection to high frequency called code 2012-08-03 06:19:17 -04:00
Roberto Rosario
9ff4ff75ff Remove some close connections from jobs sub process 2012-08-03 06:02:34 -04:00
Roberto Rosario
b779042694 Update updated singleton manager names 2012-08-03 05:32:22 -04:00
Roberto Rosario
7b5a64f434 Add support for starting and stopping a job queue 2012-08-01 16:07:56 -04:00
Roberto Rosario
f43f496241 Add view, permission, links to edit global job processing config 2012-08-01 04:15:11 -04:00
Roberto Rosario
cdb6e7c6c6 Spelling update 2012-08-01 01:47:08 -04:00
Roberto Rosario
344e738c48 Update apps interface for the new LocalScheduler class 2012-08-01 01:43:00 -04:00
Roberto Rosario
ffaf01c637 Add job queue list, pending, active and error queue items view, links and permissions 2012-07-31 01:19:08 -04:00
Roberto Rosario
e0fbac66d1 Connect the worker with the job queue item that spawned it 2012-07-30 16:23:38 -04:00
Roberto Rosario
d339a250fe Don't hide worker objects 2012-07-30 13:16:19 -04:00
Roberto Rosario
6d8aebb411 Change name 2012-07-30 13:13:59 -04:00
Roberto Rosario
c2da6512e4 Record and display worker name correctly 2012-07-30 13:11:15 -04:00
Roberto Rosario
cfb1278c7e Use floating point literals 2012-07-30 13:07:01 -04:00
Roberto Rosario
2f6a1d4e76 Add job processing app migration 2012-07-30 12:56:27 -04:00
Roberto Rosario
30eb32f888 Job processing app updates 2012-07-30 12:55:53 -04:00
Roberto Rosario
198538df4f Use the new simple lock decorator to simplify a job processor task 2012-07-30 10:56:12 -04:00
Roberto Rosario
96a1b68221 Fix some simple typos 2012-07-30 10:55:32 -04:00
Roberto Rosario
ba2f2fc455 Add database migrations for the job processor app 2012-07-30 10:55:05 -04:00
Roberto Rosario
3762f90ada Use the new .myself method of Node 2012-07-30 09:23:10 -04:00
Roberto Rosario
e0abb02df0 Improve Node.objects.myself to do a refresh 2012-07-30 09:22:37 -04:00
Roberto Rosario
486f983d4b Refactor job processing app to do actual job queue and job subprocess launching, remove queue mananger app, update ocr app to use new job processing app 2012-07-30 07:36:02 -04:00
Roberto Rosario
5bc61ca70e Remove unused test files 2012-02-22 11:55:48 -04:00
Roberto Rosario
063cc06325 Remove unused import 2012-01-23 20:03:09 -04:00
Roberto Rosario
d9aa63f8ca Remove Sentry and celery from Mayan EDMS 2012-01-23 20:00:39 -04:00
Roberto Rosario
842d0c8868 Added job_processors app to abstract background job processing 2011-07-23 16:54:45 -04:00