Apply transformation before doing OCR, added unpaper to the OCR pre processing pipe

docs/CREDITS

@@ -4,7 +4,8 @@ Python
     Copyright (c) 1995-2001 Corporation for National Research Initiatives.
     Copyright (c) 1991-1995 Stichting Mathematisch Centrum, Amsterdam.
 
-Django - A high-level Python Web framework that encourages rapid development and clean, pragmatic design.
+Django - A high-level Python Web framework that encourages rapid 
+         development and clean, pragmatic design.
     Copyright Django Software Foundation
     http://www.djangoproject.com/
 
@@ -32,7 +33,8 @@ django-extensions - Extensions for Django
     Copyright Bas van Oostveen (v.oostveen@gmail.com)
     http://code.google.com/p/django-command-extensions/
 
-django-rosetta - A Django application that eases the translation of Django projects
+django-rosetta - A Django application that eases the translation of
+                 Django projects
     Copyright Marco Bonetti (mbonetti@gmail.com)
     http://code.google.com/p/django-rosetta/
 
@@ -48,7 +50,8 @@ django-filetransfers - File upload/download abstraction
     Waldemar Kornewald
     http://www.allbuttonspressed.com/projects/django-filetransfers
 
-tesseract - An OCR Engine that was developed at HP Labs between 1985 and 1995... and now at Google.
+tesseract - An OCR Engine that was developed at HP Labs between 1985 and
+            1995... and now at Google.
     http://code.google.com/p/tesseract-ocr/
 
 Image file 1068504_92921456 "Mayan piramid" (Stock Exchange)
@@ -63,3 +66,12 @@ Fat cow icon set
 Python-magic - python-magic is a simple wrapper for libmagic
     Adam Hupp <adam at hupp.org>
     https://github.com/ahupp/python-magic
+
+Fancybox - FancyBox is a tool for displaying images, html content and
+           multi-media in a Mac-style "lightbox" that floats overtop of
+           web page. 
+    http://fancybox.net
+
+unpaper - post-processing scanned and photocopied book pages
+    Jens Gulden 2005-2007 - unpaper@jensgulden.de.
+    http://unpaper.berlios.de/

docs/Changelog.txt

@@ -10,3 +10,5 @@
     To update a previous database do: [d.update_page_count() for d in Document.objects.all()]
 * Added support for document page transformation (no GUI yet)
 * Added views to create, edit and grant/revoke permissions to roles
+* Apply default transformations to document before OCR
+* Added unpaper to the OCR convertion pipe

docs/TODO

@@ -31,6 +31,8 @@
 * Assign default role to new users                                     - DONE
 * DB stored transformations                                            - DONE
 * Recognize multi-page documents                                       - DONE
+* Add unpaper to pre OCR document cleanup                              - DONE
+* Role editing view under setup                                        - STARTED
 * Document list filtering by metadata
 * Filterform date filtering widget
 * Validate GET data before saving file
@@ -53,10 +55,10 @@
 * Field for document language or autodetect
 * Count pages in a PDF file http://pybrary.net/pyPdf/
 * Download a document in diffent formats: (jpg, png, pdf)
+* Download a document in diffent formats: (jpg, png, pdf)
 * Cache.cleanup function to delete cached images when document hash changes
 * Divide navigation links search by object and by view
 * Add show_summary method to model to display as results of a search
-* Add unpaper to pre OCR document cleanup
 * Support distributed OCR queues (RabbitMQ & Celery?)
 * DXF viewer - http://code.google.com/p/dxf-reader/source/browse/#svn%2Ftrunk
 * Support spreadsheets, wordprocessing docs using openoffice in server mode
@@ -64,10 +66,12 @@
 * Handle ziped or rar archives
 * Display preferences 'document transformations' (Rotation, default zoom)
 * Gallery view for document groups
-* Role editing view under setup
 * Download metadata group documents as a single zip file
 * Download original document or transformed document
 * Include annotations in transformed documents downloads
 * Document view temp transformations
 * Implement permissions decorators
 * block Setup menu item to non staff and non superuser users
+* Don't append an extension separator if extension is non existant
+* Don't do OCR on wordproccessing or spreadsheet document, strip tags and store text
+* Storage backend to storage backend copy support, to move/migrate document to new storage backend