 Trenton H
|
8c06858807
|
Updates workflow to clone all history so changed-files can work (probably)
|
2022-10-10 14:30:55 -07:00 |
|
|
Trenton H
|
8025df5fe3
|
Catch the new error raised by redis when it can't find the broker and stub out the call for testing
|
2022-10-10 14:21:42 -07:00 |
|
|
Trenton H
|
5aeb656a48
|
Fixes usage of a depracated logger method
|
2022-10-10 14:20:19 -07:00 |
|
|
Trenton H
|
f96ee4f7a0
|
Updates the pre-commit hooks to ensure alignment with Pipfile
|
2022-10-10 14:20:19 -07:00 |
|
|
Trenton H
|
fcdb1dc30c
|
Adds hiredis extra to redis-py and updates everything
|
2022-10-10 14:16:14 -07:00 |
|
|
Trenton H
|
dafefa33d6
|
Adds step to bare metal setup regarding downloading the required NLTK data
|
2022-10-10 08:58:23 -07:00 |
|
|
Trenton H
|
d08eb0c66b
|
Adds skipping of NLTK data download if the feature appears disabled
|
2022-10-10 08:58:23 -07:00 |
|
|
Trenton H
|
d1a17480ea
|
Account for plusses in the OCR language setting
|
2022-10-10 08:58:23 -07:00 |
|
|
Trenton H
|
1e891414a3
|
Allows disabling NLTK, adds it as a consideration for low power devices
|
2022-10-10 08:58:23 -07:00 |
|
|
Trenton Holmes
|
c44c914d3d
|
Changes the NLTK language to be based on the Tesseract OCR language, with fallback to the default processing
|
2022-10-10 08:58:23 -07:00 |
|
|
Trenton H
|
d10d2f5a54
|
Allows configuration of the NLTK processing language
|
2022-10-10 08:58:23 -07:00 |
|
|
Trenton Holmes
|
6523cf0c4b
|
Fixes the download and usage of the downloaded data
|
2022-10-10 08:58:23 -07:00 |
|
|
Trenton Holmes
|
1262c121f0
|
Missed one mock
|
2022-10-10 08:58:23 -07:00 |
|
|
Trenton Holmes
|
f7cd6974c5
|
Mock out the nltk portions so the data doesn't need to be downloaded
|
2022-10-10 08:58:23 -07:00 |
|
|
Trenton Holmes
|
a7e1ba82d6
|
Fixes CI unit testing
|
2022-10-10 08:58:23 -07:00 |
|
|
Trenton Holmes
|
d856e48045
|
Updates the pre-processing of document content to be much more robust, with tokenization, stemming and stop word removal
|
2022-10-10 08:58:23 -07:00 |
|
|
Trenton Holmes
|
11ab469a39
|
Updates a few more instances of the container
|
2022-10-09 18:03:29 -07:00 |
|
|
Trenton Holmes
|
694ad53ef9
|
Updates Gotenberg container to the latest
|
2022-10-09 17:55:09 -07:00 |
|
|
Trenton Holmes
|
a3be3bb71a
|
Re-lock pipenv version to the last working version
|
2022-10-09 17:43:58 -07:00 |
|
|
Trenton Holmes
|
77b3aa5011
|
Fixes is_relative_to not being availible for 3.8
|
2022-10-09 17:43:58 -07:00 |
|
|
Trenton Holmes
|
9aefff38e7
|
If the original file containing a barcode was in the temporary scratch dir, move the split files to consume dir
|
2022-10-09 17:43:58 -07:00 |
|
|
Trenton H
|
97ceb1a8a6
|
Enable some testing against a real email server to hopefully catch things earlier
|
2022-10-07 18:28:11 -07:00 |
|
|
Trenton H
|
55089aab32
|
Fixes handling of gmail label extension to IMAP
|
2022-10-07 18:28:11 -07:00 |
|
|
Trenton Holmes
|
9c0c734b34
|
Enables some basic live testing against a tika server with actual sample documents to catch some more errors mocking won't catch
|
2022-10-07 18:06:06 -07:00 |
|
|
Trenton H
|
0f25260163
|
Updates to qpdf 11.1.1, pikepdf 6.1.0, and a few other updates
|
2022-10-05 10:03:40 -07:00 |
|
|
Trenton H
|
ff7d4d15cd
|
Fixes migration error if some tasks are defined already
|
2022-10-04 07:56:40 -07:00 |
|
|
Trenton H
|
788b3a5ba8
|
Fixes django-q still in the Pipfile.lock
|
2022-10-03 13:35:01 -07:00 |
|
|
Trenton H
|
19d4b85961
|
Fixes up some issues with the migrations and type mismatches
|
2022-10-03 13:18:25 -07:00 |
|
|
Trenton Holmes
|
905b28c1d7
|
When a document is a duplicate, include the title of the existing document in the fail message
|
2022-10-02 10:27:45 -07:00 |
|
|
Trenton H
|
436f9e891e
|
Changes MariaDB encoding to use utf8mb4
|
2022-09-29 13:53:44 -07:00 |
|
|
Trenton Holmes
|
38ba1d1a52
|
Cleans up and documnets installation on bare metal, includes systemd service file for the celery and celery beat
|
2022-09-28 19:38:41 -07:00 |
|
 
|
4422bb3f69
|
Fix logger location tag
Co-authored-by: shamoon <4887959+shamoon@users.noreply.github.com>
|
2022-09-28 11:02:34 -07:00 |
|
|
Trenton H
|
5b66ef0a74
|
Updates how task_args and task_kwargs are parsed, adds testing to cover everything I can think of
|
2022-09-28 10:40:55 -07:00 |
|
|
Trenton H
|
14b6216b49
|
Ensures all existing one to one fields are nulled before altering the field
|
2022-09-27 14:17:42 -07:00 |
|
|
Trenton H
|
9188e25dc5
|
Fixes migration order back to the right way
|
2022-09-27 13:55:31 -07:00 |
|
|
Trenton H
|
fad1b03458
|
Finalizes what the PaperlessTask will look like to the frontend
|
2022-09-27 12:44:01 -07:00 |
|
|
Trenton H
|
8c07b76e6a
|
Bumps version numbers to 1.9.2
|
2022-09-27 08:06:35 -07:00 |
|
|
Trenton H
|
07ec74a5d6
|
Runs the pre-commit hooks against the changelog before committing it
|
2022-09-26 12:12:57 -07:00 |
|
|
Trenton H
|
a865f2af7d
|
Fixes changelog linting
|
2022-09-26 12:06:42 -07:00 |
|
|
Trenton H
|
71b4571524
|
Merge branch 'main' into dev
|
2022-09-26 11:31:18 -07:00 |
|
|
Trenton Holmes
|
9247300230
|
Transitions the backend to celery and celery beat
|
2022-09-26 11:25:34 -07:00 |
|
|
Trenton H
|
8967f07c8d
|
Fixes a missing option for OCR mode and incorrect clean mode
|
2022-09-26 11:05:19 -07:00 |
|
|
Trenton H
|
e5de658e78
|
Updates to qpdf 11.1, pikepdf 6 and OCRMyPDF 14
|
2022-09-26 09:49:03 -07:00 |
|
|
Trenton H
|
df7e4d85c6
|
Fixes the linting issue
|
2022-09-26 09:15:22 -07:00 |
|
|
Trenton H
|
ea60b83336
|
Fixes missing markdown text from a PR title
|
2022-09-26 08:44:42 -07:00 |
|
|
Trenton Holmes
|
05a00b3057
|
Updates Python deps all at once
|
2022-09-26 08:26:55 -07:00 |
|
|
Trenton Holmes
|
cb2823ff45
|
Moves the pipenv generation of requirements.txt into a seperate build stage, disconnecting the main image from its dependencies
|
2022-09-21 09:43:40 -07:00 |
|
 Trenton HandFlorian
|
355b3fcb3d
|
Fixes grammar in comment
Co-authored-by: Florian <florian.brandes@posteo.de>
|
2022-09-16 09:08:16 -07:00 |
|
|
Trenton Holmes
|
7aa0e5650b
|
Updates how barcodes are detected, using pikepdf images, instead of converting each page to an image
|
2022-09-16 09:08:16 -07:00 |
|
|
Trenton H
|
3a7cbd3a42
|
Fixes an issue where the consume directory wasn't included in the permissions fix at Docker entry
|
2022-09-16 07:52:33 -07:00 |
|
|
Trenton HandGitHub
|
0e443ba017
|
Merge pull request #1596 from paperless-ngx/fix/1590-barcodes
Fix: Double barcode separation creates empty file
|
2022-09-15 14:18:01 -07:00 |
|
|
Trenton Holmes
|
9ae847039b
|
Fixes the seperation of files by barcode, during the case where 2 barcodes appear back to back
|
2022-09-14 14:00:37 -07:00 |
|
|
Trenton Holmes
|
d4cb84ff76
|
Ensure the tika parse function gets a string, not a PathLike
|
2022-09-14 07:48:12 -07:00 |
|
|
Trenton Holmes
|
3cf2aaf8ff
|
Locks numpy version until an upstream fix or resolution to aarch64 classifier slowdown
|
2022-09-13 10:33:07 -07:00 |
|
|
Trenton H
|
e206687070
|
Updates django-q and add optional setproctitle to allow display
|
2022-09-12 12:18:41 -07:00 |
|
|
Trenton Holmes
|
cdb9c48545
|
Minor logging updates
|
2022-09-12 11:44:33 -07:00 |
|
|
Trenton Holmes
|
0b8eff9643
|
Extends the cleanup of image versions to the library images and all the registry cache images as well
|
2022-09-12 11:44:33 -07:00 |
|
|
Trenton Holmes
|
b0d842a370
|
Updates version string to 1.9.0-rc1
Signed-off-by: Trenton Holmes <holmes.trenton@gmail.com>
|
2022-09-11 15:34:10 -07:00 |
|
|
Trenton Holmes
|
194dda6d84
|
Merge branch 'main' into beta
|
2022-09-11 15:12:54 -07:00 |
|
|
Trenton Holmes
|
2c3c26edf1
|
Ensures the Pipfile.lock hash is up to date
|
2022-09-11 08:20:58 -07:00 |
|
|
Trenton Holmes
|
18a4ba7778
|
Removes optipng, added in a bad merge
|
2022-09-11 07:42:20 -07:00 |
|
|
Trenton Holmes
|
140e239bdb
|
Fixes the shellcheck issues
|
2022-09-11 07:42:20 -07:00 |
|
|
Trenton Holmes
|
537e7c63f4
|
Combines the two database folders to a single variable during installation
|
2022-09-11 07:42:20 -07:00 |
|
|
Trenton Holmes
|
ed2e884de8
|
Fully qualifies the image and updates to Redis 7
|
2022-09-11 07:42:20 -07:00 |
|
|
Trenton Holmes
|
60980cb26a
|
Adds the mysql Python dependency
|
2022-09-11 07:42:19 -07:00 |
|
|
Trenton Holmes
|
d408900a91
|
Adds validation and testing to cover some of the common settings
|
2022-09-09 11:48:57 -07:00 |
|
|
Trenton Holmes
|
0bf9e55ca7
|
Fixes a minor TODO in settings, and enables flake8 for settings.py
|
2022-09-09 11:42:50 -07:00 |
|
|
Trenton Holmes
|
45fd01a688
|
Decrease the final size of the images containing .deb and .whl files
|
2022-09-08 07:31:00 -07:00 |
|
|
Trenton Holmes
|
5ffb25b71d
|
Tweaks gunicorn to preload the app and use shared memory for temporary fs
|
2022-09-01 18:04:12 -07:00 |
|
|
Trenton Holmes
|
bd18a57a5d
|
Updates imap_tools and updates to use the new login method for UTF-8
|
2022-09-01 08:54:44 -07:00 |
|
|
Trenton Holmes
|
8ad2f7daf0
|
Locks scipy to 1.8.1, allows some other minor version updates
|
2022-08-25 11:34:00 -07:00 |
|
|
Trenton HolmesandMichael Shamoon
|
67bb140eef
|
Finalizes testing of the delete comment
|
2022-08-24 14:24:10 -07:00 |
|
|
Trenton HolmesandMichael Shamoon
|
6d5d308d6c
|
Starts on implementing tests for the new API
|
2022-08-24 14:24:10 -07:00 |
|
|
Trenton HolmesandMichael Shamoon
|
d39b4ae8cb
|
Merges the migration branches
|
2022-08-24 14:24:10 -07:00 |
|
|
Trenton Holmes
|
ab761e837c
|
Implements a better re-do of OCR by making the document archiver function common. Actually creates updated file now
|
2022-08-21 18:20:59 -07:00 |
|
|
Trenton Holmes
|
c8e838e3a0
|
Adds the storage paths to the re-tagger command
|
2022-08-21 18:01:19 -07:00 |
|
|
Trenton Holmes
|
9b24cf7591
|
Also provide the original file name to the post consumption script
|
2022-08-21 16:16:28 -07:00 |
|
|
Trenton Holmes
|
5e3cdcdd6e
|
Bumps all library versions which are currently working
|
2022-08-21 08:34:40 -07:00 |
|
|
Trenton Holmes
|
b3b2519bf0
|
Fixes the creation of an archive file, even if noarchive was specified
|
2022-08-20 13:47:56 -07:00 |
|
|
Trenton Holmes
|
ad1f5ae081
|
Corrects the timeout's interaction with files waiting to be consumed
|
2022-08-14 17:47:59 -07:00 |
|
|
Trenton Holmes
|
86358d5561
|
Attempts to make production consumer more event driven while still allowing unit testing
|
2022-08-14 17:47:59 -07:00 |
|
|
Trenton Holmes
|
f58e0041ce
|
Resets to a last known working pipenv version
|
2022-08-14 16:01:22 -07:00 |
|
|
Trenton Holmes
|
89b7270233
|
Updates some deps, skipping scipy
|
2022-08-10 08:45:49 -07:00 |
|
|
Trenton Holmes
|
d4c3b7614d
|
Catch all exceptions during the task creation so some error here, but not with a file, will allow consumption to run
|
2022-08-09 15:50:03 -07:00 |
|
|
Trenton Holmes
|
32861ad592
|
Removes no longer needed files
|
2022-08-04 11:11:49 -07:00 |
|
|
Trenton Holmes
|
ada8516803
|
Allows the webserver binding address to be configured via the environment
|
2022-08-04 07:43:23 -07:00 |
|
|
Trenton Holmes
|
d5c27a95aa
|
Fixes minor linting
|
2022-08-03 13:26:04 -07:00 |
|
|
Trenton Holmes
|
6b8a21d2b0
|
Test pre-commit action
|
2022-08-03 13:20:02 -07:00 |
|
|
Trenton Holmes
|
cb7e6f8cd0
|
Adds a pull of all images for the main image after the pruning
|
2022-08-03 10:19:15 -07:00 |
|
|
Trenton Holmes
|
f48a2cb65e
|
Fixes the untagged image deletion so it will not remove images which are referred to by a multi-arch manifest image
|
2022-08-03 10:19:15 -07:00 |
|
|
Trenton Holmes
|
0fdd3d56f4
|
Changes the cleanup images workflow so it uses a OAuth token with the correct scope (GITHUB_TOKEN is not enough). Also prevents running if the token is not defined and generally does commenting/cleanups"
|
2022-08-03 10:19:15 -07:00 |
|
|
Trenton Holmes
|
b70e21a6d5
|
When raising an exception during exception handling, chain them together for slightly cleaner logs
|
2022-08-03 09:00:56 -07:00 |
|
|
Trenton Holmes
|
641ff9a71d
|
Revert "Bump watchfiles from 0.15.0 to 0.16.1"
This reverts commit b596502f74.
|
2022-08-02 11:25:01 -07:00 |
|
|
Trenton Holmes
|
e721092c2a
|
Changes the Dockerfile to use pipenv and the releases to use pipenv, removing the need for a requirements.txt
|
2022-07-30 13:41:08 -07:00 |
|
|
Trenton Holmes
|
2a4ec13c8e
|
Fixes issue where barcode containing files wouldn't be placed into the same directory after splitting
|
2022-07-29 10:22:54 -07:00 |
|
|
Trenton Holmes
|
b4d20d9b9a
|
Fixes document import copying PNG files to .webp extensions without actual conversion
|
2022-07-24 10:22:53 -07:00 |
|
|
Trenton Holmes
|
ef790ca6f4
|
Fixes the copy and paste of the log line
|
2022-07-22 11:08:52 -07:00 |
|
|
Trenton Holmes
|
91ba0bd0af
|
Locks dependencies to the final versions for the beta
|
2022-07-22 08:53:02 -07:00 |
|
|
Trenton Holmes
|
0e2e5f3413
|
Creates utiliy to ensure all paths in settings are normalized and absolute
|
2022-07-22 08:48:17 -07:00 |
|
|
Trenton Holmes
|
7a99dcf693
|
Adds configuration for database timeout, documentation and troubleshotting suggestion
|
2022-07-22 08:40:08 -07:00 |
|