Commit Graph
100 Commits
Author SHA1 Message Date
Trenton H dd6ae13281 Changes the type of the connection timeout to be an int, not a float 2023-06-12 08:45:57 -07:00
Trenton H e3ea5dd13c Silence a warning about setting this by setting it 2023-06-08 15:05:36 -07:00
Trenton H 883937bfd7 In cases where a temporary file is created or used, copy the original file stats to it 2023-06-07 09:02:19 -07:00
Trenton H 36b4fff5c7 Removes packages which are no longer built/published from the cleaning 2023-06-06 14:38:59 -07:00
Trenton H 45d8c945e2 Small improvements to coverage 2023-06-06 13:18:13 -07:00
Trenton H ee19307ea2 Restore pushing codecov in all cases. I don't think this was doing what I wanted 2023-06-06 09:05:26 -07:00
Trenton H 2c1cd25be4 Rewrites the email parsing to be more clear and concise.
Adds testing to use httpx mocked responses to stand in as a server even offline
2023-06-06 09:05:26 -07:00
Trenton H 6e65558ea4 Swapping out the tika and replaces requests with httpx 2023-06-06 09:05:26 -07:00
Trenton H c1641f6fb8 Just in case, catch a sometimes nltk error and return the basic processed content instead 2023-05-24 19:34:49 -07:00
Trenton H 452c79f9a1 Improves the logging mixin and allows it to be typed better 2023-05-23 17:16:39 -07:00
Trenton H 07e07fc7e8 Updates handling of barcodes to encapsulate logic, moving it out of tasks and into barcodes 2023-05-22 06:52:31 -07:00
Trenton H 3cdd358fc8 Adds a note to bare metal upgrading about removing old dependencies 2023-05-16 12:05:29 -07:00
Trenton H 548b6352ca Updates the coverage to upload on push, not pull request, as dev doesn't upload fully otherwise 2023-05-15 12:54:35 -07:00
Trenton H 49d0b6aa00 Fixes a couple of fixes and other appearing as enhancements 2023-05-15 09:25:12 -07:00
Trenton Holmes 3205d52331 Changes the error mode to replace instead of ignore, to better highlight where a problem happened 2023-05-13 09:29:18 -07:00
Trenton H 111960c530 Adds better handling for files with invalid utf8 content 2023-05-13 09:29:18 -07:00
Trenton H b5f0cd7c70 Adds back the extras from uvicorn 2023-05-12 06:43:32 -07:00
Trenton H 90488cd77a Removes even more remanents from the lock file 2023-05-12 06:43:32 -07:00
Trenton H 5bbc59e87c Fixes testing requirements, removes further leftover libraries 2023-05-12 06:43:32 -07:00
Trenton H c02758213b Upgrades to the latest django channels 2023-05-12 06:43:32 -07:00
Trenton H 17144c45e5 Transition to new library for finding IPs from the Django request 2023-05-11 13:51:04 -07:00
Trenton H 22cbfd473b Upgrades dependencies to their latest allowed versions 2023-05-10 06:59:44 -07:00
Trenton H 02b2bcafc5 Fixes a small step naming thing, updates codecov to only upload on pull request events 2023-05-05 11:47:43 -07:00
Trenton Holmes 81a5fd377e Use a tagged version of the image cleaner action 2023-05-05 11:47:43 -07:00
Trenton H f875ae4abf CI cleanup and improvements.
Removes the building of installers from the repo, they can now be built elsewhere,
on demand, as their building is no longer tied to the Dockerfile
2023-05-05 11:47:43 -07:00
Trenton H 01fd400ec7 Moves to the new action for cleaning the published images 2023-05-05 11:47:43 -07:00
Trenton H ec4814a76e Bumps version to 1.14.4 2023-05-04 07:48:55 -07:00
Trenton H 69b53d70c5 Merge remote-tracking branch 'origin/dev' 2023-05-04 07:48:00 -07:00
Trenton H 29d8c4e08d Fixes inversion in tagged mail searching 2023-05-04 06:29:41 -07:00
Trenton Holmes fd84fc9dbe Re-add -dev version tag 2023-05-03 06:55:59 -07:00
Trenton Holmes 4353646b3a Bumps version to 1.14.3 2023-05-03 06:54:37 -07:00
Trenton Holmes 7545e5312c Merge remote-tracking branch 'origin/dev' 2023-05-03 06:53:33 -07:00
Trenton Holmes b7577038a0 Replace usages of os.rename with shutil.move to properly handle cases where the source and dest arent't on the same filesystem 2023-05-01 07:28:52 -07:00
Trenton Holmes 613b71d23b Ignores a specific _FILE setting which doesn't actually get set to a file 2023-05-01 07:23:31 -07:00
Trenton H 26cd470d31 Don't ever send GMail related keywords if the server doesn't report support for the extensions 2023-04-29 09:34:50 -07:00
Trenton H d3e14818df Reset dev versioning string 2023-04-27 07:16:20 -07:00
Trenton H 864e242ed9 Bumps version to 1.14.1 2023-04-27 07:12:44 -07:00
Trenton H 8f18baea8f Merge remote-tracking branch 'origin/dev' 2023-04-27 07:10:04 -07:00
Trenton H 6f163111ce Upgrades black to v23, upgrades ruff 2023-04-26 09:35:27 -07:00
Trenton H 3bcbd05252 Fixes ruff not running isort against the codebase 2023-04-26 09:35:27 -07:00
Trenton H a2d4d16867 Make the importer a little more robust against some types of errors 2023-04-26 07:08:50 -07:00
Trenton H b34dfcd72f Fixes StoragePath missing the owned or granted filter 2023-04-25 18:48:22 -07:00
Trenton H 319aa39925 Selectivly upgrade redis-py to resolve issues with socket connections 2023-04-25 10:03:41 -07:00
Trenton H 4108eabd0d Allows users to set some additional Django settings for proxy configuration 2023-04-20 18:32:17 -07:00
Trenton H 829a693128 To support token auth better, increase the password field (more of a double duty) to be 2048 chars 2023-04-20 14:43:19 -07:00
Trenton Holmes 1b4020b3d7 Fixes barcode tests not running 2023-04-01 17:38:18 -07:00
Trenton H ce41ac9158 Configures ruff as the one stop linter and resolves warnings it raised 2023-04-01 17:03:52 -07:00
Trenton H 3c2bbf244d Creates a data model for the document consumption, allowing stronger typing of arguments and setting of some information about the file only once 2023-04-01 11:05:34 -07:00
Trenton HandGitHub dde3205425 Merge pull request #2907 from margau/feature-multiple-barcode-scanners
feature: Add support for zxing as barcode scanning lib
2023-03-29 12:12:56 -07:00
Trenton H 15a264de3d Enables images to be release to Quay.io, alongside the existing registries 2023-03-29 11:35:57 -07:00
Trenton H 66929a9088 Merge remote-tracking branch 'origin/dev' into feature-multiple-barcode-scanners 2023-03-29 09:40:10 -07:00
Trenton Holmes 5468394ef2 Disables mingle and gossip. Not useful with the single worker we use 2023-03-25 19:17:02 -07:00
Trenton Holmes 7ad21e0e45 Configures logging to capture celery and kombu debugging to library 2023-03-25 19:17:02 -07:00
Trenton H e0d5fd9290 Unlock channels_redis and implement the workaround from the issue to use pub/sub instead 2023-03-23 19:54:19 -07:00
Trenton H 4bd1974911 Updates to the latest and still working pipenv version. Updates to latest wheels 2023-03-23 18:00:08 -07:00
Trenton H d246e4090a Adds a tip for using tokens instead of passwords, now that support is integrated 2023-03-23 08:52:12 -07:00
Trenton H 09b1413748 Allows users to use OAuth tokens instead of passwords 2023-03-23 08:52:12 -07:00
Trenton H 4637e33326 Adds possible scary looking log line that is actually fine to troubleshooting 2023-03-21 07:46:57 -07:00
Trenton H 4a5f21dd87 Limit the number of threads waiting for files to be ready during polling 2023-03-21 07:46:57 -07:00
Trenton H 0778c2808b Instead of using PIL directly to convert TIFF to PDF, use the existing library of img2pdf 2023-03-20 13:48:05 -07:00
Trenton H 96e8cfb765 Couple more documentation improvements 2023-03-15 10:40:10 -07:00
Trenton Handshamoon d47ca6109a Apply suggestions from code review
Co-authored-by: shamoon <4887959+shamoon@users.noreply.github.com>
2023-03-15 10:40:10 -07:00
Trenton H 8ac7d56fc5 Improve documentation around barcodes, re-organize configuration and update links 2023-03-15 10:40:10 -07:00
Trenton Holmes bfaede26c4 Replace commas with underscores to handle Chrome issues with commas 2023-03-15 10:29:04 -07:00
Trenton H 477fd360f8 Unlock cryptography version now that PiWheels built the most recent version. Update in bulk. 2023-03-15 06:35:05 -07:00
Trenton Holmes 851b23fb09 Adds additional note for bare metal suggesting Redis be secured 2023-03-12 20:53:53 -07:00
Trenton H 849a108520 Changes the celery serializer to use pickle over json 2023-03-12 20:53:53 -07:00
Trenton Holmes 97ff2e126c Adds owner and original name to the possible naming schemes 2023-03-12 15:29:58 -07:00
Trenton H 3e467c517d Allows filtering email by the TO value(s) as well 2023-03-12 10:31:42 -07:00
Trenton H 7c90702ff7 Updates to libqpdf 11.3.0 2023-03-10 20:36:17 -08:00
Trenton H 4383550d98 When tagging an email using Gmail label extensions, append the label instead of replacing 2023-03-10 09:19:58 -08:00
Trenton H 5e7b93d153 Comment up the testing a bit more 2023-03-09 08:43:31 -08:00
Trenton H f100198a8a Handle the possilbe case of splitting on an empty string returning a list with an empty string 2023-03-08 07:32:17 -08:00
Trenton Holmes b470fc0140 Adds a utility for the settings to parse out a list, seperated by something, from an environment key 2023-03-08 07:32:17 -08:00
Trenton H db02d5eff0 Ensure dates from emails are made timezone aware if not already 2023-03-07 10:01:40 -08:00
Trenton H 41bcfcaffe Changes out the settings and a decent amount of test code to be pathlib compatible 2023-03-06 09:16:07 -08:00
Trenton H 74a1e5ed86 Disables creation of videos during testing with Cypress 2023-03-02 08:03:41 -08:00
Trenton H 3d961a3dbb Enable package caching for frontend testing 2023-03-02 08:03:41 -08:00
Trenton H c422a081bf Be sure the scratch directory exists before using it as temporary directory 2023-03-01 07:13:31 -08:00
Trenton Holmes 6b939f7567 Returns to using hashing against primary keys, at least for fields. Improves testing coverage 2023-02-28 08:13:10 -08:00
Trenton Holmes c958a7c593 Changes from a hash based system to a time based system to prevent extra retrains 2023-02-28 08:13:10 -08:00
Trenton H 8709ea4df0 Changes classifier training to hold less data in memory at the same time 2023-02-28 08:13:10 -08:00
Trenton H 16d3041d7a Add new packages catagory for mypy typing stubs and configure some mypy settings in setup.cfg 2023-02-27 15:59:55 -08:00
Trenton H afcefe3d04 Fixes creation of the paperless.conf in the release dist 2023-02-23 14:59:34 -08:00
Trenton H 8df1324afd Updates the latest test to use status codes 2023-02-20 10:25:21 -08:00
Trenton Holmes a6e2708605 Changes testing to use more declarative status code names from DRF 2023-02-20 10:25:21 -08:00
Trenton Holmes 0df91c31f1 Creates a mix-in for asserting file system states 2023-02-20 10:25:21 -08:00
Trenton Holmes bec8d00232 Allow setting the ASN on document upload 2023-02-20 07:56:37 -08:00
Trenton Holmes 1471dd72a6 Bulk update of all Python libraries 2023-02-20 07:15:48 -08:00
Trenton H 07ec6ff7ab Adds some quick testing of the IP logging during a failed login 2023-02-18 15:26:09 -08:00
Trenton H abc58000b4 Moves the renaming ttask into the serialiser update instead of post_save. Feels more correct 2023-02-18 12:19:33 -08:00
Trenton H 5e3ef94697 Moves the renaming triggered from a storage path change to be a background task 2023-02-18 12:19:33 -08:00
Trenton H 857944aabe When a StoragePath is changed, check if related documents require a rename 2023-02-18 12:19:33 -08:00
Trenton Handshamoon 72f58d54a3 Moves django-ipware up to be with other Django libraries 2023-02-17 08:12:27 -08:00
Trenton H ee272da95f Instead of pulling all images, inspect the manifest index and each digest index 2023-02-16 13:03:24 -08:00
Trenton H c08f0054da Updates ignore path filtering so files in a folder in an ignored folder will be ignored correctly 2023-02-16 09:05:11 -08:00
Trenton Holmes 0d1a8d6d2f Resolves the subshell not returnning when generating SECRET_KEY 2023-02-14 17:20:34 -08:00
Trenton H 0d777343fb Changes the default setting for compression to enabled 2023-02-12 14:45:51 -08:00
Trenton H 3b0fa4f707 Adds option to enable compression of webserver responses 2023-02-12 14:45:51 -08:00
Trenton Holmes 8b3d01c49b When splitting via barcodes, cleanup the split documents better 2023-02-12 08:20:12 -08:00