Commit Graph
77 Commits
Author SHA1 Message Date
Yichi YangandGitHub a0c227fe55 Refactor: Use django-filter logic for filtering full text search queries (#7507) 2024-08-24 21:20:43 -07:00
shamoon b5e4aaa778 Revert "Chore: add line to log indexing"
This reverts commit b34f9c3b20.
2024-08-20 22:11:20 -07:00
shamoon b34f9c3b20 Chore: add line to log indexing 2024-08-15 08:03:35 -07:00
shamoonandGitHub 63e1f9f5d3 Feature: custom fields filtering & bulk editing (#6484) 2024-04-26 15:10:03 -07:00
shamoonandGitHub fc68f79cc8 Enhancement: always place search term first in autocomplete results (#6142) 2024-03-21 19:03:17 +00:00
Trenton HandGitHub fba416e8e1 Fixes a corrupted index not being handled by whoosh.create_in (#5950) 2024-02-29 00:07:17 +00:00
Trenton HandGitHub 13201dbfff Ensure all creations of directories create the parents too (#5711) 2024-02-10 11:02:40 -08:00
Trenton HandGitHub 37e34d92de Replaces deprecated Django with standard library (#5262) 2024-01-05 21:20:38 -08:00
shamoonandGitHub 5e8de4c1da Enhancement: shared icon & shared by me filter (#4859) 2023-12-19 20:45:04 +00:00
Adam BogdałandGitHub 4510902677 Fix: Don't attempt to parse none objects during date searching 2023-12-14 07:39:49 -08:00
Trenton HandGitHub 7e12bd1bef Fix: Removes the FieldParser plugin from autocomplete searches (#4934) 2023-12-11 10:21:58 -08:00
Adam BogdałandGitHub af0817ab74 Fix: Convert search dates to UTC in advanced search (#4891)
* Index documents using local timezone

* Add local date parser
2023-12-11 09:32:43 -08:00
shamoonandTrenton H 10729f0362 Feature: Implement custom fields for documents (#4502)
Adds custom fields of certain data types, attachable to documents and searchable

Co-Authored-By: Trenton H <797416+stumpylog@users.noreply.github.com>
2023-11-05 17:27:23 -08:00
shamoon 304324ebd0 Update index.py 2023-06-04 10:41:45 -07:00
97cd06d2ba Feature: Allow to filter documents by original filename and checksum (#3485)
* Allow to filter documents by original filename and checksum

This adds filters for the original filename and checksum of documents to
be able to to lazy checks if the file is already stored in paperless.

* Add tests for DelayedQuery

* Add checksum and original_filename to whoosh index and DelayedQuery

* Refactored DelayedQuery to reduce duplicate code
* Choose icontains for checksums as whoosh has no exact match query term
* Bumped index version

* Revert whoosh filtering logic to simpler structure, remove redundant tests

Revert "Revert whoosh filtering logic to simpler structure, remove redundant tests"

This reverts commit 86792174bfbc697f42b72c4b39ee9eba483bb425.

---------

Co-authored-by: shamoon <4887959+shamoon@users.noreply.github.com>
2023-06-04 10:34:27 -07:00
shamoonandGitHub 350c20d6ab Merge pull request #3359 from paperless-ngx/feature-fix-autocomplete-respect-perms
Fix: respect permissions for autocomplete suggestions
2023-05-12 13:35:45 -07:00
shamoon 66a0783e7b Respect permissions for autocomplete suggestions 2023-05-11 14:43:25 -07:00
shamoonandTrenton H b7540fab58 Apply code suggestions
Co-Authored-By: Trenton H <797416+stumpylog@users.noreply.github.com>
2023-05-09 19:48:19 -07:00
shamoon 3c4dadd905 Re-work filter editor, bulk editor & reset buttons 2023-05-09 19:48:04 -07:00
shamoon 487d3a6262 Support owner API query vars 2023-05-08 15:34:14 -07:00
shamoon df203311fe Fix note sorting, testing, bump search index version 2023-05-04 02:07:48 -07:00
shamoon 10f9b91c44 fix __in filtering 2023-05-04 02:07:16 -07:00
shamoon e275a2736a Respect superuser for advanced queries, test coverage for object perms 2023-04-27 15:51:34 -07:00
shamoon 448dcbab46 Include multi object queries in whoosh searcher 2023-04-27 08:06:55 -07:00
Trenton H 6f163111ce Upgrades black to v23, upgrades ruff 2023-04-26 09:35:27 -07:00
Trenton H 3bcbd05252 Fixes ruff not running isort against the codebase 2023-04-26 09:35:27 -07:00
Trenton H ce41ac9158 Configures ruff as the one stop linter and resolves warnings it raised 2023-04-01 17:03:52 -07:00
shamoon bf8ae22f3f Rename comments --> notes 2023-03-18 13:59:17 -07:00
shamoon d2a6f79612 Merge branch 'dev' into feature-permissions 2023-02-03 14:23:50 -08:00
Trenton H 0f536a9b9a Detect and reset invalid ASNs to 0 during indexing with a loud error to the user 2023-02-03 08:31:45 -08:00
Trenton H dc7bef5d48 Fixes relative date Whoosh queries and adds testing to ensure it remains working with multiple timezones 2023-01-31 12:53:46 -08:00
Michael Shamoon 44f860d9b0 Merge branch 'dev' into feature-permissions 2023-01-24 14:10:45 -08:00
Michael ShamoonandTrenton H 99c2442b28 Use 32bit integer for asn, unsigned Whoosh NUMERIC field
Co-Authored-By: Trenton H <797416+stumpylog@users.noreply.github.com>
2023-01-24 10:13:05 -08:00
Michael Shamoon a4d96061de Merge branch 'dev' into feature-permissions 2023-01-05 19:45:12 -08:00
Michael Shamoon 91d4941438 Support comment search 2023-01-04 19:06:06 -08:00
Michael Shamoon d71d388c08 Merge branch 'dev' into feature-permissions 2022-12-29 20:12:42 -08:00
Michael Shamoon 94e32005ca support tags__id__none for advanced search 2022-12-17 19:49:17 -08:00
Michael Shamoon 4cf9ed9d26 Support owner and object permissions for advanced queries 2022-12-12 22:40:31 -08:00
69ef26dab0 Feature: Dynamic document storage pathes (#916)
* Added devcontainer

* Add feature storage pathes

* Exclude tests and add versioning

* Check escaping

* Check escaping

* Check quoting

* Echo

* Escape

* Escape :

* Double escape \

* Escaping

* Remove if

* Escape colon

* Missing \

* Esacpe :

* Escape all

* test

* Remove sed

* Fix exclude

* Remove SED command

* Add LD_LIBRARY_PATH

* Adjusted to v1.7

* Updated test-cases

* Remove devcontainer

* Removed internal build-file

* Run pre-commit

* Corrected flak8 error

* Adjusted to v1.7

* Updated test-cases

* Corrected flak8 error

* Adjusted to new plural translations

* Small adjustments due to code-review backend

* Adjusted line-break

* Removed PAPERLESS prefix from settings variables

* Corrected style change due to search+replace

* First documentation draft

* Revert changes to Pipfile

* Add sphinx-autobuild with keep-outdated

* Revert merge error that results in wrong storage path is evaluated

* Adjust styles of generated files ...

* Adds additional testing to cover dynamic storage path functionality

* Remove unnecessary condition

* Add hint to edit storage path dialog

* Correct spelling of pathes to paths

* Minor documentation tweaks

* Minor typo

* improving wrapping of filter editor buttons with new storage path button

* Update .gitignore

* Fix select border radius in non input-groups

* Better storage path edit hint

* Add note to edit storage path dialog re document_renamer

* Add note to bulk edit storage path re document_renamer

* Rename FILTER_STORAGE_DIRECTORY to PATH

* Fix broken filter rule parsing

* Show default storage if unspecified

* Remove note re storage path on bulk edit

* Add basic validation of filename variables

Co-authored-by: Markus Kling <markus@markus-kling.net>
Co-authored-by: Trenton Holmes <holmes.trenton@gmail.com>
Co-authored-by: Michael Shamoon <4887959+shamoon@users.noreply.github.com>
Co-authored-by: Quinn Casey <quinn@quinncasey.com>
2022-05-19 14:42:25 -07:00
Trenton Holmes 1771d18a21 Runs the pre-commit hooks over all the Python files 2022-03-11 11:34:28 -08:00
kpj fc695896dd Format Python code with black 2022-02-27 15:26:41 +01:00
jonaswinkler f3703fc6e3 only show score when sorting by score 2021-05-15 17:25:49 +02:00
jonaswinkler 0d5fd229bf disable reverse sorting by score 2021-05-15 17:11:26 +02:00
jonaswinkler 8ee2e8b23d sorting for full text queries 2021-05-15 13:58:11 +02:00
jonaswinkler 1dbd7b9bb4 fix some issues with the search index 2021-04-05 21:53:07 +02:00
jonaswinkler d13baab0a6 more testing 2021-04-04 01:19:07 +02:00
jonaswinkler b7063b199a disable sorting for now 2021-04-03 21:49:31 +02:00
jonaswinkler 38a386d5ae fix date filtering for full text search 2021-04-03 21:02:13 +02:00
jonaswinkler b6ff88645b lots of changes for the new unified search 2021-03-17 22:25:22 +01:00
jonaswinkler f9263ddb62 some initial attempts to merge search and document list 2021-03-07 13:16:23 +01:00