Commit Graph

59 Commits

Author SHA1 Message Date
35d1b32bba remove debugs 2021-04-12 00:16:06 +10:00
095b7c8333 Path in the DB is complete, still have hacks around displaying folders (hardcoded path name) 2021-04-11 15:35:01 +10:00
fddd47a1ab now using uselist=False to ensure file_details, dir_details, in_dir are one-to-one, and dont have useless list of 1 element. updated TODO to reflect order of how to tackle change over to paths and dirs 2021-04-10 11:28:17 +10:00
1ece519a2a added first pass of viewing by folders, see TODO for next steps 2021-04-06 17:05:24 +10:00
e6fd9a9b13 made just one checkdups/rmdups front end message once we dups 2021-04-02 16:19:40 +11:00
7e7d757afb use kfid instead of fkname for consistency 2021-03-28 16:16:12 +11:00
5ee718b1d4 added search comparison with dir name 2021-03-26 17:09:42 +11:00
a2ef27e6a1 had to revert the import line - pylint didnt originally like it this way, cant see issue now - go figure, but it definitely caused the video thumbs to fail 2021-03-23 18:38:10 +11:00
f20ce0f7a4 removed old code, commented out Dump() debug 2021-03-21 16:58:06 +11:00
2292777b83 fixed bug with no pagesize on fresh DB / first time in fix_dups. Also passing duplicate data (DD) as single object to dups.html 2021-03-21 12:17:43 +11:00
6fd0205b71 fixed up a few issues found from linter 2021-03-19 17:49:48 +11:00
08dc646371 first pass of using Duplicate class, rather than files doing all the dup work. The html still is shown preferreds, and does not know there are preferred files and preferred dirs yet 2021-03-15 20:36:10 +11:00
8ff61dddfa trialing a new duplicate class to deal more consistently with the various types of duplicates -- mostly to enable "auto" deleting of duplicates in specific conditions, e.g. in both an import dir and storage dir - just delete dups from import dir 2021-03-13 12:36:16 +11:00
76aee3a10a okay fix_dups page now has functioning pagination, highlights regex matching "good" files as green, and just a file as yellow if we cant find the right one, so easily shows where to really pat attention. Has DBox based help page, and overall just a better UI/UX 2021-03-06 17:18:11 +11:00
b9dea327d0 use pagesize not page_size, and pass it in based on job extras, also use path based on job extras, so we fix issue of fix_dups not knowing which path from settings was used (import or storage) 2021-03-06 11:45:21 +11:00
f1ec7f9eb6 just make sure file size is the same as well as hash, this should make it nearly impossible for accidentally having 2 files with the same hash that are different 2021-03-06 11:18:11 +11:00
8649edfe7c added page_size on reducing and hardcoded stich of prefix of dups (STILL needs fixing) 2021-03-03 22:03:55 +11:00
689081ef0b put summary counts on dups 2021-03-02 22:44:00 +11:00
06eb1ef927 fixed BUG-27, duplicate count per same named files in 2 dirs, was always 1 2021-03-01 18:46:03 +11:00
477bd6f099 added code to split out storage_path and import_path, still a bit clunky, but functional. SymlinkName also now in shared 2021-02-27 18:30:54 +11:00
2482a2e829 fixed BUG-24, only appends per_path_dups if we have one to append 2021-02-22 17:26:32 +11:00
7fd6a2eddb fixed BUGs 22 and 23 - both relate to the HTML forms being different for the search and viewing data, so changing one when the other was set, did not pass the values through, e.g. search term not there when you change a viewing option, or after searching, it did not know the grouping options. Fixed from the search side by showing a label of what you are searching for and storing it statically in the viewing form. Sorted by jscript onSubmit func to take 5 viewing options and store the last value in hidden inputs in the search form 2021-02-21 15:40:47 +11:00
6ef383f732 update status message to link to job created for del dup files 2021-02-17 21:42:59 +11:00
9e84236f49 moved to storing DB ids rather than names of files/dirs for deletions 2021-02-14 16:20:48 +11:00
27e881ea8c minor clean up on headings, alerts at top of /fix_dups route 2021-02-13 20:30:21 +11:00
7014eb0f35 now have a partial fix_dups path, it shows the content in a much more reasonable manner, and allows the GUI to select the files/paths to keep, HOWEVER, the form POST is not enabled, and I still need to process the form data -- right now, now sure how I know which files to delete vs keep -> will need hidden vars of options, not just the to_keep - then process them 2021-02-13 20:21:08 +11:00
1499f2ca61 fixed BUG-21: file stucture broken after rescan, and beginnings of new job for checking for duplicate files, and having the back-end job indicate to the front-end that there are duplicates, and the basic route is in the f/e, but not built yet 2021-02-11 20:09:24 +11:00
941890c55f placholder for move_files route 2021-02-07 20:42:59 +11:00
1e219fd2b8 now keep size over reloads of page, its hacky though 2021-02-02 01:15:28 +11:00
09a099cc34 pass noo into render html files 2021-02-02 00:20:32 +11:00
5703664019 changed to fixed number of images per load, rather than complicating with week/month/year retrieval 2021-02-01 23:13:38 +11:00
4fe74c02bb keep last form values and fix month -> Month in oldest / if 2021-01-31 18:16:55 +11:00
2db7f59a40 made basic newest/oldest week/month/year part of gui actually retreive what we want, and have a title per grouping, but the grouping title is hard-coded for now, will need more data to do a better test, also hacky submit button for now until I decide how to enact the gui change requested 2021-01-30 23:26:52 +11:00
4b6887eb4b first pass of reduced data so new files "button bar" could be used 2021-01-30 15:40:46 +11:00
89cc7aad2d fix bug with unique on both entry name and dir path_prefix 2021-01-29 00:15:30 +11:00
5a8e139263 order the file by name/date 2021-01-28 13:10:16 +11:00
18b8a30140 Fixed BUG-11: we have changed to file_refimg_link table (from file_person_link), this means we now have some optimisations, and can definitely re-run AI jobs without crashing. Several optims could still be done - see TODO 2021-01-25 01:05:30 +11:00
afc4eda233 last commit or the night, a feel-good one, now have search by file name and refimg tag, can find ppl :) 2021-01-23 00:48:00 +11:00
2dc0e921ef added people to file in the ORM 2021-01-22 21:15:23 +11:00
cc3a6cebd7 changed all new_file to file, also make JobForceScan work 2021-01-20 20:02:40 +11:00
31d45e80b6 moved over to new ENTRY based data structures for loading from DB and viewing content 2021-01-19 17:33:10 +11:00
2b9dedb9b9 change how we calculate active jobs, probably will remove it from pa_job_engine, safer with threads I think. But, mostyle, added in client / server socket comms between web FE and job manager, with better job creation message (including link to job detail) and when you view job detail it auto-refreshes every few seconds until job complete) 2021-01-17 12:35:28 +11:00
abff2d8bab finished moving GenerateFileData out of files.py into pa_job_manager.py 2021-01-17 11:31:06 +11:00
c5d8811671 actually create a job for scan now, and let the job manager do the work and send back output via new PA_JobManager_FE_Message table 2021-01-17 10:50:43 +11:00
e138ab22aa git commit, converted over to base.html pulling Status*, rather than every render_template calling it. Tightened up naming for job manager, fixed a few bugs in there with items like div by zero, created the active jobs link/badge in navbar, have it invoked each time by base.html template and it gets active jobs from DB, pa_job_manager now initiliases from an empty DB and can work out where it is at, no loop/thread/or actual job code yet. jobs.py has basics of a NewJob(), so next step is to force that job to be executed in pa_job_manager, but its tea time 2021-01-16 17:51:16 +11:00
a93f9e1da8 changed files table to file to be consistent with other tables in the db 2021-01-14 21:58:20 +11:00
e884accd0a renamed importlog* to job* -- in db, python and html 2021-01-14 21:47:12 +11:00
3684f279e4 first pass of import logging, its not being used, data is in real tables, but faked. will probably have to switch to gunicorn and threading to allow import and serving pages when we use slower AI routines 2021-01-14 00:15:54 +11:00
684d057e59 added admin routes/code to allow a scan now and a forced scan 2021-01-12 18:45:13 +11:00
e83a40ee52 converted over to a flat settings table, no more key-value pairs of settings 2021-01-12 18:32:47 +11:00