Commit Graph

164 Commits

Author SHA1 Message Date
eb0145467f fixed bugs 47, 48, 49 and reduced complexity of dup counting as well. Now removes dirs than become empty due to duplicate removals 2021-09-04 19:50:49 +10:00
6e2d04cd76 updated comments 2021-08-12 23:22:05 +10:00
220200f017 face_distance is a float, also pass model through correctly to FaceFileLink 2021-07-28 21:41:35 +10:00
b7d346c206 model_used is now per file, not per face, implemented split of default_model to default_refimg_model and default_scan_model in settings, and default_refimg_model actualy works when creating refimgs in person.py. The model_used in face_file_link is based on default settings model and will scan with cnn if chosen and store that in DB as needed. Need viewer to allow changing per file / not just default for future scans 2021-07-27 17:14:03 +10:00
cd51ea21bf quick add of default_{model|threshold} to settings, face_refimg_link now stores model_used and face_distance AND working implementation of own face_distance algorithm rather than compareAI(), removed older AI code it would no longer work with DB structures anyway, tweaked viewer to remove coords of unmatched faces for now 2021-07-26 18:39:36 +10:00
555ce70577 renamed AI_Model to AIModel for consistency, added it as a functioning drop-down select on settings page, added face_distance to db and code, put face_distance model_used into all classes ready for use 2021-07-25 15:13:39 +10:00
347532daef fix up exception to not crash with further unset variables 2021-07-22 19:48:02 +10:00
1df519ee37 remove own copy of GenThumb, and use the one from shared.py. Also use zip() to merge face locations and encodings for AddFaceToFile() 2021-07-17 16:36:34 +10:00
e1a3ad388c added small spaces before first row of images to stop squishing into navbar, added flipping / made that work, and now show thumbnail after rotation/flip is finished - all works, and removed debugs 2021-07-16 22:28:44 +10:00
cd6a42088d remove old refimg.encodings generation, we now do this when we make a person/refimg, so its always done before an AI job needs to use it 2021-07-11 22:29:38 +10:00
3dbcf68dad force session commit in AddLogForJob() if no recent commit - 5 seconds 2021-07-07 18:05:24 +10:00
fbd9e72f28 updated TODO to remove AI job count issues, and added optimised AI searching code to reduce DB queries on recursion into dirs 2021-07-07 17:42:00 +10:00
8b857bf994 Fixed: BUG-40: RunAI file counts broken 2021-07-06 17:45:15 +10:00
95b8b4e17b use r.face now, instead of r.encodings - prep for big cutover to new refimg DB and thumb/face creation 2021-07-04 20:20:02 +10:00
9e3612578c use new shared version of GenThumb, add face / thumb into refimg class - still need much more to optimise refimg usage/creation in AI jobs, but it works 2021-07-04 20:08:18 +10:00
518df7ee10 removed all remnants of FILE_REFIMG_LINK 2021-07-03 12:43:25 +10:00
8818888596 make sure force delete removes face links too. removed extra job debug logs. rewrite of ProcessRecycleBinDir to never import content, just call AddPath appropriately 2021-07-03 12:01:51 +10:00
d74df55e58 now using new face linking code, and working, removed many debugs, needs work (around log commits). Also put a quick hack to create Bin path on init, but need to rethink this bit 2021-06-30 14:29:28 +10:00
c-d-p
818fdaa685 updated job manager to (theoretically) work for ai, but i havent tested the comparison code yet 2021-06-29 15:46:04 +10:00
4cb10c4a6b started hooking up right-click menu for Dir and Files all the way through to calling the new ScanFileForPerson() - which is still incomplete but does use the new Faces DB linkages and functions 2021-06-28 18:52:05 +10:00
ef3cb3fb6f added in DB tables for new face DB structures/links 2021-06-28 17:05:52 +10:00
31db4fcca1 added in DB tables for new face DB structures/links 2021-06-28 17:03:13 +10:00
add702a1e2 code for making a new folder and moving content to it 2021-06-24 17:34:06 +10:00
83db6d492b fix bug I added when switching symlink create to init code, path_type was the id, not a string... use DB to get right val 2021-06-22 20:54:52 +10:00
eb574e3c75 moved InitValidation checks to log to a Job to show errors in front-end, and moved the creation of the symlinks to the InitValidation so we can restart paweb docker container and it will recreate the symlinks in static without needing an import. Also added token highlighting of a failed job 2021-06-22 19:30:04 +10:00
288665ec42 set parent_dir each time, not remember last dir as parent... that was simply dumb 2021-06-17 19:54:34 +10:00
43b39af61d stop causing SqlAlchemy to have an ambiguous join of entry dir links for files and directories in the class, by removing files from class Entry, and explicitly getting the list of files for a directory via sqlalchemy in RunFuncOnFilesInPath() and ProcessFilesInDir() 2021-06-16 23:29:25 +10:00
b09d19570f improved DBox images/html, improved look of MoveDBox, started plumbing for pa_job_manager to do actual moves, all the data is there, just havent performed the FS or DB move. cleaned up duplicated DEBUGS that are straight before AddLogForJob... tweaked TODO appropriately 2021-06-14 18:30:52 +10:00
22b41899e9 FIXED: BUG-32: sometimes still getting extra directories in Bin, that just have a trailing slash (or 2 or 3, etc.) -- Also improved Job logs for Del/Restore 2021-06-12 17:06:54 +10:00
2f3224ea61 put messages to FE in for del / restore. Also, added code to see if files in Bin/ path, if so do quick WARNING, with TODO on how to improve. Finally, when importing Bin paths, just do the intial AddPath (and AddDir), then bail out of further importing. Fixed misssing return on function too 2021-06-11 23:39:21 +10:00
137b3f347d removed debugs, created ClearOtherDupMessagesAndJobs() function so CheckDups jobs created by restore/delete are removing old f/e messages, e.g. I delete a dup by hand and the dup error disappears :) MAIN thing though is the crazy restore/delete paths are now fully functional, with content in top-level of a path, different paths on import, and in subdirs of import PATHs, also tested mass delete via flat-view of all files, then mass restore -- ALL WORKED :) 2021-06-11 20:26:15 +10:00
0b6acd1899 changed to consistently use restore instead of awful undelete 2021-06-10 17:55:44 +10:00
d80871b063 added undelete functions 2021-06-10 17:43:05 +10:00
6a0141504d added JobDeleteFiles plumbing / tested... removed test code for Undel, and added in CheckDups call for Undel - that is untested though, so debug to that effect still in this commit 2021-06-09 21:34:59 +10:00
97a21cadab created/tested an Undelete function and associated classes, it works but nothing calls it yet 2021-06-08 21:17:38 +10:00
66268ad6bb use explicit set of dir_obj for path, as ORM cant easily work out which dir is the right one for a path 2021-06-07 17:46:45 +10:00
7e2494884e can now toggle between folder or flat view, its a bit ugly, but it works 2021-06-06 14:09:11 +10:00
Damien De Paoli
9a9dc01c5a added code to check paths exist on startup 2021-05-28 16:37:26 +10:00
4ed76961a8 Now have an AddPath (which calls AddDir if needed). This also fixes a bug where re-scanning, caused duplicate database entries. Also cleaned up comments, prints 2021-05-27 18:34:08 +10:00
9b926938e4 added viewing recycle bin via folders, added comments, cleaned up TODO to note this is done 2021-05-26 18:32:52 +10:00
8dc98dd368 first-pass of deleting a file moving to the bin instead, not in right spot on FS/ path&rel_path, and no visualisation yet 2021-05-24 07:42:08 +10:00
Damien De Paoli
e04fc4c068 mostly a TODO update, but start of recycle bin in DB work (PATH, etc.) is now created when we do a force rebuild from the GUI 2021-05-22 17:24:48 +10:00
5e03650ed5 first cut of paths actually working with folder viewing - for now defaulting on for both Storage only 2021-05-01 18:16:45 +10:00
3237e3bf8f fixed up dup code to work with paths, added path_types throughout and updated TODO to be clear on what next 2021-04-17 17:43:42 +10:00
095b7c8333 Path in the DB is complete, still have hacks around displaying folders (hardcoded path name) 2021-04-11 15:35:01 +10:00
4a55e98f5b first pass at removing explicit use of path_prefix, the remaining code either uses it to search so needs new path_dir_link table, or is AddDir which I need to think about 2021-04-10 11:48:56 +10:00
fddd47a1ab now using uselist=False to ensure file_details, dir_details, in_dir are one-to-one, and dont have useless list of 1 element. updated TODO to reflect order of how to tackle change over to paths and dirs 2021-04-10 11:28:17 +10:00
e6fd9a9b13 made just one checkdups/rmdups front end message once we dups 2021-04-02 16:19:40 +11:00
e3f2870197 added support for recycle bin 2021-04-02 15:11:47 +11:00
5e6d63d668 cleaned up some logs / debugs, fixed bug where we stripped comma of list of hashes, but there was none, so failed to find that hash, also created convenience functions to remove a file / dir from DB for exists_of_fs code, but also re-used so deleting duplicates also removes files 2021-03-28 16:30:46 +11:00