Commit Graph

178 Commits

Author SHA1 Message Date
5abd01bb4d fix BUG-66: deleting files out from under and in general CleanUpDirInDB needs to use Entry not Dir 2021-09-25 12:11:13 +10:00
e9f37aa6a8 minor change to optim, if file hash is same but we have no thumb, then try to gen one anyway 2021-09-24 20:42:39 +10:00
012c2809f1 handle case where video is so black we fail to get a thumbnail 2021-09-24 20:05:49 +10:00
a44810a2f4 fix bug with parent_dir being set to an Entry, instead of leaving it being the Dir set earlier in func 2021-09-24 17:34:29 +10:00
13aab072db use full path for current_file I think its more meaningful, and also extra optimisation - if same md5 hash, dont redo thumbnail 2021-09-21 13:46:22 +10:00
9f90cdaaac fix up all the dumb bugs I introduced and clearly never tested when I tweaked the remove file/dir after if you move files on the FS out from under PA 2021-09-21 00:37:39 +10:00
3f21f3d1f5 fix not setting in progress when we should on 2 more jobs 2021-09-18 17:55:32 +10:00
fe7627c89c DEBUG is now a boolean to fix occasionaly debug when I did not want it 2021-09-17 18:08:55 +10:00
85dd7d7bd1 fix bug with commit logs every log, rather than actually every 5 seconds as intentended. 2021-09-16 20:22:50 +10:00
4d0addb87b removing extra session.commits, and optimsing run_ai_on - dont reprocess faces if no new refimgs since last scan -- so we had set last_ai_scan on FILE as well 2021-09-16 19:25:23 +10:00
a068133149 fixed bug where job is not set to "In Progress" for run_ai_on 2021-09-15 18:09:52 +10:00
301b3d220b fixed BUG-54/55, viewer now works in PROD, current_file being set in run_ai_on job, added "new" bug-53 re video fname not being set properly when next/prev in viewer 2021-09-14 17:56:06 +10:00
444b206c64 use better face distance sorting/matching algo 2021-09-12 18:35:04 +10:00
a64b651118 use new base_path Setting, but have not tested use of absolute paths instead of relative paths, also need better tooltips for the paths -- AND, still have odd trailing slash due to SymLinkName, etc. being too complex 2021-09-05 21:58:54 +10:00
eb0145467f fixed bugs 47, 48, 49 and reduced complexity of dup counting as well. Now removes dirs than become empty due to duplicate removals 2021-09-04 19:50:49 +10:00
6e2d04cd76 updated comments 2021-08-12 23:22:05 +10:00
220200f017 face_distance is a float, also pass model through correctly to FaceFileLink 2021-07-28 21:41:35 +10:00
b7d346c206 model_used is now per file, not per face, implemented split of default_model to default_refimg_model and default_scan_model in settings, and default_refimg_model actualy works when creating refimgs in person.py. The model_used in face_file_link is based on default settings model and will scan with cnn if chosen and store that in DB as needed. Need viewer to allow changing per file / not just default for future scans 2021-07-27 17:14:03 +10:00
cd51ea21bf quick add of default_{model|threshold} to settings, face_refimg_link now stores model_used and face_distance AND working implementation of own face_distance algorithm rather than compareAI(), removed older AI code it would no longer work with DB structures anyway, tweaked viewer to remove coords of unmatched faces for now 2021-07-26 18:39:36 +10:00
555ce70577 renamed AI_Model to AIModel for consistency, added it as a functioning drop-down select on settings page, added face_distance to db and code, put face_distance model_used into all classes ready for use 2021-07-25 15:13:39 +10:00
347532daef fix up exception to not crash with further unset variables 2021-07-22 19:48:02 +10:00
1df519ee37 remove own copy of GenThumb, and use the one from shared.py. Also use zip() to merge face locations and encodings for AddFaceToFile() 2021-07-17 16:36:34 +10:00
e1a3ad388c added small spaces before first row of images to stop squishing into navbar, added flipping / made that work, and now show thumbnail after rotation/flip is finished - all works, and removed debugs 2021-07-16 22:28:44 +10:00
cd6a42088d remove old refimg.encodings generation, we now do this when we make a person/refimg, so its always done before an AI job needs to use it 2021-07-11 22:29:38 +10:00
3dbcf68dad force session commit in AddLogForJob() if no recent commit - 5 seconds 2021-07-07 18:05:24 +10:00
fbd9e72f28 updated TODO to remove AI job count issues, and added optimised AI searching code to reduce DB queries on recursion into dirs 2021-07-07 17:42:00 +10:00
8b857bf994 Fixed: BUG-40: RunAI file counts broken 2021-07-06 17:45:15 +10:00
95b8b4e17b use r.face now, instead of r.encodings - prep for big cutover to new refimg DB and thumb/face creation 2021-07-04 20:20:02 +10:00
9e3612578c use new shared version of GenThumb, add face / thumb into refimg class - still need much more to optimise refimg usage/creation in AI jobs, but it works 2021-07-04 20:08:18 +10:00
518df7ee10 removed all remnants of FILE_REFIMG_LINK 2021-07-03 12:43:25 +10:00
8818888596 make sure force delete removes face links too. removed extra job debug logs. rewrite of ProcessRecycleBinDir to never import content, just call AddPath appropriately 2021-07-03 12:01:51 +10:00
d74df55e58 now using new face linking code, and working, removed many debugs, needs work (around log commits). Also put a quick hack to create Bin path on init, but need to rethink this bit 2021-06-30 14:29:28 +10:00
c-d-p
818fdaa685 updated job manager to (theoretically) work for ai, but i havent tested the comparison code yet 2021-06-29 15:46:04 +10:00
4cb10c4a6b started hooking up right-click menu for Dir and Files all the way through to calling the new ScanFileForPerson() - which is still incomplete but does use the new Faces DB linkages and functions 2021-06-28 18:52:05 +10:00
ef3cb3fb6f added in DB tables for new face DB structures/links 2021-06-28 17:05:52 +10:00
31db4fcca1 added in DB tables for new face DB structures/links 2021-06-28 17:03:13 +10:00
add702a1e2 code for making a new folder and moving content to it 2021-06-24 17:34:06 +10:00
83db6d492b fix bug I added when switching symlink create to init code, path_type was the id, not a string... use DB to get right val 2021-06-22 20:54:52 +10:00
eb574e3c75 moved InitValidation checks to log to a Job to show errors in front-end, and moved the creation of the symlinks to the InitValidation so we can restart paweb docker container and it will recreate the symlinks in static without needing an import. Also added token highlighting of a failed job 2021-06-22 19:30:04 +10:00
288665ec42 set parent_dir each time, not remember last dir as parent... that was simply dumb 2021-06-17 19:54:34 +10:00
43b39af61d stop causing SqlAlchemy to have an ambiguous join of entry dir links for files and directories in the class, by removing files from class Entry, and explicitly getting the list of files for a directory via sqlalchemy in RunFuncOnFilesInPath() and ProcessFilesInDir() 2021-06-16 23:29:25 +10:00
b09d19570f improved DBox images/html, improved look of MoveDBox, started plumbing for pa_job_manager to do actual moves, all the data is there, just havent performed the FS or DB move. cleaned up duplicated DEBUGS that are straight before AddLogForJob... tweaked TODO appropriately 2021-06-14 18:30:52 +10:00
22b41899e9 FIXED: BUG-32: sometimes still getting extra directories in Bin, that just have a trailing slash (or 2 or 3, etc.) -- Also improved Job logs for Del/Restore 2021-06-12 17:06:54 +10:00
2f3224ea61 put messages to FE in for del / restore. Also, added code to see if files in Bin/ path, if so do quick WARNING, with TODO on how to improve. Finally, when importing Bin paths, just do the intial AddPath (and AddDir), then bail out of further importing. Fixed misssing return on function too 2021-06-11 23:39:21 +10:00
137b3f347d removed debugs, created ClearOtherDupMessagesAndJobs() function so CheckDups jobs created by restore/delete are removing old f/e messages, e.g. I delete a dup by hand and the dup error disappears :) MAIN thing though is the crazy restore/delete paths are now fully functional, with content in top-level of a path, different paths on import, and in subdirs of import PATHs, also tested mass delete via flat-view of all files, then mass restore -- ALL WORKED :) 2021-06-11 20:26:15 +10:00
0b6acd1899 changed to consistently use restore instead of awful undelete 2021-06-10 17:55:44 +10:00
d80871b063 added undelete functions 2021-06-10 17:43:05 +10:00
6a0141504d added JobDeleteFiles plumbing / tested... removed test code for Undel, and added in CheckDups call for Undel - that is untested though, so debug to that effect still in this commit 2021-06-09 21:34:59 +10:00
97a21cadab created/tested an Undelete function and associated classes, it works but nothing calls it yet 2021-06-08 21:17:38 +10:00
66268ad6bb use explicit set of dir_obj for path, as ORM cant easily work out which dir is the right one for a path 2021-06-07 17:46:45 +10:00