Commit Graph

171 Commits

Author SHA1 Message Date
20c76609cd fixed up some missing try/excepts on os. calls 2022-08-06 12:02:10 +10:00
a620024de6 remove debug, fix BUG-105 by setting last_update on job always 2022-08-03 17:59:41 +10:00
a8af00fe66 big change to get metadata working fully in DB and on Filesystem, and recover from most common scenarios, improved GUI as well for allowing an immediate search after adding refimg as well 2022-08-01 23:44:38 +10:00
391b61f3c4 first pass at keeping overrides on face delete - should at least stop code crashing if you try to delete faces from DB and they still had a matching override 2022-07-28 21:23:34 +10:00
24bcfa0aab now have a NewJob used in pa_job_mgr and it does not set start_time until it starts, caters for BUG-97 (restarting jobs resetting start times) 2022-07-23 00:33:04 +10:00
9164b2c9f6 use python-ffmpeg (run external ffmpeg) to generate video thumb as it also auto-rotates 2022-07-21 20:59:05 +10:00
9f0dd2ba94 fix up extra debug / file_cnts on RunAIOn job -- when we fix logging, fix this properly 2022-07-17 16:45:56 +10:00
a1245151d3 when restart JobRunAIOnPath, dont add the path again, move a couple of debug lines to an actual debug 2022-07-17 15:32:59 +10:00
34c759b7a0 fix up video thumbnailing issue, seems I repalce cv2 with cv2.cv2 in a couple of spots 2022-07-15 22:50:11 +10:00
84a4cf7cf8 added ability to auto-rotate jpegs as we import them. The auto-rotation uses /usr/bin/exifautotran which rotates losslessly, and we optimised to then not also re-rotate the thumbmail. This address a few bugs in the 90s, including the one where Mandys photos were not getting faces (they were rotated), and without really doing anything the odd one where we sometimes lost tmp_locn on first load after db recreation - I cant reproduce so ignoring it 2022-07-15 17:18:31 +10:00
37bea367f5 fixed BUG-90 (not finding best match, but last match) 2022-07-10 20:09:22 +10:00
226f6fdb3e remove old/wrong faces binary from FILE in DB 2022-02-27 00:40:06 +11:00
694aef038b if we use run_ai_on_path, then we remove all existing matches on the path, then go again -- allows us to change threshold and reset 2022-02-04 22:03:04 +11:00
e1a6348967 face_size_limit added so we ignore faces that are too small 2022-02-02 21:12:14 +11:00
0751cc6010 clarified bug-82, fixed issue with AI scan optimising still scanning when it should not, finalised back button work for view/viewlist 2022-01-27 21:44:29 +11:00
08ca9b4e74 partial implementation of first_eid, last_eid -- I think the vals work -- they do for searches anyway, but not stored in pa_user_state yet 2022-01-25 00:48:14 +11:00
65ebfe2d31 DONE - todo to have force rescan delete face from DB 2022-01-23 14:54:49 +11:00
f8cff5f73e make optimisation from scan do run_ai_on_path IF there are newer reference images than the last scan even if we dont find new files in the scan itself 2022-01-19 15:37:27 +11:00
2b923f0b60 fix BUG that made job mgr break in prod (with DEBUG not even defined, its now False in Prod) 2022-01-19 01:20:40 +11:00
2af93312e1 fix minor syntax, and make sure checkdups waits for getfiledetails not run_ai_on, to avoid the ai job failing due to no ref images, and then withdrawing the checkdups and the ai job cannot create a duplicate 2022-01-18 22:11:39 +11:00
b327ddff7b optimise to not go past scan job if it does not find any new files, also now print out if we find new files into scan log, fix up first attempt at debug being off/on with "production" or not 2022-01-18 22:01:39 +11:00
4a1fbf3f44 debug off for prod, on for rest by default 2022-01-18 21:01:47 +11:00
de81db9412 unmatched faces now sorts size of face desc, and is slightly prettier -- still slow and only takes you to the file anyway, might optimise that later. still no code to auto deal with unmatched face, but will add some capabilities next. Also, remembered last dir when file_ip/sp/bin. Also throw error if try to find unknown person - happened since I allowed the back/forward. 2022-01-18 20:59:39 +11:00
096d4f79cf scans now put AI back on by default, and optimise to only call path-level scans once per path, rather than once per dir in path 2022-01-16 12:51:25 +11:00
a3c75c699d fixed BUGs with deleting old files out of the recyle bin, when they were already deleted from the FS and added timeout debugs, still not 100% the scheduled jobs are working 2022-01-15 16:37:40 +11:00
bd7cae6037 fixed BUG-78 (deleted recursively too far - took out parent_dir), also deleting from the viewer page works with Delete key too. Removed debugs in viewer for fullscreen 2022-01-14 13:49:39 +11:00
10866c3147 scheduled jobs implemented, after X days in settings we scan import, storage paths, and check the Bin for old files and actually delete them from the file system 2022-01-13 13:27:55 +11:00
a67c20d72b new BUG (very minor), reordered TODOs and now have basic stale job handling - they are detected, and can be cancelled or restarted from GUI 2022-01-11 13:18:21 +11:00
33ce78cb17 fixed Bug-75, moving dir between paths now works 2022-01-09 18:35:37 +11:00
dc21d65dd7 Put new functionality in to allow choosing existing folder in move code - it goes back and forwards 7 days from the date of this file and finds matching files and uses those dirs, or just dirname matches for those dates and offers them up. Also improved Move code to reject dodgy paths 2022-01-09 12:20:29 +11:00
b1917855e2 code clean up, created CreateFSLocation() and refactored code to use it 2022-01-08 11:24:53 +11:00
665f45c03e working condensed / logical version of moving on Files system - works for multiple scenarios 2022-01-07 17:32:23 +11:00
ff41164eff over-thought version of new move, about to radically simplify, committing so I dont lost it just in case 2022-01-07 15:08:44 +11:00
2b0217184f optimise a move via GUI and any re-hashing, due to FS move, or Transform, etc. to update the last_hash_dt so we dont keep redoing the md5 hash as ctime > last_hash_dt, but there is no new content so no new last_hash_dt was being modified 2021-10-17 12:05:48 +11:00
0ac047f7d6 comments 2021-10-13 16:53:32 +11:00
8f4eb870bb use stat_mtime for gen hash (as moving a file does not change content) AND for fall-back date/time of importing a photo -- Fixes BUG-72 2021-10-10 21:12:52 +11:00
28a1e73c54 log cleanup 2021-10-10 12:16:06 +11:00
9f2165c04d reset sub dir path properly based on parents path. Also fixed bug-69 - FullPathOnFS() was wrong for first dir in a path 2021-10-02 14:48:50 +10:00
64466abde2 real fix for BUG-64, can now move a directory between import/storage too... Still have move button disabled on selecting a folder in GUI - to be fixed, then we can move 111 Working dir back to the import dir 2021-10-02 12:58:45 +10:00
3dafae334b remove last remnants of rotate instead of transform, updated rot* svgs to have arrow point in direction of actual rotation, AND, fixed bug where when we rotate an image that has already had an exif_transform on it, then we have to do that and then the requested rotation - fixes why sometimes we rotate say 180 when we intended a 90 rotate. Also, when we transform, recalc md5 as file has changed 2021-10-01 22:16:28 +10:00
592b283ceb remove debugs 2021-09-29 16:56:18 +10:00
23c8d16a5b fix BUG-64: can now move files into import or storage path 2021-09-26 21:14:08 +10:00
92e643f425 actually call RemoveDirFromDB when deleting a missing dir, I really screwed this - didnt test properly until now. Should all work finally 2021-09-25 13:13:35 +10:00
5abd01bb4d fix BUG-66: deleting files out from under and in general CleanUpDirInDB needs to use Entry not Dir 2021-09-25 12:11:13 +10:00
e9f37aa6a8 minor change to optim, if file hash is same but we have no thumb, then try to gen one anyway 2021-09-24 20:42:39 +10:00
012c2809f1 handle case where video is so black we fail to get a thumbnail 2021-09-24 20:05:49 +10:00
a44810a2f4 fix bug with parent_dir being set to an Entry, instead of leaving it being the Dir set earlier in func 2021-09-24 17:34:29 +10:00
13aab072db use full path for current_file I think its more meaningful, and also extra optimisation - if same md5 hash, dont redo thumbnail 2021-09-21 13:46:22 +10:00
9f90cdaaac fix up all the dumb bugs I introduced and clearly never tested when I tweaked the remove file/dir after if you move files on the FS out from under PA 2021-09-21 00:37:39 +10:00
3f21f3d1f5 fix not setting in progress when we should on 2 more jobs 2021-09-18 17:55:32 +10:00