Commit Graph

48 Commits

Author SHA1 Message Date
eb0145467f fixed bugs 47, 48, 49 and reduced complexity of dup counting as well. Now removes dirs than become empty due to duplicate removals 2021-09-04 19:50:49 +10:00
ebeb085326 alter desc 2021-07-29 21:41:13 +10:00
bd28c0cf64 face_distance is a float 2021-07-28 21:35:12 +10:00
b7d346c206 model_used is now per file, not per face, implemented split of default_model to default_refimg_model and default_scan_model in settings, and default_refimg_model actualy works when creating refimgs in person.py. The model_used in face_file_link is based on default settings model and will scan with cnn if chosen and store that in DB as needed. Need viewer to allow changing per file / not just default for future scans 2021-07-27 17:14:03 +10:00
555ce70577 renamed AI_Model to AIModel for consistency, added it as a functioning drop-down select on settings page, added face_distance to db and code, put face_distance model_used into all classes ready for use 2021-07-25 15:13:39 +10:00
4f9e03f99e added ai model settings 2021-07-25 13:18:21 +10:00
08ef9ea224 added locan data to face 2021-07-17 16:35:40 +10:00
955df598ee remove encodings, add face, orig_w, orig_h, face_locn to refimg table AND remove DEV refimg data, it needs to be done in the UI now 2021-07-11 22:30:57 +10:00
ddc9b18e3e reference images now create thumb and face on first association, so have DB for that 2021-07-04 20:05:47 +10:00
518df7ee10 removed all remnants of FILE_REFIMG_LINK 2021-07-03 12:43:25 +10:00
61b7a3e457 updated DEV for Cams paths 2021-06-29 15:46:02 +10:00
31db4fcca1 added in DB tables for new face DB structures/links 2021-06-28 17:03:13 +10:00
886776f737 Made saved users be in the DB, not in dict in memory of workers in gunicorn - otherwise we had BUG-39, and also added input validation to username to stop ldap injection on login form 2021-06-26 16:46:26 +10:00
c8f82dbb6d move back to DEV settings, while we work on moving files for real 2021-06-22 19:51:11 +10:00
e29c0ae5af switched to prod settings 2021-06-18 01:05:39 +10:00
651e1250a4 added DEL_FILE 2021-06-08 21:13:41 +10:00
3898d1a943 remove unused path_prefix from DIR, its not in PATH 2021-05-22 17:48:34 +10:00
3237e3bf8f fixed up dup code to work with paths, added path_types throughout and updated TODO to be clear on what next 2021-04-17 17:43:42 +10:00
095b7c8333 Path in the DB is complete, still have hacks around displaying folders (hardcoded path name) 2021-04-11 15:35:01 +10:00
2e6b59a0ec added DB support for recycle bin 2021-04-02 15:09:49 +11:00
fa6be43c3a back to DEV for real deleting testing 2021-03-27 15:11:37 +11:00
f6ce155217 allow dev or prod defaults for settings table 2021-03-24 19:34:56 +11:00
1de74f8f51 added token settings data for testing so it has a storage path too 2021-03-21 10:29:51 +11:00
039b6fd805 value with hashes is large for job extra, so remove 1024 limit 2021-02-14 16:01:53 +11:00
e6bc751844 added storage_path to settings 2021-02-09 19:37:30 +11:00
15dd42f979 added fields to do sorting / grouping on file view 2021-01-30 15:39:31 +11:00
ac9bb7ee2e fixed BUG-17 (deleting files/dirs) - currently 0 BUGS :) 2021-01-25 13:40:53 +11:00
96b9a6b5ca fixed BUG-16 - Hash optimisation (last_hast_date is now in File not Dir), also converted a few .format() to f" 2021-01-25 12:08:08 +11:00
18b8a30140 Fixed BUG-11: we have changed to file_refimg_link table (from file_person_link), this means we now have some optimisations, and can definitely re-run AI jobs without crashing. Several optims could still be done - see TODO 2021-01-25 01:05:30 +11:00
56f19ff3b7 first pass/thoughts on faces per file in DB, mostyl commented out. Also put a poor hack in to allow AI jobs to re-run without error, its limited, need to really fix this properly 2021-01-24 00:16:58 +11:00
469745ce3b partial fix/optimisation for refimgs, only recalc if file is newer than when we build the refimg encoding 2021-01-23 21:21:29 +11:00
2e5811adf4 changed encoding to bytea 2021-01-22 18:42:07 +11:00
Cam
53d0f71b58 tables updated to reflect ai changes in pa_job_manager.py 2021-01-22 17:18:12 +11:00
dace66473e remove pa_job_manager table, its not needed 2021-01-21 00:57:32 +11:00
aaeb4a8ffe now have a last_hash_date 2021-01-20 21:48:13 +11:00
5644cd4952 changed all new_file to file and updated sql to be correct case 2021-01-20 20:03:08 +11:00
41c2af2cd2 removed fake job data, and pass* from jobs, moved last_import_date into Dir from settings 2021-01-20 16:35:35 +11:00
1c181668e8 small renames of id to eid, added num_files to DIR and removed comments 2021-01-19 23:32:47 +11:00
5eb967c77f added foreign key constraint for file type in ENTRY 2021-01-19 17:30:51 +11:00
5285bf66ab alternate database structure with entry, (new_)file, dir works in terms of DB and SQL alchemy, tomorrow we rewrite the jobs to really use the new structure 2021-01-18 21:40:46 +11:00
ab3eff4e62 starting on new DB structure, with a new branch, with thoughts in TODO, file_types in tables.sql 2021-01-18 13:19:25 +11:00
2b9dedb9b9 change how we calculate active jobs, probably will remove it from pa_job_engine, safer with threads I think. But, mostyle, added in client / server socket comms between web FE and job manager, with better job creation message (including link to job detail) and when you view job detail it auto-refreshes every few seconds until job complete) 2021-01-17 12:35:28 +11:00
f661cf0489 Fixed BUG-1 - timezone issues, by forcing alter database 2021-01-17 10:49:29 +11:00
e138ab22aa git commit, converted over to base.html pulling Status*, rather than every render_template calling it. Tightened up naming for job manager, fixed a few bugs in there with items like div by zero, created the active jobs link/badge in navbar, have it invoked each time by base.html template and it gets active jobs from DB, pa_job_manager now initiliases from an empty DB and can work out where it is at, no loop/thread/or actual job code yet. jobs.py has basics of a NewJob(), so next step is to force that job to be executed in pa_job_manager, but its tea time 2021-01-16 17:51:16 +11:00
34814236fc add pa_job_engine_id_seq 2021-01-15 16:57:27 +11:00
a8789e60fe first thoughts on pa_job_engine - to keep overall pa_job engine state, also a pa_job_state in each action also a wait_for so we can do basic handling of jobs and dependencies 2021-01-14 22:13:00 +11:00
348c9132f2 rename of files table to file, included settings defaults to make this work in DEV after rebuild of DB container 2021-01-14 21:57:53 +11:00
f7688badd1 created a tables.sql so program can run from a brand new docker / db 2021-01-14 21:46:12 +11:00