Commit Graph

86 Commits

Author SHA1 Message Date
886776f737 Made saved users be in the DB, not in dict in memory of workers in gunicorn - otherwise we had BUG-39, and also added input validation to username to stop ldap injection on login form 2021-06-26 16:46:26 +10:00
c8f82dbb6d move back to DEV settings, while we work on moving files for real 2021-06-22 19:51:11 +10:00
e29c0ae5af switched to prod settings 2021-06-18 01:05:39 +10:00
651e1250a4 added DEL_FILE 2021-06-08 21:13:41 +10:00
3898d1a943 remove unused path_prefix from DIR, its not in PATH 2021-05-22 17:48:34 +10:00
3237e3bf8f fixed up dup code to work with paths, added path_types throughout and updated TODO to be clear on what next 2021-04-17 17:43:42 +10:00
095b7c8333 Path in the DB is complete, still have hacks around displaying folders (hardcoded path name) 2021-04-11 15:35:01 +10:00
2e6b59a0ec added DB support for recycle bin 2021-04-02 15:09:49 +11:00
fa6be43c3a back to DEV for real deleting testing 2021-03-27 15:11:37 +11:00
f6ce155217 allow dev or prod defaults for settings table 2021-03-24 19:34:56 +11:00
1de74f8f51 added token settings data for testing so it has a storage path too 2021-03-21 10:29:51 +11:00
039b6fd805 value with hashes is large for job extra, so remove 1024 limit 2021-02-14 16:01:53 +11:00
e6bc751844 added storage_path to settings 2021-02-09 19:37:30 +11:00
15dd42f979 added fields to do sorting / grouping on file view 2021-01-30 15:39:31 +11:00
ac9bb7ee2e fixed BUG-17 (deleting files/dirs) - currently 0 BUGS :) 2021-01-25 13:40:53 +11:00
96b9a6b5ca fixed BUG-16 - Hash optimisation (last_hast_date is now in File not Dir), also converted a few .format() to f" 2021-01-25 12:08:08 +11:00
18b8a30140 Fixed BUG-11: we have changed to file_refimg_link table (from file_person_link), this means we now have some optimisations, and can definitely re-run AI jobs without crashing. Several optims could still be done - see TODO 2021-01-25 01:05:30 +11:00
56f19ff3b7 first pass/thoughts on faces per file in DB, mostyl commented out. Also put a poor hack in to allow AI jobs to re-run without error, its limited, need to really fix this properly 2021-01-24 00:16:58 +11:00
469745ce3b partial fix/optimisation for refimgs, only recalc if file is newer than when we build the refimg encoding 2021-01-23 21:21:29 +11:00
2e5811adf4 changed encoding to bytea 2021-01-22 18:42:07 +11:00
Cam
53d0f71b58 tables updated to reflect ai changes in pa_job_manager.py 2021-01-22 17:18:12 +11:00
dace66473e remove pa_job_manager table, its not needed 2021-01-21 00:57:32 +11:00
aaeb4a8ffe now have a last_hash_date 2021-01-20 21:48:13 +11:00
5644cd4952 changed all new_file to file and updated sql to be correct case 2021-01-20 20:03:08 +11:00
41c2af2cd2 removed fake job data, and pass* from jobs, moved last_import_date into Dir from settings 2021-01-20 16:35:35 +11:00
1c181668e8 small renames of id to eid, added num_files to DIR and removed comments 2021-01-19 23:32:47 +11:00
5eb967c77f added foreign key constraint for file type in ENTRY 2021-01-19 17:30:51 +11:00
5285bf66ab alternate database structure with entry, (new_)file, dir works in terms of DB and SQL alchemy, tomorrow we rewrite the jobs to really use the new structure 2021-01-18 21:40:46 +11:00
ab3eff4e62 starting on new DB structure, with a new branch, with thoughts in TODO, file_types in tables.sql 2021-01-18 13:19:25 +11:00
2b9dedb9b9 change how we calculate active jobs, probably will remove it from pa_job_engine, safer with threads I think. But, mostyle, added in client / server socket comms between web FE and job manager, with better job creation message (including link to job detail) and when you view job detail it auto-refreshes every few seconds until job complete) 2021-01-17 12:35:28 +11:00
f661cf0489 Fixed BUG-1 - timezone issues, by forcing alter database 2021-01-17 10:49:29 +11:00
e138ab22aa git commit, converted over to base.html pulling Status*, rather than every render_template calling it. Tightened up naming for job manager, fixed a few bugs in there with items like div by zero, created the active jobs link/badge in navbar, have it invoked each time by base.html template and it gets active jobs from DB, pa_job_manager now initiliases from an empty DB and can work out where it is at, no loop/thread/or actual job code yet. jobs.py has basics of a NewJob(), so next step is to force that job to be executed in pa_job_manager, but its tea time 2021-01-16 17:51:16 +11:00
34814236fc add pa_job_engine_id_seq 2021-01-15 16:57:27 +11:00
a8789e60fe first thoughts on pa_job_engine - to keep overall pa_job engine state, also a pa_job_state in each action also a wait_for so we can do basic handling of jobs and dependencies 2021-01-14 22:13:00 +11:00
348c9132f2 rename of files table to file, included settings defaults to make this work in DEV after rebuild of DB container 2021-01-14 21:57:53 +11:00
f7688badd1 created a tables.sql so program can run from a brand new docker / db 2021-01-14 21:46:12 +11:00