Commit Graph

314 Commits

Author SHA1 Message Date
e19e1b57f8 add extension so that break from loop works 2021-03-03 22:04:23 +11:00
8649edfe7c added page_size on reducing and hardcoded stich of prefix of dups (STILL needs fixing) 2021-03-03 22:03:55 +11:00
0c583aa868 finished containers, added new items on reducing dups per page and prefix of dups 2021-03-03 22:03:06 +11:00
df954e1e1a created wrapper.sh to also run pa_job_manager in paweb container, exposed port 55432, have not tested that the job manager is connectable and we prob. should not expose that port in the long run, but for another night 2021-03-03 20:33:51 +11:00
8074225a60 fixed Dockerfile and requirements.txt (for pip) so that pa.depaoli.id.au is now a working docker container on mara 2021-03-03 01:04:57 +11:00
ba8cca1bed todo to paginate dup processing 2021-03-02 22:45:39 +11:00
689081ef0b put summary counts on dups 2021-03-02 22:44:00 +11:00
42e00d0aea more TODOs 2021-03-02 22:43:19 +11:00
269009f14f fixed choosing dup dir alert 2021-03-01 19:13:38 +11:00
06eb1ef927 fixed BUG-27, duplicate count per same named files in 2 dirs, was always 1 2021-03-01 18:46:03 +11:00
564962097a count of files that are duplicates in 2 dirs is 1 every time, but looks wrong 2021-02-28 19:23:09 +11:00
b156040483 joblog todo when there are too many log lines 2021-02-28 19:17:22 +11:00
3fa6a83a1a had to set recursion limit higher to get code to work, also debugs 2021-02-28 19:16:59 +11:00
0d49511c6c file counts are wrong on import jobs and bug with duplicated displays 2021-02-28 19:16:30 +11:00
59accc2f82 TODO: next steps 2021-02-27 18:32:33 +11:00
477bd6f099 added code to split out storage_path and import_path, still a bit clunky, but functional. SymlinkName also now in shared 2021-02-27 18:30:54 +11:00
40dba847c1 moved SymlinkName into shared 2021-02-27 18:30:20 +11:00
fcb7b82306 several new TODOs 2021-02-27 18:29:56 +11:00
eedff768b8 new bug around file counts 2021-02-27 18:29:46 +11:00
93d7b6c4e7 remove storage content from repo, and its added to gitignore now too 2021-02-27 17:40:31 +11:00
3f8c6a3d55 added storage path 2021-02-27 17:39:51 +11:00
c7452ac70c making a storage dir 2021-02-27 17:39:19 +11:00
23188c5389 Merge branch 'master' of 192.168.0.2:photoassistant 2021-02-27 17:38:31 +11:00
b137e74abd updated TODO 2021-02-27 17:33:49 +11:00
Damien De Paoli
98207dfd9c added TODO for includes when not on internet 2021-02-27 10:58:45 +11:00
Damien De Paoli
4042fdef77 put explicit use of locahost:5432 for pg, and localhost:5000 for flask for lappy 2021-02-27 10:57:57 +11:00
Damien De Paoli
a82226b082 use DB_URL from shared 2021-02-27 10:57:27 +11:00
Damien De Paoli
f7d78c2257 also need flask 2021-02-27 00:22:02 +11:00
fe1c01e2f4 fixed issue where we cant do for loop over os.walk more than once, so now convert it to a list, and then go through that once to get overal_file_cnt, and then commit this to the job and Dir structure so that it is known on the joblog page, e.g. we get the progress bar on the first import once the os.walk is finished. Also cleaned the code to remove unnecessary string manipulation around symlink name in loop, it cant happen there. Finally updated TODO to remove this todo item (progress bar on first import) and a few other old TODOs, added new section on scanning storage_dir, the next big thing... 2021-02-22 18:24:34 +11:00
1320ecba20 fixed BUG-24, only appends per_path_dups if we have one to append 2021-02-22 18:22:18 +11:00
2482a2e829 fixed BUG-24, only appends per_path_dups if we have one to append 2021-02-22 17:26:32 +11:00
7fd6a2eddb fixed BUGs 22 and 23 - both relate to the HTML forms being different for the search and viewing data, so changing one when the other was set, did not pass the values through, e.g. search term not there when you change a viewing option, or after searching, it did not know the grouping options. Fixed from the search side by showing a label of what you are searching for and storing it statically in the viewing form. Sorted by jscript onSubmit func to take 5 viewing options and store the last value in hidden inputs in the search form 2021-02-21 15:40:47 +11:00
e13f44810d more bugs 2021-02-21 15:33:24 +11:00
33ad544354 removed extra stuff from rmdups job list view, to keep the job list useful 2021-02-17 21:52:58 +11:00
26c2ef717c cleaned up some debugs, added logs and finally committed code that does its best to make sure the os.remove(file) matches the duplicate detected, and it now actually does the file remove 2021-02-17 21:46:29 +11:00
6ef383f732 update status message to link to job created for del dup files 2021-02-17 21:42:59 +11:00
03ddbb1c90 display logs ordered by log_date 2021-02-17 21:35:53 +11:00
9e84236f49 moved to storing DB ids rather than names of files/dirs for deletions 2021-02-14 16:20:48 +11:00
7fa0d3e02b fixed primary key bug with PA_JobManager_FE_Message, made Message return id, so it can be used in link to rm_dups, added in code to have rm_dups as a job, it does everthing but the actual deletes now, but the data is ready to be used 2021-02-14 16:20:17 +11:00
0bfd3b58b3 moved to storing DB ids rather than names of files/dirs for deletions 2021-02-14 16:18:22 +11:00
d9a94ff5da allow NewJob to have job extras added 2021-02-14 16:02:41 +11:00
09d56c5cc5 added comments, also remove url_for on request.endpoint, was breaking when needing a param to be passed 2021-02-14 16:02:20 +11:00
039b6fd805 value with hashes is large for job extra, so remove 1024 limit 2021-02-14 16:01:53 +11:00
27e881ea8c minor clean up on headings, alerts at top of /fix_dups route 2021-02-13 20:30:21 +11:00
49e0a5a797 now have a partial fix_dups path, it shows the content in a much more reasonable manner, and allows the GUI to select the files/paths to keep, HOWEVER, the form POST is not enabled, and I still need to process the form data -- right now, now sure how I know which files to delete vs keep -> will need hidden vars of options, not just the to_keep - then process them 2021-02-13 20:21:26 +11:00
7014eb0f35 now have a partial fix_dups path, it shows the content in a much more reasonable manner, and allows the GUI to select the files/paths to keep, HOWEVER, the form POST is not enabled, and I still need to process the form data -- right now, now sure how I know which files to delete vs keep -> will need hidden vars of options, not just the to_keep - then process them 2021-02-13 20:21:08 +11:00
0fe5d97317 fix missing self. in prints of Settings __repr__ 2021-02-13 20:19:14 +11:00
236beb70d8 minor formatting fix 2021-02-13 20:18:55 +11:00
1499f2ca61 fixed BUG-21: file stucture broken after rescan, and beginnings of new job for checking for duplicate files, and having the back-end job indicate to the front-end that there are duplicates, and the basic route is in the f/e, but not built yet 2021-02-11 20:09:24 +11:00
2d88403756 new BUG-21: second pass, the file structures in the DB are broken 2021-02-11 20:07:15 +11:00