Commit Graph

330 Commits

Author SHA1 Message Date
517069c709 use raw string for regex to make linter happy 2021-03-19 17:19:45 +11:00
df8f9c88de whitespace removed 2021-03-19 17:17:29 +11:00
de9cd7b4fb update 2021-03-18 19:08:41 +11:00
924058e18d made pa_job_manager use mythtv:mythtv, but had to hardcode PJM_* vars, I tried to pass them through docker-compose.yml 2021-03-18 19:08:30 +11:00
2cd55580a9 rewrote dups.html to now use newer model, where we will auto-delete those that match the regexp, and not show a per row view of these. Also removed extra / unneeded line when processing deleting files 2021-03-17 20:04:25 +11:00
08dc646371 first pass of using Duplicate class, rather than files doing all the dup work. The html still is shown preferreds, and does not know there are preferred files and preferred dirs yet 2021-03-15 20:36:10 +11:00
046c512e6b added comments 2021-03-14 14:33:22 +11:00
f88ef2542f updated dups.py to have a DupRow class to store the data in a way dot-notation works consistently in Duplicates class, also moved attributes into top of __init__ for consistency, but needed for DupRow to work (implies the attributes are not globally shared per DupRow, which would not work). Broke into a couple more functions for readability, and added back the first-pass duplicate row creation into AddDups -- that needs a better name too 2021-03-14 11:51:56 +11:00
8ff61dddfa trialing a new duplicate class to deal more consistently with the various types of duplicates -- mostly to enable "auto" deleting of duplicates in specific conditions, e.g. in both an import dir and storage dir - just delete dups from import dir 2021-03-13 12:36:16 +11:00
155068ab85 new duplicate processing thoughts 2021-03-08 19:37:50 +11:00
94c84a1907 new duplicate processing thoughts 2021-03-08 19:36:39 +11:00
0d0607e9c6 made help go via on mouse over instead of onclick 2021-03-06 17:26:28 +11:00
76aee3a10a okay fix_dups page now has functioning pagination, highlights regex matching "good" files as green, and just a file as yellow if we cant find the right one, so easily shows where to really pat attention. Has DBox based help page, and overall just a better UI/UX 2021-03-06 17:18:11 +11:00
b9dea327d0 use pagesize not page_size, and pass it in based on job extras, also use path based on job extras, so we fix issue of fix_dups not knowing which path from settings was used (import or storage) 2021-03-06 11:45:21 +11:00
f1ec7f9eb6 just make sure file size is the same as well as hash, this should make it nearly impossible for accidentally having 2 files with the same hash that are different 2021-03-06 11:18:11 +11:00
1dc8477758 first pass of paginated dups, with drop-down (non-functional), but otherwise pages work - presume if I clicked it to delete, it would, but then I would need to re-do check_dups OR optimise and get it to come back to dups with next page -- probably preferred -- BUT, need to keep job state between page loads? 2021-03-03 22:05:58 +11:00
e19e1b57f8 add extension so that break from loop works 2021-03-03 22:04:23 +11:00
8649edfe7c added page_size on reducing and hardcoded stich of prefix of dups (STILL needs fixing) 2021-03-03 22:03:55 +11:00
0c583aa868 finished containers, added new items on reducing dups per page and prefix of dups 2021-03-03 22:03:06 +11:00
df954e1e1a created wrapper.sh to also run pa_job_manager in paweb container, exposed port 55432, have not tested that the job manager is connectable and we prob. should not expose that port in the long run, but for another night 2021-03-03 20:33:51 +11:00
8074225a60 fixed Dockerfile and requirements.txt (for pip) so that pa.depaoli.id.au is now a working docker container on mara 2021-03-03 01:04:57 +11:00
ba8cca1bed todo to paginate dup processing 2021-03-02 22:45:39 +11:00
689081ef0b put summary counts on dups 2021-03-02 22:44:00 +11:00
42e00d0aea more TODOs 2021-03-02 22:43:19 +11:00
269009f14f fixed choosing dup dir alert 2021-03-01 19:13:38 +11:00
06eb1ef927 fixed BUG-27, duplicate count per same named files in 2 dirs, was always 1 2021-03-01 18:46:03 +11:00
564962097a count of files that are duplicates in 2 dirs is 1 every time, but looks wrong 2021-02-28 19:23:09 +11:00
b156040483 joblog todo when there are too many log lines 2021-02-28 19:17:22 +11:00
3fa6a83a1a had to set recursion limit higher to get code to work, also debugs 2021-02-28 19:16:59 +11:00
0d49511c6c file counts are wrong on import jobs and bug with duplicated displays 2021-02-28 19:16:30 +11:00
59accc2f82 TODO: next steps 2021-02-27 18:32:33 +11:00
477bd6f099 added code to split out storage_path and import_path, still a bit clunky, but functional. SymlinkName also now in shared 2021-02-27 18:30:54 +11:00
40dba847c1 moved SymlinkName into shared 2021-02-27 18:30:20 +11:00
fcb7b82306 several new TODOs 2021-02-27 18:29:56 +11:00
eedff768b8 new bug around file counts 2021-02-27 18:29:46 +11:00
93d7b6c4e7 remove storage content from repo, and its added to gitignore now too 2021-02-27 17:40:31 +11:00
3f8c6a3d55 added storage path 2021-02-27 17:39:51 +11:00
c7452ac70c making a storage dir 2021-02-27 17:39:19 +11:00
23188c5389 Merge branch 'master' of 192.168.0.2:photoassistant 2021-02-27 17:38:31 +11:00
b137e74abd updated TODO 2021-02-27 17:33:49 +11:00
Damien De Paoli
98207dfd9c added TODO for includes when not on internet 2021-02-27 10:58:45 +11:00
Damien De Paoli
4042fdef77 put explicit use of locahost:5432 for pg, and localhost:5000 for flask for lappy 2021-02-27 10:57:57 +11:00
Damien De Paoli
a82226b082 use DB_URL from shared 2021-02-27 10:57:27 +11:00
Damien De Paoli
f7d78c2257 also need flask 2021-02-27 00:22:02 +11:00
fe1c01e2f4 fixed issue where we cant do for loop over os.walk more than once, so now convert it to a list, and then go through that once to get overal_file_cnt, and then commit this to the job and Dir structure so that it is known on the joblog page, e.g. we get the progress bar on the first import once the os.walk is finished. Also cleaned the code to remove unnecessary string manipulation around symlink name in loop, it cant happen there. Finally updated TODO to remove this todo item (progress bar on first import) and a few other old TODOs, added new section on scanning storage_dir, the next big thing... 2021-02-22 18:24:34 +11:00
1320ecba20 fixed BUG-24, only appends per_path_dups if we have one to append 2021-02-22 18:22:18 +11:00
2482a2e829 fixed BUG-24, only appends per_path_dups if we have one to append 2021-02-22 17:26:32 +11:00
7fd6a2eddb fixed BUGs 22 and 23 - both relate to the HTML forms being different for the search and viewing data, so changing one when the other was set, did not pass the values through, e.g. search term not there when you change a viewing option, or after searching, it did not know the grouping options. Fixed from the search side by showing a label of what you are searching for and storing it statically in the viewing form. Sorted by jscript onSubmit func to take 5 viewing options and store the last value in hidden inputs in the search form 2021-02-21 15:40:47 +11:00
e13f44810d more bugs 2021-02-21 15:33:24 +11:00
33ad544354 removed extra stuff from rmdups job list view, to keep the job list useful 2021-02-17 21:52:58 +11:00