## GENERAL
    * doing actual file deletes needed again 
    * SymlinkName - use it from shared everywhere, never do path_prefix by hand use this function
    * AddJobForLog can absorb DEBUGs, etc.  in fact fix up logging in general
    * comment your code
    * do we need to make some funcs/code into OO?
    * scan_sp needs to be in scannow
    * need a way for page to show we are in import_path or storage_path
    * storage_path viewing needs to be by folder / not a big grab bag of files (by default)

## DB	
    Need to think about...
        file (image) -> has X faces, Y matches
            X == Y (optim: dont scan again)
            say X-Y == 1, then to optimise, we need to only check the missing
            face... at the moment, the DB structure is not that clever...
            (file_refimg_link --> file_refimg_link needs a face_num?)

### BACKEND
    scan storage/import dir:
        ignore *thumb*

    deal with duplicates differently, and process in this order:
        1) DONE GUI: any duplicate from inside import dir -> storage dir => delete all import dir duplicate files
        2) DONE GUI: any duplicate from inside storage dir -> storage dir => 
            if regex match yyyy/yyyymmdd in a set of files and no other regex match -> keep regex files & delete others
            if regex match yyyy/yyyymmdd in a set of files and other regex matches -> present to user to choose
            if no regex match yyyy/yyyymmdd in a set of files -> present to user to choose
            if regex match yyyy/yyyymmdd in a dir of files and no other regex match -> keep regex dir files & delete others
            all other dir sets -> present to user to choose
        3) DONE GUI: any duplicate from inside import dir -> import dir == Do as we do now
        NOTING that deleting files as per above, should be just presented as we are auto-deleting these X files for this condition -> click confirm

    -- started on some basic optimisations (commit logs every 100 logs, not each log)
        - with debugs: import = 04:11, getfiledetails== 0:35:35
        - without debugs: import == 04:03, getfiledetails == 0:35:36 -- not a sig diff
        - with exifread & debug: import == 04:26

    *** Need to use thread-safe sessions per Thread, half-assed version did not work

    need a manual button to restart a job in the GUI, 
        (based on file-level optims, just run the job as new and it will optim over already done parts and continue)

    Future:
        Admin
            -> reset face_flag

        AI
            -> rescan <dir> for <person> --> can do this on new image only
            (optimised to only scan has_unidentified_face)... BUT if you change
            thresholds on AI, or we get a new/better one some day, then it can
            all images with faces, or if we 'reset face_flag' rescan all images

        Admin
            -> delete old jobs / auto delete jobs older than ???

### UI
    paginate duplicate fixing as its too much at once
    
    job management:
        joblog needs to show only say 25 log lines (last?) by default and allow see start/end, page by page, and search
        clear all jobs (via GUI)
        clear old jobs? (via b/end?)
        clear FE messages (at least dup ones on File data deletion) -- in backend
	need to copy into here the jquery/fa files so we don't need internet to function

    sorter... 
        need some way to multiselect images [DONE]
        and then get them into a new "folder" 
            - this needs to 'move' the files / database info from import path to new storage path -- so if we do face rec. we don't need to redo it :)


        timelineview? (I think maybe sunburst for large amounts of files, then maybe something more timeline-series for drilling in?)
            (vertical timeline, date has thumbnails (small) horizontally along
            a page, etc.?
        https://www.highcharts.com/docs/chart-and-series-types/timeline-series
        https://www.highcharts.com/demo/sunburst
        https://www.highcharts.com/demo/heatmap
        https://www.highcharts.com/demo/packed-bubble-split

### AI
    * allow for threshold/settings to be tweaked from the GUI
        - it would be good to then say, just run the scanner against this image or maybe this DIR, to see how it IDs ppl


### SORTER
	* exif processing?
		* location stuff - test a new photo from my camera out
        -- image is in dir, need to look at exifread output