ddp/photoassistant
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Huge change, removed Status class and all "alert" messages are now shown as BS toast() and are via the DB and handled async in the F/E in jscript via Ajax. Fixed BUG-113 where toasts() were repeating. Removed many of the explicit alert messages (other than errors) and hooked {New|Finish}Job to consistently send messages to the F/E. Other messages (F/E without a job, like save settings) now use this model as well. Finally converted most of the older POST responses to formal json

Browse Source
This commit is contained in:
Damien De Paoli
2023-01-11 13:50:05 +11:00
parent 2be2c504b2
commit a29cbb143c
15 changed files with 162 additions and 217 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
BUGs
View File

@@ -1,4 +1,4 @@
### Next: 113 ### Next: 114
BUG-100: I managed to get 2 photos matching mich in the NOT_WORKING photo (probably dif refimgs but same p.tag?) BUG-100: I managed to get 2 photos matching mich in the NOT_WORKING photo (probably dif refimgs but same p.tag?)
= /photos/2012/20120414-damien/IMG_8467.JPG = /photos/2012/20120414-damien/IMG_8467.JPG
BUG-106: cant add trudy /pat? as refimgs via FaceDBox BUG-106: cant add trudy /pat? as refimgs via FaceDBox
@@ -6,4 +6,3 @@ BUG-106: cant add trudy /pat? as refimgs via FaceDBox
(it came from a face bbox, BUT, I have grown the face seln by 10%?) (it came from a face bbox, BUT, I have grown the face seln by 10%?)
BUG-109: add mich force override, removed it, then re-added it, then rebuild DB form scratch and metadata has a duplicate BUG-109: add mich force override, removed it, then re-added it, then rebuild DB form scratch and metadata has a duplicate
- redo disco metadata with md5 not UUID of face dataS - redo disco metadata with md5 not UUID of face dataS
BUG-113: with a stale job, we keep checking each 1 second, and so we keep creating new status messages

11
TODO
View File

@@ -1,19 +1,14 @@
### GENERAL ### GENERAL
* get all status messages to use toasts AND get func to also increase/descrease the job counter as appropriate)
- [DONE] all (success/creation) status messages use toasts
-- [TODO] ensure all pa_job_mgr jobs are sending messages back to the FE -- SHOULD??? I just hook FinishJob???
* should be using jsonify to return real json to my API calls, e.g: * should be using jsonify to return real json to my API calls, e.g:
use make_response( jsonify (... ) ) use make_response( jsonify (... ) )
-- [TODO] all POSTs should follow new status behaviour (unless its a form POST, as that immediately renders the form in flask and will show the Status) -- [TODO] all POSTs should follow new status behaviour (unless its a form POST, as that immediately renders the form in flask and will show the Status)
all GETs stay as is for now (as they expect a html reply, not data, and then html is base.html+ and it handles the status) all GETs stay as is for now (as they expect a html reply, not data, and then html is base.html+ and it handles the status)
-- ONLY time this will fail is multiple status messages (which can occur I believe if a Wake of job mgr and then a job is created in DB, the success will only be shown) -- [TODO] find persons needs an array returned - test this, also viewlist
-- [TODO] simple fix will be to get 'hidden' jobs (wake job_mgr and maybe? metadata) to post failure events to the JobMgr_FE DB queue
-- [TODO] -- change class Status to class UILog
-- [TODO] -- change alert to level
* delete files should behave like /move_files (stay on same page) as well as the status messages above * delete files should behave like /move_files (stay on same page) as well as the status messages above
* all routes should be consistent naming conventions (with or without _ )
* change the rotation code to use that jpeg util to reduce/remove compression loss? * change the rotation code to use that jpeg util to reduce/remove compression loss?
* ignore face should ignore ALL matching faces (re: Declan) * ignore face should ignore ALL matching faces (re: Declan)

10
ai.py
View File

@@ -4,7 +4,6 @@ from flask import request, render_template, redirect
from main import db, app, ma from main import db, app, ma
from sqlalchemy import Sequence from sqlalchemy import Sequence
from sqlalchemy.exc import SQLAlchemyError from sqlalchemy.exc import SQLAlchemyError
from status import st, Status
from path import Path, PathType from path import Path, PathType
from files import Entry, Dir, File, PathDirLink from files import Entry, Dir, File, PathDirLink
from person import Refimg, Person, PersonRefimgLink from person import Refimg, Person, PersonRefimgLink
@@ -52,8 +51,7 @@ def run_ai_on():
jex=[] jex=[]
for el in request.form: for el in request.form:
jex.append( JobExtra( name=f"{el}", value=request.form[el] ) ) jex.append( JobExtra( name=f"{el}", value=request.form[el] ) )
job=NewJob( "run_ai_on", 0, None, jex ) job=NewJob( "run_ai_on", num_files=0, wait_for=None, jex=jex, desc="Look for face(s) in selected file(s)" )
st.SetMessage( f"Created&nbsp;<a href=/job/{job.id}>Job #{job.id}</a>&nbsp;to Look for face(s) in selected file(s)")
return redirect("/jobs") return redirect("/jobs")
@app.route("/run_ai_on_import", methods=["GET"]) @app.route("/run_ai_on_import", methods=["GET"])
@@ -64,8 +62,7 @@ def run_ai_on_import():
ptype=PathType.query.filter(PathType.name=='Import').first() ptype=PathType.query.filter(PathType.name=='Import').first()
jex.append( JobExtra( name=f"person", value="all" ) ) jex.append( JobExtra( name=f"person", value="all" ) )
jex.append( JobExtra( name=f"path_type", value=ptype.id ) ) jex.append( JobExtra( name=f"path_type", value=ptype.id ) )
job=NewJob( "run_ai_on_path", 0, None, jex ) job=NewJob( "run_ai_on_path", num_files=0, wait_for=None, jex=jex, desc="Look for face(s) in import path(s)")
st.SetMessage( f"Created&nbsp;<a href=/job/{job.id}>Job #{job.id}</a>&nbsp;to Look for face(s) in import path(s)")
return redirect("/jobs") return redirect("/jobs")
@app.route("/run_ai_on_storage", methods=["GET"]) @app.route("/run_ai_on_storage", methods=["GET"])
@@ -75,8 +72,7 @@ def run_ai_on_storage():
ptype=PathType.query.filter(PathType.name=='Storage').first() ptype=PathType.query.filter(PathType.name=='Storage').first()
jex.append( JobExtra( name=f"person", value="all" ) ) jex.append( JobExtra( name=f"person", value="all" ) )
jex.append( JobExtra( name=f"path_type", value=ptype.id ) ) jex.append( JobExtra( name=f"path_type", value=ptype.id ) )
job=NewJob( "run_ai_on_path", 0, None, jex ) job=NewJob( "run_ai_on_path", num_files=0, wait_for=None, jex=jex, desc="Look for face(s) in storage path(s)")
st.SetMessage( f"Created&nbsp;<a href=/job/{job.id}>Job #{job.id}</a>&nbsp;to Look for face(s) in storage path(s)")
return redirect("/jobs") return redirect("/jobs")
@app.route("/unmatched_faces", methods=["GET"]) @app.route("/unmatched_faces", methods=["GET"])

2
dups.py
View File

@@ -4,7 +4,6 @@ from flask import request, render_template, send_from_directory
from main import db, app, ma from main import db, app, ma
from sqlalchemy import Sequence from sqlalchemy import Sequence
from sqlalchemy.exc import SQLAlchemyError from sqlalchemy.exc import SQLAlchemyError
from status import st, Status
import os import os
import glob import glob
from PIL import Image from PIL import Image
@@ -20,7 +19,6 @@ import re
################################################################################ ################################################################################
# Local Class imports # Local Class imports
################################################################################ ################################################################################
from job import Job, JobExtra, Joblog, NewJob
from settings import Settings from settings import Settings
from shared import SymlinkName, PA from shared import SymlinkName, PA
from path import PathType from path import PathType

55
files.py
View File

@@ -4,7 +4,6 @@ from flask import request, render_template, redirect, send_from_directory, url_f
from main import db, app, ma from main import db, app, ma
from sqlalchemy import Sequence from sqlalchemy import Sequence
from sqlalchemy.exc import SQLAlchemyError from sqlalchemy.exc import SQLAlchemyError
from status import st, Status
import os import os
import glob import glob
from PIL import Image from PIL import Image
@@ -24,7 +23,7 @@ from states import States, PA_UserState
################################################################################ ################################################################################
# Local Class imports # Local Class imports
################################################################################ ################################################################################
from job import Job, JobExtra, Joblog, NewJob from job import Job, JobExtra, Joblog, NewJob, SetFELog
from path import PathType, Path, MovePathDetails from path import PathType, Path, MovePathDetails
from person import Refimg, Person, PersonRefimgLink from person import Refimg, Person, PersonRefimgLink
from settings import Settings, SettingsIPath, SettingsSPath, SettingsRBPath from settings import Settings, SettingsIPath, SettingsSPath, SettingsRBPath
@@ -463,13 +462,12 @@ def search(search_term):
return render_template("files.html", page_title='View Files', search_term=search_term, entry_data=entries, OPT=OPT, move_paths=move_paths ) return render_template("files.html", page_title='View Files', search_term=search_term, entry_data=entries, OPT=OPT, move_paths=move_paths )
################################################################################ ################################################################################
# /files/scannow -> allows us to force a check for new files # /files/scan_ip -> allows us to force a check for new files
################################################################################ ################################################################################
@app.route("/files/scannow", methods=["GET"]) @app.route("/files/scan_ip", methods=["GET"])
@login_required @login_required
def scannow(): def scan_ip():
job=NewJob("scannow" ) job=NewJob( name="scan_ip", num_files=0, wait_for=None, jex=None, desc="scan for new files in import path" )
st.SetMessage("scanning for new files in:&nbsp;<a href=/job/{}>Job #{}</a>&nbsp;(Click the link to follow progress)".format( job.id, job.id) )
return redirect("/jobs") return redirect("/jobs")
################################################################################ ################################################################################
@@ -478,8 +476,7 @@ def scannow():
@app.route("/files/forcescan", methods=["GET"]) @app.route("/files/forcescan", methods=["GET"])
@login_required @login_required
def forcescan(): def forcescan():
job=NewJob("forcescan" ) job=NewJob( name="forcescan", num_files=0, wait_for=None, jex=None, desc="remove data and rescan import & storage paths" )
st.SetMessage("force scan & rebuild data for files in:&nbsp;<a href=/job/{}>Job #{}</a>&nbsp;(Click the link to follow progress)".format( job.id, job.id) )
return redirect("/jobs") return redirect("/jobs")
################################################################################ ################################################################################
@@ -488,8 +485,7 @@ def forcescan():
@app.route("/files/scan_sp", methods=["GET"]) @app.route("/files/scan_sp", methods=["GET"])
@login_required @login_required
def scan_sp(): def scan_sp():
job=NewJob("scan_sp" ) job=NewJob( name="scan_sp", num_files=0, wait_for=None, jex=None, desc="scan for new files in storage path" )
st.SetMessage("scanning for new files in:&nbsp;<a href=/job/{}>Job #{}</a>&nbsp;(Click the link to follow progress)".format( job.id, job.id) )
return redirect("/jobs") return redirect("/jobs")
@@ -504,7 +500,7 @@ def fix_dups():
rows = db.engine.execute( "select e1.id as id1, f1.hash, d1.rel_path as rel_path1, d1.eid as did1, e1.name as fname1, p1.id as path1, p1.type_id as path_type1, e2.id as id2, d2.rel_path as rel_path2, d2.eid as did2, e2.name as fname2, p2.id as path2, p2.type_id as path_type2 from entry e1, file f1, dir d1, entry_dir_link edl1, path_dir_link pdl1, path p1, entry e2, file f2, dir d2, entry_dir_link edl2, path_dir_link pdl2, path p2 where e1.id = f1.eid and e2.id = f2.eid and d1.eid = edl1.dir_eid and edl1.entry_id = e1.id and edl2.dir_eid = d2.eid and edl2.entry_id = e2.id and p1.type_id != (select id from path_type where name = 'Bin') and p1.id = pdl1.path_id and pdl1.dir_eid = d1.eid and p2.type_id != (select id from path_type where name = 'Bin') and p2.id = pdl2.path_id and pdl2.dir_eid = d2.eid and f1.hash = f2.hash and e1.id != e2.id and f1.size_mb = f2.size_mb order by path1, rel_path1, fname1"); rows = db.engine.execute( "select e1.id as id1, f1.hash, d1.rel_path as rel_path1, d1.eid as did1, e1.name as fname1, p1.id as path1, p1.type_id as path_type1, e2.id as id2, d2.rel_path as rel_path2, d2.eid as did2, e2.name as fname2, p2.id as path2, p2.type_id as path_type2 from entry e1, file f1, dir d1, entry_dir_link edl1, path_dir_link pdl1, path p1, entry e2, file f2, dir d2, entry_dir_link edl2, path_dir_link pdl2, path p2 where e1.id = f1.eid and e2.id = f2.eid and d1.eid = edl1.dir_eid and edl1.entry_id = e1.id and edl2.dir_eid = d2.eid and edl2.entry_id = e2.id and p1.type_id != (select id from path_type where name = 'Bin') and p1.id = pdl1.path_id and pdl1.dir_eid = d1.eid and p2.type_id != (select id from path_type where name = 'Bin') and p2.id = pdl2.path_id and pdl2.dir_eid = d2.eid and f1.hash = f2.hash and e1.id != e2.id and f1.size_mb = f2.size_mb order by path1, rel_path1, fname1");
if rows.returns_rows == False: if rows.returns_rows == False:
st.SetMessage(f"Err, no dups - should now clear the FE 'danger' message?") SetFELog(f"Err, no dups - should now clear the FE 'danger' message?", "warning")
return redirect("/") return redirect("/")
if 'pagesize' not in request.form: if 'pagesize' not in request.form:
@@ -546,8 +542,7 @@ def rm_dups():
jex.append( JobExtra( name="pagesize", value=10 ) ) jex.append( JobExtra( name="pagesize", value=10 ) )
job=NewJob( "rmdups", 0, None, jex ) job=NewJob( name="rmdups", num_files=0, wait_for=None, jex=jex, desc="to delete duplicate files" )
st.SetMessage( f"Created&nbsp;<a href=/job/{job.id}>Job #{job.id}</a>&nbsp;to delete duplicate files")
return redirect("/jobs") return redirect("/jobs")
@@ -561,8 +556,7 @@ def restore_files():
for el in request.form: for el in request.form:
jex.append( JobExtra( name=f"{el}", value=request.form[el] ) ) jex.append( JobExtra( name=f"{el}", value=request.form[el] ) )
job=NewJob( "restore_files", 0, None, jex ) job=NewJob( name="restore_files", num_files=0, wait_for=None, jex=jex, desc="to restore selected file(s)" )
st.SetMessage( f"Created&nbsp;<a href=/job/{job.id}>Job #{job.id}</a>&nbsp;to restore selected file(s)")
return redirect("/jobs") return redirect("/jobs")
################################################################################ ################################################################################
@@ -575,8 +569,7 @@ def delete_files():
for el in request.form: for el in request.form:
jex.append( JobExtra( name=f"{el}", value=request.form[el] ) ) jex.append( JobExtra( name=f"{el}", value=request.form[el] ) )
job=NewJob( "delete_files", 0, None, jex ) job=NewJob( name="delete_files", num_files=0, wait_for=None, jex=jex, desc="to delete selected file(s)" )
st.SetMessage( f"Created&nbsp;<a href=/job/{job.id}>Job #{job.id}</a>&nbsp;to delete selected file(s)")
return redirect("/jobs") return redirect("/jobs")
################################################################################ ################################################################################
@@ -589,11 +582,9 @@ def move_files():
jex=[] jex=[]
for el in request.form: for el in request.form:
jex.append( JobExtra( name=f"{el}", value=request.form[el] ) ) jex.append( JobExtra( name=f"{el}", value=request.form[el] ) )
job=NewJob( "move_files", 0, None, jex ) job=NewJob( name="move_files", num_files=0, wait_for=None, jex=jex, desc="to move selected file(s)" )
return make_response( jsonify( # data is not used, but send response to trigger CheckForJobs()
job_id=job.id, return make_response( jsonify( job_id=job.id ) )
message=f"Created&nbsp;<a class='link-light' href=/job/{job.id}>Job #{job.id}</a>&nbsp;to move selected file(s)",
level="success", alert="success", persistent=False, cant_close=False ) )
@login_required @login_required
@app.route("/viewlist", methods=["POST"]) @app.route("/viewlist", methods=["POST"])
@@ -700,7 +691,7 @@ def view(id):
msg += "Clearing out all states. This means browser back buttons will not work, please start a new tab and try again" msg += "Clearing out all states. This means browser back buttons will not work, please start a new tab and try again"
PA_UserState.query.delete() PA_UserState.query.delete()
db.session.commit() db.session.commit()
st.SetMessage( msg, "warning" ) SetFELog( msg, "warning" )
return redirect("/") return redirect("/")
else: else:
NMO_data = FaceOverrideType.query.all() NMO_data = FaceOverrideType.query.all()
@@ -735,12 +726,8 @@ def transform():
for el in request.form: for el in request.form:
jex.append( JobExtra( name=f"{el}", value=request.form[el] ) ) jex.append( JobExtra( name=f"{el}", value=request.form[el] ) )
job=NewJob( "transform_image", 0, None, jex ) job=NewJob( name="transform_image", num_files=0, wait_for=None, jex=jex, desc="to transform selected file(s)" )
return make_response( jsonify( job_id=job.id ) )
resp={}
resp['job_id']=job.id
return resp
################################################################################ ################################################################################
# /checktransformjob -> URL that is called repeatedly by front-end waiting for the # /checktransformjob -> URL that is called repeatedly by front-end waiting for the
@@ -753,14 +740,12 @@ def transform():
def checktransformjob(): def checktransformjob():
job_id = request.form['job_id'] job_id = request.form['job_id']
job = Job.query.get(job_id) job = Job.query.get(job_id)
resp={} j=jsonify( finished=False )
resp['finished']=False
if job.pa_job_state == 'Completed': if job.pa_job_state == 'Completed':
id=[jex.value for jex in job.extra if jex.name == "id"][0] id=[jex.value for jex in job.extra if jex.name == "id"][0]
e=Entry.query.join(File).filter(Entry.id==id).first() e=Entry.query.join(File).filter(Entry.id==id).first()
resp['thumbnail']=e.file_details.thumbnail j=jsonify( finished=True, thumbnail=e.file_details.thumbnail )
resp['finished']=True return make_response( j )
return resp
################################################################################ ################################################################################
# /include -> return contents on /include and does not need a login, so we # /include -> return contents on /include and does not need a login, so we

2
internal/js/files_support.js
View File

@@ -64,7 +64,7 @@ function MoveSubmit()
// reorder the images via ecnt again, so highlighting can work // reorder the images via ecnt again, so highlighting can work
document.mf_id=0; $('.figure').each( function() { $(this).attr('ecnt', document.mf_id ); document.mf_id++ } ) document.mf_id=0; $('.figure').each( function() { $(this).attr('ecnt', document.mf_id ); document.mf_id++ } )
$('#dbox').modal('hide') $('#dbox').modal('hide')
$.ajax({ type: 'POST', data: $('#mv_fm').serialize(), url: '/move_files', success: function(data){ console.log(data); StatusMsg(data); CheckForJobs(); return false; } }) $.ajax({ type: 'POST', data: $('#mv_fm').serialize(), url: '/move_files', success: function(data){ CheckForJobs(); return false; } })
} }
// show the DBox for a move file, includes all thumbnails of selected files to move // show the DBox for a move file, includes all thumbnails of selected files to move

41
internal/js/jobs.js
View File

@@ -1,30 +1,31 @@
// global
var next_toast_id=1
function NewToast(data) function NewToast(data)
{ {
console.log(data) // toast "id" is based on msg_id, for any persistent/long-lived msg's we will try to reshow them
// make new div, include data.alert as background colour, and data.message as toast body // dont bother, if it already exists it is visible, just move on
d_id='st' + String(next_toast_id) d_id='st' + String(data.id)
if( $('#'+d_id).length !== 0 )
return
// make new div, include data.level as background colour, and data.message as toast body
div='<div id="' + d_id + '"' div='<div id="' + d_id + '"'
if( data.persistent === true ) if( data.persistent === true )
div+=' data-bs-autohide="false"' div+=' data-bs-autohide="false"'
if( data.job_id !== undefined )
div+=' job_id=' + String(data.job_id)
div +=' class="toast hide align-items-center border-0' div +=' class="toast hide align-items-center border-0'
if( data.alert == "success" || data.alert == "danger" ) if( data.level == "success" || data.level == "danger" )
div += ' text-white' div += ' text-white'
div += ' bg-' + data.alert div += ' bg-' + data.level + '" '
div += `" role="alert" aria-live="assertive" aria-atomic="true"> if( data.level == "success" )
div += 'data-bs-delay="2000" '
div += `role="alert" aria-live="assertive" aria-atomic="true">
<div class="d-flex"> <div class="d-flex">
<div class="toast-body"> <div class="toast-body">
<font size="1.5em">
` `
div += data.message div += data.message
div += ' </div>' div += ' </font></div>'
if( data.cant_close !== true ) if( data.cant_close !== true )
{ {
div += ' <button type="button" class="btn-close me-2 m-auto' div += ' <button type="button" class="btn-close me-2 m-auto'
if( data.alert === "success" || data.alert === "danger" ) if( data.level === "success" || data.level === "danger" )
div += ' btn-close-white' div += ' btn-close-white'
div += ' " data-bs-dismiss="toast" aria-label="Close"></button>' div += ' " data-bs-dismiss="toast" aria-label="Close"></button>'
} }
@@ -35,9 +36,6 @@ function NewToast(data)
// insert this as the first element in the status_container // insert this as the first element in the status_container
$('#status_container').prepend(div) $('#status_container').prepend(div)
// make sure we have a new id for next toast
next_toast_id++
return d_id return d_id
} }
@@ -45,20 +43,13 @@ function NewToast(data)
// can reuse any that are hidden, OR, create a new one by appending as needed (so we can have 2+ toasts on screen) // can reuse any that are hidden, OR, create a new one by appending as needed (so we can have 2+ toasts on screen)
function StatusMsg(st) function StatusMsg(st)
{ {
console.log('StatusMsg' + st )
el=NewToast(st) el=NewToast(st)
$('#' + el ).toast("show") $('#' + el ).toast("show")
// if there is a job_id, then clear the message for it or it will be picked up again on reload // clear message only when toast is hidden (either timeout OR user clicks close btn)
// BUT, we dont want to do this immediately, should hook on close, but for
// now, we will do this to get a first pass working
if( st.job_id !== undefined )
{
console.log( 'set hidden.bs.toast handler for: ' + st.job_id )
$('#' + el).on( 'hidden.bs.toast', $('#' + el).on( 'hidden.bs.toast',
function() { function() {
$.ajax( { type: 'POST', url: '/clearmsgforjob/'+st.job_id, success: function(data) { console.log('cleared job id' )} } ) $.ajax( { type: 'POST', url: '/clearmsg/'+st.id, success: function(data) {} } )
} ) } )
}
} }
// this will make the active jobs badge red with a > 0 value, or navbar colours // this will make the active jobs badge red with a > 0 value, or navbar colours

1
internal/js/view_support.js
View File

@@ -305,6 +305,7 @@ function CreatePersonAndRefimg( key )
$('#dbox').modal('hide') $('#dbox').modal('hide')
$('#faces').prop('checked',true) $('#faces').prop('checked',true)
DrawImg() DrawImg()
CheckForJobs()
} }
}) })
} }

53
job.py
View File

@@ -5,7 +5,6 @@ from settings import Settings
from main import db, app, ma from main import db, app, ma
from sqlalchemy import Sequence, func from sqlalchemy import Sequence, func
from sqlalchemy.exc import SQLAlchemyError from sqlalchemy.exc import SQLAlchemyError
from status import st, Status
from datetime import datetime, timedelta from datetime import datetime, timedelta
import pytz import pytz
import socket import socket
@@ -68,24 +67,22 @@ class Job(db.Model):
# DB. has to be about a specific job_id and is success/danger, etc. (alert) # DB. has to be about a specific job_id and is success/danger, etc. (alert)
# and a message # and a message
################################################################################ ################################################################################
class PA_JobManager_Message(db.Model): class PA_JobManager_Message(PA,db.Model):
__tablename__ = "pa_job_manager_fe_message" __tablename__ = "pa_job_manager_fe_message"
id = db.Column(db.Integer, db.Sequence('pa_job_manager_fe_message_id_seq'), primary_key=True ) id = db.Column(db.Integer, db.Sequence('pa_job_manager_fe_message_id_seq'), primary_key=True )
job_id = db.Column(db.Integer, db.ForeignKey('job.id') ) job_id = db.Column(db.Integer, db.ForeignKey('job.id') )
alert = db.Column(db.String) level = db.Column(db.String)
message = db.Column(db.String) message = db.Column(db.String)
persistent = db.Column(db.Boolean) persistent = db.Column(db.Boolean)
cant_close = db.Column(db.Boolean) cant_close = db.Column(db.Boolean)
job = db.relationship ("Job" ) job = db.relationship ("Job" )
def __repr__(self):
return f"<id: {self.id}, job_id: {self.job_id}, alert: {self.alert}, message: {self.message}, job: {self.job}"
################################################################################ ################################################################################
# GetJM_Message: used in html to display any message for this front-end # GetJM_Message: used in html to display any message for this front-end
################################################################################ ################################################################################
def GetJM_Message(): def GetJM_Message():
msg=PA_JobManager_Message.query.first() msg=PA_JPA_JobManager_MessageobManager_Message.query.first()
return msg return msg
################################################################################ ################################################################################
@@ -111,20 +108,20 @@ def GetNumActiveJobs():
# should never really be needed, but was useful when developing / the job # should never really be needed, but was useful when developing / the job
# engine got 'stuck' when jobs were run in parallel # engine got 'stuck' when jobs were run in parallel
################################################################################ ################################################################################
def WakePAJobManager(): def WakePAJobManager(job_id):
try: try:
s=socket.socket(socket.AF_INET, socket.SOCK_STREAM) s=socket.socket(socket.AF_INET, socket.SOCK_STREAM)
s.connect((PA_JOB_MANAGER_HOST, PA_JOB_MANAGER_PORT)) s.connect((PA_JOB_MANAGER_HOST, PA_JOB_MANAGER_PORT))
s.close() s.close()
except Exception as e: except Exception as e:
st.SetMessage(f"Failed to connect to job manager, has it crashed? Exception was:{e}", "danger") SetFELog( message=f"Failed to connect to job manager, has it crashed? Exception was:{e}", level="danger", persistent=True, job_id=job_id )
return return
############################################################################### ###############################################################################
# NewJob takes a name (which will be matched in pa_job_manager.py to run # NewJob takes a name (which will be matched in pa_job_manager.py to run
# the appropriate job - which will update the Job() until complete # the appropriate job - which will update the Job() until complete
############################################################################### ###############################################################################
def NewJob(name, num_files="0", wait_for=None, jex=None ): def NewJob(name, num_files="0", wait_for=None, jex=None, desc="No description provided" ):
job=Job(start_time='now()', last_update='now()', name=name, state="New", num_files=num_files, job=Job(start_time='now()', last_update='now()', name=name, state="New", num_files=num_files,
current_file_num=0, current_file='', current_file_num=0, current_file='',
wait_for=wait_for, pa_job_state="New" ) wait_for=wait_for, pa_job_state="New" )
@@ -134,8 +131,9 @@ def NewJob(name, num_files="0", wait_for=None, jex=None ):
db.session.add(job) db.session.add(job)
db.session.commit() db.session.commit()
SetFELog( message=f'Created <a class="link-light" href="/job/{job.id}">Job #{job.id}</a> to {desc}', level="success" )
WakePAJobManager() WakePAJobManager(job.id)
return job return job
################################################################################ ################################################################################
@@ -161,6 +159,20 @@ def FinishJob(job, last_log, state="Completed", pa_job_state="Completed"):
if job.state=="Failed": if job.state=="Failed":
WithdrawDependantJobs( job, job.id, "dependant job failed" ) WithdrawDependantJobs( job, job.id, "dependant job failed" )
db.session.commit() db.session.commit()
if state=="Completed" :
level="success"
elif state=="Withdrawn" :
level="warning"
SetFELog( message=last_log, level=level )
return
################################################################################
# This allows a log to be picked up in jscript on the FE
################################################################################
def SetFELog(message, level="success", job_id=None, persistent=False, cant_close=False):
m=PA_JobManager_Message( message=message, level=level, job_id=job_id, persistent=persistent, cant_close=cant_close)
db.session.add(m)
db.session.commit()
return return
################################################################################ ################################################################################
@@ -230,7 +242,7 @@ def joblog(id):
@app.route("/wakeup", methods=["GET"]) @app.route("/wakeup", methods=["GET"])
@login_required @login_required
def wakeup(): def wakeup():
WakePAJobManager() WakePAJobManager(job_id=None)
return redirect("/") return redirect("/")
################################################################################ ################################################################################
@@ -259,7 +271,7 @@ def stale_job(id):
db.engine.execute( f"delete from pa_job_manager_fe_message where job_id = {id}" ) db.engine.execute( f"delete from pa_job_manager_fe_message where job_id = {id}" )
db.session.commit() db.session.commit()
WakePAJobManager() WakePAJobManager(job.id)
return redirect("/jobs") return redirect("/jobs")
################################################################################ ################################################################################
@@ -311,11 +323,12 @@ def joblog_search():
@login_required @login_required
def CheckForJobs(): def CheckForJobs():
num=GetNumActiveJobs() num=GetNumActiveJobs()
print( f"called: /checkforjobs -- num={num}" )
sts=[] sts=[]
for msg in PA_JobManager_Message.query.all(): for msg in PA_JobManager_Message.query.all():
u=''
if 'Job #' not in msg.message and msg.job_id:
u='<a class="link-light" href="' + url_for('joblog', id=msg.job_id) + '">Job #' + str(msg.job_id) + '</a>: ' u='<a class="link-light" href="' + url_for('joblog', id=msg.job_id) + '">Job #' + str(msg.job_id) + '</a>: '
sts.append( { 'message': u+msg.message, 'alert': msg.alert, 'job_id': msg.job_id, 'persistent': msg.persistent, 'cant_close': msg.cant_close } ) sts.append( { 'id': msg.id, 'message': u+msg.message, 'level': msg.level, 'job_id': msg.job_id, 'persistent': msg.persistent, 'cant_close': msg.cant_close } )
return make_response( jsonify( num_active_jobs=num, sts=sts ) ) return make_response( jsonify( num_active_jobs=num, sts=sts ) )
############################################################################### ###############################################################################
@@ -330,6 +343,18 @@ def ClearMessageForJob(id):
# no real need for this response, as if it succeeded/failed the F/E ignores it # no real need for this response, as if it succeeded/failed the F/E ignores it
return make_response( jsonify( status="success" ) ) return make_response( jsonify( status="success" ) )
###############################################################################
# / -> POST -> looks for pa_job_manager status to F/E jobs and sends json of
# them back to F/E (called form internal/js/jobs.js:CheckForJobs()
################################################################################
@app.route("/clearmsg/<id>", methods=["POST"])
@login_required
def ClearMessage(id):
PA_JobManager_Message.query.filter(PA_JobManager_Message.id==id).delete()
db.session.commit()
# no real need for this response, as if it succeeded/failed the F/E ignores it
return make_response( jsonify( id=id, status="success" ) )
############################################################################### ###############################################################################
# This func creates a new filter in jinja2 to format the time from the db in a # This func creates a new filter in jinja2 to format the time from the db in a
# way that is more readable (converted to local tz too) # way that is more readable (converted to local tz too)

8
main.py
View File

@@ -11,7 +11,6 @@ from datetime import datetime
import os import os
import re import re
import socket import socket
from status import st, Status
from shared import CreateSelect, CreateFoldersSelect, LocationIcon, DB_URL, PROD_HOST, OLDEST_LOG_LIMIT from shared import CreateSelect, CreateFoldersSelect, LocationIcon, DB_URL, PROD_HOST, OLDEST_LOG_LIMIT
# for ldap auth # for ldap auth
@@ -59,19 +58,12 @@ Compress(app)
from ai import aistats from ai import aistats
from files import Entry from files import Entry
from person import Person from person import Person
from job import Job, GetNumActiveJobs, GetJM_Message, ClearJM_Message
from settings import Settings from settings import Settings
from user import PAUser from user import PAUser
####################################### GLOBALS ####################################### ####################################### GLOBALS #######################################
# allow jinja2 to call these python functions directly # allow jinja2 to call these python functions directly
app.jinja_env.add_extension('jinja2.ext.loopcontrols') app.jinja_env.add_extension('jinja2.ext.loopcontrols')
app.jinja_env.globals['ClearStatus'] = st.ClearStatus
app.jinja_env.globals['GetAlert'] = st.GetAlert
app.jinja_env.globals['GetMessage'] = st.GetMessage
app.jinja_env.globals['GetNumActiveJobs'] = GetNumActiveJobs
app.jinja_env.globals['GetJM_Message'] = GetJM_Message
app.jinja_env.globals['ClearJM_Message'] = ClearJM_Message
app.jinja_env.globals['CreateSelect'] = CreateSelect app.jinja_env.globals['CreateSelect'] = CreateSelect
app.jinja_env.globals['CreateFoldersSelect'] = CreateFoldersSelect app.jinja_env.globals['CreateFoldersSelect'] = CreateFoldersSelect
app.jinja_env.globals['LocationIcon'] = LocationIcon app.jinja_env.globals['LocationIcon'] = LocationIcon

78
pa_job_manager.py
View File

@@ -494,19 +494,19 @@ class Job(Base):
############################################################################## ##############################################################################
# Class describing PA_JobManager_FE_Message and in the DB (via sqlalchemy) # Class describing PA_JobManager_FE_Message and in the DB (via sqlalchemy)
# the job manager (this code) can send a message back to the front end via the # the job manager (this code) can send a message back to the front end via the
# DB. has to be about a specific job_id and is success/danger, etc. (alert) # DB. has to be about a specific job_id and is success/danger, etc. (level)
# and a message # and a message
################################################################################ ################################################################################
class PA_JobManager_FE_Message(Base): class PA_JobManager_FE_Message(Base):
__tablename__ = "pa_job_manager_fe_message" __tablename__ = "pa_job_manager_fe_message"
id = Column(Integer, Sequence('pa_job_manager_fe_message_id_seq'), primary_key=True ) id = Column(Integer, Sequence('pa_job_manager_fe_message_id_seq'), primary_key=True )
job_id = Column(Integer, ForeignKey('job.id') ) job_id = Column(Integer, ForeignKey('job.id') )
alert = Column(String) level = Column(String)
message = Column(String) message = Column(String)
persistent = Column(Boolean) persistent = Column(Boolean)
cant_close = Column(Boolean) cant_close = Column(Boolean)
def __repr__(self): def __repr__(self):
return "<id: {}, job_id: {}, alert: {}, message: {}".format(self.id, self.job_id, self.alert, self.message) return "<id: {}, job_id: {}, level: {}, message: {}".format(self.id, self.job_id, self.level, self.message)
class PA_UserState(Base): class PA_UserState(Base):
@@ -542,7 +542,7 @@ class PA_UserState(Base):
############################################################################## ##############################################################################
# NewJob(): convenience function to create a job, appropriately # NewJob(): convenience function to create a job, appropriately
############################################################################## ##############################################################################
def NewJob(name, num_files=0, wait_for=None, jex=None, parent_job=None ): def NewJob(name, num_files=0, wait_for=None, jex=None, parent_job=None, desc="No description provided" ):
job=Job( name=name, current_file_num=0, current_file='', num_files=num_files, job=Job( name=name, current_file_num=0, current_file='', num_files=num_files,
wait_for=wait_for, state="New", pa_job_state="New", start_time=None, wait_for=wait_for, state="New", pa_job_state="New", start_time=None,
last_update=datetime.now(pytz.utc) ) last_update=datetime.now(pytz.utc) )
@@ -552,6 +552,8 @@ def NewJob(name, num_files=0, wait_for=None, jex=None, parent_job=None ):
session.add(job) session.add(job)
session.commit() session.commit()
MessageToFE( job_id=job.id, message=f'Created <a class="link-light" href="/job/{job.id}">Job #{job.id}</a> to {desc}',
level="success", persistent=False, cant_close=False )
if parent_job: if parent_job:
str=f"adding <a href='/job/{job.id}'>job id={job.id} {job.name}</a>" str=f"adding <a href='/job/{job.id}'>job id={job.id} {job.name}</a>"
if job.wait_for: if job.wait_for:
@@ -560,11 +562,11 @@ def NewJob(name, num_files=0, wait_for=None, jex=None, parent_job=None ):
return job return job
############################################################################## ##############################################################################
# MessageToFE(): sends a specific alert/messasge for a given job via the DB to # MessageToFE(): sends a specific level/messasge for a given job via the DB to
# the front end # the front end
############################################################################## ##############################################################################
def MessageToFE( job_id, alert, message, persistent, cant_close ): def MessageToFE( job_id, message, level, persistent, cant_close ):
msg = PA_JobManager_FE_Message( job_id=job_id, alert=alert, message=message, persistent=persistent, cant_close=cant_close) msg = PA_JobManager_FE_Message( job_id=job_id, message=message, level=level, persistent=persistent, cant_close=cant_close)
session.add(msg) session.add(msg)
session.commit() session.commit()
return msg.id return msg.id
@@ -686,22 +688,22 @@ def JobsForPath( parent_job, path, ptype ):
jex=[] jex=[]
jex.append( JobExtra( name="path", value=path ) ) jex.append( JobExtra( name="path", value=path ) )
jex.append( JobExtra( name="path_type", value=ptype.id ) ) jex.append( JobExtra( name="path_type", value=ptype.id ) )
job1=NewJob( "importdir", cfn, None, jex, parent_job ) job1=NewJob( name="importdir", num_files=cfn, wait_for=None, jex=jex, parent_job=parent_job, desc=f"scan for files from {ptype.name} path" )
# then get file details (hash/thumbs) # then get file details (hash/thumbs)
jex=[] jex=[]
jex.append( JobExtra( name="path", value=path ) ) jex.append( JobExtra( name="path", value=path ) )
job2=NewJob("getfiledetails", 0, job1.id, jex, parent_job ) job2=NewJob( name="getfiledetails", num_files=0, wait_for=job1.id, jex=jex, parent_job=parent_job, desc=f"get details of files from {ptype.name} path" )
# can start straight after importdir - job1, does not need details (job2) # can start straight after importdir - job1, does not need details (job2)
jex=[] jex=[]
jex.append( JobExtra( name="person", value="all" ) ) jex.append( JobExtra( name="person", value="all" ) )
jex.append( JobExtra( name="path_type", value=ptype.id ) ) jex.append( JobExtra( name="path_type", value=ptype.id ) )
job3=NewJob("run_ai_on_path", 0, job1.id, jex, parent_job ) job3=NewJob( name="run_ai_on_path", num_files=0, wait_for=job1.id, jex=jex, parent_job=parent_job, desc=f"match faces on files from {ptype.name} path" )
# careful here, wait for getfiledetails (job2), the ai job cannot cause a dup # careful here, wait for getfiledetails (job2), the ai job cannot cause a dup
# but it can fail - in which case the checkdup will be withdrawn # but it can fail - in which case the checkdup will be withdrawn
job4=NewJob( "checkdups", 0, job2.id, None, parent_job ) job4=NewJob( name="checkdups", num_files=0, wait_for=job2.id, jex=None, parent_job=parent_job, desc="check for duplicate files" )
# okay, now process all the new jobs # okay, now process all the new jobs
HandleJobs(False) HandleJobs(False)
@@ -832,8 +834,8 @@ def RunJob(job):
# only update start_time if we have never set it - stops restarts resetting start_time # only update start_time if we have never set it - stops restarts resetting start_time
if not job.start_time: if not job.start_time:
job.start_time=datetime.now(pytz.utc) job.start_time=datetime.now(pytz.utc)
if job.name =="scannow": if job.name =="scan_ip":
JobScanNow(job) JobScanImportDir(job)
elif job.name =="forcescan": elif job.name =="forcescan":
JobForceScan(job) JobForceScan(job)
elif job.name =="scan_sp": elif job.name =="scan_sp":
@@ -874,7 +876,7 @@ def RunJob(job):
############################################################################## ##############################################################################
# FinishJob(): finish this job off (if no overrides), its just marked completed # FinishJob(): finish this job off (if no overrides), its just marked completed
############################################################################## ##############################################################################
def FinishJob(job, last_log, state="Completed", pa_job_state="Completed"): def FinishJob(job, last_log, state="Completed", pa_job_state="Completed", level="success", persistent=False, cant_close=False):
job.state=state job.state=state
job.pa_job_state=pa_job_state job.pa_job_state=pa_job_state
if not job.start_time: if not job.start_time:
@@ -884,6 +886,7 @@ def FinishJob(job, last_log, state="Completed", pa_job_state="Completed"):
if job.state=="Failed": if job.state=="Failed":
WithdrawDependantJobs( job, job.id, "failed" ) WithdrawDependantJobs( job, job.id, "failed" )
session.commit() session.commit()
MessageToFE( job_id=job.id, message=last_log, level=level, persistent=persistent, cant_close=cant_close )
if DEBUG: if DEBUG:
print( f"DEBUG: {last_log}" ) print( f"DEBUG: {last_log}" )
return return
@@ -906,7 +909,7 @@ def HandleJobs(first_run=False):
job.pa_job_state = 'Stale' job.pa_job_state = 'Stale'
session.add(job) session.add(job)
AddLogForJob( job, "ERROR: Job has been marked stale as it did not complete" ) AddLogForJob( job, "ERROR: Job has been marked stale as it did not complete" )
MessageToFE( job.id, "danger", f'Stale job, click&nbsp; <a href="javascript:document.body.innerHTML+=\'<form id=_fm method=GET action=/stale_jobs></form>\'; document.getElementById(\'_fm\').submit();">here</a>&nbsp;to restart or cancel', True, False ) MessageToFE( job_id=job.id, message=f'Stale job, click&nbsp; <a class="link-light" href="javascript:document.body.innerHTML+=\'<form id=_fm method=GET action=/stale_jobs></form>\'; document.getElementById(\'_fm\').submit();">here</a>&nbsp;to restart or cancel', level="danger", persistent=True, cant_close=False )
session.commit() session.commit()
continue continue
if job.pa_job_state == 'New': if job.pa_job_state == 'New':
@@ -932,7 +935,7 @@ def HandleJobs(first_run=False):
# threading.Thread(target=RunJob, args=(job,)).start() # threading.Thread(target=RunJob, args=(job,)).start()
except Exception as e: except Exception as e:
try: try:
MessageToFE( job.id, "danger", "Failed with: {} (try job log for details)".format(e), True, False ) MessageToFE( job_id=job.id, level="danger", message="Failed with: {} (try job log for details)".format(e), persistent=True, cant_close=False )
except Exception as e2: except Exception as e2:
print("ERROR: Failed to let front-end know, but back-end Failed to run job (id: {}, name: {} -- orig exep was: {}, this exception was: {})".format( job.id, job.name, e, e2) ) print("ERROR: Failed to let front-end know, but back-end Failed to run job (id: {}, name: {} -- orig exep was: {}, this exception was: {})".format( job.id, job.name, e, e2) )
print("INFO: PA job manager is waiting for a job") print("INFO: PA job manager is waiting for a job")
@@ -950,13 +953,12 @@ def JobProgressState( job, state ):
return return
############################################################################## ##############################################################################
# JobScanNow(): start and process the job to start scanning now (import paths) # JobScanImportDir(): start and process the job to start scanning now (import paths)
############################################################################## ##############################################################################
def JobScanNow(job): def JobScanImportDir(job):
JobProgressState( job, "In Progress" ) JobProgressState( job, "In Progress" )
ProcessImportDirs(job) ProcessImportDirs(job)
FinishJob( job, "Completed (scan for new files)" ) FinishJob( job, "Completed (scan for new files)" )
MessageToFE( job.id, "success", "Completed (scan for new files)", False, False )
return return
############################################################################## ##############################################################################
@@ -966,7 +968,6 @@ def JobScanStorageDir(job):
JobProgressState( job, "In Progress" ) JobProgressState( job, "In Progress" )
ProcessStorageDirs(job) ProcessStorageDirs(job)
FinishJob( job, "Completed (scan for new files)" ) FinishJob( job, "Completed (scan for new files)" )
MessageToFE( job.id, "success", "Completed (scan for new files)", False, False )
return return
@@ -1080,7 +1081,6 @@ def JobForceScan(job):
ProcessImportDirs(job) ProcessImportDirs(job)
ProcessStorageDirs(job) ProcessStorageDirs(job)
FinishJob(job, "Completed (forced remove and recreation of all file data)") FinishJob(job, "Completed (forced remove and recreation of all file data)")
MessageToFE( job.id, "success", "Completed (forced remove and recreation of all file data)", False, False )
return return
############################################################################## ##############################################################################
@@ -1553,7 +1553,7 @@ def AddJexToDependantJobs(job,name,value):
#################################################################################################################################### ####################################################################################################################################
def WithdrawDependantJobs( job, id, reason ): def WithdrawDependantJobs( job, id, reason ):
for j in session.query(Job).filter(Job.wait_for==id).all(): for j in session.query(Job).filter(Job.wait_for==id).all():
FinishJob(j, f"Job (#{j.id}) has been withdrawn -- #{job.id} {reason}", "Withdrawn" ) FinishJob(j, f"Job #{j.id} has been withdrawn -- #{job.id} {reason}", "Withdrawn" )
WithdrawDependantJobs(j, j.id, reason) WithdrawDependantJobs(j, j.id, reason)
return return
@@ -1722,17 +1722,18 @@ def JobImportDir(job):
for j in session.query(Job).filter(Job.wait_for==job.id).all(): for j in session.query(Job).filter(Job.wait_for==job.id).all():
if j.name == "getfiledetails" and last_file_details > last_scan: if j.name == "getfiledetails" and last_file_details > last_scan:
FinishJob(j, f"Job (#{j.id}) has been withdrawn -- #{job.id} (scan job) did not find new files", "Withdrawn" ) FinishJob(j, f"Job #{j.id} has been withdrawn -- #{job.id} (scan job) did not find new files", "Withdrawn" )
# scan found no new files and last ai scan was after the last file scan # scan found no new files and last ai scan was after the last file scan
if j.name == "run_ai_on_path" and last_ai_scan > last_scan: if j.name == "run_ai_on_path" and last_ai_scan > last_scan:
newest_refimg = session.query(Refimg).order_by(Refimg.created_on.desc()).limit(1).all() newest_refimg = session.query(Refimg).order_by(Refimg.created_on.desc()).limit(1).all()
# IF we also have no new refimgs since last scan, then no need to run any AI again # IF we also have no new refimgs since last scan, then no need to run any AI again
if newest_refimg and newest_refimg[0].created_on < last_scan: if newest_refimg and newest_refimg[0].created_on < last_scan:
FinishJob(j, f"Job (#{j.id}) has been withdrawn -- scan did not find new files, and no new reference images since last scan", "Withdrawn" ) FinishJob(j, f"Job #{j.id} has been withdrawn -- scan did not find new files, and no new reference images since last scan", "Withdrawn" )
# IF we also have no new refimgs since last AI scan, then no need to run any AI again # IF we also have no new refimgs since last AI scan, then no need to run any AI again
elif newest_refimg and newest_refimg[0].created_on < last_ai_scan: elif newest_refimg and newest_refimg[0].created_on < last_ai_scan:
FinishJob(j, f"Job (#{j.id}) has been withdrawn -- scan did not find new files, and no new reference images since last scan", "Withdrawn" ) FinishJob(j, f"Job #{j.id} has been withdrawn -- scan did not find new files, and no new reference images since last scan", "Withdrawn" )
FinishJob(job, f"Finished Importing: {path} - Processed {overall_file_cnt} files, Found {found_new_files} new files, Removed {rm_cnt} file(s)") AddLogForJob(job, f"Finished importing: {path} - Processed {overall_file_cnt} files, Found {found_new_files} new files, Removed {rm_cnt} file(s)")
FinishJob(job, f"Finished import of {path_obj.type.name} path")
return return
#################################################################################################################################### ####################################################################################################################################
@@ -2042,10 +2043,9 @@ def JobCheckForDups(job):
for row in res: for row in res:
if row.count > 0: if row.count > 0:
AddLogForJob(job, f"Found duplicates, Creating Status message in front-end for attention") AddLogForJob(job, f"Found duplicates, Creating Status message in front-end for attention")
MessageToFE( job.id, "danger", f'Found duplicate(s), click&nbsp; <a href="javascript:document.body.innerHTML+=\'<form id=_fm method=POST action=/fix_dups></form>\'; document.getElementById(\'_fm\').submit();">here</a>&nbsp;to finalise import by removing duplicates', True, True ) FinishJob( job=job, last_log=f'Found duplicate(s), click&nbsp; <a class="link-light" href="javascript:document.body.innerHTML+=\'<form id=_fm method=POST action=/fix_dups></form>\'; document.getElementById(\'_fm\').submit();">here</a>&nbsp;to finalise import by removing duplicates', state="Completed", pa_job_state="Completed", level="danger", persistent=True, cant_close=True )
else: else:
FinishJob(job, f"No duplicates found") FinishJob(job, f"No duplicates found")
FinishJob(job, f"Finished looking for duplicates")
return return
#################################################################################################################################### ####################################################################################################################################
@@ -2109,12 +2109,11 @@ def JobRemoveDups(job):
MoveFileToRecycleBin(job,del_me) MoveFileToRecycleBin(job,del_me)
dup_cnt += 1 dup_cnt += 1
FinishJob(job, f"Finished removing {dup_cnt} duplicate files" )
# Need to put another checkdups job in now to force / validate we have no dups # Need to put another checkdups job in now to force / validate we have no dups
next_job=NewJob( "checkdups" ) next_job=NewJob( name="checkdups", num_files=0, wait_for=None, jex=None, parent_job=None, desc="check for duplicate files" )
AddLogForJob(job, f"adding <a href='/job/{next_job.id}'>job id={next_job.id} {next_job.name}</a> to confirm there are no more duplicates" ) AddLogForJob(job, f"adding <a href='/job/{next_job.id}'>job id={next_job.id} {next_job.name}</a> to confirm there are no more duplicates" )
MessageToFE( job.id, "success", f"Finished Job#{job.id} removing duplicate files", False, False ) FinishJob(job, f"Finished removing {dup_cnt} duplicate files" )
return return
#################################################################################################################################### ####################################################################################################################################
@@ -2143,8 +2142,7 @@ def JobMoveFiles(job):
if 'eid-' in jex.name: if 'eid-' in jex.name:
move_me=session.query(Entry).get(jex.value) move_me=session.query(Entry).get(jex.value)
MoveEntriesToOtherFolder( job, move_me, dst_storage_path, f"{prefix}{suffix}" ) MoveEntriesToOtherFolder( job, move_me, dst_storage_path, f"{prefix}{suffix}" )
next_job=NewJob( "checkdups" ) NewJob( name="checkdups", num_files=0, wait_for=None, jex=None, parent_job=None, desc="check for duplicate files" )
MessageToFE( job.id, "success", "Completed (move of selected files)", False, False )
FinishJob(job, f"Finished move selected file(s)") FinishJob(job, f"Finished move selected file(s)")
return return
@@ -2158,8 +2156,7 @@ def JobDeleteFiles(job):
if 'eid-' in jex.name: if 'eid-' in jex.name:
del_me=session.query(Entry).join(File).filter(Entry.id==jex.value).first() del_me=session.query(Entry).join(File).filter(Entry.id==jex.value).first()
MoveFileToRecycleBin(job,del_me) MoveFileToRecycleBin(job,del_me)
next_job=NewJob( "checkdups" ) NewJob( name="checkdups", num_files=0, wait_for=None, jex=None, parent_job=None, desc="check for duplicate files" )
MessageToFE( job.id, "success", "Completed (delete of selected files)", False, False )
FinishJob(job, f"Finished deleting selected file(s)") FinishJob(job, f"Finished deleting selected file(s)")
return return
@@ -2173,8 +2170,7 @@ def JobRestoreFiles(job):
if 'eid-' in jex.name: if 'eid-' in jex.name:
restore_me=session.query(Entry).join(File).filter(Entry.id==jex.value).first() restore_me=session.query(Entry).join(File).filter(Entry.id==jex.value).first()
RestoreFile(job,restore_me) RestoreFile(job,restore_me)
next_job=NewJob( "checkdups" ) NewJob( name="checkdups", num_files=0, wait_for=None, jex=None, parent_job=None, desc="check for duplicate files" )
MessageToFE( job.id, "success", "Completed (restore of selected files)", False, False )
FinishJob(job, f"Finished restoring selected file(s)") FinishJob(job, f"Finished restoring selected file(s)")
return return
@@ -2339,7 +2335,7 @@ def ReloadMetadata(job):
#################################################################################################################################### ####################################################################################################################################
def InitialValidationChecks(): def InitialValidationChecks():
now=datetime.now(pytz.utc) now=datetime.now(pytz.utc)
job=NewJob( "init" ) job=NewJob( name="init", num_files=0, wait_for=None, jex=None, parent_job=None, desc="initialise photo assistant" )
job.start_time=datetime.now(pytz.utc) job.start_time=datetime.now(pytz.utc)
JobProgressState( job, "In Progress" ) JobProgressState( job, "In Progress" )
AddLogForJob(job, f"INFO: Starting Initial Validation checks...") AddLogForJob(job, f"INFO: Starting Initial Validation checks...")
@@ -2640,7 +2636,7 @@ def CheckAndRunBinClean():
now=datetime.now(pytz.utc) now=datetime.now(pytz.utc)
if not j or (now-j.last_update).days >= settings.scheduled_bin_cleanup: if not j or (now-j.last_update).days >= settings.scheduled_bin_cleanup:
print( f"INFO: Should force clean up bin path, del files older than {settings.bin_cleanup_file_age} days old" ) print( f"INFO: Should force clean up bin path, del files older than {settings.bin_cleanup_file_age} days old" )
job=NewJob( "clean_bin" ) NewJob( name="clean_bin", num_files=0, wait_for=None, jex=None, parent_job=None, desc="periodic clean up on Bin path" )
created_jobs=True created_jobs=True
return created_jobs return created_jobs
@@ -2660,11 +2656,11 @@ def ScheduledJobs():
now=datetime.now(pytz.utc) now=datetime.now(pytz.utc)
if ndays_since_last_im_scan >= settings.scheduled_import_scan: if ndays_since_last_im_scan >= settings.scheduled_import_scan:
print( f"INFO: Time to force an import scan, last scan was {ndays_since_last_im_scan} days ago" ) print( f"INFO: Time to force an import scan, last scan was {ndays_since_last_im_scan} days ago" )
job=NewJob( "scannow" ) NewJob( name="scan_ip", num_files=0, wait_for=None, jex=None, parent_job=None, desc="periodic clean scan for new files in Import path" )
created_jobs=True created_jobs=True
if ndays_since_last_st_scan >= settings.scheduled_storage_scan: if ndays_since_last_st_scan >= settings.scheduled_storage_scan:
print( f"INFO: Time to force a storage scan, last scan was {ndays_since_last_st_scan}" ) print( f"INFO: Time to force a storage scan, last scan was {ndays_since_last_st_scan}" )
job=NewJob( "scan_sp" ) NewJob( name="scan_sp", num_files=0, wait_for=None, jex=None, parent_job=None, desc="periodic clean scan for new files in Storage path" )
created_jobs=True created_jobs=True
if CheckAndRunBinClean(): if CheckAndRunBinClean():
created_jobs=True created_jobs=True

74
person.py
View File

@@ -1,17 +1,16 @@
from wtforms import SubmitField, StringField, HiddenField, validators, Form from wtforms import SubmitField, StringField, HiddenField, validators, Form
from flask_wtf import FlaskForm from flask_wtf import FlaskForm
from flask import request, render_template, redirect, url_for from flask import request, render_template, redirect, url_for, make_response, jsonify
from main import db, app, ma from main import db, app, ma
from settings import Settings, AIModel from settings import Settings, AIModel
from sqlalchemy import Sequence from sqlalchemy import Sequence
from sqlalchemy.exc import SQLAlchemyError from sqlalchemy.exc import SQLAlchemyError
from status import st, Status
from flask_login import login_required, current_user from flask_login import login_required, current_user
from werkzeug.utils import secure_filename from werkzeug.utils import secure_filename
from shared import GenFace, GenThumb, PA from shared import GenFace, GenThumb, PA
from face import Face, FaceRefimgLink, FaceOverrideType, FaceNoMatchOverride, FaceForceMatchOverride from face import Face, FaceRefimgLink, FaceOverrideType, FaceNoMatchOverride, FaceForceMatchOverride
from path import Path, PathType from path import Path, PathType
from job import JobExtra, NewJob from job import JobExtra, NewJob, SetFELog
import os import os
import time import time
@@ -98,7 +97,7 @@ def AddRefimgToPerson( filename, person ):
print( f"Failed to delete tmp file for refimg addition: {e}" ) print( f"Failed to delete tmp file for refimg addition: {e}" )
if not face_locn: if not face_locn:
st.SetMessage( f"<b>Failed to find face in Refimg:</b>" ) SetFELog( f"<b>Failed to find face in Refimg:</b>", "danger" )
raise Exception("Could not find face in uploaded reference image" ) raise Exception("Could not find face in uploaded reference image" )
return return
refimg.face_top = face_locn[0] refimg.face_top = face_locn[0]
@@ -111,11 +110,11 @@ def AddRefimgToPerson( filename, person ):
db.session.add(person) db.session.add(person)
db.session.add(refimg) db.session.add(refimg)
db.session.commit() db.session.commit()
st.SetMessage( f"Associated new Refimg ({refimg.fname}) with person: {person.tag}" ) SetFELog( f"Associated new Refimg ({refimg.fname}) with person: {person.tag}" )
except SQLAlchemyError as e: except SQLAlchemyError as e:
st.SetMessage( f"<b>Failed to add Refimg:</b>&nbsp;{e.orig}", "danger" ) SetFELog( f"<b>Failed to add Refimg:</b>&nbsp;{e.orig}", "danger" )
except Exception as e: except Exception as e:
st.SetMessage( f"<b>Failed to modify Refimg:</b>&nbsp;{e}", "danger" ) SetFELog( f"<b>Failed to modify Refimg:</b>&nbsp;{e}", "danger" )
return return
################################################################################ ################################################################################
@@ -171,10 +170,10 @@ def new_person():
try: try:
db.session.add(person) db.session.add(person)
db.session.commit() db.session.commit()
st.SetMessage( "Created new Person ({})".format(person.tag) ) SetFELog( f"Created new Person ({person.tag})" )
return redirect( url_for( 'person', id=person.id) ) return redirect( url_for( 'person', id=person.id) )
except SQLAlchemyError as e: except SQLAlchemyError as e:
st.SetMessage( f"<b>Failed to add Person:</b>&nbsp;{e.orig}", "danger" ) SetFELog( f"<b>Failed to add Person:</b>&nbsp;{e.orig}", "danger" )
return redirect( url_for( '/persons') ) return redirect( url_for( '/persons') )
else: else:
return render_template("person.html", person=None, form=form, page_title=page_title ) return render_template("person.html", person=None, form=form, page_title=page_title )
@@ -186,10 +185,8 @@ def match_with_create_person():
# add this fname (of temp refimg) to person # add this fname (of temp refimg) to person
fname=TempRefimgFile( request.form['refimg_data'], p.tag ) fname=TempRefimgFile( request.form['refimg_data'], p.tag )
AddRefimgToPerson( fname, p ) AddRefimgToPerson( fname, p )
resp={} SetFELog( f"Created person: {p.tag}" )
resp['who']=p.tag return make_response( jsonify( who=p.tag, distance='0.0' ) )
resp['distance']='0.0'
return resp
################################################################################ ################################################################################
# /person/<id> -> GET/POST(save or delete) -> shows/edits/delets a single person # /person/<id> -> GET/POST(save or delete) -> shows/edits/delets a single person
@@ -204,7 +201,7 @@ def person(id):
try: try:
person = Person.query.get(id) person = Person.query.get(id)
if 'delete' in request.form: if 'delete' in request.form:
st.SetMessage("Successfully deleted Person: ({})".format( person.tag ) ) SetFELog( f"Successfully deleted Person: ({person.tag})" )
# do linkages by hand, or one day replace with delete cascade in the DB defintions # do linkages by hand, or one day replace with delete cascade in the DB defintions
db.session.execute( f"delete from face_refimg_link frl where refimg_id in ( select refimg_id from person_refimg_link where person_id = {id} )" ) db.session.execute( f"delete from face_refimg_link frl where refimg_id in ( select refimg_id from person_refimg_link where person_id = {id} )" )
db.session.execute( f"delete from person_refimg_link where person_id = {id}" ) db.session.execute( f"delete from person_refimg_link where person_id = {id}" )
@@ -225,23 +222,23 @@ def person(id):
# delete the "match" between a face found in a file and this ref img # delete the "match" between a face found in a file and this ref img
FaceRefimgLink.query.filter(FaceRefimgLink.refimg_id==deld[0].id).delete() FaceRefimgLink.query.filter(FaceRefimgLink.refimg_id==deld[0].id).delete()
Refimg.query.filter(Refimg.id==deld[0].id).delete() Refimg.query.filter(Refimg.id==deld[0].id).delete()
st.SetMessage( f"Successfully Updated Person: removed reference image {deld[0].fname}" ) SetFELog( f"Successfully Updated Person: removed reference image {deld[0].fname}" )
else: else:
st.SetMessage("Successfully Updated Person: (From: {}, {}, {})".format(person.tag, person.firstname, person.surname) ) s=f"Successfully Updated Person: (From: {person.tag}, {person.firstname}, {person.surname})"
person.tag = request.form['tag'] person.tag = request.form['tag']
person.surname = request.form['surname'] person.surname = request.form['surname']
person.firstname = request.form['firstname'] person.firstname = request.form['firstname']
st.AppendMessage(" To: ({}, {}, {})".format(person.tag, person.firstname, person.surname) ) SetFELog( f"{s} To: ({person.tag}, {person.firstname}, {person.surname})" )
db.session.add(person) db.session.add(person)
db.session.commit() db.session.commit()
return redirect( url_for( 'person', id=person.id) ) return redirect( url_for( 'person', id=person.id) )
except SQLAlchemyError as e: except SQLAlchemyError as e:
st.SetMessage( f"<b>Failed to modify Person:</b>&nbsp;{e}", "danger" ) SetFELog( f"<b>Failed to modify Person:</b>&nbsp;{e}", "danger" )
return redirect( url_for( 'persons' ) ) return redirect( url_for( 'persons' ) )
else: else:
person = Person.query.get(id) person = Person.query.get(id)
if not person: if not person:
st.SetMessage( f"No such person with id: {id}", "danger" ) SetFELog( f"No such person with id: {id}", "danger" )
return redirect("/") return redirect("/")
form = PersonForm(request.values, obj=person) form = PersonForm(request.values, obj=person)
return render_template("person.html", person=person, form=form, page_title = page_title) return render_template("person.html", person=person, form=form, page_title = page_title)
@@ -266,7 +263,7 @@ def add_refimg():
fname = f"/tmp/{fname}" fname = f"/tmp/{fname}"
f.save( fname ) f.save( fname )
except Exception as e: except Exception as e:
st.SetMessage( f"<b>Failed to load reference image:</b>&nbsp;{e}", "danger" ) SetFELog( f"<b>Failed to load reference image:</b>&nbsp;{e}", "danger" )
AddRefimgToPerson( fname, person ) AddRefimgToPerson( fname, person )
return redirect( url_for( 'person', id=person.id) ) return redirect( url_for( 'person', id=person.id) )
@@ -297,7 +294,6 @@ def find_persons(who):
@app.route("/add_refimg_to_person", methods=["POST"]) @app.route("/add_refimg_to_person", methods=["POST"])
@login_required @login_required
def add_refimg_to_person(): def add_refimg_to_person():
resp={}
f = Face.query.get( request.form['face_id'] ) f = Face.query.get( request.form['face_id'] )
p = Person.query.get( request.form['person_id'] ) p = Person.query.get( request.form['person_id'] )
@@ -310,19 +306,15 @@ def add_refimg_to_person():
ptype=PathType.query.filter(PathType.name=='Import').first() ptype=PathType.query.filter(PathType.name=='Import').first()
jex.append( JobExtra( name=f"person", value="all" ) ) jex.append( JobExtra( name=f"person", value="all" ) )
jex.append( JobExtra( name=f"path_type", value=ptype.id ) ) jex.append( JobExtra( name=f"path_type", value=ptype.id ) )
job=NewJob( "run_ai_on_path", 0, None, jex ) job=NewJob( name="run_ai_on_path", num_files=0, wait_for=None, jex=jex, desc="Look for face(s) in import path(s)" )
st.SetMessage( f"Created&nbsp;<a href=/job/{job.id}>Job #{job.id}</a>&nbsp;to Look for face(s) in import path(s)")
jex=[] jex=[]
ptype=PathType.query.filter(PathType.name=='Storage').first() ptype=PathType.query.filter(PathType.name=='Storage').first()
jex.append( JobExtra( name=f"person", value="all" ) ) jex.append( JobExtra( name=f"person", value="all" ) )
jex.append( JobExtra( name=f"path_type", value=ptype.id ) ) jex.append( JobExtra( name=f"path_type", value=ptype.id ) )
job=NewJob( "run_ai_on_path", 0, None, jex ) job=NewJob( name="run_ai_on_path", num_files=0, wait_for=None, jex=jex, desc="Look for face(s) in storage path(s)" )
st.SetMessage( f"Created&nbsp;<a href=/job/{job.id}>Job #{job.id}</a>&nbsp;to Look for face(s) in storage path(s)")
resp['who']=p.tag return make_response( jsonify( who=p.tag, distance='0.0' ) )
resp['distance']='0.0'
return resp
################################################################################ ################################################################################
# /add_force_match_override -> POST # /add_force_match_override -> POST
@@ -349,13 +341,11 @@ def add_force_match_override():
jex.append( JobExtra( name="face_id", value=f.id ) ) jex.append( JobExtra( name="face_id", value=f.id ) )
jex.append( JobExtra( name="person_id", value=p.id ) ) jex.append( JobExtra( name="person_id", value=p.id ) )
# dont do status update here, the F/E is in the middle of a dbox, just send metadata through to the B/E # dont do status update here, the F/E is in the middle of a dbox, just send metadata through to the B/E
NewJob( "metadata", 0, None, jex ) NewJob( "metadata", num_files=0, wait_for=None, jex=jex, desc="create metadata for adding forced match" )
print( f"Placing an override match with face_id {face_id}, for person: {p.tag}" ) print( f"Placing an override match with face_id {face_id}, for person: {p.tag}" )
# this will reply to the Ajax / POST, and cause the page to re-draw with new face override to person_tag # this will reply to the Ajax / POST, and cause the page to re-draw with new face override to person_tag
resp={} return make_response( jsonify( person_tag=p.tag ) )
resp['person_tag']=p.tag
return resp
################################################################################ ################################################################################
# /remove_force_match_override -> POST # /remove_force_match_override -> POST
@@ -379,11 +369,10 @@ def remove_force_match_override():
jex.append( JobExtra( name="face_id", value=face_id ) ) jex.append( JobExtra( name="face_id", value=face_id ) )
jex.append( JobExtra( name="person_id", value=p.id ) ) jex.append( JobExtra( name="person_id", value=p.id ) )
# dont do status update here, the F/E is in the middle of a dbox, just send metadata through to the B/E # dont do status update here, the F/E is in the middle of a dbox, just send metadata through to the B/E
NewJob( "metadata", 0, None, jex ) NewJob( "metadata", num_files=0, wait_for=None, jex=jex, desc="create metadata for removing forced match" )
# this will reply to the Ajax / POST, and cause the page to re-draw with new face override # this will reply to the Ajax / POST, and cause the page to re-draw with new face override (data is not used)
resp={} return make_response( jsonify( person_tag=p.tag ) )
return resp
################################################################################ ################################################################################
# /remove_no_match_override -> POST # /remove_no_match_override -> POST
@@ -403,11 +392,10 @@ def remove_no_match_override():
jex.append( JobExtra( name="face_id", value=face_id ) ) jex.append( JobExtra( name="face_id", value=face_id ) )
jex.append( JobExtra( name="type_id", value=type_id ) ) jex.append( JobExtra( name="type_id", value=type_id ) )
# dont do status update here, the F/E is in the middle of a dbox, just send metadata through to the B/E # dont do status update here, the F/E is in the middle of a dbox, just send metadata through to the B/E
NewJob( "metadata", 0, None, jex ) NewJob( "metadata", num_files=0, wait_for=None, jex=jex, desc="create metadata for removing forced non-match" )
# this will reply to the Ajax / POST, and cause the page to re-draw with new face override # this will reply to the Ajax / POST, and cause the page to re-draw with new face override (data is not used)
resp={} return make_response( jsonify( face_id=face_id ) )
return resp
################################################################################ ################################################################################
@@ -435,10 +423,8 @@ def add_no_match_override():
jex.append( JobExtra( name="face_id", value=f.id ) ) jex.append( JobExtra( name="face_id", value=f.id ) )
jex.append( JobExtra( name="type_id", value=t.id ) ) jex.append( JobExtra( name="type_id", value=t.id ) )
# dont do status update here, the F/E is in the middle of a dbox, just send metadata through to the B/E # dont do status update here, the F/E is in the middle of a dbox, just send metadata through to the B/E
NewJob( "metadata", 0, None, jex ) NewJob( "metadata", num_files=0, wait_for=None, jex=jex, desc="create metadata for adding forced non-match" )
print( f"Placing an override of NO Match for face_id {face_id}" ) print( f"Placing an override of NO Match for face_id {face_id}" )
# this will reply to the Ajax / POST, and cause the page to re-draw with new face override to person_tag # this will reply to the Ajax / POST, and cause the page to re-draw with new face override to person_tag
resp={} return make_response( jsonify( type=t.name ) )
resp['type']=t.name
return resp

7
settings.py
View File

@@ -3,7 +3,6 @@ from flask_wtf import FlaskForm
from flask import request, render_template, redirect, url_for from flask import request, render_template, redirect, url_for
from sqlalchemy import Sequence from sqlalchemy import Sequence
from sqlalchemy.exc import SQLAlchemyError from sqlalchemy.exc import SQLAlchemyError
from status import st, Status
from flask_login import login_required, current_user from flask_login import login_required, current_user
from main import db, app, ma from main import db, app, ma
@@ -98,10 +97,10 @@ def settings():
if request.method == 'POST' and form.validate(): if request.method == 'POST' and form.validate():
try: try:
from job import SetFELog
s = Settings.query.one() s = Settings.query.one()
if 'submit' in request.form: if 'submit' in request.form:
st.SetMessage("Successfully Updated Settings" ) SetFELog("Successfully Updated Settings" )
s.import_path = request.form['import_path'] s.import_path = request.form['import_path']
s.storage_path = request.form['storage_path'] s.storage_path = request.form['storage_path']
s.recycle_bin_path = request.form['recycle_bin_path'] s.recycle_bin_path = request.form['recycle_bin_path']
@@ -122,7 +121,7 @@ def settings():
db.session.commit() db.session.commit()
return redirect( url_for( 'settings' ) ) return redirect( url_for( 'settings' ) )
except SQLAlchemyError as e: except SQLAlchemyError as e:
st.SetMessage( f"<b>Failed to modify Setting:</b>&nbsp;{e.orig}", "danger" ) SetFELog( f"<b>Failed to modify Setting:</b>&nbsp;{e.orig}", "danger" )
return render_template("settings.html", form=form, page_title=page_title, HELP=HELP) return render_template("settings.html", form=form, page_title=page_title, HELP=HELP)
else: else:
form = SettingsForm( obj=Settings.query.first() ) form = SettingsForm( obj=Settings.query.first() )

25
templates/base.html
View File

@@ -96,7 +96,7 @@
<a class="nav-item dropdown nav-link dropdown-toggle" href="#" id="AdminMenu" data-bs-toggle="dropdown" aria-haspopup="true" aria-expanded="false">Admin</a> <a class="nav-item dropdown nav-link dropdown-toggle" href="#" id="AdminMenu" data-bs-toggle="dropdown" aria-haspopup="true" aria-expanded="false">Admin</a>
<div class="dropdown-menu" aria-labelledby="AdminMenu"> <div class="dropdown-menu" aria-labelledby="AdminMenu">
<a class="dropdown-item" href="{{url_for('settings')}}">Edit Settings</a> <a class="dropdown-item" href="{{url_for('settings')}}">Edit Settings</a>
<a class="dropdown-item" href="{{url_for('scannow')}}">Scan now (for new files)</a> <a class="dropdown-item" href="{{url_for('scan_ip')}}">Scan now (for new files)</a>
<a class="dropdown-item" href="{{url_for('scan_sp')}}">Scan Storage Path</a> <a class="dropdown-item" href="{{url_for('scan_sp')}}">Scan Storage Path</a>
{% if config.ENV != "production" %} {% if config.ENV != "production" %}
<a class="dropdown-item" href="{{url_for('forcescan')}}">Force Scan (delete data & rebuild)</a> <a class="dropdown-item" href="{{url_for('forcescan')}}">Force Scan (delete data & rebuild)</a>
@@ -135,27 +135,10 @@
{% if not InDBox %} {% if not InDBox %}
{%block script_content %}{% endblock script_content %} {%block script_content %}{% endblock script_content %}
<div id="status_container" class="position-fixed top-0 end-0 p-1 my-5" "z-index: 11"> <div id="status_container" class="position-fixed top-0 end-0 p-0 my-5" "z-index: 11"> </div>
<div id="st1" class="toast hide align-items-center text-white bg-success border-0" role="alert" aria-live="assertive" aria-atomic="true"> <!-- CheckForJobs(), will see if there are any messages/jobs and keep doing this until there are 0 more and then stop -->
<div class="d-flex">
<div class="toast-body">
</div>
<button type="button" class="btn-close btn-close-white me-2 m-auto" data-bs-dismiss="toast" aria-label="Close"></button>
</div>
</div>
</div>
<script> <script>
$(document).ready(function() { $(document).ready(function() { CheckForJobs() } )
<!-- f/e messages are resident in memory of the page being rendered, just process now (stay this way so faster/dont need DB for some message) -->
{% if GetMessage()|length %}
msg = "{{ GetMessage()|safe }}"
msg=msg.replace('href=', 'class=link-light href=')
st=Object; st.message=msg; st.alert='{{GetAlert()}}'; StatusMsg(st)
<!-- call ClearStatus: strictly not needed as we are near finished rendering, and any new page will lose it from memory (better to be explicit) -->
{{ ClearStatus() }}
{% endif %}
CheckForJobs()
} )
</script> </script>
</body> </body>
</html> </html>

1
user.py
View File

@@ -4,7 +4,6 @@ from flask import request, redirect
from flask_login import UserMixin, login_required from flask_login import UserMixin, login_required
from main import db, app, ma from main import db, app, ma
from sqlalchemy.exc import SQLAlchemyError from sqlalchemy.exc import SQLAlchemyError
from status import st, Status
# pylint: disable=no-member # pylint: disable=no-member