ddp/photoassistant: PhotoAssistant - allows me to remove duplicate photos, more easily create folders to store common photos and uses python AI libraries to find faces and allows searching across all - photoassistant - Gitea

ddp/photoassistant

Go to file

Damien De Paoli 5c840273c2 added hidden route to wake up the job manager

2021-01-19 23:33:08 +11:00

reference_images

further refinement of gitignore

2021-01-13 14:07:24 +11:00

KLUDGE around num_passes for now, jobs need a clean up before I finish the new wait_for jobs

2021-01-19 23:31:37 +11:00

.gitignore

trying to force reference_images/ into git

2021-01-13 14:03:26 +11:00

ai.py

git commit, converted over to base.html pulling Status*, rather than every render_template calling it. Tightened up naming for job manager, fixed a few bugs in there with items like div by zero, created the active jobs link/badge in navbar, have it invoked each time by base.html template and it gets active jobs from DB, pa_job_manager now initiliases from an empty DB and can work out where it is at, no loop/thread/or actual job code yet. jobs.py has basics of a NewJob(), so next step is to force that job to be executed in pa_job_manager, but its tea time

2021-01-16 17:51:16 +11:00

BUGs

fixed BUG-1 ages ago (timezones)

2021-01-19 23:29:51 +11:00

files.py

moved over to new ENTRY based data structures for loading from DB and viewing content

2021-01-19 17:33:10 +11:00

job.py

added hidden route to wake up the job manager

2021-01-19 23:33:08 +11:00

logs.py

added a logs.py, not completely finished but theoretically just initialise the class to start the logger

2021-01-13 13:54:25 +11:00

main.py

moved over to new ENTRY based data structures for loading from DB and viewing content

2021-01-19 17:33:10 +11:00

pa_job_manager.py

set up FileType properly, select on in DB, rather than add new ones each time, ouch! Also renamed type to type_id (better as it is a new foreign key) and use type as the relationship to hold the object anyway

2021-01-19 17:32:33 +11:00

person.py

remove unnecessary import

2021-01-19 17:30:13 +11:00

README

added instructions on how to run all this

2021-01-19 17:29:41 +11:00

refimg.py

git commit, converted over to base.html pulling Status*, rather than every render_template calling it. Tightened up naming for job manager, fixed a few bugs in there with items like div by zero, created the active jobs link/badge in navbar, have it invoked each time by base.html template and it gets active jobs from DB, pa_job_manager now initiliases from an empty DB and can work out where it is at, no loop/thread/or actual job code yet. jobs.py has basics of a NewJob(), so next step is to force that job to be executed in pa_job_manager, but its tea time

2021-01-16 17:51:16 +11:00

settings.py

git commit, converted over to base.html pulling Status*, rather than every render_template calling it. Tightened up naming for job manager, fixed a few bugs in there with items like div by zero, created the active jobs link/badge in navbar, have it invoked each time by base.html template and it gets active jobs from DB, pa_job_manager now initiliases from an empty DB and can work out where it is at, no loop/thread/or actual job code yet. jobs.py has basics of a NewJob(), so next step is to force that job to be executed in pa_job_manager, but its tea time

2021-01-16 17:51:16 +11:00

shared.py

change how we calculate active jobs, probably will remove it from pa_job_engine, safer with threads I think. But, mostyle, added in client / server socket comms between web FE and job manager, with better job creation message (including link to job detail) and when you view job detail it auto-refreshes every few seconds until job complete)

2021-01-17 12:35:28 +11:00

status.py

renamed ClearMessage to better name of ClearStatus, and exposed it to jinja2 so status messages now work in base.html

2021-01-10 12:17:14 +11:00

tables.sql

small renames of id to eid, added num_files to DIR and removed comments

2021-01-19 23:32:47 +11:00

TODO

stopping for the night, so keeping track of where I am at

2021-01-19 23:30:53 +11:00

README

In here we can put instructions on how to run this / any general info


ubuntu packages:
	sudo apt-get install -y mediainfo

pip packages:
    * pymediainfo
    * PIL (should be there by default)
    * ExifRead
    * opencv-python
    * datetime
    * pytz


To run debug version of web server:
    FLASK_APP=main FLASK_ENV=development flask run --host=192.168.0.2

to run prod version of web server:
    gunicorn --bind="192.168.0.2:5000" --threads=2 --workers=2 main:app

Also have to run the job manager for jobs to work:
    python3 pa_job_manager.py

To rebuild DB:

    ###BE CAREFUL this completely destroys the database contents and starts from
    #scratch, when we get real data, we will instead cp a backup file not the
    #tables.sql

    ( cd /srv/docker/config/ ; sudo docker-compose  stop padb ;  yes | sudo docker-compose rm padb ; sudo rm -rf /srv/docker/container/padb/data/ ; sudo cp /home/ddp/src/photoassistant/tables.sql /srv/docker/container/padb/docker-entrypoint-initdb.d/tables.sql ; sudo docker-compose up padb )

Languages

Python 67.5%

HTML 22.1%

JavaScript 9.3%

Shell 0.7%

Dockerfile 0.4%