Face recognition / registration

Gerhard

Hello Andrey,
I don’t know whether this is a bug or user error …
After I had problems with the hanging Tonfotos on Windows, I used the program with Linux and MacOS for my photo collection of about 70,000 photos … including the face recognition.
After it was announced that the error on Windows has been fixed, I have now used the program again on Windows.

What I am experiencing now, however, is very, very strange.
The program scans through all folders (which takes about 15 hours) and successively recognizes the peoples faces. Probably via the tonfotos.ini located in the folders?
Interestingly, from time to time, for one face or another, multiple folders with the same name are created. When I try to merge these via command, they sometimes disappear completely, and I always have to start over and over to reconfirm all these faces. In addition, I have the feeling that the database is becoming increasingly unstable, as the suggestions for faces are also becoming more and more inappropriate.
Perhaps the reason is that I had previously scanned the photo collection with Windows, Linux, and MacOS?

Can you please give me a hint on what I might be doing wrong or what I can do to stop this infinite loop? Can I somehow reset the database?

Thank you very much for your help,
Best regards, Gerhard

Andrey

Gerhard First, please read this about poor face suggestions. If your database is already saturated with recognized faces, this is more or less expected behavior. The thing is that settings like “suggest less” or previously rejected faces are not stored in .ini files. Those files only contain information about confirmed faces. So when you scan your collection anew, you may still apply those “suggest less” settings again.

However it sounds there is some bug with merging people. They definitely should not disappear after merge. Can you please be more specific and describe step by step how to reproduce this behaiviour?

Gerhard

Hi Andrey,
Thank you so much for your feedback regarding the facial recognition algorithm – I understand.

Now to my problem:
It’s about face folders repeatedly disappearing and the constant need to re-verify the same faces …
1.) When the program starts, sometimes, a dialog box appears with mny faces in it, asking for the name of this person.
Usually it’s my face, or my wife’s – for whatever reason. … maybe because for us, I get the most matches?
When I then enter the name, the message “Person added” appears, and I have to re-verify an incredible number of faces – including the many incorrect suggestions.
It also happens during the scan, that more than one folder will be created with my name or my wife’s name. Here ist can happen that when I click the merge function, that these folders disappear immediately or, what also can happen is, that one of the folders is not accessable. No right mouse menu appears, no picture is shown.
I also cannot scroll over (when mouse is in the picture panel). The program stops at this section - coming from the previous faces and scrolling dow, or from following faces, scrolling up.
On top - after a program restart - this folder is no more shown! and this person is entirely kicked out.

Another observation is that while scanning for faces, the number of detected faces increases (over 1000 hits) and then suddenly drops to fewer than ten. Then the number increases again, and I have to reconfirm everything.

I generally get the impression that facial recognition is no longer learning, or is constantly forgetting what it has learned.
Sorry, but it’s difficult to provide a step-by-step description because - in my case - the program behaves so unpredictably.

Nevertheless, I hope it helps - best regards,
Gerhard

Andrey

Gerhard It looks like there is some serious problem with data consistency. People should not disappear! This is not normal at all. Everything else you are observing is just a consequence of the fact thad data is not stored properly. Can you please make logs and send them to us? More about logs here: https://community.tonfotos.com/d/26-making-debug-logs-in-tonfotos

Andrey

Gerhard Thank you for the logs. I can see few things we need to resolve first before going further.

First of all your CUDA fails very often. That may leed to faces being completely lost. Since your initial indexing is done, you don’t need CUDA that much. I would suggest you remove CUDA Runtime completely to to get this out the way. CPU processing is very stable, and since you only will need it occasionally, there will be no noticeable performance impact.

Second, permissions. I can see errors in the log when program get rejected with EPERM error when trying to update ini files. This can actually lead to some of the issues you are experiencing, namely your changes to peple/faces can get lost because of that.

I am not sure this is the only problem (there can also be an issue with dossier file) but let us resolve those first and see if that will resolve everything.

If some errors will remain, I would recommend you to delete dossier file (and backup file next to it too). That will make it be recreated again, and with this some of the confilcts with the data will be gone.

Please let me know if that helped.