Re-index folder

GlikeG

Hi Andrey,

Is there a way to re-index the whole folder?

I ask because I see that for some folders, Tonfotos in previous runs wasn’t successful in detecting faces.
I don’t want to investigate why, but instead I prefer to re-index the whole folder.

Any tips on that?

Andrey

GlikeG You can select files and then do “re-index” from context menu. However I guess this is not what you are asking and you want to do that with subfolders too. In that case you can exclude whole folder from the index (right click on it in the navigation pane) and then add it again (in the Library locations dialog). That will force complete reindex of folder with all subfolders.

GlikeG

Andrey Yes, this trick with folder removal from the library and adding it once again is doing the job.

Anyway, it would be amazing to have an option to re-search faces in the selected folder, rather than proceeding with a workaround. This would save some time and resources.

Andrey

GlikeG I am not sure what exactly you mean by “that would save some time and resources”. In order to search for faces again you will have to re-read all photos and re-run image recognition. This is 90% of what is happening during re-index. I am afraid, there is not much to optimize.

Also, why you think this operation (re-search for faces) should be more prominent in the UI? I thought this is extremely rare operation. Why you had to do it by the way?

GlikeG

Andrey Here is an extract (after anonymisation) showing processing for one file (and some additional details for the other 2):

+1ms | Assigning 2011-01-21T21:21:11.000Z NaN NaN normdirs: [] +2ms | time is not trusted, alernative time undefined undefined from undefined to undefined +3ms | n.events.length 1 +1ms | res { id: 1111111111111 } +115ms | Nothing to recognize for 20.jpg +102ms | V-R-path: XYZ:\abc name: 2.jpg parent_id:2222222222222 +35ms | Unload from cache 11.jpg cache len = 36 +6ms | Cache miss: XYZ:\abc\2.jpg +1ms | Creating sharp: XYZ:\abcz\2.jpg ->0.000s +2ms | { ctime: 2011-01-21T21:21:11.696Z, mtime: 2011-01-21T21:21:11.000Z, birthtime: 2011-01-21T21:21:11.696Z, exif_dates: {}, xmp: { faces: [], metadata: { 'xmpMM:OriginalDocumentID': '111111111111111111111111111111111', 'xmpMM:DocumentID': 'xmp.did:11111111-2222-3333-4444-555555555555', 'xmpMM:InstanceID': 'xmp.iid:11111111-2222-3333-4444-555555555555', 'xap:MetadataDate': '2011-01-21T21:21:11+01:00' }, 'dc:rights': [ 'abc' ] }, png: undefined }

GlikeG

I see that I need to re-index a few folders, as Tonfotos was unable to find faces during the initial run.
I have no idea what went wrong during the first attempt.

GlikeG

Unfortunately, in 1.13.9, the trick of removing the folder and adding it again doesn’t work.
It doesn’t detect faces in images.
Only re-indexing selected photos performs face detection.

It looks like a bug.

GlikeG

Andrey this was regarding the latest version of program where face detection stopped to work.
I mentioned it in one post above - GlikeG

Andrey

GlikeG Unfortunately, I am not sure I understand what you are trying to demonstrate by this log portion. Can you please explain?

Andrey

GlikeG I am a bit confused. I thought you already sorted out this issue using re-index comand, no?

GlikeG

Andrey I’m also very confused, but let’s take it step by step.

Yes, for the old folder, where I was missing detected faces, for selected photos, I can re-index them.
Yes, for old folders, I was able to do batch face detecting on the whole folder by the suggested workaround.
In the latest version of Tonfotos, when it is re-importing photos from the reintroduced folder (suggested workaround to re-index the whole folder at once), it is not detecting any faces.

Since the beginning of my journey with Tonfotos, face detection and face assignment suggestions have been very unstable.
I suggested several improvements to detect places where it hiccups, to give a chance to push them through manually, but none were accepted or implemented in the software.
This situation makes Tonfotos unreliable to do its job.

If there is any way to sort it out, I’m more than happy to help and deliver necessary, detailed input.
Maybe I’m doing something wrong, but with such limited options, I have a problem finding something.
I would love to trust Tonfotos that it’s doing its job.

Andrey

GlikeG Sorry you feel this way. I know this is not really an excuse, but for most of users faces recognition in Tonfotos “just works” and they do not have same negative experience as you have, and they never have to re-index photos. If I remember correctly, this all started for you with CUDA not functioning correctly, which happens sometimes, but only for small portion of the users. We tend to assume this has to do with NVidia drivers malfunction or GPU working unstable, but we don’t know for sure, unfortuntately.

Regarding item 3, this is totally my fault. This suggestion is outdated, it is not supposed to work as described. We changed something in our algorithms several months ago to improve stability, but I did not take this into account when suggesting it to you. Now, in current version you not only need to hide folder and then enable it again, you need to delelete tonfotos.ini files in that folder when it is still hidden. Only then it will result to re-recongition of all faces in your case (when previously faces were errourneously missed due to CUDA issue). Hope that makes sense.

GlikeG

Andrey now we have progress 🙂
Deleting the INI file was my next best guess to solve the problem.

I’ll try to come back if there are any further challenges.

Andrey, I really appreciate your help!

GlikeG

Andrey yesterday, I tested INI file deletion before re-adding the folder to the library. Everything works, and now all faces are recognised.
Today I have added CUDA, and it can still recognise faces. It works much faster, with lower CPU utilisation, which means that it can finally run using CUDA capabilities.

Thank you for your help and valuable advice.
Have a wonderful weekend!