I was thinking more about this. Maybe you can add a “Show More” button or link at the bottom of lets say X number of photos shown. That way, if I do not want to see every photo in the folder or face recognition area under people, it would only show a set amount. This could be done by being responsive to the device/monitor. E.g., a large screen would show more photos upfront, then clicking Show More would show the same amount of photos added to the list.
So if X=10, Show More would have 20 photos shown OR it would fill up the rest of the area in the screen, as if I enlarged the app window, it could fill in the rest of the blank space with photos and a Show More button at the bottom of that.
I believe that might be tricky when more faces are recognized, but right now the list of yellow question marks can become cumbersome at times.