Facial Recognition

tspear

Senior Member
Joined
Sep 23, 2014
Messages
1,713
Location
Waltham MA
Lightroom Experience
Beginner
Lightroom Version
Classic 7
#1
Operating System: Windows 10
Exact Lightroom Version (Help menu > System Info): Lr Classic CC 7.0.2

I have been using facial recognition in Lr since it was introduced. This is a critical part of my flow for family/friends events and for send out images to family/friends. It is rather annoying and tedious to do though.

I have recently been quasi forced into using Google hangouts and Facebook tagging. OMG the facial tagging in these two platforms is light years ahead of Lr. Does anyone know of any standalone facial tagging tools which I can export back as keywords to facial regions using sidecar files?

Tim
 

mcasan

Active Member
Joined
Apr 26, 2015
Messages
419
Location
Atlanta
Lightroom Experience
Intermediate
Lightroom Version
Classic 7
#2
I have yet to get that feature to work reliably on brown bears, lions, or even birds. ;)
 

Ferguson

Linwood Ferguson
Staff member
Moderator
Lightroom Guru
Joined
Jan 18, 2009
Messages
1,783
Location
Cape Coral, FL
Lightroom Experience
Intermediate
#3
I've never heard of anyone doing it, but taking a quick look...

The XMP file has a pretty simply reverse engineered format for face regions. It seems to just contain spacing and the keywords. Spacing appears to be fractions of the frame.

So if you could somehow export from Google or Facebook the information, transform it into this format, you could put it in an XMP and import. I think LR would create the keywords and regions.

But LR also builds an index of face recognition data. I doubt it would update that from the regions in the XMP. I'm not sure. Moreover, if it did I think you would need to very precisely build the region to its expectation (which are not documented and unlikely to match the region size and shape of the other two. Now maybe none of that matters if you are not ever going to use LR itself for indexing.

One complication is that the regions in LR are pre-crop, so you can't crop and push up to google and pull it from there without a lot of care to map the region back to where it was.

Another is whether not matching their expectations for regions will cause something bad to happen when it interacts with LR's face recognition stuff. I think when you import an image with face regions, it gets excluded from further face recognition, but that doesn't mean it gets excluded from all processing such as its indexing of face shape data.

It sure would be nice to have an alternative. I just stopped using the current one, as it was really not very good.
 
Joined
Jan 27, 2013
Messages
934
Location
Netherlands
Lightroom Experience
Power User
Lightroom Version
Classic 7
#4

tspear

Senior Member
Joined
Sep 23, 2014
Messages
1,713
Location
Waltham MA
Lightroom Experience
Beginner
Lightroom Version
Classic 7
#5
@Ferguson

If I find a better tool for face recognition, that I can use to tag the images, I am not going to continue or use the facial recognition database in Lr. I would just want the data associated with the images for search capabilities.

@Roelof Moorlag

Yes. That is how it works. However, Picasa was ended years ago.

Tim
 

Ferguson

Linwood Ferguson
Staff member
Moderator
Lightroom Guru
Joined
Jan 18, 2009
Messages
1,783
Location
Cape Coral, FL
Lightroom Experience
Intermediate
#6
@Roelof Moorlag I had not seen that program, that's very interesting how JF worked that out.

I also remembered this company: Excire Search - Find your Lightroom Images fast and intuitive

They have a facial component. I have no idea if they are any good, or if this component works, and how it would integrate. There was a flurry of discussion with them a while back, then I have not heard of them in a year or two, but might be worth a look if you haven't.
 

tspear

Senior Member
Joined
Sep 23, 2014
Messages
1,713
Location
Waltham MA
Lightroom Experience
Beginner
Lightroom Version
Classic 7
#7
@Roelof Moorlag I had not seen that program, that's very interesting how JF worked that out.

I also remembered this company: Excire Search - Find your Lightroom Images fast and intuitive

They have a facial component. I have no idea if they are any good, or if this component works, and how it would integrate. There was a flurry of discussion with them a while back, then I have not heard of them in a year or two, but might be worth a look if you haven't.
Excire tags the faces, and some attributes. e.g. Smiling, angry... It does NOT associate the face with a name. Further, it really only works if the face is straight on to the camera.
When I talked to them at some point last year they had facial recognition on the road map. They just could not say when a release was targeted or desired; or if this was one, two or ten down the priority list.

Tim
 
Joined
Jan 27, 2013
Messages
934
Location
Netherlands
Lightroom Experience
Power User
Lightroom Version
Classic 7
#8
Yes. That is how it works. However, Picasa was ended years ago.
I had not seen that program, that's very interesting how JF worked that out
Indeed, that was my point. If JF have found a way to do it with Picasa, someone else (or he) could do it again with Google and/or Facebook.
 

tspear

Senior Member
Joined
Sep 23, 2014
Messages
1,713
Location
Waltham MA
Lightroom Experience
Beginner
Lightroom Version
Classic 7
#9
From what I have explored, neither Google or FaceBook expose the metadata from facial recognition.
Interestingly, I did find a beta product from Microsoft that does that is a couple of years old.

Tim
 

solexcire

New Member
Joined
Sep 14, 2018
Messages
7
Lightroom Experience
Beginner
Lightroom Version
6.x / CC 2015.x
#10
Excire tags the faces, and some attributes. e.g. Smiling, angry... It does NOT associate the face with a name. Further, it really only works if the face is straight on to the camera.
When I talked to them at some point last year they had facial recognition on the road map. They just could not say when a release was targeted or desired; or if this was one, two or ten down the priority list.

Tim
It is on top of our list today!
Sol
 

PhilBurton

Senior Member
Joined
Nov 16, 2015
Messages
1,502
Location
California, USA
Lightroom Experience
Intermediate
Lightroom Version
Classic 7
#11
Excire tags the faces, and some attributes. e.g. Smiling, angry... It does NOT associate the face with a name. Further, it really only works if the face is straight on to the camera.
When I talked to them at some point last year they had facial recognition on the road map. They just could not say when a release was targeted or desired; or if this was one, two or ten down the priority list.

Tim
Tim,

I should have ask you this question back in February, but ...

Are you using Excire for overall keywording? If so, how well does it work for you? How much do you need to change or delete Excire keywords? How much do you need to do manual keywording?

Phil Burton
 

tspear

Senior Member
Joined
Sep 23, 2014
Messages
1,713
Location
Waltham MA
Lightroom Experience
Beginner
Lightroom Version
Classic 7
#12
Tim,

I should have ask you this question back in February, but ...

Are you using Excire for overall keywording? If so, how well does it work for you? How much do you need to change or delete Excire keywords? How much do you need to do manual keywording?

Phil Burton
I am not using it. Back then I was only interested in facial tagging. My meta-data is mostly comprised of event, local, season, and who is in the image.
Based on a some recent questions and images searches, I may be interested in expanding my meta-data. But for now, I have not. I also have been focused on other projects, such as finding a new CTO/CIO position.

Tim
 

PhilBurton

Senior Member
Joined
Nov 16, 2015
Messages
1,502
Location
California, USA
Lightroom Experience
Intermediate
Lightroom Version
Classic 7
#14

solexcire

New Member
Joined
Sep 14, 2018
Messages
7
Lightroom Experience
Beginner
Lightroom Version
6.x / CC 2015.x
#15

solexcire

New Member
Joined
Sep 14, 2018
Messages
7
Lightroom Experience
Beginner
Lightroom Version
6.x / CC 2015.x
#16
Roelof,

Thank you for this article. It was very interesting, even though it left out some detailed explanations. I will definitely do a trial soon.

Phil Burton
Phil

I would be pleased to answer all your questions and you might find a lot of answers in our forum as well.
Excire Forum - English Community
Best
Sol
 

solexcire

New Member
Joined
Sep 14, 2018
Messages
7
Lightroom Experience
Beginner
Lightroom Version
6.x / CC 2015.x
#17
Phil

I would be pleased to answer all your questions and you might find a lot of answers in our forum as well.
Excire Forum - English Community
Best
Sol
I am not using it. Back then I was only interested in facial tagging. My meta-data is mostly comprised of event, local, season, and who is in the image.
Based on a some recent questions and images searches, I may be interested in expanding my meta-data. But for now, I have not. I also have been focused on other projects, such as finding a new CTO/CIO position.

Tim
This is a new article from Andrew Darlow:

Excire Search: A Groundbreaking Search and Auto Keyword Tool for Lightroom – Hands-On Review : The Imaging Buffet
 

PhilBurton

Senior Member
Joined
Nov 16, 2015
Messages
1,502
Location
California, USA
Lightroom Experience
Intermediate
Lightroom Version
Classic 7
#18
Phil

I would be pleased to answer all your questions and you might find a lot of answers in our forum as well.
Excire Forum - English Community
Best
Sol
Sol,

Thank you.

I am starting to use a controlled vocabulary from www.controlledvocabulary.com. I need to see how well Excire integrates with the CVKC (or not). It's very important that Excire does not use its own keywords if the keywords are available in CVKC, particularly after I've added keywords from an Excire run into CKVC. I just have to download the trial and try out the different use cases.

Phil Burton
 

PhilBurton

Senior Member
Joined
Nov 16, 2015
Messages
1,502
Location
California, USA
Lightroom Experience
Intermediate
Lightroom Version
Classic 7
#19
Sol,

Thank you.

I am starting to use a controlled vocabulary from www.controlledvocabulary.com. I need to see how well Excire integrates with the CVKC (or not). It's very important that Excire does not use its own keywords if the keywords are available in CVKC, particularly after I've added keywords from an Excire run into CKVC. I just have to download the trial and try out the different use cases.

Phil Burton
Sol,

I was hoping that you would reply to my post, quoted. After i did some searching on the Excrire website, there are concerns that Excire maintains its own keyword list in Lightroom, separate from the keyword tree structure created by the user.

Phil Burton
 

solexcire

New Member
Joined
Sep 14, 2018
Messages
7
Lightroom Experience
Beginner
Lightroom Version
6.x / CC 2015.x
#20
Phil

Sorry, but because of the Photokina Show and a 10 days family trip to NYC, I did not visit the blog.
We create our own keyword hierarchy for our keywords (named Excire) so the that there is no mixing with existing keywords.

I hope this helps you.

Sol
 

PhilBurton

Senior Member
Joined
Nov 16, 2015
Messages
1,502
Location
California, USA
Lightroom Experience
Intermediate
Lightroom Version
Classic 7
#21
I'm sorry to read that Excire keywords do not integrate with any other keyword hierarchies. Consider adding this feature as a future enhancement that can really broaden the appeal of your product. As is, I can't use Excire and won't even spend the time to evaluate it.

Phil Burton
 

solexcire

New Member
Joined
Sep 14, 2018
Messages
7
Lightroom Experience
Beginner
Lightroom Version
6.x / CC 2015.x
#22
Hi Phil

There is a misunderstanding. Yes, we do create an Excire hierarchy, which allows you to manage your images even if you do not transfer the tags in your Lightroom catalog. As you might know, the Excire Search version, differently to the Pro version, does not allow a keyword transfer to the Lightroom catalog. If you work with the Ero version instead, you can transfer all the excire keywords to your Lightroom catalog and we will set up the hierarchy in addition to your own keywords. Further, if you change any of the Excire keywords, our system does recognize this and does not apply any changes to this customization.

Best
Sol
 

PhilBurton

Senior Member
Joined
Nov 16, 2015
Messages
1,502
Location
California, USA
Lightroom Experience
Intermediate
Lightroom Version
Classic 7
#23
Hi Phil

There is a misunderstanding. Yes, we do create an Excire hierarchy, which allows you to manage your images even if you do not transfer the tags in your Lightroom catalog. As you might know, the Excire Search version, differently to the Pro version, does not allow a keyword transfer to the Lightroom catalog. If you work with the Ero version instead, you can transfer all the excire keywords to your Lightroom catalog and we will set up the hierarchy in addition to your own keywords. Further, if you change any of the Excire keywords, our system does recognize this and does not apply any changes to this customization.

Best
Sol
Sol,

No I did not know, else I would not have had to ask.

Phil Burton
 

tspear

Senior Member
Joined
Sep 23, 2014
Messages
1,713
Location
Waltham MA
Lightroom Experience
Beginner
Lightroom Version
Classic 7
#24
@solexcire

Do you have a list of of the keywords your engine finds? And also what is the false positive rates?
And how does the keyword transfer work exactly? Your website mentions they are under their own hierarchy, but is kinda vague.

For another personal project, I found it would be neat to classify the image in some manner based on the general category of image. Is this a "group" shot with many people? Is this a "family" shot? Is it mostly background? ... I think you get the idea.; this would appeal I think to hobby photographers. Which may give you more reach. Do you think this would be possible with Excire?
 

solexcire

New Member
Joined
Sep 14, 2018
Messages
7
Lightroom Experience
Beginner
Lightroom Version
6.x / CC 2015.x
#25
Hi Tim

most of your questions are answered on our website. Including this evaluation:

Excire Search - Evaluation of AI-based Image Search

Some of the things you want we already offer, but other things not (family and background share).

I would appreciate if you just test the trial version, its 30 days for free.

Best
Sol
 
Top