• Welcome to Lightroom Forums! We're a friendly bunch, so please feel free to register and join in the conversation. If you're not familiar with forums, you'll find step by step instructions on how to register and post your first thread under Help on the menubar above. You're also welcome to join our newsletter, download our free Lightroom Quick Start eBook and explore our other FAQ resources.
  • You may have noticed this website was offline on Saturday 22nd September. Our web host suffered what is known as "a perfect storm". Everything that could go wrong, did go wrong. As a result of restoring backups, we appear to have lost about 18 hours of posts, but hopefully nothing more. If your post seems to have been affected, please do repost, and we look forward to helping. If you have any questions, you're welcome to use the Contact Webmaster link on the page footer.
  • Lightroom Classic 7.5 and Lightroom CC 1.5 have just gone live, and there's some exciting mobile updates to follow. And the big news... my Lightroom CC - Edit Like a Pro book has just been released too!

Facial Recognition

tspear

Senior Member
Joined
Sep 23, 2014
Messages
1,640
Location
Waltham MA
Lightroom Experience
Beginner
Lightroom Version
Classic 7
#1
Operating System: Windows 10
Exact Lightroom Version (Help menu > System Info): Lr Classic CC 7.0.2

I have been using facial recognition in Lr since it was introduced. This is a critical part of my flow for family/friends events and for send out images to family/friends. It is rather annoying and tedious to do though.

I have recently been quasi forced into using Google hangouts and Facebook tagging. OMG the facial tagging in these two platforms is light years ahead of Lr. Does anyone know of any standalone facial tagging tools which I can export back as keywords to facial regions using sidecar files?

Tim
 

mcasan

Active Member
Joined
Apr 26, 2015
Messages
403
Location
Atlanta
Lightroom Experience
Intermediate
Lightroom Version
Classic 7
#2
I have yet to get that feature to work reliably on brown bears, lions, or even birds. ;)
 

Ferguson

Linwood Ferguson
Staff member
Moderator
Lightroom Guru
Joined
Jan 18, 2009
Messages
1,713
Location
Cape Coral, FL
Lightroom Experience
Intermediate
#3
I've never heard of anyone doing it, but taking a quick look...

The XMP file has a pretty simply reverse engineered format for face regions. It seems to just contain spacing and the keywords. Spacing appears to be fractions of the frame.

So if you could somehow export from Google or Facebook the information, transform it into this format, you could put it in an XMP and import. I think LR would create the keywords and regions.

But LR also builds an index of face recognition data. I doubt it would update that from the regions in the XMP. I'm not sure. Moreover, if it did I think you would need to very precisely build the region to its expectation (which are not documented and unlikely to match the region size and shape of the other two. Now maybe none of that matters if you are not ever going to use LR itself for indexing.

One complication is that the regions in LR are pre-crop, so you can't crop and push up to google and pull it from there without a lot of care to map the region back to where it was.

Another is whether not matching their expectations for regions will cause something bad to happen when it interacts with LR's face recognition stuff. I think when you import an image with face regions, it gets excluded from further face recognition, but that doesn't mean it gets excluded from all processing such as its indexing of face shape data.

It sure would be nice to have an alternative. I just stopped using the current one, as it was really not very good.
 
Joined
Jan 27, 2013
Messages
895
Location
Netherlands
Lightroom Experience
Power User
Lightroom Version
Classic 7
#4

tspear

Senior Member
Joined
Sep 23, 2014
Messages
1,640
Location
Waltham MA
Lightroom Experience
Beginner
Lightroom Version
Classic 7
#5
@Ferguson

If I find a better tool for face recognition, that I can use to tag the images, I am not going to continue or use the facial recognition database in Lr. I would just want the data associated with the images for search capabilities.

@Roelof Moorlag

Yes. That is how it works. However, Picasa was ended years ago.

Tim
 

Ferguson

Linwood Ferguson
Staff member
Moderator
Lightroom Guru
Joined
Jan 18, 2009
Messages
1,713
Location
Cape Coral, FL
Lightroom Experience
Intermediate
#6
@Roelof Moorlag I had not seen that program, that's very interesting how JF worked that out.

I also remembered this company: Excire Search - Find your Lightroom Images fast and intuitive

They have a facial component. I have no idea if they are any good, or if this component works, and how it would integrate. There was a flurry of discussion with them a while back, then I have not heard of them in a year or two, but might be worth a look if you haven't.
 

tspear

Senior Member
Joined
Sep 23, 2014
Messages
1,640
Location
Waltham MA
Lightroom Experience
Beginner
Lightroom Version
Classic 7
#7
@Roelof Moorlag I had not seen that program, that's very interesting how JF worked that out.

I also remembered this company: Excire Search - Find your Lightroom Images fast and intuitive

They have a facial component. I have no idea if they are any good, or if this component works, and how it would integrate. There was a flurry of discussion with them a while back, then I have not heard of them in a year or two, but might be worth a look if you haven't.
Excire tags the faces, and some attributes. e.g. Smiling, angry... It does NOT associate the face with a name. Further, it really only works if the face is straight on to the camera.
When I talked to them at some point last year they had facial recognition on the road map. They just could not say when a release was targeted or desired; or if this was one, two or ten down the priority list.

Tim
 
Joined
Jan 27, 2013
Messages
895
Location
Netherlands
Lightroom Experience
Power User
Lightroom Version
Classic 7
#8
Yes. That is how it works. However, Picasa was ended years ago.
I had not seen that program, that's very interesting how JF worked that out
Indeed, that was my point. If JF have found a way to do it with Picasa, someone else (or he) could do it again with Google and/or Facebook.
 

tspear

Senior Member
Joined
Sep 23, 2014
Messages
1,640
Location
Waltham MA
Lightroom Experience
Beginner
Lightroom Version
Classic 7
#9
From what I have explored, neither Google or FaceBook expose the metadata from facial recognition.
Interestingly, I did find a beta product from Microsoft that does that is a couple of years old.

Tim
 

solexcire

New Member
Joined
Sep 14, 2018
Messages
4
Lightroom Experience
Beginner
Lightroom Version
6.x / CC 2015.x
#10
Excire tags the faces, and some attributes. e.g. Smiling, angry... It does NOT associate the face with a name. Further, it really only works if the face is straight on to the camera.
When I talked to them at some point last year they had facial recognition on the road map. They just could not say when a release was targeted or desired; or if this was one, two or ten down the priority list.

Tim
It is on top of our list today!
Sol
 

PhilBurton

Senior Member
Joined
Nov 16, 2015
Messages
1,383
Location
California, USA
Lightroom Experience
Intermediate
Lightroom Version
Classic 7
#11
Excire tags the faces, and some attributes. e.g. Smiling, angry... It does NOT associate the face with a name. Further, it really only works if the face is straight on to the camera.
When I talked to them at some point last year they had facial recognition on the road map. They just could not say when a release was targeted or desired; or if this was one, two or ten down the priority list.

Tim
Tim,

I should have ask you this question back in February, but ...

Are you using Excire for overall keywording? If so, how well does it work for you? How much do you need to change or delete Excire keywords? How much do you need to do manual keywording?

Phil Burton
 

tspear

Senior Member
Joined
Sep 23, 2014
Messages
1,640
Location
Waltham MA
Lightroom Experience
Beginner
Lightroom Version
Classic 7
#12
Tim,

I should have ask you this question back in February, but ...

Are you using Excire for overall keywording? If so, how well does it work for you? How much do you need to change or delete Excire keywords? How much do you need to do manual keywording?

Phil Burton
I am not using it. Back then I was only interested in facial tagging. My meta-data is mostly comprised of event, local, season, and who is in the image.
Based on a some recent questions and images searches, I may be interested in expanding my meta-data. But for now, I have not. I also have been focused on other projects, such as finding a new CTO/CIO position.

Tim
 

PhilBurton

Senior Member
Joined
Nov 16, 2015
Messages
1,383
Location
California, USA
Lightroom Experience
Intermediate
Lightroom Version
Classic 7
#14

solexcire

New Member
Joined
Sep 14, 2018
Messages
4
Lightroom Experience
Beginner
Lightroom Version
6.x / CC 2015.x
#15

solexcire

New Member
Joined
Sep 14, 2018
Messages
4
Lightroom Experience
Beginner
Lightroom Version
6.x / CC 2015.x
#16
Roelof,

Thank you for this article. It was very interesting, even though it left out some detailed explanations. I will definitely do a trial soon.

Phil Burton
Phil

I would be pleased to answer all your questions and you might find a lot of answers in our forum as well.
Excire Forum - English Community
Best
Sol
 

solexcire

New Member
Joined
Sep 14, 2018
Messages
4
Lightroom Experience
Beginner
Lightroom Version
6.x / CC 2015.x
#17
Phil

I would be pleased to answer all your questions and you might find a lot of answers in our forum as well.
Excire Forum - English Community
Best
Sol
I am not using it. Back then I was only interested in facial tagging. My meta-data is mostly comprised of event, local, season, and who is in the image.
Based on a some recent questions and images searches, I may be interested in expanding my meta-data. But for now, I have not. I also have been focused on other projects, such as finding a new CTO/CIO position.

Tim
This is a new article from Andrew Darlow:

Excire Search: A Groundbreaking Search and Auto Keyword Tool for Lightroom – Hands-On Review : The Imaging Buffet
 

PhilBurton

Senior Member
Joined
Nov 16, 2015
Messages
1,383
Location
California, USA
Lightroom Experience
Intermediate
Lightroom Version
Classic 7
#18
Phil

I would be pleased to answer all your questions and you might find a lot of answers in our forum as well.
Excire Forum - English Community
Best
Sol
Sol,

Thank you.

I am starting to use a controlled vocabulary from www.controlledvocabulary.com. I need to see how well Excire integrates with the CVKC (or not). It's very important that Excire does not use its own keywords if the keywords are available in CVKC, particularly after I've added keywords from an Excire run into CKVC. I just have to download the trial and try out the different use cases.

Phil Burton
 
Joined
Nov 16, 2015
Messages
1,383
Location
California, USA
Lightroom Experience
Intermediate
Lightroom Version
Classic 7
#19
Sol,

Thank you.

I am starting to use a controlled vocabulary from www.controlledvocabulary.com. I need to see how well Excire integrates with the CVKC (or not). It's very important that Excire does not use its own keywords if the keywords are available in CVKC, particularly after I've added keywords from an Excire run into CKVC. I just have to download the trial and try out the different use cases.

Phil Burton
Sol,

I was hoping that you would reply to my post, quoted. After i did some searching on the Excrire website, there are concerns that Excire maintains its own keyword list in Lightroom, separate from the keyword tree structure created by the user.

Phil Burton
 
Top