• Welcome to the Lightroom Queen Forums! We're a friendly bunch, so please feel free to register and join in the conversation. If you're not familiar with forums, you'll find step by step instructions on how to post your first thread under Help at the bottom of the page. You're also welcome to download our free Lightroom Quick Start eBooks and explore our other FAQ resources.
  • Stop struggling with Lightroom! There's no need to spend hours hunting for the answers to your Lightroom 6 questions. All the information you need is in Adobe Lightroom 6 - The Missing FAQ!

    To help you get started, there's a series of easy tutorials to guide you through a simple workflow. As you grow in confidence, the book switches to a conversational FAQ format, so you can quickly find answers to advanced questions. When you upgrade to subscription, there's also a Lightroom Classic version available.
  • The February 2020 Lightroom updates are now available. Lightroom Classic has a brand new Defaults system, the ability to set a specific monitor for the secondary window and PSB format support. Lightroom (cloud-based service) has the ability to import presets on Android, DNG export and Split View support on iPadOS. The Missing FAQ and Edit Like a Pro eBooks are already updated for the changes.

Slow LR 6.14 Catalog Backup Problem

marinephoto

Active Member
Joined
Dec 4, 2014
Messages
139
Lightroom Experience
Intermediate
Lightroom Version
6.14
Operating System
macOS 10.13 High Sierra
Awhile ago I began to experience painfully slow Catalog backups so I posted here in search of advice. By painfully slow I mean that when exiting Lightroom after clicking the checkboxes for Optimize Catalog and Backup Catalog it would take several hours for the process to complete. My Library contains around 75,000 images and the Catalog at the time was 13.7 GB in size. People responding said that was a very large catalog size for 75,000 images so I asked if an extensive Develop History could account for the large size and slow backup speed, Folks said it could so eventually I made a duplicate catalog for experimenting with and deleted the Develop History from all 75,000 photos, This reduced the catalog size from 13.7 GB to 2.34 GB. I decided that I wanted to retain the Develop History for my 4 ✩ or better images, so I did a sort for all images less than 4 ✩ and deleted the Develop History from all but 2,500 of the 4 ✩ or better images. This resulted in a catalog size of 5.79 GB. Hoping that this would result in a much faster catalog backup time I Optimized and Backed Up the modified, now much smaller, 5.79 GB catalog, but to my dismay it still takes more than an hour to complete. I don't know precisely how long because I've never had the time to sit there and wait. Neither do I know just how long it should take to complete a catalog backup.

Some had mentioned that this slow backup could indicate a problem with catalog corruption but I have never gotten any error code, nor have I seen any other problem that might indicate catalog corruption. It did occur to me today, however that the ESET Cyber Security software I am running might be playing a role in this??? Does anyone know if this might be the case? If not, any idea what the problem might be causing such slow catalog backups? I am using a 2017 21.5" Retina Screen iMac 3 Ghz Intel Core i5 Processor with 16 GB of memory, running High Sierra 10.13.6 My equipped with a 1 TB Fusion Drive with 375 GB available and I am saving the catalog to that internal drive

Thanks!
 

marinephoto

Active Member
Joined
Dec 4, 2014
Messages
139
Lightroom Experience
Intermediate
Hi

I have heard of Anti-virus causing issues in the past. Can you exclude files or folders from it? As the catalog is entirely local to you, one may question the need for it to be monitored.
Paul last night at 11:30 pm I deactivated both my ESET Cyber Security App and Time machine, exited Lightroom clicking Check Catalog Integrity and Optimize Catalog and clicked OK. Forty minutes later the progress bar had barely moved an eighth of an inch. When I checked this morning 8.5 hrs later the screen said "Compressing Catalog." A minute or two later it said "Copying Catalog." And then when the progress bar was nearly at the end it said "Optimizing Catalog." The inner workings of Lightroom shall forever remain a mystery to me so although I am generally good at diagnosing problems this one eludes me. But clearly something is wrong here.

As I said earlier I have never gotten any catalog corruption errors, or anything indicating catalog trouble. I do however recall that a year or so ago I ran into a problem that may be playing a role in this? I began shooting with two different cameras and started getting duplicate file names. To resolve this I used Lightroom's sorting power to sort shots by camera name/model and I added that prefix to the image names: As in ShawD700_YRMODY_01.dng, ShawD500_, etc. After doing this I did see some odd images names show up from time to time with screwy names like
“ShawD71_190514_710019.DNG”. I was never able to figure out what caused this and wonder now if this may be causing catalog problems now?

I guess the question is where to I go from here? The future of 11 years work and 75,000 images depends upon me making the right decesion. I know in the past I've seen notes on this forum that Victoria knows someone at Adobe who is expert at dealing with catalog problems and I am wondering if she might be willing to forward my catalog to him to see if he can figure out what the problem is and how to fix it?
 
Joined
Jun 20, 2009
Messages
15,343
Location
Houston, TX USA
Lightroom Experience
Power User
Lightroom Version
Classic
I don't see a reason to send this catalog file to Victoria just yet. Even a 5.79GB catalog seems huge for an inventory of ~75K images.
I would like you to make a different kind of test. Select ALL of the images in the 5.79GB master catalog and use the function " Export as a Catalog..." to create a new catalog This will make a copy of the metadata about all of your ~75K images in a new catalog. it will leave behind any detritus and orphaned records that might be causing problems. Once you never this Exported catalog , report its size (Hopefully it will be under 1GB) and open it in LR 6.14 like you would your master catalog . The exit Lightroom normally doing the usual catalog backup/integrity check. You can then report any observed difference in backup behavior.
 

marinephoto

Active Member
Joined
Dec 4, 2014
Messages
139
Lightroom Experience
Intermediate
I don't see a reason to send this catalog file to Victoria just yet. Even a 5.79GB catalog seems huge for an inventory of ~75K images.
I would like you to make a different kind of test. Select ALL of the images in the 5.79GB master catalog and use the function " Export as a Catalog..." to create a new catalog This will make a copy of the metadata about all of your ~75K images in a new catalog. it will leave behind any detritus and orphaned records that might be causing problems. Once you never this Exported catalog , report its size (Hopefully it will be under 1GB) and open it in LR 6.14 like you would your master catalog . The exit Lightroom normally doing the usual catalog backup/integrity check. You can then report any observed difference in backup behavior.
Cletus

Thanks! Sounds like good news to me and much appreciated. I will follow your instructions soon as I get a moment and report back what I discover. Hopefully the news wiil be good!
 

LexS

Member
Joined
Feb 14, 2019
Messages
48
Lightroom Experience
Intermediate
Lightroom Version
6.x
Why do you run Eset Cyber Security at all? Why not dump it completely as it does not do anything that the mac does not do on itself !. Setting it off does not help, only uninstalling helps, and then a restart. Another remark I want to make is this, did you set Filevault on your mac? If so do you really know why?
 

marinephoto

Active Member
Joined
Dec 4, 2014
Messages
139
Lightroom Experience
Intermediate
Why do you run Eset Cyber Security at all? Why not dump it completely as it does not do anything that the mac does not do on itself !. Setting it off does not help, only uninstalling helps, and then a restart. Another remark I want to make is this, did you set Filevault on your mac? If so do you really know why?
To answer your question ESET was loaded on my computer by the repair shop I paid to transfer all my stuff over from my old iMac. They gavve it a strong recomendation at the time. I had my doubts but gave them the OK to load it. When the 1 year subscription ran out I did not renew. I'm still not clear on the vulnerability of the Mac OS to threats. Some sites say you need protection, others say you do not. I recently happened upon the very impressive MacMost site on YouTube and like you Gary says that the Mac OS already features the ability to get rid of threats and that nothing else is required. Soon as get a moment I will get rid of it. As to Filefault...I watch James Bond movies, but I have no desire to star in one of them.
 

LexS

Member
Joined
Feb 14, 2019
Messages
48
Lightroom Experience
Intermediate
Lightroom Version
6.x
Look in the Apple Forum. Mac OS & System Software - Apple Community. Choose your OS, although it is the same in all OS: numerous discussions on Antivirus and other "saviour apps": always recommended NOT to install these.
BTW in Windows OS10 the built in safety is better than any outside app too, Look in the windows security from the menu.
 

marinephoto

Active Member
Joined
Dec 4, 2014
Messages
139
Lightroom Experience
Intermediate
Look in the Apple Forum. Mac OS & System Software - Apple Community. Choose your OS, although it is the same in all OS: numerous discussions on Antivirus and other "saviour apps": always recommended NOT to install these.
BTW in Windows OS10 the built in safety is better than any outside app too, Look in the windows security from the menu.
I checked out your link and it does indeed appear that ESET is not the best thing since sliced bread. I cheched out ESET's instructions for uninstalling the app and will do so. My question is just how important is it to track down and delete the ESET files left behind after following their uninstall directions? Gary at MacMost says it is simply not worth the trouble.
 

LexS

Member
Joined
Feb 14, 2019
Messages
48
Lightroom Experience
Intermediate
Lightroom Version
6.x
To burn out all leftovers is probably not important. However there are small free apps that can uninstall including all the remains:
Appdelete.app and Apcleaner.app. Both not in the Appstore. Other such apps can do "too much" for you.
Success.
 

marinephoto

Active Member
Joined
Dec 4, 2014
Messages
139
Lightroom Experience
Intermediate
To burn out all leftovers is probably not important. However there are small free apps that can uninstall including all the remains:
Appdelete.app and Apcleaner.app. Both not in the Appstore. Other such apps can do "too much" for you.
Success.
Thanks!
 
Top