Help with my Lightroom database / XMP Related Data

  • Thread starter Thread starter dougsturgess
  • Start date Start date
Status
Not open for further replies.
D

dougsturgess

Guest
(I'm using a PC w/XP)

I recently tried to tidy up my folders in Lightroom by renaming them & moving some files. I did this in Lightroom, not Windows Explorer. Lightroom has always made backups upon launch. However, for some reason, now when I look at my folders in Lightroom, many of my portfolio images do not have the history of what was done to them in Lightroom.

I hope that all the time I spent using Lightroom to 'develop' my portfolio images can be restored. Databases scare me.

Can anyone help with advice on how to restore this information?

Thank you.
 
Hi Doug, welcome to the forum!

Sorry to hear you're having trouble. You did absolutely the right thing, moving them in LR. It does seem odd that your history has disappeared though - are the settings all there still?

Can you walk us through exactly how you went about moving them etc, from start to finish?
 
Lightroom & xmp related data

I've been using Lightroom 1.4 & just upgraded to 2.' & am using a PC w/XP.

In both versions, after moving folders around in lightroom, Lightroom has lost the history data of what I've done to the raw files. I have the preferences configured to include this data into the original file instead of writing a separate xmp file.

I've tried reimporting a back up catalog & it doesn't have the history info either. After upgrading to 2.', I tried importing my most recent catalog backup and it, too, had no history info.

One of the main reasons I went with Lightroom was to keep track of the changes I made in developing my raw images & I find it frustrating that I'm going to have to go back through all my originals & re-do them.

Am I just missing something that would retrieve all my stored changes? If so, please help.

On another topic, I guess Windows XP isn't going to come out with a dng viewer for Windows like they did the raw viewer. What are people using out there to view their dng's with on PC platform?

Thanks!
 
Victoria Bampton;176'5 said:
Hi Doug, welcome to the forum!

Sorry to hear you're having trouble. You did absolutely the right thing, moving them in LR. It does seem odd that your history has disappeared though - are the settings all there still?

Can you walk us through exactly how you went about moving them etc, from start to finish?


Sure.

I had a lot of images in different folders in Lightroom. I wanted to re-organize my files for easier management. I read in Scott Kelby's book not to do this in Windows Explorer but to do it in Lightroom as it will automatically change it when viewed in Explorer.

So, for example, I had a folder in Lightroom named 2''7 with many subfolders named for various events. I decided to consolodate all the subfolders into one main DNG file under 2''7. Somewhere in the process, I'm not sure how, my master files (CRW/CR2's) disappeared. So, I exited & either opened a backup catalog or imported the catalog (I can't remember). I have it back up every time I start the program. When I did this, the history wasn't there.

I have the preferences set to write the changes made into the original raw file, not in a separate xmp file. Shouldn't the history information be recorded in the original raw files?

If I back up my entire photo collection to an external hard drive, will the changes that are supposed to be imbedded with the raw file also copy over or not? I gathered from Scott Kelby's book that having it store the changes in a separate xmp file is more of a bother, especially when the program can write the changes directly into the original file.

Thanks for your help. I hope I don't have to completely re-develop my portfolio :)
 
I dont think you are missing anything. The History states are designed to stay with the catalog until such point the image is removed from the catalog or the History panel is cleared.

The preference you have set will only write the last step or current state of the file to the file. It will only do this if you actually use the command "Save Metadata to file".

Also it will not write the changes to a RAW file unless it is a dng (which I guess you are using)

So, if I make changes to a file, remove the file from the catalog for any reason, reimport it, none of the history state will be there nor will the last known develop state.
If I make changes to a file, save metadata to file, remove it from the catalog for any reaso and then reimport it. None of the history states will be ther but the last known develop state will be.
 
I dont think you are missing anything. The History states are designed to stay with the catalog until such point the image is removed from the catalog or the History panel is cleared.

The preference you have set will only write the last step or current state of the file to the file. It will only do this if you actually use the command "Save Metadata to file".

Also it will not write the changes to a RAW file unless it is a dng (which I guess you are using)

So, if I make changes to a file, remove the file from the catalog for any reason, reimport it, none of the history state will be there nor will the last known develop state.
If I make changes to a file, save metadata to file, remove it from the catalog for any reaso and then reimport it. None of the history states will be ther but the last known develop state will be.

Thank you for the clarification, David, and this leads to another question:

Now that my history states are gone, if I re-develop all my .dng portfolio images in lightroom and want to save the history states with the original dng files, I'll have to "save metadata to file" for each image (or can I select all the images after developing them all & "save metadate to file?" If my machine crashes and I have to reinstall the operating system (which happened this week) or I move my files around within Lightroom to tidy up, if import the most recent catalog, will it contain the history states? If I transfer the catalog from my desktop to my laptop, will the history states follow?

I'll have to look, but I don't remember Scott Kelby's Lightroom book saying at all that the history states would only be saved to dng files & that you had to "save metadata to file" manually. Why doesn't Lightroom always save the history states regardless, when backing up a catalog? I had always assumed that was the purpose of backing up the catalog everytime Lightroom opens.
 
History states are only contained in the catalog, whatever you do. It saves them there almost immediately, but never writes it to the original file - it gets too big.

Some data is not stored in XMP (sidecars or file headers) - history, flags & collections are the main ones.

Develop settings, along with most of the data, can be saved to XMP. Select all in Grid view and Ctrl-S / Cmd-S to write to XMP. Alternatively select all in Grid view and go to Metadata menu > Update DNG Metadata & Preview will update the embedded preview too, so that when you view the files in another program, the preview will be up to date.

If you remove files from the catalog, that history will be gone.

If you move files around within LR, it should keep all of the settings including history just fine. If you transfer the catalog back and forth between machines, it should keep all of the settings including history just fine.

If the worst comes to the worst and your hard drive dies, just make sure you've got recent catalog backups as well as your photo backups, and you'll be fine. A catalog backup is simply a duplicate of your current catalog, so should contain all of the existing information.
 
Threads merged for clarity.
 
Lightroom DOES save the history states, that is why I said you are not missing anything. In other words, based on what you wrote there is no logical reason why you do not see your history states.

The example I was trying to illustrate was a case of why the history states may be missing and to clarify that the preferences you have do not determine the safety of the history, only the last developed stage.

You do not have to save metadata to file in order to save the history states as the history states should not go missing, UNLESS as I was trying illustrate the link between the file and Lightrooms record of the file was broken at some point, IE. moving the file without using lightroom. OR reinstalling the software.
Then a new lightroom installation, as far as it is concerned has never seen those files and knows nothing of the history. Building a new catalog of the files will not automatically contain the history as the history is not stored within the file itself it is stored in the catalog.

What you should have been able to do is open a backed up catalog after installation and you should have been able to see the history states provided nothing else changed like the location of the files.

The key word being "should" That is why, based on your original post I say no, you are not missing anything.
 
Thank you both for the clarification. From now on, I'll be sure to import all files as dng's before making any developing changes...and of course, cross my fingers :)
 
Doug, just to make sure we understand and are answering the right question, why are the history states important to you?

In what way do use them (after your adjustment work is completed)? What do you wish to do, that you can't, if the history is missing?
 
Status
Not open for further replies.
Back
Top