Exporting and re-importing Catalogs

[Leon Booyens]

I need to confirm the best procedure to go about exporting a piece of my database as a new catalog, and then re-importing once I have done working with it.

This is due to some speed considerations (I have approx 27k images) and Lightroom gets stuck (hanging - or just keeps failing with any new transaction) when it reaches about 1.5M memory usage. (I have 4Gb -3.2 used by Vista)

I have exported a selection into a new catalog, did some manipulation, and re-imported into light room. One of the things I did was to delete some images from the new catalog (and disk) in the new catalog. This deletion did not go through on the new re-import. I suspect to fix this in my workflow I would have to export a selection, and then delete it from my current catalog (and disk) if I want my workflow to work correctly. This would mean that the import should only import the images left in the manipulated catalog. Although I have backups I am not very comfortable deleting images from my Master catalogue until I understand the impact.

What else will not re-import?
Is there a feature I should be using which I have missed to make this easier?
Is deleting the images from disk the way to do this?

Hope my explanation and question makes sence.

Any help will be appreciated.

Regards
Leon Booyens
Pretoria, South Africa

Software : Lightroom 1.3.1
OS : Vista Home Premium
Hardware : HP Qaud 2.4 4Gb, 4 internal Sata2 Disks, 1 T Laci f8'' Raid 5 as backup. (some other external backup disks)
[COLOR=#''64'']Hobby : Avian Photography
[/COLOR]

 

[DonRicklin]

What a great first question! Unfortunately I am not sure of the answer. Of course the main Catalog would not know about anything you delete in the Exported Catalog, so you would have to delete it there.

Thinking about it! Instead of deleting in the Export Catalog try Labeling by Unpick or other label and delete on re-import. then you will be sure of what you are deleting.


Meanwhile, could you fill in your Signature with Complete OS, System and Gear under User CP.

Welcome,

Don

 

[Leon Booyens]

I have some tests, and have come to the following conclusions.

Deleting the files work, but there is a cost to pay when importing. If you are doing this a folder at a time it seems fine, and you can control where the files are re-imported. Importing with a catalog does not provide for copying the files to a dated folder (if that’s the method you use). I.e. I have a sub folders 2''7-1'-19 to 2''7-1'-21>Kalizo>Namibia>South Africa. If I export Kalizo as a new catalog it creates subfolders and all in the new catalog.
I then delete Kalizo from the original catalog. When I re-import it wants to put them all in one place, without using the date for sub-folders.

There are two solutions I suppose.

1) Don’t delete files in the exported catalog, only mark them as rejected and delete when re-imported in original catalog. (Better solution)

2) Create a new catalog by importing files at their current location. Make sure you do a Ctrl-S on all files to ensure metadata is saved in files. Sync folders from original catalog when done. This will pick up deleted files. The limitation of doing this is that you lose the use of features like collections etc. in the new catalog, as you can't take them back to the original.

Sorry for replying to my own mail. Am I on track?

PS:
I suppose the current multi catalog does not really cater for syncing catalogs and its benefit is when moving in a catalog from your laptop into your catalog. This is a once off merge of new data into your current database. Not going back and forth.

Regards

 

[RipIt]

Leon, you do not state whether, when you export your collection you actually move the assets (files) to a separate location.
IE. Include negative files. I suspect that you are and propose that you dont need to be doing so.

From your main catalog:
Export selection/collection as catalog. Uncheck "include negative files"

This will create a catalog in a location of your choice and will not move/copy the original assets. Perform any edits on the files via the new catalog, including any deletions if you wish.
Close the catalog.

Open the main catalog and import the new catalog. Since both catalogs are referencing the same files all you will need to "import" is the updated metadata.
Then for the deleted files: In the Library module and the Library pane you will see "Missing Files". These will be the references to the actual assets you deleted from the disk via the new catalog. Select the records and delete (remove) from catalog.

Any collections and keywords (metadata) you made in the new catalog will transfer to the main catalog. Even if you wanted to do this operation on a desktop / laptop situation you would be able to because you never actually moved any files. You dont need to move the files if all you are doing is working within Lightroom and do not need to process the files or print Hi Resolutions.

hope this helps

 

[Leon Booyens]

Thank you David,

Yes, I did include negative files ...
... and yes your proposal helps a lot.

It makes much more sence.
I am going to try it and change my workflow.

Sometimes the solution is so obvious you can't see it.

Regards