Exporting Issues

  • Thread starter Thread starter Mark Smith
  • Start date Start date
Status
Not open for further replies.
M

Mark Smith

Guest
Hello all,

**ISSUE**

When I export to an external drive my internal drive loses the equal disk space - then when I quit lightroom the space ''magically'' reappears back on my internal HDD (exports are on my external in the correct place) - however the disk thinks it's full and the internal disk space errors pops up and stops the exporting.

I initially had the library on my internal disk and the original images on the external, attempting to export to the external - then when the issue persisted I scrapped everything and created an entirely new library on the external - reimported the images from the external (where the original images are) and still same issue when I try to export.

This is quite unusual and has just started happening. In the past I could have as little as 1GB of internal disk space and work off my 2TB external without issue.




**Background**

RAW-TIFF from a 5D mark II.

Usually 1K+ images from a macbook to an external drive via fw8''.

I have done this for quite some time using both version 1 and 2 of lightroom and a mixture of dSLR's. No previous issue



Any ideas how to correct this? I've trashed my .plist and gone through some other house keeping.....

Thanks
 
Sort by date Sort by votes
Kolorist, just saying welcome, and acknowledging your question.

I'm on Windows, with plenty of internal drive space, and haven't encountered this problem. So, I don't have anything productive to offer.

You're doing a straight export of JPGs from LR to the external, but the internal indicates it's filling up? (But then fixes itself, before you can identify what's taking up the space?)
 
Upvote 0 Downvote
Brad,

It's as though the files are exporting to both the internal and external. However if I look at my disk space while I quit lightroom, the space is instantly returned. I've hunted endlessly on my internal to see if maybe the files were actually being ''physically'' put somewhere on my internal before quitting - but no.

Mark - ACR is only to do with RAWs correct? In any case regardless of the file type the issue persists. I trashed my .plist so that reset any post export processes - non appear to be active

losing hair!!

Mark (trying to get my user name to my real name)
 
Upvote 0 Downvote
Mark, user names are fine, but we encourage real name signatures for the friendliness of it. As you did it this time. Also important, are the various system tech specs you'll see in most signatures, it saves a lot of back and forth when issues may be platform/application specific.

If you actually want to change, send a forum private message to Ian Farlow, the Admin. I think he can fix that. (Maybe Victoria, too, I'm not sure of that)

On the ACR cache thing, I'm not positive that's raw only. Because of the way LR non-destructively edits, all file types go thru a rendering process. (Whether that actually taps the ACR cache, I dunno')

One thing you could try, it's pretty painless to move or resize the cache. Edit > Preferences > File Handling tab; Choose a new location for the ACR Cache in the 3rd panel down, try moving it to the external temporarily.
 
Upvote 0 Downvote
tried it all

deleted LR and any associated files.. Issue still lives on. I have tried other drives, still same.

What is going on !?!
 
Upvote 0 Downvote
Mark, can you please detail exactly the steps you are taking as this seems very weird.
 
Upvote 0 Downvote
Kiwi Geoff,

Sure,

It doesn't really matter which format as the issue persists for all formats.

Anyhow one example would be

1 - Shoot - dump images from CF card to desktop

2 - Import images (.CR2 = 5D Mark II files) into Lightroom

(Ive tried both - '' add photos to catalog without moving'' and ''copy/move to new location....'')

3 - Make adjustments and so forth.

4 - Export TIFF to external drive

It doesn't matter where the library folder is or where the original images are. I have tried various combos - such as:

- library on HDD - RAW files on External - Export to external
- library on external - RAW files on external - Export to external


I have deleted the .plist - all associated folders such as receipts - registration the actual program and its extensions such as presets.

I deleted the receipt so I would be prompted to enter the serial (i purchased the software - not cracked or anything) hoping that would reset as much as possible. Still nothing.

2 new tests I just performed in the last hour or so, was move the files over to a different external entirely - but no such luck.

Also, went into an old library and tried to export and the issue was still there.


Again to make the issue clear. Essentially if I have 1''GB of images, when I export to the external the same volume is subtracted from my internal disk on the computer - however as soon as i quit lightroom, the 1''GB is put back instantly


!
 
Upvote 0 Downvote
Kiwi Geoff,

Sure,

It doesn't really matter which format as the issue persists for all formats.

Anyhow one example would be

1 - Shoot - dump images from CF card to desktop

2 - Import images (.CR2 = 5D Mark II files) into Lightroom

(Ive tried both - '' add photos to catalog without moving'' and ''copy/move to new location....'')

3 - Make adjustments and so forth.

4 - Export TIFF to external drive

It doesn't matter where the library folder is or where the original images are. I have tried various combos - such as:

- library on HDD - RAW files on External - Export to external
- library on external - RAW files on external - Export to external


I have deleted the .plist - all associated folders such as receipts - registration the actual program and its extensions such as presets.

Reinstalled

I deleted the receipt so I would be prompted to enter the serial (i purchased the software - not cracked or anything) hoping that would reset as much as possible. Still nothing.

2 new tests I just performed in the last hour or so, was move the files over to a different external drive and repeat entirely - but no such luck.

Also, went into an old library and tried to export and the issue behaved the same way?? An old library that never saw this issue before!


Again to make the issue clear. Essentially if I have 1''GB of images, when I export to the external the same volume is subtracted from my internal disk on the computer - however as soon as i quit lightroom, the 1''GB is put back instantaneously???


!
 
Upvote 0 Downvote
Mark, are you on Mac or Windows? (I apologize if you've said already.)

I ask because once we know the answer, we can try to find a tool which can detect where the new files are and figure out what they are.
 
Upvote 0 Downvote
Okay, then you can use find in a Terminal window to figure this out. Here are the steps:
  1. Open up a Terminal window.
  2. In the Terminal window run
    Code: 
    cd /Volumes/'Macintosh HD'
    The quotes are important because there's a space in the name of the disk. If you've renamed your disk, substitute its name for 'Macintosh HD'.
  3. Start up Lightroom and prepare to export, but don't start it yet.
  4. In the Terminal window run
    Code: 
    find . -mtime -1 > /tmp/before
  5. Do your export.
  6. In the Terminal window run
    Code: 
    find . -mtime -1 > /tmp/after
  7. In the Terminal window run
    Code: 
    diff /tmp/before /tmp/after
The result will tell us which files have changed since you started the export.
 
Upvote 0 Downvote
Mark thanks for the instructions

Other then curious observations I've never played with the terminal window. Open new basic window - type in the command - then how do I ''run'' it?

thanks
 
Upvote 0 Downvote
Check the Trash while your exporting.... I have a problem where LR fills the trash with files while re-building dng previews, it could be a similar mechanism.
 
Upvote 0 Downvote
also Macintosh HD is a soft link to / so it will search all the connected disks too and will take a while to run...

I'll do some testing...............
 
Upvote 0 Downvote
Results...

Well, I have about 2' pages of data to post (not going to post it all unless there is a key area to show), most if it looks like its repeating - one common thread I can see is everything is ending in - permission denied

Do I have a permissions issue?

find: ./private/var/at/tabs: Permission denied
find: ./private/var/at/tmp: Permission denied
find: ./private/var/backups: Permission denied
find: ./private/var/db/dhcpclient: Permission denied
find: ./private/var/db/DirectoryService: Permission denied
find: ./private/var/db/dslocal/indices/Default: Permission denied
find: ./private/var/db/dslocal/nodes/Default: Permission denied
find: ./private/var/db/krb5kdc: Permission denied
find: ./private/var/db/shadow: Permission denied
find: ./private/var/folders/Mt/Mtof7szjGWuxlvlxclX3tU+++TM/-Caches-: Permission denied
find: ./private/var/folders/zz/zzzivhrRnAmviuee+++++++++++/-Caches-: Permission denied
find: ./private/var/folders/zz/zzzivhrRnAmviuee++++EE+++22/-Caches-: Permission denied
find: ./private/var/folders/zz/zzzivhrRnAmviuee++++EE+++22/-Tmp-: Permission denied
find: ./private/var/folders/zz/zzzivhrRnAmviuee++++KE+++3Y/-Caches-: Permission denied
find: ./private/var/folders/zz/zzzivhrRnAmviuee++++KE+++3Y/-Tmp-: Permission denied
find: ./private/var/folders/zz/zzzivhrRnAmviuee++++L++++3k/-Caches-: Permission denied
find: ./private/var/folders/zz/zzzivhrRnAmviuee++++L++++3k/-Tmp-: Permission denied
find: ./private/var/folders/zz/zzzivhrRnAmviuee++++ME+++42/-Caches-: Permission denied
find: ./private/var/folders/zz/zzzivhrRnAmviueezzzzzjzzzzs/-Caches-: Permission denied
find: ./private/var/folders/zz/zzzivhrRnAmviueezzzzzjzzzzs/-Tmp-: Permission denied
find: ./private/var/log/krb5kdc: Permission denied
find: ./private/var/log/samba/cores: Permission denied
find: ./private/var/root: Permission denied

and so on..............
 
Upvote 0 Downvote
Mark, you could add the data as a text file attached.
 
Upvote 0 Downvote
I have just spent a fair bit of time trying this and I couldn't find any cached / copies of images while I was exporting to another drive. I cut my search down to just the local drive which made it a bit quicker too.

The permission denied errors are fine... these are because you don't have root access which is required for many folders.

Where are you seeing the disk usage ? ie What tool is showing that the local drive has space being used ?
 
Upvote 0 Downvote
If we can't find the problem using Marks approach above then it may be a good idea to narrow the problem down to a specific root directory. This would help speed up our search. There is also the possibility the files being created are private and you won't have permission to see them. The following commands can be run in Terminal to get the size of the root directories (we are interested in), it will take a few minutes to run.

cd /
sudo du -sh `ls -p | grep -v Volumes | grep -v net | grep /`

now run an export of a few GB and then repeat the command so we can see which directory has grown in size.

The command will ask for your password so that it can run as root and get accurate information about all files (so no permission denied errors). Note that the single quotes are back quotes (on the tilde key) not ordinary quotes (next to the return key)

The output should look something like this...

sudo du -sh `ls -p | grep -v Volumes | grep -v net | grep /`
Password:
6.5G Applications/
1'G Library/
'B Network/
4.4G System/
126G Users/
7.4M bin/
'B cores/
2.'K dev/
1.'K home/
754M private/
5.1M sbin/
1.1G usr/
 
Upvote 0 Downvote
Just as a side thought, how much RAM available on that machine? Could it be using VM because it's running out of RAM doing the export?
 
Upvote 0 Downvote
Hello all,

I was out of town- - just got to it today


Last login: Fri Jun 19 23:21:'2 on console
CPE''1b6391efb5-CM''159a4'278a:~ Mark$ cd /
CPE''1b6391efb5-CM''159a4'278a:/ Mark$ sudo du -sh `ls -p | grep -v Volumes | grep -v net | grep /`
Password:
3'G Applications/
du: Audio: No such file or directory
du: Render: No such file or directory
du: Files/: No such file or directory
du: Capture: No such file or directory
du: Scratch/: No such file or directory
57G Library/
'B Network/
76K P2CMS/
du: Previous: No such file or directory
du: Systems.localized/: No such file or directory
du: Render: No such file or directory
du: Files/: No such file or directory
3.9G System/
4.'K TheVolumeSettingsFolder/
1'7G Users/
7.5M bin/
'B cores/
2.'K dev/
1.'K home/
55M opt/
4.5G private/
5.2M sbin/
939M usr/
CPE''1b6391efb5-CM''159a4'278a:/ Mark$ cd /
CPE''1b6391efb5-CM''159a4'278a:/ Mark$ sudo du -sh `ls -p | grep -v Volumes | grep -v net | grep /`
Password:
3'G Applications/
du: Audio: No such file or directory
du: Render: No such file or directory
du: Files/: No such file or directory
du: Capture: No such file or directory
du: Scratch/: No such file or directory
57G Library/
'B Network/
76K P2CMS/
du: Previous: No such file or directory
du: Systems.localized/: No such file or directory
du: Render: No such file or directory
du: Files/: No such file or directory
3.9G System/
4.'K TheVolumeSettingsFolder/
11'G Users/
7.5M bin/
'B cores/
2.'K dev/Mark
1.'K home/
55M opt/
4.5G private/
5.2M sbin/
939M usr/
CPE''1b6391efb5-CM''159a4'278a:/ Mark$
 
Upvote 0 Downvote
ok, so how much did you export ? about 3GB worth ?

/Users has grown by 3GB during the export.

where did you export too during this test ?
 
Upvote 0 Downvote
Status
Not open for further replies.
Back
Top