The DAM Forum
Welcome, Guest. Please login or register.
May 25, 2013, 04:15:01 AM

Login with username, password and session length
Search:     Advanced search
Jan 9, 2012
John Beardsworth's new Lightroom site
Lightroom Solutions
27960 Posts in 5113 Topics by 2914 Members
Latest Member: imthedamstar
* Home Help Search Login Register
+  The DAM Forum
|-+  DAM Stuff
| |-+  Backup Strategies and Tools
| | |-+  Folder structure questions
« previous next »
Pages: [1] Print
Author Topic: Folder structure questions  (Read 2311 times)
RichB
Newbie
*
Posts: 10


View Profile
« on: November 03, 2006, 06:23:51 AM »

I download from my camera into a folder named yymmdd_subject.  Underneath, I create 2 master derivative folders (I use both Capture and Photoshop) and a delivery folder.  At some point, I am ready to deal with backing up and using iView Media Pro.  (Note: I am planning on downloading a trial version of Media Pro today to verify this will be my cataloging sw, but am assuming I will end up using it.)  My dilemma is when do I move these files to my backup structure (RAW_###) and (DRV_###) and what happens to the original working structure?  (I can't tell from the DAM workflow on pg. 9) Or is my concept of the working structure all messed up?   Which structure do I use for my catalog; i.e., the working structure or the backup structure?  Or is there a better workflow?  It appears there is a "Working" folder used on pg. 168 of DAM.

1.  Move the Raw files to the RAW_### folder immediately after I complete updating the IPTC info?
2.  Have the catalog import the ingested files either immediately after downloading or after updating the IPTC info?
3.  Have the catalog import the working files either daily or after completing the editing and/or creating the deliveries?
4.  Have the catalog import the files after moving everything to the backup structure (RAW_### and DRV_###)?

Thanks,
Rich
Logged
David Anderson
Sr. Member
****
Posts: 287


View Profile
« Reply #1 on: November 03, 2006, 08:28:41 AM »

Rich,
Questions about whether one workflow is better than another are a little difficult to answer with certainty because everyone's needs are different. There is a wide spectrum of DAM users, from a busy professional like Peter Krogh (whose book tells you that he created 135,000 digital images within 3 years!) to an amateur photographer like myself who takes less than 2500 images every year. That being said, most of the principles espoused in The DAM Book apply across the board. The differences lie in the detail. Another point worth making is that most people find that they have to read Peter's book at least twice!

In my own case, a single 300GB hard disk on my PC is more than enough to take all my images. I have a root folder called My Pictures. Under this there are two subfolders, Archive and Working. The Archive folder is further subdivided into Originals and Derivatives (I also have some other subfolders here for film scans, pictures from other people, etc, but for simplicity these may be ignored for the present).

My Originals folder contains a set of RAW_### 'bucket' subfolders and a set of DNG_### 'bucket' subfolders. The DNG_### folders are used for both original JPEGs taken before I changed to using Raw, and for DNG conversions. In practice, they form my primary original archive. The RAW_### folders contain the original Raw files generated in the camera, which are kept only for added security (Peter chooses to delete his Raw originals). The bucket structure, of course, enables easy backup to DVD - a vital process that should not be delayed. My Derivatives folder simply contains a set of DERIV_### 'bucket' subfolders.

At present, my Working folder only contains an Ingestion folder for new images (in folders automatically named by ingestion date). I will probably choose to create working folders here for new derivatives, which are currently being stored directly into the active DERIV_### bucket. The higher your image creation rate, the more likely you will want to separate your current derivative generation activity from the archived derivatives.

Because my storage infrastructure is relatively simple, I choose to catalogue everything in MediaPro on an ongoing basis. That means that images newly added to my Ingestion folder may be catalogued even before I have added bulk metadata and keywords in Bridge. That just means that I have to run a Sync Annotations process in MediaPro at a later date, which is not a big deal. In my circumstances, I don't think that there is some critical point when images should be transferred from the Working folder structure to the Archive folder structure. The normal prerequisites are to complete the basic metadata annotations and a basic level of ACR adjustments. The files can be transferred at any time after that, though not so long after that you seriously delay backup to DVD. Both the Working folder and the MediaPro catalogue file should be regularly backed up in addition to your bucket DVD backups.

If I understand you correctly, your folder structure seems to mix together all types of image (ingestion, original, derivative and working) in the same hierarchy. I'm not saying that this can't work, but I think that there may be some practical advantages in keeping these different sets of images in separate parallel folder structures, as I have described.

Hope this helps.

David    

 
Logged
RichB
Newbie
*
Posts: 10


View Profile
« Reply #2 on: November 03, 2006, 04:43:05 PM »

David,
Darn right it helps.  I can't tell you how impressed I am with your most articulate, thoughtful, and thorough reply.  You have addressed most of my concerns.  I love your directory structure and am still trying to assess why I shouldn't mimic it.  I, too have an (external) 300GB hard drive.  However, I use my second internal HD, for performance, to create my derivatives.

So, let me ask you some timing questions.  Do you see a problem with the following:

1. Ingest to Working/YYMMDD_subject
2. Update metadata
3. Copy to HD RAW_###/YYMMDD_subject
4. Copy to DVD RAW_###/YYMMDD_subject with
5. Create Derivatives and process the deliverables
6. Copy Derviatives to HD DERIV_###/YYMMDD_subject
7. Copy to DVD  DERIV_###/YYMMDD_subject

I am assuming each step will be accompanied with MediaPro cataloging/Sync Annotations.  (Thanks for the Sync Annotations bonus tip.  I'll check it out when I download the MediaPro trial.)

I like the idea of having a subfolder that loosely describes the contained images and I think Peter gave his blessing on this approach in his book.

Between Peter's book and your answer, I feel I am ready to start pulling the trigger (depending upon your response to this message, if you so choose).

A hearfelt thank you again for your generous reply. 

Rich
Logged
David Anderson
Sr. Member
****
Posts: 287


View Profile
« Reply #3 on: November 04, 2006, 11:49:52 AM »

Rich,
Thank you for your kind words. I'm more than happy to try and help as others here have helped me. I'm only a few notches further up the learning curve than you and I know how confusing it all seems at the start.

I never normally use subject-oriented subfolders within my original bucket folders, but as long as you are still planning to fill your buckets in strict chronological order then such subfolders are not a problem. However MediaPro, or any other catalogue app, is where you should normally be searching for all files for a given subject (as I'm sure you already know). I do use some subject folders within my derivative buckets, but I don't yet claim to have fully sorted my derivative workflow.

Your proposed workflow looks fine, except that I would strongly recommend that you also consider conversion to DNG (please ask if you don't understand the benefits). The Sync Annotations process in MediaPro is only necessary if you have added keywords, etc, outside MediaPro to files that have already been catalogued. If you choose to do all bulk metadata (via a template) and basic keywording via Bridge during initial processing before cataloguing in MediaPro, and if all subsequent additional metadata is added via MediaPro, then you will not need to use Sync Annotations to import such data. You might, however, use Sync Annotations to export metadata back to the original files.

David

Logged
Pages: [1] Print 
« previous next »
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.11 | SMF © 2006-2009, Simple Machines LLC Valid XHTML 1.0! Valid CSS!