The DAM Forum
Welcome, Guest. Please login or register.
April 23, 2014, 04:14:54 PM

Login with username, password and session length
Search:     Advanced search
28003 Posts in 5130 Topics by 2912 Members
Latest Member: kbroch
* Home Help Search Login Register
  Show Posts
Pages: [1]
1  DAM Stuff / Backup Strategies and Tools / Re: Mac and windows apps that can do incremntal backups accurately on: October 28, 2012, 11:52:09 AM
Chronosync will do precisely what you are asking - create a mirror of drive A onto drive B. There is a verify copy option which will add to the integrity of the backup.

I use this to sync to my image backup drive using a script that runs it every hour.
2  DAM Stuff / Backup Strategies and Tools / Anyone moved to Blu-Ray on: October 28, 2012, 08:05:31 AM
Has anyone moved from DVD to blu-ray? I'm thinking this would be much easier as teh buckets would be larger and require fewer burns.

My concerns are:

Will Blu-Ray be around very long as a format? (Then again, will DVDs?)

Will an internal Blu-ray burner be compatible with the new Mac pros that are rumored to be coming out in the near future.

First question is factual, second two are speculative. Thanks for any thoughts you might have.
3  DAM Stuff / Hardware Discussions / Are people still using optical media? Blu-ray? on: April 10, 2012, 04:59:12 PM
I've been using a workflow based on the DAM book which creates an archive with one live copy on HDD, plus two offline HDD copies, plus one copy on DVDs. As the price for Blu-Ray media has dropped significantly since the last time I looked, I was considering switching from DVD to Blu-Ray. I've started shooting with a higher MP sensor and it's taking a lot of time to burn DVDs, not to mention the storage space.

However, some people I've talked to have questioned the archivalness (for lack of a better term) of HDDs which are not powered on occaisionally. I know that DVDs will eventually corrode.

What is the current thinking on archiving data on either HDD or optical media?
4  DAM Stuff / Hardware Discussions / Re: Hard Drive Brands on: April 10, 2012, 02:24:37 PM
I've used Seagate w/o problems for years. But one or two people is not a good enough sample size. You should have a look at http://www.storagereview.com/. they have comprehensive reviews and user-contributed reliability databses for different drives. I don't see a lot of data for the seagates there, and the data hasn't been updated recently. They do say in reviews:

Low Power - Thankfully for consumers the green drive space has three very solid entries that when on sale, are all valid choices. However, we have favorites - for always-on applications like home servers, the Seagate Barracuda LP is a nice choice due to its lowest in class idle power consumption and the Western Digital Caviar Green earns a nod for high reliability. The fifth generation Caviar Green, which come in 2.5TB and 3TB capacities, while if you want to take the step up to a 4TB drive, look at the new 4TB Hitachi Deskstar 5K4000.

http://www.storagereview.com/best_drives

If you can find any concrete data, I'd be interested to see. Apparantly Google did a big reliability study a few years ago, but didn't release the data.
5  DAM Stuff / Loss and Recovery / Re: Thousands of corrupted images on: January 18, 2012, 07:42:42 AM
Matthew --

I think that my problem was a transcription error - files got corrupted during the process of copying from one drive to another. I always use Chronosync's verified copy when copying files now. I'm not sure what happened in your case. I'm assuming that you've run disk utility and or disk warrior, although I'm not sure that would solve any of the problems you're having. I think the files themselves have become corrupt. Can you post some more details? What operating system, what type of storage medium, uncorrupted files are becoming corrupted, etc?
6  Software Discussions / ImageIngester and ImageVerifier / Log not accurate on: April 25, 2011, 07:28:21 PM
Recently started using IV again, and noticed that the log did not register a job I ran last night 4/24 verifying a folder with many sub-folders. I started at about 5PM, finished sometime the following day. The results from IV say that it processed 66,544 images in 11:44. This is inaccurate in terms of time as by 7 the following morning the job was still running. Not so important. More important is that Tools/Results does not show that or other jobs I ran that day, either in Sorted by Date or in Sorted by Folder. By date has jobs run on a day I know I was out of town and ran no jobs, and by folder lists only runs from six months ago.

-jonathan
7  Software Discussions / Choosing Software/Other DAM Applications / Re: Software for large numbers of files ? on: September 30, 2010, 06:02:30 AM
Ignore last post - it's been taken over by Phase One:

http://www.phaseone.com/Phase%20One/Try-and-buy/Online-Store.aspx
8  Software Discussions / Choosing Software/Other DAM Applications / Re: Software for large numbers of files ? on: September 30, 2010, 06:00:37 AM
One of the problems with EM is that it doesn't exist anymore - as far as I can tell MS killed it. Nothing on the website about it anymore...
9  Software Discussions / Choosing Software/Other DAM Applications / Re: Replacing IView Media Pro on Mac with Snow Leopard on: September 30, 2010, 05:57:26 AM
Mike -

I've been using iview in 10.6.4 with few problems. Anyhow, I've heard good things about Extensis Portfolio, but haven't tried it. I think it can be gotten for about $100 with an academic discount.
10  DAM Stuff / Loss and Recovery / Re: Thousands of corrupted images on: May 25, 2010, 10:46:06 AM
Peter - Thanks for posting. In short, yes I was able to recover the images, mostly because I had a pretty rigorous backup and archiving system based on your first book. I simply copied from an archived HD. I think it was a transfer error, as I was not using a verified copy system. I now have a copy of your new book and Chronosync and will use that to copy files from now on.

Do you have any recommendations for verifying images? ImageVerifier seems to work pretty well but gives a lot of false positives (image is corrupt when it is not, and I suppose is better than a false negative) and given that my archive is 100k images, a 1% false positive rate still gives me a thousand images to check. Generating a hash is only good for archived images - writing data to the DNG changes the file. 

I think you mention using Expression Media - does it look at actual image data or only the thumbnail? If not, how would you recommend validating files that IV flags as possibly invalid? I think IV generates a text file log, so I could probably write a shell script that would open the files in a program like EM.
11  DAM Stuff / Loss and Recovery / Re: Thousands of corrupted images on: April 11, 2010, 06:36:07 AM
PS, to add to the story, it looks like there are many many directories with corrupted images, and by that I mean that every file in the directory is corrupted, including jpg, dng and avi. About forty directories hold nothing but corrupt files. So it's not a bunch of scattered files, as far as I can tell, but as I've said, Im not sure how to truly verify images.
12  DAM Stuff / Loss and Recovery / Re: Thousands of corrupted images on: April 11, 2010, 06:16:06 AM
To be more specific about verifying: I can't tell if an Expression media (I'm using v.1) catalog looks at actual image data or simply builds a preview through the thumbnail. Using bridge to go through 165 folders seems like it would take a long time, and Show Items from Subfolders doesn't seem to work.

Also, anyone having problems with EM? It seems to crash a lot and I can't find an upgrade path.
13  DAM Stuff / Loss and Recovery / Thousands of corrupted images on: April 11, 2010, 06:10:13 AM
I just found that I have several thousand corrupted images. Luckily, I have multiple copies archived on drives and DVDs and can recover them pretty easily. The question is, how to do this, how this happened, and how to avoid in the future.

I have v.2 of DAM book on order (lost my v1 copy, but it's probably dated..), so I hope to avoid this in the future.

Here's the story:

1. Using Mac os 10.6.3 on 2x1.8ghz mac pro, following workflow based on DAM book v1, more or less: Ingest using LR into folders, burn to DVD when the folder reaches 4.6g.
2. Last month, I decided to move my images from internal SATA drives to an eSATA RAID 5. I copied the files to external drives temporarily, removed the internals and used them to make the RAID. All seemed to go well- no copying errors.
3. Last week, LR told me that a few files in a collection were unreadable. Sure enough, they wouldn't open in PS either, nor bridge, Expression Media won't build a preview, etc. They appear to be the same file size as non-corrupt images.
4. Luckily the archived copies are fine, so I simply have to restore from the drives/
5. I tried using DNG converter to verify the images, but it doesn't recognize them as image files. In other words, when I point it at a folder containing the corrupt files, it gives me an error message stating that the folder contains no image files. So, if I point it at the enclosing folder, it will simply skip the corrupt files. There is no error stating that there was a problem converting the file.


So my questions are:
1. How do I verify that the files on my RAID are corrupted or intact? Bridge? Expression Media?
2. When I do find and replace the corrupt files, how do I ensure that my LR adjusments are copied into the DNG data?
3. I will await v2 of the dam book to see how to copy files and verify
4. Do I need to occaisionally verify images on the RAID? and how?

---------------------
Jonathan Lipkin
http://www.jlipkin.com

Pages: [1]
Powered by MySQL Powered by PHP Powered by SMF 1.1.11 | SMF © 2006-2009, Simple Machines LLC Valid XHTML 1.0! Valid CSS!