Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase 12»»

Data Preservation Expand / Collapse
Author
Message
Posted Tuesday, December 3, 2013 1:24 AM


SSC-Dedicated

SSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-Dedicated

Group: Administrators
Last Login: Yesterday @ 2:28 PM
Points: 33,062, Visits: 15,174
Comments posted to this topic are about the item Data Preservation






Follow me on Twitter: @way0utwest

Forum Etiquette: How to post data/code on a forum to get the best help
Post #1519099
Posted Tuesday, December 3, 2013 2:03 AM


SSCertifiable

SSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiable

Group: General Forum Members
Last Login: Today @ 2:30 AM
Points: 5,175, Visits: 2,789
A lot of music has been lost too. In the 80s and early 90s1 a lot of bands started out by releasing singles on vinyl either individually or through tiny labels. The media has a reputation for being damaged beyond use if treated badly. Another media, cassettes, has the same issue. Both of which may also have been discarded. I should imagine that this is just a different version of what has always occurred: the most popular things will be remembered and repeated. This has happened in music and poetry as well as stories which were originally only held verbally (see Homer for an example - not Simpson!!!).

I have total faith that the digital photos will be convertible because the formats are widely known so, even if it will cost, there will be conversion services or readers available. I think the bigger problem is the vast amount of photos the current generations are producing as I can imagine that more photos are taken on an average night out than my Mum took on our annual holiday (vacation to you overponders ) which accounted for over half the yearly photos taken. Also loss due to services disappearing. How many people back up their Facebook photos?

As for databases? I think that if there is some real value then the data will have been transferred and if there is some historic value than there will be digital historians who will learn to dissect digital archives. Perhaps akin to archeologists. The rest will be eventually be discarded as irrelevant.

1 It may have occurred longer than this but I am not that knowledgable. Sorry.


Gaz

-- Stop your grinnin' and drop your linen...they're everywhere!!!
Post #1519105
Posted Tuesday, December 3, 2013 2:20 AM
Forum Newbie

Forum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum Newbie

Group: General Forum Members
Last Login: Tuesday, December 3, 2013 2:07 AM
Points: 1, Visits: 0
Nice topic Steve,

I totally agree with your worries as same applies to me & everyone here.

I think this as negative effect of evolution. As other user mentioned, same thing has happened to music also.

It does not matter if you have made copies of your digital data on Hard disk, CD ROM or DVD. Because sooner or later, they are going to vanish (Just like TAPE drive). Another problem is tools to use that digital data. What if you have saved all images in JPEG format and music in MP3 format and that formats are extinct for your grandchild ?

In big picture, this problem is not only for digital data. It is very big. What if we have preserved all books in ENGLISH today, but ENGLISH itself might gets extinct after couple of decades. I remember that same problem raised when USA government had to bury their radio active waste.

Really mankind has to do more efforts in this way at earliest. Meanwhile, we can only try and hope for best.

For my personal digital data, twice a year, i recall all my old data and backup them and current data to latest available media (Currently DVD or Blue Ray). I know, i have to do this again and again and data is going to grow exponentially. But there is no alternative i can see around. This is very difficult for companies having TB's of data.

Thanks for reading,
Post #1519114
Posted Tuesday, December 3, 2013 3:53 AM
SSC Veteran

SSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC Veteran

Group: General Forum Members
Last Login: Thursday, June 19, 2014 11:36 AM
Points: 244, Visits: 378
I once attended a session where the process for archiving state records in Michigan was discussed. They talked about maintaining records in a digital format and having to burn fresh CDs / DVDs every five years due to the deterioration that can take place within that media.

Most interestingly, they also stated that, regardless of the digital storage, all records also had to be stored in a "human-readable" form - micro card or microfiche or something along those lines.

In the article referenced, they mention that in some ways an older movie on film is more stable and safe than a 2-year-old movie stored digitally, because of this same "human-readable" concept.

I attended that session 15 years ago or more, and still think of this concept on a regular basis.
Post #1519152
Posted Tuesday, December 3, 2013 3:56 AM


SSCertifiable

SSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiable

Group: General Forum Members
Last Login: Today @ 2:30 AM
Points: 5,175, Visits: 2,789
This is where the cloud services can help. For example, if you have a music store then why not raise the level of abstraction and store a piece of music which can be retrieved as many different formats but the service guarantees that its storage is lossless. The same could be applied to pictures, video and documents.

Any VCs want to give me a load of cash?


Gaz

-- Stop your grinnin' and drop your linen...they're everywhere!!!
Post #1519154
Posted Tuesday, December 3, 2013 5:17 AM
SSC-Enthusiastic

SSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-Enthusiastic

Group: General Forum Members
Last Login: Yesterday @ 12:29 PM
Points: 127, Visits: 239
Todd Townley (12/3/2013)

Most interestingly, they also stated that, regardless of the digital storage, all records also had to be stored in a "human-readable" form - micro card or microfiche or something along those lines.

In the article referenced, they mention that in some ways an older movie on film is more stable and safe than a 2-year-old movie stored digitally, because of this same "human-readable" concept.
.


Years ago I was on a tour of the Paul Garber facility near DC. This is where the National Air and Space Museum warehoused and restored much of its collection (A large part of which is now in the Udvar-Hazy annex out at Dulles).

A researcher on the tour explained the #1 archival medium is microfilm/microfiche. The reason is simple: it is technology-independent. All you need to retrieve the data is a candle and a magnifying glass. Someone asked about digital storage and he held up an old 12" laser disc (yeah, this was quite a while ago). He said, "In 10 years or so, you'll have yourself a very pretty frisbee."


____________
Just my $0.02 from over here in the cheap seats of the peanut gallery - please adjust for inflation and/or your local currency.
Post #1519171
Posted Tuesday, December 3, 2013 6:32 AM


SSCommitted

SSCommittedSSCommittedSSCommittedSSCommittedSSCommittedSSCommittedSSCommittedSSCommitted

Group: General Forum Members
Last Login: Tuesday, July 22, 2014 7:58 AM
Points: 1,795, Visits: 2,167
Back in the "Dark Ages" (1985), I worked for a major insurance firm (COBOL programmer). It was decided that in addition to tape storage, all "important" documents would be stored on microfiche/film.

MG

"There are two ways of constructing a software design. One way is to make it so simple that there are obviously no deficiencies. And the other way is to make it so complicated that there are no obvious deficiencies."
Tony Hoare

"If you think it's expensive to hire a professional to do the job, wait until you hire an amateur." Red Adair.

Post #1519197
Posted Tuesday, December 3, 2013 6:47 AM
SSC Eights!

SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!

Group: General Forum Members
Last Login: Yesterday @ 8:08 AM
Points: 890, Visits: 2,865
n big picture, this problem is not only for digital data. It is very big. What if we have preserved all books in ENGLISH today, but ENGLISH itself might gets extinct after couple of decades. I remember that same problem raised when USA government had to bury their radio active waste.


I remember reading that another part of the problem for the radioactive waste problem was they needed to use a medium that would last for millennia. I seem to recall one of the solutions mooted was to etch the records on to stone tablets because that was about the only thing that could be guaranteed not to degrade.

I also remember my high school technology teacher telling us that the designs for the Harrier Jump Jet were stored on punched tape in a fireproof room because that would survive the EM pulse from a nuclear detonation. This was in the mid-90's so there were other storage media available but they were all magnetic. I imagine shortly after that the designs were transferred to CD though.



On two occasions I have been asked, "Pray, Mr. Babbage, if you put into the machine wrong figures, will the right answers come out?" ... I am not able rightly to apprehend the kind of confusion of ideas that could provoke such a question.
—Charles Babbage, Passages from the Life of a Philosopher
Post #1519206
Posted Tuesday, December 3, 2013 9:09 AM


SSC-Dedicated

SSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-Dedicated

Group: Administrators
Last Login: Yesterday @ 2:28 PM
Points: 33,062, Visits: 15,174
Gary Varga (12/3/2013)

I have total faith that the digital photos will be convertible because the formats are widely known so, even if it will cost, there will be conversion services or readers available. I think the bigger problem is the vast amount of photos the current generations are producing as I can imagine that more photos are taken on an average night out than my Mum took on our annual holiday (vacation to you overponders ) which accounted for over half the yearly photos taken. Also loss due to services disappearing. How many people back up their Facebook photos?



I actually grab my Facebook stuff every quarter. They make it easy to export, though it's not quick.

Volume is a huge issue. Right now YouTube gets over 24 hours of video every second uploaded. It's not all from me, but I have some up there. I worry about those older videos, those photos, etc. being converted. I suspect there will be services software to do it, but it's not necessarily an easy process. Already I know I have digital and analog video tapes that may be lost since I'm not sure the devices work. I should convert our VHS stuff over now while we can.







Follow me on Twitter: @way0utwest

Forum Etiquette: How to post data/code on a forum to get the best help
Post #1519272
Posted Tuesday, December 3, 2013 4:52 PM
SSCrazy

SSCrazySSCrazySSCrazySSCrazySSCrazySSCrazySSCrazySSCrazy

Group: General Forum Members
Last Login: Yesterday @ 11:53 AM
Points: 2,264, Visits: 1,312
Thanks for the topic.

As one who has used old data for trend analysis and environmental change I have found that not only the media the data is one degrades over time but the data itself often does. The idea here is that the instrument and the calibration of the instrument that took the readings that became the data is so inaccurate compared to the current methods and technology of taking the same reading today that old data must be accompanied with a caveat.

Some old data is very valuable, and old pictures are great. We need to find ways to keep it so those grandchildren do have a record.

M.


Not all gray hairs are Dinosaurs!
Post #1519443
« Prev Topic | Next Topic »

Add to briefcase 12»»

Permissions Expand / Collapse