A New World of Data

  • Louis Davidson (@drsql)

    SSCommitted

    Points: 1505

    Comments posted to this topic are about the item A New World of Data

  • skeleton567

    SSCertifiable

    Points: 5024

    As I recently pointed out, even though mass storage is pretty inexpensive, there is also the consideration of time and effort spent with backups and validation and such that goes along with the whole thing.  I think that data architects need to include in their efforts ways to summarize and archive data even offline such that it can be retrieved effectively IF AND WHEN needed to get to the detail.

    Massive storage of detail may be of value in the case of audits and such requirements, but is hardly of much value as it ages and can be more meaningful for many needs if well summarized.

    Offline storage of detail can be so much more cost-effective if it is properly designed and managed.

    Rick

    The only thing worse than being an influencer
    is believing one.

  • Jeff Moden

    SSC Guru

    Points: 995978

    I think it's funny... way back when a 1GB disk was the "ultimate", people filled them up.  Now we have easy access to inexpensive disks that measure in TeraBytes and, yet, people still manage to fill them up.   In both instances, they're usually filled up with junk that no one will ever use a year from now but no one will delete it even 5 years from now.

    Same old problems for the last 20 years... the only two things that have changed are the sizes of the disk and the ratio of absolute junk data that people keep compared to what is really needed.

    --Jeff Moden


    RBAR is pronounced "ree-bar" and is a "Modenism" for Row-By-Agonizing-Row.
    First step towards the paradigm shift of writing Set Based code:
    ________Stop thinking about what you want to do to a row... think, instead, of what you want to do to a column.
    "If you think its expensive to hire a professional to do the job, wait until you hire an amateur."--Red Adair
    "Change is inevitable... change for the better is not."

    Helpful Links:
    How to post code problems
    How to Post Performance Problems
    Create a Tally Function (fnTally)

  • skeleton567

    SSCertifiable

    Points: 5024

    Maybe it's time for a new version of DVD-RW about the size of the old LP records, and a drive the size of a turntable.  You could get lots of those DVD-RW's in a 5-drawer lateral file cabinet and it could be indexed and automated to mount and dismount.  My old LP turntable would hold ten at a time decades ago and then I had a Sony CDP-CX400 rotary CD player that held 400 at a time.

    • This reply was modified 1 month, 1 week ago by  skeleton567.
    • This reply was modified 1 month, 1 week ago by  skeleton567.
    • This reply was modified 1 month, 1 week ago by  skeleton567.

    Rick

    The only thing worse than being an influencer
    is believing one.

  • Jeff Moden

    SSC Guru

    Points: 995978

    skeleton567 wrote:

    Maybe it's time for a new version of DVD-RW about the size of the old LP records, and a drive the size of a turntable.  You could get lots of those DVD-RW's in a 5-drawer lateral file cabinet and it could be indexed and automated to mount and dismount.  My old LP turntable would hold ten at a time decades ago and then I had a Sony CDP-CX400 rotary CD player that held 400 at a time.

    Oh my... too funny that you brought that up.  I was working for a DOD company back in the 80's and early 90s and their document library was stored on a large array of what they referred to as "optical storage" and the plastic disks they used were actually the same size as an LP, as you've described.  I don't recall how much they could hold but I don't believe that it came anything close to what a DVD can.

    --Jeff Moden


    RBAR is pronounced "ree-bar" and is a "Modenism" for Row-By-Agonizing-Row.
    First step towards the paradigm shift of writing Set Based code:
    ________Stop thinking about what you want to do to a row... think, instead, of what you want to do to a column.
    "If you think its expensive to hire a professional to do the job, wait until you hire an amateur."--Red Adair
    "Change is inevitable... change for the better is not."

    Helpful Links:
    How to post code problems
    How to Post Performance Problems
    Create a Tally Function (fnTally)

  • skeleton567

    SSCertifiable

    Points: 5024

    Jeff Moden wrote:

    skeleton567 wrote:

    Maybe it's time for a new version of DVD-RW about the size of the old LP records, and a drive the size of a turntable.  You could get lots of those DVD-RW's in a 5-drawer lateral file cabinet and it could be indexed and automated to mount and dismount.  My old LP turntable would hold ten at a time decades ago and then I had a Sony CDP-CX400 rotary CD player that held 400 at a time.

    Oh my... too funny that you brought that up.  I was working for a DOD company back in the 80's and early 90s and their document library was stored on a large array of what they referred to as "optical storage" and the plastic disks they used were actually the same size as an LP, as you've described.  I don't recall how much they could hold but I don't believe that it came anything close to what a DVD can.

    I never worked with them myself, but recall the "optical storage" days too.  Assuming those LP-sized disks had the same density as a DVD-RW, they would be some pretty cheap bulk storage.

    I've never tried it, but can you put a SQL Server db on a DVD-RW and then detach and store it for when you want the data?  Waiting for slow retrieval and processing might be an alternative for seldom needed data.

    Rick

    The only thing worse than being an influencer
    is believing one.

Viewing 6 posts - 1 through 6 (of 6 total)

You must be logged in to reply to this topic. Login to reply