Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase 12»»

Too Much Data Expand / Collapse
Author
Message
Posted Wednesday, February 18, 2009 5:52 PM


SSC-Dedicated

SSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-Dedicated

Group: Administrators
Last Login: Today @ 4:22 PM
Points: 30,079, Visits: 12,279
Comments posted to this topic are about the item Too Much Data






Follow me on Twitter: @way0utwest

Forum Etiquette: How to post data/code on a forum to get the best help
Post #659987
Posted Thursday, February 19, 2009 6:41 AM


Old Hand

Old HandOld HandOld HandOld HandOld HandOld HandOld HandOld Hand

Group: General Forum Members
Last Login: Thursday, May 03, 2012 1:12 PM
Points: 341, Visits: 835
Hi Steve,

Great editorial and valid points. BI could help here, imo. But you're right: it's expensive and time-consuming (which is saying the same thing twice) - at least for now.

:{> Andy

PS - I love to see "Business Intelligence" in quotes!


Andy Leonard
SQLPeople Person

Follow me on Twitter: @AndyLeonard
Post #660243
Posted Thursday, February 19, 2009 7:07 AM


SSChampion

SSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampion

Group: General Forum Members
Last Login: Today @ 1:49 PM
Points: 14,133, Visits: 8,525
I think it actually goes one step further than that in some of these cases.

Gathering vast amounts of information is usually justified with "it's more efficient". It's more efficient to have a camera on every street-corner than a cop, and so on.

The problem with this is, the single most "efficient" means of government is totalitarianism. Call it socialism, call it monarchy or fascism, call it whatever you like, the only real way to get efficiency out of government is to make it centrally controlled and to grant it singular authority.

Inefficiency and ignorance in government is actually a necessity for freedom. There has to be a ballancing act to maintain the minimum necessary to carry out the minimum government needed to keep a free society running. Anything beyond that, in terms of efficiency and data, is just a move towards "more efficient government", meaning, of course, "more authoritarian government".


- GSquared, RSVP, OODA, MAP, NMVP, FAQ, SAT, SQL, DNA, RNA, UOI, IOU, AM, PM, AD, BC, BCE, USA, UN, CF, ROFL, LOL, ETC
Property of The Thread

"Nobody knows the age of the human race, but everyone agrees it's old enough to know better." - Anon
Post #660270
Posted Thursday, February 19, 2009 7:15 AM
SSChasing Mays

SSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing Mays

Group: General Forum Members
Last Login: Today @ 12:35 PM
Points: 624, Visits: 1,451
GSquared (2/19/2009)
I...Inefficiency and ignorance in government is actually a necessity for freedom. There has to be a ballancing act to maintain the minimum necessary to carry out the minimum government needed to keep a free society running. Anything beyond that, in terms of efficiency and data, is just a move towards "more efficient government", meaning, of course, "more authoritarian government".



Agreed. Privacy is essentially inefficiency in other people's knowledge about you. It's not just a nice thing, the need for privacy is deeply embedded in our psychology


To move onto more mundane areas, information is often confused with data, but information is what's left when excess data is intelligently pruned away (as when an image from carbon paper* only produces information when most of the pigments are not transferred onto the paper)

[*for you youngsters: http://en.wikipedia.org/wiki/Carbon_paper]


...

-- FORTRAN manual for Xerox Computers --
Post #660277
Posted Thursday, February 19, 2009 7:20 AM
SSCommitted

SSCommittedSSCommittedSSCommittedSSCommittedSSCommittedSSCommittedSSCommittedSSCommitted

Group: General Forum Members
Last Login: Today @ 6:35 AM
Points: 1,676, Visits: 2,319
Data without context is useless. Software helps to put data into context but humans have to study the data to make sense from it.

Danger comes from acting on data without understanding the context. It's dangerous to freedom when a government does it.
Post #660287
Posted Thursday, February 19, 2009 7:22 AM


SSCrazy

SSCrazySSCrazySSCrazySSCrazySSCrazySSCrazySSCrazySSCrazy

Group: General Forum Members
Last Login: Today @ 12:50 PM
Points: 2,419, Visits: 18,230
I had two thoughts here, neither constructive.
1. Semantic Web
2. Eagle Eye



---------------------------------------------------------
How best to post your question
How to post performance problems
Tally Table:What it is and how it replaces a loop

"stewsterl 80804 (10/16/2009)I guess when you stop and try to understand the solution provided you not only learn, but save yourself some headaches when you need to make any slight changes."
Post #660289
Posted Thursday, February 19, 2009 7:55 AM


SSC-Addicted

SSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-Addicted

Group: General Forum Members
Last Login: Friday, April 27, 2012 2:55 PM
Points: 452, Visits: 404
To take the reverse opinion. Camera's that are not monitored serve not only as a deterent, but the video is there should an incident occur where the identification of a suspect is needed. You can hardly watch any cops and and robbers show on TV where some post incident review of video helps to catch the bad guys.

In the DBA world, how often do you review the log files? The common answer is almost never, unless an incident occurs that requires finding a cause for some problem. Hmmm...sounds like we are just as guilty collecting needless intelligence until it suddenly becomes needed. Maybe some BI software would be great to extract only needed database log entries in a meaningful way and discard the junk. But, using what basis and before or only after an incident?


Ron K.

"Any fool can write code that a computer can understand. Good programmers write code that humans can understand." -- Martin Fowler
Post #660345
Posted Thursday, February 19, 2009 8:37 AM


SSC-Dedicated

SSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-Dedicated

Group: Administrators
Last Login: Today @ 4:22 PM
Points: 30,079, Visits: 12,279
I do think there's value for the cameras being there, even if they're not watched, or even hooked up. There's a bit of a deterrent, and as you mentioned, you can review them later. they're like logs, which you don't review often, but you keep around.

However there can be valuable things in logs if you could proactively monitor them. Some type of BI might alert you to issues before they become problems. The same for lots of other data if you spend the time building something to review the data.







Follow me on Twitter: @way0utwest

Forum Etiquette: How to post data/code on a forum to get the best help
Post #660431
Posted Thursday, February 19, 2009 11:22 AM
Ten Centuries

Ten CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen Centuries

Group: General Forum Members
Last Login: Monday, March 05, 2012 8:49 AM
Points: 1,094, Visits: 791
Steve Jones - Editor
...and I think businesses need to make sure they are not only making the investments, but continuing to fund them as they evolve.


This I agree with heartily. Projects are never perfect, and a "living" company needs a "living" project that can be flexed.
Post #660614
Posted Thursday, February 19, 2009 3:29 PM


SSChampion

SSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampion

Group: General Forum Members
Last Login: Today @ 1:49 PM
Points: 14,133, Visits: 8,525
Steve Jones - Editor (2/19/2009)
I do think there's value for the cameras being there, even if they're not watched, or even hooked up. There's a bit of a deterrent, and as you mentioned, you can review them later. they're like logs, which you don't review often, but you keep around.

However there can be valuable things in logs if you could proactively monitor them. Some type of BI might alert you to issues before they become problems. The same for lots of other data if you spend the time building something to review the data.


The problem with the cameras not being hooked up is that the news on that will get around, and then they'll be ignored, and no more deterent value, even for the ones that are hooked up. Good old "boy who cried wolf" syndrome.


- GSquared, RSVP, OODA, MAP, NMVP, FAQ, SAT, SQL, DNA, RNA, UOI, IOU, AM, PM, AD, BC, BCE, USA, UN, CF, ROFL, LOL, ETC
Property of The Thread

"Nobody knows the age of the human race, but everyone agrees it's old enough to know better." - Anon
Post #660925
« Prev Topic | Next Topic »

Add to briefcase 12»»

Permissions Expand / Collapse