Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase

Managing Your IT Data Expand / Collapse
Author
Message
Posted Monday, January 19, 2009 10:05 PM


SSC-Dedicated

SSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-Dedicated

Group: Administrators
Last Login: Today @ 4:29 PM
Points: 32,819, Visits: 14,965
Comments posted to this topic are about the item Managing Your IT Data






Follow me on Twitter: @way0utwest

Forum Etiquette: How to post data/code on a forum to get the best help
Post #639646
Posted Tuesday, January 20, 2009 5:37 AM


Old Hand

Old HandOld HandOld HandOld HandOld HandOld HandOld HandOld Hand

Group: General Forum Members
Last Login: Wednesday, April 16, 2014 1:39 PM
Points: 388, Visits: 1,034
Enterprise metadata is important. Unfortunately, you learn that (or you will) when something goes wrong. I wrote about using SSIS to collect enterprise metadata at http://sqlblog.com/blogs/andy_leonard/archive/2008/08/28/ssis-design-pattern-collect-enterprise-sql-server-database-metadata-with-ssis.aspx. That article was prompted by an email from someone doing what I've needed to do before: detect changes in the source system schema before it broke the ETL.

On storing data in flat files: I've heard the argument that all data is stored in flat files.

An anecdote: My first database application used Access (and I'm admitting that here for all to see). But Access wasn't fast enough to lookup and return the data I needed. I needed screens to "pop." So I wrote my own data store using ini files. I created numeric indices using the keys of key/value pairs.

It flew.

:{> Andy


Andy Leonard
CSO, Linchpin People
Follow me on Twitter: @AndyLeonard
Post #639839
Posted Tuesday, January 20, 2009 7:26 AM
SSC Journeyman

SSC JourneymanSSC JourneymanSSC JourneymanSSC JourneymanSSC JourneymanSSC JourneymanSSC JourneymanSSC Journeyman

Group: General Forum Members
Last Login: Tuesday, April 01, 2014 7:50 AM
Points: 80, Visits: 222
We use LogClarity, by LogFidelity, to do the same thing. It gathers and stores raw log data, including SQL server traces, but also separately stores the data after it has been correlated and cleaned up. It has reporting and alerts and the data are stored in SQL Server. http://www.logfidelity.com/


Post #639946
Posted Tuesday, January 20, 2009 8:11 AM
SSCommitted

SSCommittedSSCommittedSSCommittedSSCommittedSSCommittedSSCommittedSSCommittedSSCommitted

Group: General Forum Members
Last Login: Today @ 9:00 AM
Points: 1,526, Visits: 1,834
Andy Leonard (1/20/2009)
Enterprise metadata is important. Unfortunately, you learn that (or you will) when something goes wrong. I wrote about using SSIS to collect enterprise metadata at http://sqlblog.com/blogs/andy_leonard/archive/2008/08/28/ssis-design-pattern-collect-enterprise-sql-server-database-metadata-with-ssis.aspx. That article was prompted by an email from someone doing what I've needed to do before: detect changes in the source system schema before it broke the ETL.

:{> Andy

Andy, I don't know if it is just my computer, but a lot of the images in your article seem to be broken.
Post #639959
Posted Tuesday, January 20, 2009 9:11 AM
Say Hey Kid

Say Hey KidSay Hey KidSay Hey KidSay Hey KidSay Hey KidSay Hey KidSay Hey KidSay Hey Kid

Group: General Forum Members
Last Login: Monday, September 30, 2013 9:43 AM
Points: 710, Visits: 664
It's just you. Images are fine for me.
Post #639996
Posted Tuesday, January 20, 2009 1:21 PM
Forum Newbie

Forum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum Newbie

Group: General Forum Members
Last Login: Friday, February 26, 2010 11:49 AM
Points: 4, Visits: 43
Carla,

I'm not having any trouble with Andy's images either.
Post #640199
Posted Tuesday, January 20, 2009 7:16 PM


SSC-Dedicated

SSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-Dedicated

Group: Administrators
Last Login: Today @ 4:29 PM
Points: 32,819, Visits: 14,965
Working fine in the UK.






Follow me on Twitter: @way0utwest

Forum Etiquette: How to post data/code on a forum to get the best help
Post #640334
Posted Thursday, May 02, 2013 3:47 AM
SSC-Enthusiastic

SSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-Enthusiastic

Group: General Forum Members
Last Login: Today @ 10:07 AM
Points: 112, Visits: 238
Andy

might it be some browsers can't handle multiple heights and widths?

from the bottom image:

<img style="WIDTH:608px;HEIGHT:1614px;" height="1614" src="http://vsteamsystemcentral.com/images/ext/EntDBMetadata_31.png" width="608">

Chrome, IE9, FF for windows handle it OK (UK too)




Wayne

Did you get access denied? Great the security works.

Post #1448741
Posted Thursday, May 02, 2013 8:22 AM
Old Hand

Old HandOld HandOld HandOld HandOld HandOld HandOld HandOld Hand

Group: General Forum Members
Last Login: Today @ 2:59 PM
Points: 357, Visits: 1,931
I know some folks using Splunk for log analysis on enterprise internet connections that generate 150GB+ of log data per day. So far, they are pretty happy with the tool, but the learning curve to full usability is steep. A limited use version is available for free download, so it's pretty easy to play with.
Post #1448830
Posted Thursday, May 02, 2013 9:14 AM
Mr or Mrs. 500

Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500

Group: General Forum Members
Last Login: Today @ 4:07 PM
Points: 564, Visits: 3,418
Splunk is an excellent tool for mining tons of data (our systems log hundreds of Gb per day) and for correlating events across different devices/apps/log sources. While Splunk can make useful reports and dashboards it is not a BI platform. Now if only I can convince my superiors of this fact...
Post #1448853
« Prev Topic | Next Topic »

Add to briefcase

Permissions Expand / Collapse