|
|
|
Hall of Fame
       
Group: General Forum Members
Last Login: Today @ 8:26 AM
Points: 3,164,
Visits: 4,344
|
|
Comments posted to this topic are about the item Data Import
____________________________________________ Space, the final frontier? not any more... All limits henceforth are self-imposed. “libera tute vulgaris ex”
|
|
|
|
|
SSCrazy
      
Group: General Forum Members
Last Login: Yesterday @ 5:46 AM
Points: 2,636,
Visits: 2,788
|
|
I would be interested in knowing what the so-called JCL limitation is. With over 20 years mainframe experience it would be a new one for me (unless it is a limitation in the user's knowledge of JCL, I have seen that one before...).
Author: SQL Server FineBuild 1-click install and best practice configuration of SQL Server 2012, 2008 R2, 2008 and 2005. 4 June 2013: now over 24,000 downloads. Disclaimer: All information provided is a personal opinion that may not match reality. Concept: "Pizza Apartheid" - the discrimination that separates those who earn enough in one day to buy a pizza if they want one, from those who can not.
|
|
|
|
|
SSC-Enthusiastic
      
Group: General Forum Members
Last Login: Tuesday, October 09, 2012 2:13 AM
Points: 162,
Visits: 76
|
|
 good q
|
|
|
|
|
Hall of Fame
       
Group: General Forum Members
Last Login: Today @ 8:26 AM
Points: 3,164,
Visits: 4,344
|
|
I too have well over 10 years experience on mainframe, mainly cobol and db2 on z/os. limitations could be put in place for numerous reasons, including, inter alia, the transport mechanism used to move the files (e.g. x'com), network restrictions and, as stated, user (lack of) knowledge. however, the mention of "jcl limitations" is just incidental to the actual question, i.e. the most effective and efficient way to import the data and populate an SSAS cube.
____________________________________________ Space, the final frontier? not any more... All limits henceforth are self-imposed. “libera tute vulgaris ex”
|
|
|
|
|
SSCrazy
      
Group: General Forum Members
Last Login: Yesterday @ 5:46 AM
Points: 2,636,
Visits: 2,788
|
|
Agreed. The main point of the question is about how to import a number of files.
Author: SQL Server FineBuild 1-click install and best practice configuration of SQL Server 2012, 2008 R2, 2008 and 2005. 4 June 2013: now over 24,000 downloads. Disclaimer: All information provided is a personal opinion that may not match reality. Concept: "Pizza Apartheid" - the discrimination that separates those who earn enough in one day to buy a pizza if they want one, from those who can not.
|
|
|
|
|
SSChasing Mays
      
Group: General Forum Members
Last Login: Friday, May 24, 2013 5:20 AM
Points: 660,
Visits: 558
|
|
Excellent question, stewartc, thank you!
I wish you had set this question a long time ago, this could have saved some people some work... How did this slip under my radar?
-------- I love deadlines. I like the whooshing sound they make as they fly by. -Douglas Adams
|
|
|
|
|
Ten Centuries
      
Group: General Forum Members
Last Login: Friday, March 22, 2013 6:48 AM
Points: 1,297,
Visits: 138
|
|
I second Ed Vassie's question on the supposed JCL limitation.
I got the answer right, only because the category was SSIS and I figured that one of those two answers must be the one being driven for. However, SSIS is NEVER the most "efficient" solution. I'm sure there is a much more efficient solution using BCP or Bulk Insert (not with a cursor, that was an obvious bad answer), perhaps using CLR stored procedure, or perhaps concatenating the files before the BCP operation.
Mark
|
|
|
|
|
SSCrazy
      
Group: General Forum Members
Last Login: Tuesday, June 11, 2013 5:56 AM
Points: 2,405,
Visits: 426
|
|
Nice question! I didn't know a connections such as MULTIFLATFILE existed. I typically did what was suggested in the second answer. Thanks!
|
|
|
|
|
Hall of Fame
       
Group: General Forum Members
Last Login: Today @ 2:05 PM
Points: 3,423,
Visits: 3,439
|
|
| I agree, nice question. I learned something new today and that is the point.
|
|
|
|
|
Ten Centuries
      
Group: General Forum Members
Last Login: Wednesday, June 12, 2013 2:41 PM
Points: 1,228,
Visits: 1,726
|
|
WOW i always used the for each loop to process files and never knew about multiflatfile feature. Good one. Thank you
Alex S
|
|
|
|