July 15, 2011 at 9:30 am
Jamie Thomson (7/15/2011)
opc.three (7/15/2011)
Definitely an improvement! I look forward to them lowering the bar on using the SSIS logging.Any hints on the two "Still missing?" items I referenced above? I was kicking around the idea of writing my own connection object but have not made the time. I think it would be useful to a lot of people from what I see on these and other forums.
What would the connection object do exactly?
It would implement a parser to read and load "lines" into the pipeline different from what the Flat File Connection offers. The issue we have today is the Flat File Connection is not capable of handling CSV files as defined by RFC4180. Please correct me if I am wrong. It's been a while since I really had a go at the issue. Maybe a service pack or some config I am not aware of allows it.
There are no special teachers of virtue, because virtue is taught by the whole community.
--Plato
July 15, 2011 at 9:34 am
opc.three (7/15/2011)
Jamie Thomson (7/15/2011)
opc.three (7/15/2011)
Definitely an improvement! I look forward to them lowering the bar on using the SSIS logging.Any hints on the two "Still missing?" items I referenced above? I was kicking around the idea of writing my own connection object but have not made the time. I think it would be useful to a lot of people from what I see on these and other forums.
What would the connection object do exactly?
It would implement a parser to read and load "lines" into the pipeline different from what the Flat File Connection offers. The issue we have today is the Flat File Connection is not capable of handling CSV files as defined by RFC4180. Please correct me if I am wrong. It's been a while since I really had a go at the issue. Maybe a service pack or some config I am not aware of allows it.
OK, I'm not familiar with RFC4180 but there *are* some changes to how the Flat File Connection Manager/Source Component load in files. two changes actually:
-Embedded qualifiers are retained (I haven't tested this so can't comment)
-Differeing row formats in the same file can now be handled (I cover this in SSIS enhancements in Denali CTP3 - see "Load files multiple row formats")
Not sure if that suffices or not.
Jamie Thomson
http://sqlblog.com/blogs/jamie_thomson
July 15, 2011 at 9:46 am
Jamie Thomson (7/15/2011)
opc.three (7/15/2011)
Jamie Thomson (7/15/2011)
opc.three (7/15/2011)
Definitely an improvement! I look forward to them lowering the bar on using the SSIS logging.Any hints on the two "Still missing?" items I referenced above? I was kicking around the idea of writing my own connection object but have not made the time. I think it would be useful to a lot of people from what I see on these and other forums.
What would the connection object do exactly?
It would implement a parser to read and load "lines" into the pipeline different from what the Flat File Connection offers. The issue we have today is the Flat File Connection is not capable of handling CSV files as defined by RFC4180. Please correct me if I am wrong. It's been a while since I really had a go at the issue. Maybe a service pack or some config I am not aware of allows it.
OK, I'm not familiar with RFC4180 but there *are* some changes to how the Flat File Connection Manager/Source Component load in files. two changes actually:
-Embedded qualifiers are retained (I haven't tested this so can't comment)
-Differeing row formats in the same file can now be handled (I cover this in SSIS enhancements in Denali CTP3 - see "Load files multiple row formats")
Not sure if that suffices or not.
It may. Embedded text-qualifiers is one issue. Embedded delimiters (row and column) within text-qualified fields are/were the other issues.
The grammar laid out in the RFC is actually pretty simple and I have seen SSIS' inability to handle it be an adoption-barrier. I linked to the RFC in a previous post but links go unnoticed a lot on this site due to the style sheet. Here is the link direct into the grammar:
http://tools.ietf.org/html/rfc4180#section-2
There are no special teachers of virtue, because virtue is taught by the whole community.
--Plato
July 16, 2011 at 8:50 pm
Jamie Thomson (7/14/2011)
Koen Verbeeck (7/14/2011)
The most impressive feature for me is the whole new project deployment model with parameters (already present in CTP1). This revolutionizes the way we work with SSIS and it will make configurations, deployment, maintenance and logging a lot more easier.
I completely agree with Koen here. All of the designer ehancements are nice but the real win in SSIS in Denali is (in my opinion) the introduction of the SSIS server which eases the pain of deployment, configuration & deployment (all of which are inextricably linked).
Its gonna be a great release!
DON'T CLINK ON THE LINK UNLESS YOU WANT TO H*(&^ YOUR COMPUTER!
For better, quicker answers on T-SQL questions, click on the following...
http://www.sqlservercentral.com/articles/Best+Practices/61537/
For better answers on performance questions, click on the following...
http://www.sqlservercentral.com/articles/SQLServerCentral/66909/
July 16, 2011 at 9:40 pm
Welsh Corgi (7/16/2011)
DON'T CLINK ON THE LINK UNLESS YOU WANT TO H*(&^ YOUR COMPUTER!
Welsh, what the H*(&^ are you talking about? 😛
There are no special teachers of virtue, because virtue is taught by the whole community.
--Plato
July 17, 2011 at 5:06 am
I clicked on the link to the blog. It maxed out my PC to 100%.
After cliking on the link it started several Internet Explorer Processes. I tried to kill each process but I was unsucessful and I had to restart my machine.
I'm not going to click on the link again. I'm not sure what the issue was...
Edit: I just clicked on http://sqlblog.com/blogs/paul_white/ and I did not experience the same issue as when I clicked on http://sqlblog.com/blogs/jamie_thomson.
But you may want to try clicking on the link, hopefully you will not have the same issue. 🙂
Regards,
WC
For better, quicker answers on T-SQL questions, click on the following...
http://www.sqlservercentral.com/articles/Best+Practices/61537/
For better answers on performance questions, click on the following...
http://www.sqlservercentral.com/articles/SQLServerCentral/66909/
July 17, 2011 at 7:09 am
Reading Jamie's blog has sent my brain's CPU to 100% at times (so has reading Paul's for that matter) but my computer has never had an issue 😛
Seriously though, maybe you should run a virus/malware scan on your machine. It sounds bad what happened to you when opening that link.
There are no special teachers of virtue, because virtue is taught by the whole community.
--Plato
July 17, 2011 at 9:51 am
opc.three (7/17/2011)
Reading Jamie's blog has sent my brain's CPU to 100% at times (so has reading Paul's for that matter) but my computer has never had an issue 😛Seriously though, maybe you should run a virus/malware scan on your machine. It sounds bad what happened to you when opening that link.
I have scanned and I do not have any issues with any other sites.
Did you by chance try her site?
For better, quicker answers on T-SQL questions, click on the following...
http://www.sqlservercentral.com/articles/Best+Practices/61537/
For better answers on performance questions, click on the following...
http://www.sqlservercentral.com/articles/SQLServerCentral/66909/
July 17, 2011 at 11:54 am
Welsh Corgi (7/17/2011)
Did you by chance try her site?
I'm a fella, by the way.
Jamie Thomson
http://sqlblog.com/blogs/jamie_thomson
July 17, 2011 at 11:56 am
Jamie Thomson (7/17/2011)
Welsh Corgi (7/17/2011)
Did you by chance try her site?
I'm a fella, by the way.
opps. Sorry.
For better, quicker answers on T-SQL questions, click on the following...
http://www.sqlservercentral.com/articles/Best+Practices/61537/
For better answers on performance questions, click on the following...
http://www.sqlservercentral.com/articles/SQLServerCentral/66909/
July 17, 2011 at 11:59 am
Welsh Corgi (7/17/2011)
opps. Sorry.
No worries. Not the first time its happened 🙂
Jamie Thomson
http://sqlblog.com/blogs/jamie_thomson
July 17, 2011 at 12:42 pm
Welsh Corgi (7/17/2011)
opc.three (7/17/2011)
Reading Jamie's blog has sent my brain's CPU to 100% at times (so has reading Paul's for that matter) but my computer has never had an issue 😛Seriously though, maybe you should run a virus/malware scan on your machine. It sounds bad what happened to you when opening that link.
I have scanned and I do not have any issues with any other sites.
Did you by chance try her site?
I keep up with his blog through RSS however I am on the site a lot and have never had an issue.
There are no special teachers of virtue, because virtue is taught by the whole community.
--Plato
Viewing 12 posts - 16 through 26 (of 26 total)
You must be logged in to reply to this topic. Login to reply