Fixed Width file

Question

Post reply

Fixed Width file

Mike01

SSChampion

Points: 11395
More actions
April 15, 2022 at 7:44 pm

#4016908

I'm trying to copy fixed width files from on prem file share to AZ Blob storage. I'm getting intermittent success, but not what I'm looking for. I used the copy task. When it works, it copies the file, but each row has double quotes around it. I can run the same pipeline 2 or 3 times and it works, then it will timeout. The timeouts I can figure out, it's really how to copy the file from on-prem through the shir to AZ Blob Storage. I can't use the Azure IR yet, since it hasn't gotten to the cloud yet.
For better, quicker answers, click on the following...
http://www.sqlservercentral.com/articles/Best+Practices/61537/
For better answers on performance questions, click on the following...
http://www.sqlservercentral.com/articles/SQLServerCentral/66909/
April 15, 2023 at 4:24 pm

This was removed by the editor as SPAM

Viewing 7 posts - 1 through 6 (of 6 total)

You must be logged in to reply to this topic. Login to reply

Site Owners SSC Guru Points: 80330 More actions · Answer 1

Thanks for posting your issue and hopefully someone will answer soon.

This is an automated bump to increase visibility of your question.

Martin Schoombee SSCoach Points: 19126 More actions · Answer 2

We need more information to try and help. Can you post screenshots of your copy activity and its properties, as well as the current and expected output?

jabujakan Newbie Points: 1 More actions · Answer 3

Hi all,

I'm on my way to creating a new pipeline on our Azure stack that is supposed to read Excel sheets located at Google Drive partitions.

We're using Data Factory to read those files, but they don't have a connection directly with Google Drive.

So, I'm assuming I have basically two options

Transfer all those files to SharePoint manually or ask clients to use it instead of Gdrive (not nice)

Create an automation or pipeline at GCP that extract files from GDrive and sends to Google Cloud Storage (data factory has built-in connection with it)

How would you guys handle this scenario? There are more options available?

Thanks in advance!

Jeff Moden SSC Guru Points: 1004290 More actions · Answer 4

Nothing like a bit of PPTS. Can't help but watching.

--Jeff Moden

RBAR is pronounced "ree-bar" and is a "Modenism" for Row-By-Agonizing-Row.
First step towards the paradigm shift of writing Set Based code:
________Stop thinking about what you want to do to a ROW... think, instead, of what you want to do to a COLUMN.

Change is inevitable... Change for the better is not.

Helpful Links:
How to post code problems
How to Post Performance Problems
Create a Tally Function (fnTally)

Jeff Moden SSC Guru Points: 1004290 More actions · Answer 5

jabujakan wrote:

jabujakan wrote:
Hi all,
I'm on my way to creating a new pipeline on our Azure stack that is supposed to read Excel sheets located at Google Drive partitions.
We're using Data Factory to read those files, but they don't have a connection directly with Google Drive.
So, I'm assuming I have basically two options
Transfer all those files to SharePoint manually or ask clients to use it instead of Gdrive (not nice) Create an automation or pipeline at GCP that extract files from GDrive and sends to Google Cloud Storage (data factory has built-in connection with it) How would you guys handle this scenario? There are more options available? SPAM LINK REMOVED Thanks in advance!
I got this,...

Nope... I've got you. 😉

--Jeff Moden

RBAR is pronounced "ree-bar" and is a "Modenism" for Row-By-Agonizing-Row.
First step towards the paradigm shift of writing Set Based code:
________Stop thinking about what you want to do to a ROW... think, instead, of what you want to do to a COLUMN.

Change is inevitable... Change for the better is not.

Helpful Links:
How to post code problems
How to Post Performance Problems
Create a Tally Function (fnTally)