I didn't get it. the...

easy google - should always be first point of reference

https://blog.sqlauthority.com/2023/09/07/sql-server-resolving-the-ps1-cannot-be-loaded-because-running-scripts-is-disabled-error/#:~:text=The%20root%20cause%20is%20that,policy%20needs%20to%20be%20changed.

can you get used to post data in a consumable way - see on code below one way of doing it.

one way below to achieve what you need

            
November 18, 2023 at 7:08 pm
            
#4330218

            
            
                                                
        

the code you gave us is already doing it in "small" chunks - indeed its doing it on the smallest possible chunk size.

and that is what should not be done...

and something I've noticed - your SQL settings are default ones - you should change them - maxdop normally should not be set to zero, and Cost Threshold for Parallelism...

the issue should be clearer even for someone not experienced.

there is no index on the FIRST_NM - so for each update it needs to do a table scan.

add a index on...

That is a very ugly file. Guessing it came from a mainframe?

It may be faster and more supportable to learn some python to preclean and format the file than...

as Brian said you should not be trying to convert as is but rather understand the requirements and do fresh and better code targetting SQL Server.

for the particular error  you...

• This reply was modified 1 year, 10 months ago by frederico_fonseca.

you better give us your .ps1 file - and if using powershell you really should be outputting a valid CSV file instead of dumping the output of the command into...

you can't - googling show you lots of threads on that and the answer is always the same.

depending on what you are trying to accomplish there are ways to bypass...

AV blocking powershell

Access to that networkshare not set correctly (both to the location of the csv file and to the PS script itself.)

you can check it by using a using...

reason why you got "double quotes" is because you set the field quote to an empty string - try the basic import

e.g. remove the following 2 options

, FIELDQUOTE = ''

,...

first - while you mentioned you had "memory errors" the errors you supplied had nothing to do with memory, but only with a file format error when using the bulk...

yes. a standard pattern for this...

whenever I see these errors on BCP its one of the following

• invalid CSV file - e.g. not Double quoted on "fields" that contains double quotes or CR or LF

...