File missing

  • I have a BCP command that generates files from several views. It generates about 80 files and takes about 15 mins to complete. After the files generation step is complete, I zip the files using 7za.exe. But I am running into issues of one file missing in the zip when the customer gets it. It doesn't happen every day. Just once in a while.

    Any idea what could have happened during the BCP process? Anything I can do to prevent it from happening?

  • From your description it is very hard to tell what the problem could be.

    I suspect one of the queries within the BCP process occasionally won't return data (no rows present or maybe a non-desruptive error?). If possible build a logging mechanism inside or around the BCP process that records the rowcount of each seperate step and the creation of the file(s).

    ** Don't mistake the ‘stupidity of the crowd’ for the ‘wisdom of the group’! **
  • with BCP logging, the following error message came out. Anything I could check?

    SQLState = 08001, NativeError = 0

    Error = [Microsoft][SQL Native Client]Unable to complete login process due to delay in opening server connection

  • This error looks like the server is very busy and is under a lot of stress at that moment. Therefor it doesn't have the resources available to handle the login.

    Setup a monitoring (perfmon) to see how the resources (CPU, memory, etc) are used.

    ** Don't mistake the ‘stupidity of the crowd’ for the ‘wisdom of the group’! **

Viewing 4 posts - 1 through 3 (of 3 total)

You must be logged in to reply to this topic. Login to reply