Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase

Resource intensive processes Expand / Collapse
Author
Message
Posted Thursday, March 21, 2013 11:59 AM
SSC-Enthusiastic

SSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-Enthusiastic

Group: General Forum Members
Last Login: Monday, February 24, 2014 11:06 AM
Points: 109, Visits: 215
Hello,

I have a SSIS package that pulls files down from an FTP site and loads the files into basic SQL tables. At the moment this package runs everyday at 3:00pm. I have to check the folder to see if a specific file was uploaded to determine when the FTP upload process ends. Currently I have a simple timer script set up that checks the folder every 15 minutes to see if the file has been uploaded.

My question is... How resource intensive is this method? If the file doesn't upload for several hours will this kill performance on my production box? Here is the script that I have in a SSIS scripting task...

WHILE (select count(*) from TABLE where DATE >= GETDATE()) = 0
BEGIN
WAITFOR DELAY '00:15:00'
END;
Post #1433948
Posted Thursday, March 21, 2013 1:38 PM


SSCertifiable

SSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiable

Group: General Forum Members
Last Login: Saturday, July 26, 2014 8:57 AM
Points: 7,081, Visits: 12,575
From a T-SQL perspective WAITFOR DELAY will not actively use any server resources other than the overhead of having it keep an open thread using a little memory for the request and having it effectively do nothing.

From an SSIS perspective, if it issued the T-SQL batch out of a Script Task then the SSIS package will remain running. So again, it won't be actively using CPU or doing I/O, but it will be occupying memory on your server.

PS I am confused though. You say that you check a folder every 15 minutes but then you show a SQL batch. Are we talking about an SSIS Package checking a folder or a T-SQL process checking table?


__________________________________________________________________________________________________
There are no special teachers of virtue, because virtue is taught by the whole community. --Plato
Post #1434008
Posted Thursday, March 21, 2013 3:29 PM
SSC-Enthusiastic

SSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-Enthusiastic

Group: General Forum Members
Last Login: Monday, February 24, 2014 11:06 AM
Points: 109, Visits: 215
T-SQL process checking a table.

Thanks so much for your response!
Post #1434057
« Prev Topic | Next Topic »

Add to briefcase

Permissions Expand / Collapse