Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase

Oracle and MS SQL server Database performance check Expand / Collapse
Author
Message
Posted Friday, October 11, 2013 1:19 AM
Valued Member

Valued MemberValued MemberValued MemberValued MemberValued MemberValued MemberValued MemberValued Member

Group: General Forum Members
Last Login: Saturday, August 23, 2014 10:18 AM
Points: 53, Visits: 125
Hi Team,

My SSIS package is very slow only for past 2 weeks. Before it used to run in 2 hrs now it is running in 8 hrs. Today the package completely failed with error ": Could not allocate a new page for database 'Test' because of insufficient disk space in filegroup 'PRIMARY' ". Can PRIMARY memory allocation be a reason for the package becoming slow?

Need your opinion to know if I increase the PRIMARY memory space will this issue will be resolved. Most importantly I would like to know will it be a permanent fix.

Please suggest what are the parameters I should consider in the SSIS package and in the source(Oracle) and destination(MS SQL server) to give a permanent fix.

Oracle is 9i and SQL server 2008R2. Data pull is from 5 tables each with 300,000 rows and 10 columns.

Thanks
Jim
Post #1503895
Posted Friday, October 11, 2013 1:31 AM


SSChampion

SSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampion

Group: General Forum Members
Last Login: Yesterday @ 8:15 AM
Points: 13,017, Visits: 10,800
2 hours for 5 times 300.000 rows is slow. (ok, 8 hours is even slower)
What are you doing inside the package?

Regarding the error: PRIMARY filegroup has nothing to do with memory. The filegroup is where your database pages are saved unto disk. Your destination database has run out of size. Either there's a maximum size defined for the database, or you've run out of disk space.




How to post forum questions.
Need an answer? No, you need a question.
What’s the deal with Excel & SSIS?

Member of LinkedIn. My blog at LessThanDot.

MCSA SQL Server 2012 - MCSE Business Intelligence
Post #1503902
Posted Friday, October 11, 2013 3:18 AM


SSChasing Mays

SSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing Mays

Group: General Forum Members
Last Login: Yesterday @ 3:44 AM
Points: 608, Visits: 1,044
Also try attunity connector for oracle source.


Pramod
SQL Server DBA | MCSA SQL Server 2012

in.linkedin.com/in/pramodsingla/
http://pramodsingla.wordpress.com/
Post #1503924
Posted Friday, October 11, 2013 4:23 AM
Valued Member

Valued MemberValued MemberValued MemberValued MemberValued MemberValued MemberValued MemberValued Member

Group: General Forum Members
Last Login: Saturday, August 23, 2014 10:18 AM
Points: 53, Visits: 125
Thanks Koen. So if I increase the destination database size or the disk space, the package load performance can be improved? I'm asking this because if increasing the size will help the performance, I have to contact my DBAs to do the same.

Please suggest.

Post #1503935
Posted Friday, October 11, 2013 4:53 AM


SSChampion

SSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampion

Group: General Forum Members
Last Login: Yesterday @ 8:15 AM
Points: 13,017, Visits: 10,800
Jim1234 (10/11/2013)
Thanks Koen. So if I increase the destination database size or the disk space, the package load performance can be improved? I'm asking this because if increasing the size will help the performance, I have to contact my DBAs to do the same.


Not necessarily.
Enlarging the size of the database file will stop your package from failing.

However, if the database file size is always a bit too small and it has to autogrow each time (I don't know what the settings are on the database) and the autogrow settings are inadequate, it is possible that the database file is more busy with trying to grow than storing data. So yes, choosing a decent size for the database file might improve performance, but not necessarily.

You need to test what the bottleneck of your package is. Is it the source, the destination or something in between?




How to post forum questions.
Need an answer? No, you need a question.
What’s the deal with Excel & SSIS?

Member of LinkedIn. My blog at LessThanDot.

MCSA SQL Server 2012 - MCSE Business Intelligence
Post #1503948
Posted Friday, October 11, 2013 5:50 AM
Valued Member

Valued MemberValued MemberValued MemberValued MemberValued MemberValued MemberValued MemberValued Member

Group: General Forum Members
Last Login: Saturday, August 23, 2014 10:18 AM
Points: 53, Visits: 125
Thanks again Koen!! The package is a loading data from oracle to SQL server from 5 tables with each table of 200,000 size approx. Using Oledb providers. The 5 queries are in 5 Data Flow which are executing parallel. This used to take around 2 to 3 hrs and now it is taking around 8hrs.

Your suggestion on what are the parameters I should check will greatly help!!

Attunity we are not able to use as of now, but will plan in future..
Post #1503964
Posted Friday, October 18, 2013 12:52 AM
Valued Member

Valued MemberValued MemberValued MemberValued MemberValued MemberValued MemberValued MemberValued Member

Group: General Forum Members
Last Login: Saturday, August 23, 2014 10:18 AM
Points: 53, Visits: 125
Thanks! The problem is solved by increasing the space...
Post #1505994
Posted Friday, October 18, 2013 1:10 AM


SSChampion

SSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampion

Group: General Forum Members
Last Login: Yesterday @ 8:15 AM
Points: 13,017, Visits: 10,800
Jim1234 (10/18/2013)
Thanks! The problem is solved by increasing the space...


Great, glad you got it solved.




How to post forum questions.
Need an answer? No, you need a question.
What’s the deal with Excel & SSIS?

Member of LinkedIn. My blog at LessThanDot.

MCSA SQL Server 2012 - MCSE Business Intelligence
Post #1506000
« Prev Topic | Next Topic »

Add to briefcase

Permissions Expand / Collapse