Skip navigation
Contact Us
897 Views 2 Replies Latest reply: Nov 15, 2012 3:10 PM by Srikanth Vakalapudi RSS
Srikanth Vakalapudi Newbie 4 posts since
Nov 9, 2012
Currently Being Moderated

Nov 14, 2012 4:37 PM

SQL Transformation performance issue

Hi All,

 

I have created a mapping and at the end I have SQL transformation which executes the SQL query (very simple by taking only 1 column) and created the Target table.  If I try to dump the data into Target table from SQL Transformation it is taking too long.  Could anybody help me how i can over come this problem?

 

Here is how i used.

 

It's a SQL transformation with Dynamic Query option (Query build from the table, so it's very simple query gives about 3.1 million records output, when i try to load them into Target table is taking too much time (may be more than 8 hrs).  Please help me how to run this quickly?  btw. there is no SQL override for this.

 

regards,

Srikanth

  • Felix Ho Expert 342 posts since
    Aug 23, 2011
    Currently Being Moderated
    Nov 14, 2012 6:26 PM (in response to Srikanth Vakalapudi)
    SQL Transformation performance issue

    Hi Srikanth,

     

    I have some questinos for your case.

     

    1.) Do you want to get one column from SQL Transformation (Like the function of lookup) ?

     

    2.) Do you mean SQL transformation query give about 3.1 million records output ??

     

    3.) How many source row do you have in your ETL?

     

    4.) For this sentense,

    **when i try to load them into Target table is taking too much time (may be more than 8 hrs).**

    Do you mean your ETL use 8 hrs? or use script or others??

More Like This

  • Retrieving data ...

Bookmarked By (0)