Skip navigation
Contact Us
1475 Views 9 Replies Latest reply: Oct 29, 2013 9:02 PM by venkat sai RSS
Ummed Mahala Newbie 6 posts since
Nov 17, 2012
Currently Being Moderated

Nov 17, 2012 4:00 PM

Workflow running forever....??

Hi,

 

my workflow is running continously without giving any error ,even if in the source there are only 4 rows......but when i do not use sorter or aggregator its running absolutely fine and completes in 2 seconds.....but when i use aggregator or sorter its running forever ...and in session log last line is ..

For transformation [agg_trans], memory used is [121151248] bytes and row size is 20 bytes.....

Please refer to attached session log for your reference..

 

Please help

Attachments:
  • Felix Ho Expert 342 posts since
    Aug 23, 2011
    Currently Being Moderated
    Nov 18, 2012 9:12 PM (in response to Ummed Mahala)
    Workflow running forever....??

    Let's try to run the session with 'Verbose Data' log to see more detail information.

     

    By the way, what is the purpose of your sorter??

  • Nakul Dhoot Newbie 3 posts since
    Feb 15, 2013
    Currently Being Moderated
    Oct 22, 2013 7:00 AM (in response to Ummed Mahala)
    Workflow running forever....??

    Facing similar ssue when using Sorter Transformation. Plz suggest.

    • Shirish Ganta Master 1,141 posts since
      Feb 17, 2013
      Currently Being Moderated
      Oct 22, 2013 7:08 AM (in response to Nakul Dhoot)
      Workflow running forever....??

      Hi Nukul,

       

      Please provide the session log(By using verbose data) so that we can get idea on where is the problem like which thread is taking more time and busy percentages etc.

       

      Regards

      Shirish

      • Nakul Dhoot Newbie 3 posts since
        Feb 15, 2013
        Currently Being Moderated
        Oct 22, 2013 7:16 AM (in response to Shirish Ganta)
        Workflow running forever....??

        Hi Shirish

         

        Please find below session log with tracing Level>> Verbose Data

        Severity    Timestamp    Node    Thread    Message Code    Message

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    DIRECTOR    TM_6964    Date format for the Session is [MM/DD/YYYY HH24:MI:SS.US]

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    DIRECTOR    TM_6703    Session [s_m_Emp_Sorter] is run by 32-bit Integration Service  [node01_SYNHNJSEZA1092], version [8.6.1], build [1218].

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MANAGER    PETL_24058    Running Partition Group [1].

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MANAGER    PETL_24000    Parallel Pipeline Engine initializing.

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MANAGER    PETL_24001    Parallel Pipeline Engine running.

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MANAGER    PETL_24003    Initializing session run.

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    CMN_1569    Server Mode: [ASCII]

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    CMN_1570    Server Code page: [MS Windows Latin 1 (ANSI), superset of Latin1]

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    TM_6151    The session sort order is [Binary].

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    TM_6156    Using low precision processing.

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    TM_6180    Deadlock retry logic will not be implemented.

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    TM_6307    DTM error log disabled.

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    TE_7022    TShmWriter: Initialized

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    DBG_21249    Initializing Transform: SRTTRANS

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    DBG_21371    Number of Input Transforms = [1]:

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    DBG_21259      Input Transform[0]: [SQ_EMPLOYEES]

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    CMN_1053    SRTTRANS: Row Definition Info:(

        [0]:Names(EMPLOYEE_ID->EMPLOYEE_ID)

        Native-type:0 (N/A) C-type:1005 (Double) Precision:6 Scale:0

        [1]:Names(FIRST_NAME->FIRST_NAME)

        Native-type:0 (N/A) C-type:1003 (Char) Precision:20 Scale:0

        [2]:Names(LAST_NAME->LAST_NAME)

        Native-type:0 (N/A) C-type:1003 (Char) Precision:25 Scale:0

        [3]:Names(EMAIL->EMAIL)

        Native-type:0 (N/A) C-type:1003 (Char) Precision:25 Scale:0

        [4]:Names(PHONE_NUMBER->PHONE_NUMBER)

        Native-type:0 (N/A) C-type:1003 (Char) Precision:20 Scale:0

        [5]:Names(HIRE_DATE->HIRE_DATE)

        Native-type:0 (N/A) C-type:1007 (Date/Time) Precision:29 Scale:9

        [6]:Names(JOB_ID->JOB_ID)

        Native-type:0 (N/A) C-type:1003 (Char) Precision:10 Scale:0

        [7]:Names(SALARY->SALARY)

        Native-type:0 (N/A) C-type:1005 (Double) Precision:8 Scale:2

        [8]:Names(COMMISSION_PCT->COMMISSION_PCT)

        Native-type:0 (N/A) C-type:1005 (Double) Precision:2 Scale:2

        [9]:Names(MANAGER_ID->MANAGER_ID)

        Native-type:0 (N/A) C-type:1005 (Double) Precision:6 Scale:0

        [10]:Names(DEPARTMENT_ID->DEPARTMENT_ID)

        Native-type:0 (N/A) C-type:1005 (Double) Precision:4 Scale:0

        )

         

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    DBG_21098    Default values: Input Row[0] from transform [SQ_EMPLOYEES]

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    DBG_21056      column=[EMPLOYEE_ID], defaultvalue=[]

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    DBG_21056      column=[FIRST_NAME], defaultvalue=[]

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    DBG_21056      column=[LAST_NAME], defaultvalue=[]

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    DBG_21056      column=[EMAIL], defaultvalue=[]

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    DBG_21056      column=[PHONE_NUMBER], defaultvalue=[]

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    DBG_21056      column=[HIRE_DATE], defaultvalue=[]

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    DBG_21056      column=[JOB_ID], defaultvalue=[]

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    DBG_21056      column=[SALARY], defaultvalue=[]

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    DBG_21056      column=[COMMISSION_PCT], defaultvalue=[]

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    DBG_21056      column=[MANAGER_ID], defaultvalue=[]

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    DBG_21056      column=[DEPARTMENT_ID], defaultvalue=[]

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    DBG_21375    Number of Output Transforms = [1]:

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    DBG_21398      Output Transform[0]: [EMPLOYEES_Sorter]

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    CMN_1053    SRTTRANS: Row Definition Info:(

        [0]:Names(EMPLOYEE_ID->EMPLOYEE_ID)

        Native-type:3006 (number(p,s)) C-type:1005 (Double) Precision:6 Scale:0

        [1]:Names(FIRST_NAME->FIRST_NAME)

        Native-type:3009 (varchar2) C-type:1003 (Char) Precision:20 Scale:0

        [2]:Names(LAST_NAME->LAST_NAME)

        Native-type:3009 (varchar2) C-type:1003 (Char) Precision:25 Scale:0

        [3]:Names(EMAIL->EMAIL)

        Native-type:3009 (varchar2) C-type:1003 (Char) Precision:25 Scale:0

        [4]:Names(PHONE_NUMBER->PHONE_NUMBER)

        Native-type:3009 (varchar2) C-type:1003 (Char) Precision:20 Scale:0

        [5]:Names(HIRE_DATE->HIRE_DATE)

        Native-type:3002 (date) C-type:1007 (Date/Time) Precision:19 Scale:0

        [6]:Names(JOB_ID->JOB_ID)

        Native-type:3009 (varchar2) C-type:1003 (Char) Precision:10 Scale:0

        [7]:Names(SALARY->SALARY)

        Native-type:3006 (number(p,s)) C-type:1005 (Double) Precision:8 Scale:2

        [8]:Names(COMMISSION_PCT->COMMISSION_PCT)

        Native-type:3006 (number(p,s)) C-type:1005 (Double) Precision:2 Scale:2

        [9]:Names(MANAGER_ID->MANAGER_ID)

        Native-type:3006 (number(p,s)) C-type:1005 (Double) Precision:6 Scale:0

        [10]:Names(DEPARTMENT_ID->DEPARTMENT_ID)

        Native-type:3006 (number(p,s)) C-type:1005 (Double) Precision:4 Scale:0

        )

         

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    DBG_21099    Default values: Output Row[0] going to transform [EMPLOYEES_Sorter]

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    DBG_21693    SRTTRANS: Cache size for partition [1] = [429460272]

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    SORT_40418    Definition for Transformation [SRTTRANS] is [-mem=429460272 -temp:prefix="PMSORT14_4_0_17","C:\Informatica\PowerCenter8.6.1\server\infa_shared\Temp" -format:size=variable,maximum_size:172,minimum_size:14 -meth:po  -key=offset:2,size:9,vchar]

        INFO    10/22/2013 7:12:07 PM    node01_SYNHNJSEZA1092    MAPPING    SORT_40419    For Transformation [SRTTRANS], memory used is [429460272] bytes and row size is 172 bytes.

        • Shirish Ganta Master 1,141 posts since
          Feb 17, 2013
          Currently Being Moderated
          Oct 22, 2013 11:12 PM (in response to Nakul Dhoot)
          Workflow running forever....??

          Hi Nukul,

           

          Is this full log? please attach the log file using the advance editor option on top right corner of the thread.

           

          I didnt see any performace stats there...try with normal now and attach than we will have both logs.

           

          By the way, clarify some points below:

           

          1. Type your source ..rdbms or file

          2. Do you use any ftp/sftp in your workflow

          3. what is the throuput are you getting while processing the data...

          4. If you have any sql override try running in Toad/plsql developer and see how much time is it returning the rows.

          5.Try to identify where is the bottleneck in the mapping.source/target or tranformation etc

           

          Regards

          Shirish

  • venkat sai Newbie 3 posts since
    Oct 29, 2013
    Currently Being Moderated
    Oct 29, 2013 9:02 PM (in response to Ummed Mahala)
    Workflow running forever....??

    HI All,

     

    I'm also facing the same problem with Sorter, Aggregator and LookUp transformations.

     

    My informatica version - 8.6.0, DB - Oracle 11g XE, O.S - Win7 Home Premium

     

    If you are using 8.6.0 on win 7, then it might not be an issue with you property/config settings, but with the informatica version it self.

     

    I heard that there are some hot fixes which you can download and patch the Informatica version

     

    PowerCenter 8.6.0

     

    PowerCenter 8.6.0 HotFix 1

     

    PowerCenter 8.6.0 HotFix 2

     

    PowerCenter 8.6.0 HotFix 3

     

    PowerCenter 8.6.0 HotFix 4

     

    PowerCenter 8.6.0 HotFix 5

     

    PowerCenter 8.6.0 HotFix 6

     

    PowerCenter 8.6.0 HotFix 7

     

    PowerCenter 8.6.0 HotFix 8

     

    PowerCenter 8.6.0 HotFix 9

     

    PowerCenter 8.6.0 HotFix 10

    etc..

     

    I haven't tried any hotfix but am planning to on this weekend.

     

    WIll update u if it works.

     

    Else, only other way is to upgrade Informatica to later versions, preferably version 9 if you have more than 4gb ram in your machine(mine only 3GB )

     

    Cheers!!!

More Like This

  • Retrieving data ...

Bookmarked By (0)

Legend

  • Correct Answers - 10 points
  • Helpful Answers - 5 points