10:03:26,940 INFO [LoggingInInterceptor] Inbound Message ---------------------------- ID: 2 Address: /DataFeed/DataFeedService Encoding: UTF-8 Content-Type: text/xml;charset=UTF-8 Headers: {content-type=[text/xml;charset=UTF-8], host=[localhost:9995], Content-Length=[641], SOAPAction=[""], user-agent=[Jakarta Commons-HttpClient/3.1], accept-encoding=[gzip,deflate], Content-Type=[text/xml;charset=UTF-8]} Payload: -------------------------------------- 10:03:26,943 INFO [STDOUT] INFO 16-02 10:03:26,943 - RepositoriesMeta - Reading repositories XML file: /root/.kettle/repositories.xml 10:03:26,945 INFO [PentahoEngine] Finding repository : 1 10:03:26,964 INFO [DataFeedServiceImpl] Adding variables to job [Job 1] 10:03:26,964 INFO [DataFeedServiceImpl] Adding variable name [END_DATE] value [2012-01-05] 10:03:26,964 INFO [DataFeedServiceImpl] Adding variable name [START_DATE] value [2011-12-31] 10:03:26,965 INFO [PentahoEngine] Executing Job : Job 1 10:03:26,965 INFO [STDOUT] INFO 16-02 10:03:26,965 - Job 1 - Start of job execution 10:03:26,967 INFO [STDOUT] INFO 16-02 10:03:26,967 - Job 1 - exec(0, 0, START.0) 10:03:26,967 INFO [STDOUT] INFO 16-02 10:03:26,967 - START - Starting job entry 10:03:26,968 INFO [STDOUT] INFO 16-02 10:03:26,968 - Job 1 - Starting entry [ProcessDatafeeds] 10:03:26,968 INFO [STDOUT] INFO 16-02 10:03:26,968 - Job 1 - exec(1, 0, ProcessDatafeeds.0) 10:03:26,969 INFO [STDOUT] INFO 16-02 10:03:26,969 - ProcessDatafeeds - Starting job entry 10:03:26,969 INFO [STDOUT] INFO 16-02 10:03:26,969 - ProcessDatafeeds - Loading job from repository : [/ : ProcessDatafeeds] 10:03:26,992 INFO [STDOUT] INFO 16-02 10:03:26,992 - ProcessDatafeeds - exec(2, 0, START.0) 10:03:27,022 INFO [STDOUT] INFO 16-02 10:03:27,022 - START - Starting job entry 10:03:27,023 INFO [STDOUT] INFO 16-02 10:03:27,023 - ProcessDatafeeds - Starting entry [GetDatafeeds] 10:03:27,023 INFO [STDOUT] INFO 16-02 10:03:27,023 - ProcessDatafeeds - exec(3, 0, GetDatafeeds.0) 10:03:27,024 INFO [STDOUT] INFO 16-02 10:03:27,024 - GetDatafeeds - Starting job entry 10:03:27,024 INFO [STDOUT] INFO 16-02 10:03:27,024 - GetDatafeeds - Opening transformation: [null] in directory [/] 10:03:27,025 INFO [STDOUT] INFO 16-02 10:03:27,025 - GetDatafeeds - Loading transformation from repository [GetDatafeeds] in directory [/] 10:03:27,108 INFO [STDOUT] INFO 16-02 10:03:27,107 - GetDatafeeds - Starting transformation...(file=null, name=GetDatafeeds, repinfo=null) 10:03:27,108 INFO [STDOUT] INFO 16-02 10:03:27,108 - GetDatafeeds - Transformation is pre-loaded. 10:03:27,108 INFO [STDOUT] INFO 16-02 10:03:27,108 - GetDatafeeds - Dispatching started for transformation [GetDatafeeds] 10:03:27,108 INFO [STDOUT] INFO 16-02 10:03:27,108 - GetDatafeeds - Nr of arguments detected:0 10:03:27,109 INFO [STDOUT] INFO 16-02 10:03:27,109 - GetDatafeeds - This is not a replay transformation 10:03:27,109 INFO [STDOUT] INFO 16-02 10:03:27,109 - GetDatafeeds - I found 2 different steps to launch. 10:03:27,109 INFO [STDOUT] INFO 16-02 10:03:27,109 - GetDatafeeds - Allocating rowsets... 10:03:27,109 INFO [STDOUT] INFO 16-02 10:03:27,109 - GetDatafeeds - Allocating rowsets for step 0 --> SelectDatafeeds 10:03:27,109 INFO [STDOUT] INFO 16-02 10:03:27,109 - GetDatafeeds - prevcopies = 1, nextcopies=1 10:03:27,109 INFO [STDOUT] INFO 16-02 10:03:27,109 - GetDatafeeds - Transformation allocated new rowset [SelectDatafeeds.0 - Copy rows to result.0] 10:03:27,109 INFO [STDOUT] INFO 16-02 10:03:27,109 - GetDatafeeds - Allocated 1 rowsets for step 0 --> SelectDatafeeds 10:03:27,110 INFO [STDOUT] INFO 16-02 10:03:27,109 - GetDatafeeds - Allocating rowsets for step 1 --> Copy rows to result 10:03:27,110 INFO [STDOUT] INFO 16-02 10:03:27,110 - GetDatafeeds - Allocated 1 rowsets for step 1 --> Copy rows to result 10:03:27,110 INFO [STDOUT] INFO 16-02 10:03:27,110 - GetDatafeeds - Allocating Steps & StepData... 10:03:27,110 INFO [STDOUT] INFO 16-02 10:03:27,110 - GetDatafeeds - Transformation is about to allocate step [SelectDatafeeds] of type [TableInput] 10:03:27,110 INFO [STDOUT] INFO 16-02 10:03:27,110 - SelectDatafeeds - distribution activated 10:03:27,110 INFO [STDOUT] INFO 16-02 10:03:27,110 - SelectDatafeeds - Starting allocation of buffers & new threads... 10:03:27,110 INFO [STDOUT] INFO 16-02 10:03:27,110 - SelectDatafeeds - Step info: nrinput=0 nroutput=1 10:03:27,110 INFO [STDOUT] INFO 16-02 10:03:27,110 - SelectDatafeeds - output rel. is 1:1 10:03:27,111 INFO [STDOUT] INFO 16-02 10:03:27,111 - SelectDatafeeds - Found output rowset [SelectDatafeeds.0 - Copy rows to result.0] 10:03:27,111 INFO [STDOUT] INFO 16-02 10:03:27,111 - SelectDatafeeds - Finished dispatching 10:03:27,111 INFO [STDOUT] INFO 16-02 10:03:27,111 - GetDatafeeds - Transformation has allocated a new step: [SelectDatafeeds].0 10:03:27,111 INFO [STDOUT] INFO 16-02 10:03:27,111 - GetDatafeeds - Transformation is about to allocate step [Copy rows to result] of type [RowsToResult] 10:03:27,111 INFO [STDOUT] INFO 16-02 10:03:27,111 - Copy rows to result - distribution activated 10:03:27,111 INFO [STDOUT] INFO 16-02 10:03:27,111 - Copy rows to result - Starting allocation of buffers & new threads... 10:03:27,111 INFO [STDOUT] INFO 16-02 10:03:27,111 - Copy rows to result - Step info: nrinput=1 nroutput=0 10:03:27,112 INFO [STDOUT] INFO 16-02 10:03:27,112 - Copy rows to result - Got previous step from [Copy rows to result] #0 --> SelectDatafeeds 10:03:27,112 INFO [STDOUT] INFO 16-02 10:03:27,112 - Copy rows to result - input rel is 1:1 10:03:27,112 INFO [STDOUT] INFO 16-02 10:03:27,112 - Copy rows to result - Found input rowset [SelectDatafeeds.0 - Copy rows to result.0] 10:03:27,112 INFO [STDOUT] INFO 16-02 10:03:27,112 - Copy rows to result - Finished dispatching 10:03:27,112 INFO [STDOUT] INFO 16-02 10:03:27,112 - GetDatafeeds - Transformation has allocated a new step: [Copy rows to result].0 10:03:27,112 INFO [STDOUT] INFO 16-02 10:03:27,112 - GetDatafeeds - This transformation can be replayed with replay date: 2012/02/16 10:03:27 10:03:27,113 INFO [STDOUT] INFO 16-02 10:03:27,113 - GetDatafeeds - Initialising 2 steps... 10:03:27,113 INFO [STDOUT] INFO 16-02 10:03:27,113 - SelectDatafeeds - Running on slave server #0/1. 10:03:27,114 INFO [STDOUT] INFO 16-02 10:03:27,114 - PDI - New database connection defined 10:03:27,124 INFO [STDOUT] INFO 16-02 10:03:27,123 - PDI - Connected to database. 10:03:27,124 INFO [STDOUT] INFO 16-02 10:03:27,124 - PDI - Auto commit off 10:03:27,125 INFO [STDOUT] INFO 16-02 10:03:27,125 - SelectDatafeeds - Connected to database... 10:03:27,125 INFO [STDOUT] INFO 16-02 10:03:27,125 - Copy rows to result - Running on slave server #0/1. 10:03:27,125 INFO [STDOUT] INFO 16-02 10:03:27,125 - GetDatafeeds - Step [SelectDatafeeds.0] initialized flawlessly. 10:03:27,125 INFO [STDOUT] INFO 16-02 10:03:27,125 - GetDatafeeds - Step [Copy rows to result.0] initialized flawlessly. 10:03:27,126 INFO [STDOUT] INFO 16-02 10:03:27,126 - SelectDatafeeds - Starting to run... 10:03:27,126 INFO [STDOUT] INFO 16-02 10:03:27,126 - SelectDatafeeds - SQL query : SELECT id , name , description FROM datafeeds 10:03:27,128 INFO [STDOUT] INFO 16-02 10:03:27,128 - SelectDatafeeds - Finished reading query, closing connection. 10:03:27,129 INFO [STDOUT] INFO 16-02 10:03:27,129 - PDI - Connection to database closed! 10:03:27,129 INFO [STDOUT] INFO 16-02 10:03:27,129 - SelectDatafeeds - Finished processing (I=1, O=0, R=0, W=1, U=0, E=0) 10:03:27,129 INFO [STDOUT] INFO 16-02 10:03:27,129 - GetDatafeeds - Transformation has allocated 2 threads and 1 rowsets. 10:03:27,130 INFO [STDOUT] INFO 16-02 10:03:27,130 - Copy rows to result - Starting to run... 10:03:27,143 INFO [STDOUT] INFO 16-02 10:03:27,143 - Copy rows to result - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 10:03:27,152 INFO [STDOUT] INFO 16-02 10:03:27,152 - ProcessDatafeeds - Starting entry [SetDatafeedVariables] 10:03:27,152 INFO [STDOUT] INFO 16-02 10:03:27,152 - ProcessDatafeeds - exec(4, 0, SetDatafeedVariables.0) 10:03:27,153 INFO [STDOUT] INFO 16-02 10:03:27,153 - SetDatafeedVariables - Starting job entry 10:03:27,153 INFO [STDOUT] INFO 16-02 10:03:27,153 - SetDatafeedVariables - Opening transformation: [null] in directory [/] 10:03:27,153 INFO [STDOUT] INFO 16-02 10:03:27,153 - SetDatafeedVariables - Loading transformation from repository [SetDatafeedVariables] in directory [/] 10:03:27,181 INFO [STDOUT] INFO 16-02 10:03:27,181 - SetDatafeedVariables - Starting transformation...(file=null, name=SetDatafeedVariables, repinfo=null) 10:03:27,181 INFO [STDOUT] INFO 16-02 10:03:27,181 - SetDatafeedVariables - Transformation is pre-loaded. 10:03:27,181 INFO [STDOUT] INFO 16-02 10:03:27,181 - SetDatafeedVariables - Dispatching started for transformation [SetDatafeedVariables] 10:03:27,182 INFO [STDOUT] INFO 16-02 10:03:27,181 - SetDatafeedVariables - Nr of arguments detected:0 10:03:27,182 INFO [STDOUT] INFO 16-02 10:03:27,182 - SetDatafeedVariables - This is not a replay transformation 10:03:27,182 INFO [STDOUT] INFO 16-02 10:03:27,182 - SetDatafeedVariables - I found 2 different steps to launch. 10:03:27,182 INFO [STDOUT] INFO 16-02 10:03:27,182 - SetDatafeedVariables - Allocating rowsets... 10:03:27,182 INFO [STDOUT] INFO 16-02 10:03:27,182 - SetDatafeedVariables - Allocating rowsets for step 0 --> Get rows from result 10:03:27,182 INFO [STDOUT] INFO 16-02 10:03:27,182 - SetDatafeedVariables - prevcopies = 1, nextcopies=1 10:03:27,182 INFO [STDOUT] INFO 16-02 10:03:27,182 - SetDatafeedVariables - Transformation allocated new rowset [Get rows from result.0 - Set Variables.0] 10:03:27,183 INFO [STDOUT] INFO 16-02 10:03:27,182 - SetDatafeedVariables - Allocated 1 rowsets for step 0 --> Get rows from result 10:03:27,183 INFO [STDOUT] INFO 16-02 10:03:27,183 - SetDatafeedVariables - Allocating rowsets for step 1 --> Set Variables 10:03:27,183 INFO [STDOUT] INFO 16-02 10:03:27,183 - SetDatafeedVariables - Allocated 1 rowsets for step 1 --> Set Variables 10:03:27,183 INFO [STDOUT] INFO 16-02 10:03:27,183 - SetDatafeedVariables - Allocating Steps & StepData... 10:03:27,183 INFO [STDOUT] INFO 16-02 10:03:27,183 - SetDatafeedVariables - Transformation is about to allocate step [Get rows from result] of type [RowsFromResult] 10:03:27,183 INFO [STDOUT] INFO 16-02 10:03:27,183 - Get rows from result - distribution activated 10:03:27,183 INFO [STDOUT] INFO 16-02 10:03:27,183 - Get rows from result - Starting allocation of buffers & new threads... 10:03:27,184 INFO [STDOUT] INFO 16-02 10:03:27,183 - Get rows from result - Step info: nrinput=0 nroutput=1 10:03:27,184 INFO [STDOUT] INFO 16-02 10:03:27,184 - Get rows from result - output rel. is 1:1 10:03:27,184 INFO [STDOUT] INFO 16-02 10:03:27,184 - Get rows from result - Found output rowset [Get rows from result.0 - Set Variables.0] 10:03:27,184 INFO [STDOUT] INFO 16-02 10:03:27,184 - Get rows from result - Finished dispatching 10:03:27,184 INFO [STDOUT] INFO 16-02 10:03:27,184 - SetDatafeedVariables - Transformation has allocated a new step: [Get rows from result].0 10:03:27,184 INFO [STDOUT] INFO 16-02 10:03:27,184 - SetDatafeedVariables - Transformation is about to allocate step [Set Variables] of type [SetVariable] 10:03:27,184 INFO [STDOUT] INFO 16-02 10:03:27,184 - Set Variables - distribution activated 10:03:27,185 INFO [STDOUT] INFO 16-02 10:03:27,185 - Set Variables - Starting allocation of buffers & new threads... 10:03:27,185 INFO [STDOUT] INFO 16-02 10:03:27,185 - Set Variables - Step info: nrinput=1 nroutput=0 10:03:27,185 INFO [STDOUT] INFO 16-02 10:03:27,185 - Set Variables - Got previous step from [Set Variables] #0 --> Get rows from result 10:03:27,185 INFO [STDOUT] INFO 16-02 10:03:27,185 - Set Variables - input rel is 1:1 10:03:27,185 INFO [STDOUT] INFO 16-02 10:03:27,185 - Set Variables - Found input rowset [Get rows from result.0 - Set Variables.0] 10:03:27,185 INFO [STDOUT] INFO 16-02 10:03:27,185 - Set Variables - Finished dispatching 10:03:27,185 INFO [STDOUT] INFO 16-02 10:03:27,185 - SetDatafeedVariables - Transformation has allocated a new step: [Set Variables].0 10:03:27,186 INFO [STDOUT] INFO 16-02 10:03:27,186 - SetDatafeedVariables - This transformation can be replayed with replay date: 2012/02/16 10:03:27 10:03:27,186 INFO [STDOUT] INFO 16-02 10:03:27,186 - SetDatafeedVariables - Initialising 2 steps... 10:03:27,186 INFO [STDOUT] INFO 16-02 10:03:27,186 - Get rows from result - Running on slave server #0/1. 10:03:27,187 INFO [STDOUT] INFO 16-02 10:03:27,187 - Set Variables - Running on slave server #0/1. 10:03:27,187 INFO [STDOUT] INFO 16-02 10:03:27,187 - SetDatafeedVariables - Step [Get rows from result.0] initialized flawlessly. 10:03:27,187 INFO [STDOUT] INFO 16-02 10:03:27,187 - SetDatafeedVariables - Step [Set Variables.0] initialized flawlessly. 10:03:27,187 INFO [STDOUT] INFO 16-02 10:03:27,187 - Get rows from result - Starting to run... 10:03:27,188 INFO [STDOUT] INFO 16-02 10:03:27,188 - Get rows from result - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 10:03:27,188 INFO [STDOUT] INFO 16-02 10:03:27,188 - SetDatafeedVariables - Transformation has allocated 2 threads and 1 rowsets. 10:03:27,188 INFO [STDOUT] INFO 16-02 10:03:27,188 - Set Variables - Starting to run... 10:03:27,188 INFO [STDOUT] INFO 16-02 10:03:27,188 - Set Variables - Setting environment variables... 10:03:27,189 INFO [STDOUT] INFO 16-02 10:03:27,189 - Set Variables - Set variable DATAFEEDID to value [1] 10:03:27,203 INFO [STDOUT] INFO 16-02 10:03:27,203 - Set Variables - Finished after 1 rows. 10:03:27,203 INFO [STDOUT] INFO 16-02 10:03:27,203 - Set Variables - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 10:03:27,212 INFO [STDOUT] INFO 16-02 10:03:27,212 - ProcessDatafeeds - Starting entry [StageRequirements] 10:03:27,212 INFO [STDOUT] INFO 16-02 10:03:27,212 - ProcessDatafeeds - exec(5, 0, StageRequirements.0) 10:03:27,212 INFO [STDOUT] INFO 16-02 10:03:27,212 - StageRequirements - Starting job entry 10:03:27,212 INFO [STDOUT] INFO 16-02 10:03:27,212 - StageRequirements - Loading job from repository : [/ : StageRequirements] 10:03:27,230 INFO [STDOUT] INFO 16-02 10:03:27,230 - StageRequirements - exec(6, 0, START.0) 10:03:27,230 INFO [STDOUT] INFO 16-02 10:03:27,230 - START - Starting job entry 10:03:27,231 INFO [STDOUT] INFO 16-02 10:03:27,231 - StageRequirements - Starting entry [Write To Log] 10:03:27,231 INFO [STDOUT] INFO 16-02 10:03:27,231 - StageRequirements - exec(7, 0, Write To Log.0) 10:03:27,232 INFO [STDOUT] INFO 16-02 10:03:27,232 - Write To Log - Starting job entry 10:03:27,232 INFO [STDOUT] INFO 16-02 10:03:27,232 - Stuff - Things 1 10:03:27,232 INFO [STDOUT] INFO 16-02 10:03:27,232 - StageRequirements - Starting entry [SelectRequirements] 10:03:27,232 INFO [STDOUT] INFO 16-02 10:03:27,232 - StageRequirements - exec(8, 0, SelectRequirements.0) 10:03:27,233 INFO [STDOUT] INFO 16-02 10:03:27,233 - SelectRequirements - Starting job entry 10:03:27,233 INFO [STDOUT] INFO 16-02 10:03:27,233 - SelectRequirements - Opening transformation: [null] in directory [/] 10:03:27,233 INFO [STDOUT] INFO 16-02 10:03:27,233 - SelectRequirements - Loading transformation from repository [SelectRequirements] in directory [/] 10:03:27,254 INFO [STDOUT] INFO 16-02 10:03:27,254 - SelectRequirements - Starting transformation...(file=null, name=SelectRequirements, repinfo=null) 10:03:27,254 INFO [STDOUT] INFO 16-02 10:03:27,254 - SelectRequirements - Transformation is pre-loaded. 10:03:27,255 INFO [STDOUT] INFO 16-02 10:03:27,254 - SelectRequirements - Dispatching started for transformation [SelectRequirements] 10:03:27,255 INFO [STDOUT] INFO 16-02 10:03:27,255 - SelectRequirements - Nr of arguments detected:0 10:03:27,255 INFO [STDOUT] INFO 16-02 10:03:27,255 - SelectRequirements - This is not a replay transformation 10:03:27,255 INFO [STDOUT] INFO 16-02 10:03:27,255 - SelectRequirements - I found 3 different steps to launch. 10:03:27,255 INFO [STDOUT] INFO 16-02 10:03:27,255 - SelectRequirements - Allocating rowsets... 10:03:27,255 INFO [STDOUT] INFO 16-02 10:03:27,255 - SelectRequirements - Allocating rowsets for step 0 --> Table input 10:03:27,255 INFO [STDOUT] INFO 16-02 10:03:27,255 - SelectRequirements - prevcopies = 1, nextcopies=1 10:03:27,255 INFO [STDOUT] INFO 16-02 10:03:27,255 - SelectRequirements - Transformation allocated new rowset [Table input.0 - Write to log.0] 10:03:27,256 INFO [STDOUT] INFO 16-02 10:03:27,256 - SelectRequirements - Allocated 1 rowsets for step 0 --> Table input 10:03:27,256 INFO [STDOUT] INFO 16-02 10:03:27,256 - SelectRequirements - Allocating rowsets for step 1 --> Write to log 10:03:27,256 INFO [STDOUT] INFO 16-02 10:03:27,256 - SelectRequirements - prevcopies = 1, nextcopies=1 10:03:27,256 INFO [STDOUT] INFO 16-02 10:03:27,256 - SelectRequirements - Transformation allocated new rowset [Write to log.0 - Copy rows to result.0] 10:03:27,256 INFO [STDOUT] INFO 16-02 10:03:27,256 - SelectRequirements - Allocated 2 rowsets for step 1 --> Write to log 10:03:27,256 INFO [STDOUT] INFO 16-02 10:03:27,256 - SelectRequirements - Allocating rowsets for step 2 --> Copy rows to result 10:03:27,256 INFO [STDOUT] INFO 16-02 10:03:27,256 - SelectRequirements - Allocated 2 rowsets for step 2 --> Copy rows to result 10:03:27,257 INFO [STDOUT] INFO 16-02 10:03:27,256 - SelectRequirements - Allocating Steps & StepData... 10:03:27,257 INFO [STDOUT] INFO 16-02 10:03:27,257 - SelectRequirements - Transformation is about to allocate step [Table input] of type [TableInput] 10:03:27,257 INFO [STDOUT] INFO 16-02 10:03:27,257 - Table input - distribution activated 10:03:27,257 INFO [STDOUT] INFO 16-02 10:03:27,257 - Table input - Starting allocation of buffers & new threads... 10:03:27,257 INFO [STDOUT] INFO 16-02 10:03:27,257 - Table input - Step info: nrinput=0 nroutput=1 10:03:27,257 INFO [STDOUT] INFO 16-02 10:03:27,257 - Table input - output rel. is 1:1 10:03:27,257 INFO [STDOUT] INFO 16-02 10:03:27,257 - Table input - Found output rowset [Table input.0 - Write to log.0] 10:03:27,257 INFO [STDOUT] INFO 16-02 10:03:27,257 - Table input - Finished dispatching 10:03:27,258 INFO [STDOUT] INFO 16-02 10:03:27,258 - SelectRequirements - Transformation has allocated a new step: [Table input].0 10:03:27,258 INFO [STDOUT] INFO 16-02 10:03:27,258 - SelectRequirements - Transformation is about to allocate step [Write to log] of type [WriteToLog] 10:03:27,258 INFO [STDOUT] INFO 16-02 10:03:27,258 - Write to log - distribution activated 10:03:27,258 INFO [STDOUT] INFO 16-02 10:03:27,258 - Write to log - Starting allocation of buffers & new threads... 10:03:27,258 INFO [STDOUT] INFO 16-02 10:03:27,258 - Write to log - Step info: nrinput=1 nroutput=1 10:03:27,258 INFO [STDOUT] INFO 16-02 10:03:27,258 - Write to log - Got previous step from [Write to log] #0 --> Table input 10:03:27,259 INFO [STDOUT] INFO 16-02 10:03:27,259 - Write to log - input rel is 1:1 10:03:27,259 INFO [STDOUT] INFO 16-02 10:03:27,259 - Write to log - Found input rowset [Table input.0 - Write to log.0] 10:03:27,259 INFO [STDOUT] INFO 16-02 10:03:27,259 - Write to log - output rel. is 1:1 10:03:27,259 INFO [STDOUT] INFO 16-02 10:03:27,259 - Write to log - Found output rowset [Write to log.0 - Copy rows to result.0] 10:03:27,259 INFO [STDOUT] INFO 16-02 10:03:27,259 - Write to log - Finished dispatching 10:03:27,259 INFO [STDOUT] INFO 16-02 10:03:27,259 - SelectRequirements - Transformation has allocated a new step: [Write to log].0 10:03:27,259 INFO [STDOUT] INFO 16-02 10:03:27,259 - SelectRequirements - Transformation is about to allocate step [Copy rows to result] of type [RowsToResult] 10:03:27,260 INFO [STDOUT] INFO 16-02 10:03:27,260 - Copy rows to result - distribution activated 10:03:27,260 INFO [STDOUT] INFO 16-02 10:03:27,260 - Copy rows to result - Starting allocation of buffers & new threads... 10:03:27,260 INFO [STDOUT] INFO 16-02 10:03:27,260 - Copy rows to result - Step info: nrinput=1 nroutput=0 10:03:27,260 INFO [STDOUT] INFO 16-02 10:03:27,260 - Copy rows to result - Got previous step from [Copy rows to result] #0 --> Write to log 10:03:27,260 INFO [STDOUT] INFO 16-02 10:03:27,260 - Copy rows to result - input rel is 1:1 10:03:27,260 INFO [STDOUT] INFO 16-02 10:03:27,260 - Copy rows to result - Found input rowset [Write to log.0 - Copy rows to result.0] 10:03:27,260 INFO [STDOUT] INFO 16-02 10:03:27,260 - Copy rows to result - Finished dispatching 10:03:27,261 INFO [STDOUT] INFO 16-02 10:03:27,261 - SelectRequirements - Transformation has allocated a new step: [Copy rows to result].0 10:03:27,261 INFO [STDOUT] INFO 16-02 10:03:27,261 - SelectRequirements - This transformation can be replayed with replay date: 2012/02/16 10:03:27 10:03:27,261 INFO [STDOUT] INFO 16-02 10:03:27,261 - SelectRequirements - Initialising 3 steps... 10:03:27,262 INFO [STDOUT] INFO 16-02 10:03:27,262 - Table input - Running on slave server #0/1. 10:03:27,262 INFO [STDOUT] INFO 16-02 10:03:27,262 - Write to log - Running on slave server #0/1. 10:03:27,262 INFO [STDOUT] INFO 16-02 10:03:27,262 - Copy rows to result - Running on slave server #0/1. 10:03:27,275 INFO [STDOUT] INFO 16-02 10:03:27,275 - pdi - New database connection defined 10:03:27,286 INFO [STDOUT] INFO 16-02 10:03:27,286 - pdi - Connected to database. 10:03:27,286 INFO [STDOUT] INFO 16-02 10:03:27,286 - pdi - Auto commit off 10:03:27,286 INFO [STDOUT] INFO 16-02 10:03:27,286 - Table input - Connected to database... 10:03:27,286 INFO [STDOUT] INFO 16-02 10:03:27,286 - SelectRequirements - Step [Table input.0] initialized flawlessly. 10:03:27,287 INFO [STDOUT] INFO 16-02 10:03:27,286 - SelectRequirements - Step [Write to log.0] initialized flawlessly. 10:03:27,287 INFO [STDOUT] INFO 16-02 10:03:27,287 - SelectRequirements - Step [Copy rows to result.0] initialized flawlessly. 10:03:27,287 INFO [STDOUT] INFO 16-02 10:03:27,287 - Table input - Starting to run... 10:03:27,287 INFO [STDOUT] INFO 16-02 10:03:27,287 - Table input - SQL query : SELECT datafeedID , requirementID , stagingTableName , query , shardPattern FROM datafeedRequirements WHERE datafeedID=1 ORDER BY requirementID 10:03:27,289 INFO [STDOUT] INFO 16-02 10:03:27,289 - Table input - Finished reading query, closing connection. 10:03:27,290 INFO [STDOUT] INFO 16-02 10:03:27,290 - pdi - Connection to database closed! 10:03:27,290 INFO [STDOUT] INFO 16-02 10:03:27,290 - Table input - Finished processing (I=9, O=0, R=0, W=9, U=0, E=0) 10:03:27,291 INFO [STDOUT] INFO 16-02 10:03:27,291 - Write to log - Starting to run... 10:03:27,291 INFO [STDOUT] INFO 16-02 10:03:27,291 - Write to log - ------------> Linenr 1------------------------------ Selected Requirements datafeedID = 1 requirementID = 1 stagingTableName = dfStructureAccounts query = select a.id, a.description customerID, a.isActive from admaxCampaigns ac join tsacommon.accounts a on a.ID = ac.accountID group by ac.accountID shardPattern = st-tracker ==================== 10:03:27,292 INFO [STDOUT] INFO 16-02 10:03:27,292 - Write to log - ------------> Linenr 2------------------------------ Selected Requirements datafeedID = 1 requirementID = 2 stagingTableName = dfStructureAdMaxCampaigns query = select ac.id, ac.accountID, ac.description, cast(substring_index(substring_index(ac.description, '_', 2), '_', -1) as signed) businessAreaID, cast(substring_index(substring_index(ac.description, '_', 3), '_', -1) as signed) businessLocationID from admaxCampaigns ac shardPattern = st-tracker ==================== 10:03:27,292 INFO [STDOUT] INFO 16-02 10:03:27,292 - Write to log - ------------> Linenr 3------------------------------ Selected Requirements datafeedID = 1 requirementID = 3 stagingTableName = dfStructureSearchEngineAccounts query = select aseam.searchEngineAccountID ID, aseam.admaxCampaignID from admaxSearchEngineAccountMap aseam shardPattern = st-tracker ==================== 10:03:27,292 INFO [STDOUT] INFO 16-02 10:03:27,292 - Write to log - ------------> Linenr 4------------------------------ Selected Requirements datafeedID = 1 requirementID = 4 stagingTableName = dfStructureBusinessLocationIDMap query = select blim.businessLocationID, blim.systemBusinessLocationID from optus.businessLocationIDMap blim shardPattern = CDS|smb-services-01-write|smb_services|6WJMMA3638zpqWQq|3306|optus ==================== 10:03:27,292 INFO [STDOUT] INFO 16-02 10:03:27,292 - Write to log - ------------> Linenr 5------------------------------ Selected Requirements datafeedID = 1 requirementID = 5 stagingTableName = dfDataAdMaxCampaignStatus query = select ac.ID admaxCampaignID, date(now()) date, ac.status, acbas.status budgetAccrualStatus from admaxCampaigns ac join admaxCampaignBudgetAccrualStatus acbas on acbas.admaxCampaignID = ac.ID and acbas.startDate = (select max(acbas2.startDate) from admaxCampaignBudgetAccrualStatus acbas2 where acbas2.admaxCampaignID = ac.ID) shardPattern = st-tracker ==================== 10:03:27,292 INFO [STDOUT] INFO 16-02 10:03:27,292 - Write to log - ------------> Linenr 6------------------------------ Selected Requirements datafeedID = 1 requirementID = 6 stagingTableName = dfDataAdMaxCampaignBudgets query = select ac.ID admaxCampaignID, d.day date, coalesce(anmb.budget, 0) nominalMonthlyBudget, coalesce(c.dedicatedCarryover, 0) dedicatedCarryover, coalesce(c.commonCarryover, 0) commonCarryover from `st-tracker`.admaxCampaigns ac join pdi_staging.dates d on d.day between '${START_DATE}' and '${END_DATE}' left join `st-tracker`.admaxNominalMonthlyBudgets anmb on anmb.admaxCampaignID = ac.ID and anmb.startDate <= d.day and (anmb.endDate >= d.day or anmb.endDate is null) left join `st-tracker`.admaxCarryovers c on c.admaxCampaignID = ac.ID and c.type = 'boosted' and c.date = least(d.day, (select if(ac.status = 'Deleted', max(c2.date), d.day) from admaxCarryovers c2 where c2.admaxCampaignID = ac.ID and c2.type = 'boosted')) shardPattern = st-tracker ==================== 10:03:27,292 INFO [STDOUT] INFO 16-02 10:03:27,292 - Write to log - ------------> Linenr 7------------------------------ Selected Requirements datafeedID = 1 requirementID = 7 stagingTableName = products query = select p.accountID, p.productCode, p.ID from products p shardPattern = st-tracker ==================== 10:03:27,293 INFO [STDOUT] INFO 16-02 10:03:27,293 - Write to log - ------------> Linenr 8------------------------------ Selected Requirements datafeedID = 1 requirementID = 8 stagingTableName = accountPerfSum_rsData query = Report d false ColumnLabelText Account Channel Campaign ViewBy 1 Impressions Impressions false None 2 Prod Conv Prod Conv true None 4 Clicks Clicks false None 72 SEAID SEAID false None 208 Status Status false None 58 AdCost AdCost false None ${CONTACT_PROD}contact_uscontact_ustrueConv${FB_PROD}fb_likefb_liketrueConv${GP_PROD}gp_likegp_liketrueConv${VIEW_PROD}page_viewpage_viewtrueConv${TW_PROD}tw_liketw_liketrueConv${VANITY_PROD}vanity_urlvanity_urltrueConv${CALL_PROD}callscallstrueConv 1true7369trueAllfalse0${ACCOUNTID} Daily ${END_DATE}T23:59:59-08:00 ${START_DATE}T00:00:00-08:00 1 Day shardPattern = REPORT_SERVICE ==================== 10:03:27,293 INFO [STDOUT] INFO 16-02 10:03:27,293 - Write to log - ------------> Linenr 9------------------------------ Selected Requirements datafeedID = 1 requirementID = 9 stagingTableName = customerDatamart query = insert into customerDatamart select * from (select dfsa.customerID CustomerID, d2.day Date, coalesce(sum(if(apsrsd.channelDesc='Paid Search',apsrsd.adCost,0)),0) PaidSearchCost, coalesce(sum(if(apsrsd.channelDesc='Paid Search',apsrsd.pageViews,0)),0) PaidSearchVisitors, coalesce(sum(if(apsrsd.channelDesc!='Paid Search',apsrsd.pageViews,0)),0) NaturalSearchVisitors, coalesce(sum(apsrsd.vanity_url),0) ClickThruLeads, coalesce(sum(apsrsd.contact),0) EmailLeads, coalesce(sum(apsrsd.calls),0) CallLeads from dfStructureAccounts dfsa inner join (select day from dates d where d.day between '${START_DATE}' and '${END_DATE}') d2 left join accountPerfSum_rsData apsrsd on apsrsd.accountDesc = dfsa.customerID and apsrsd.dataDate = d2.day group by dfsa.customerID, d2.day) data on duplicate key update paidSearchCost = data.PaidSearchCost, paidSearchVisitors = data.PaidSearchVisitors, naturalSearchVisitors = data.NaturalSearchVisitors, clickThruLeads = data.ClickThruLeads, emailLeads = data.EmailLeads, callLeads = data.CallLeads shardPattern = CDS|smb_pdi|smb_services|6WJMMA3638zpqWQq|3306|pdi_staging ==================== 10:03:27,297 INFO [STDOUT] INFO 16-02 10:03:27,293 - SelectRequirements - Transformation has allocated 3 threads and 2 rowsets. 10:03:27,299 INFO [STDOUT] INFO 16-02 10:03:27,298 - Copy rows to result - Starting to run... 10:03:27,311 INFO [STDOUT] INFO 16-02 10:03:27,311 - Write to log - Finished processing (I=0, O=0, R=9, W=9, U=0, E=0) 10:03:27,331 INFO [STDOUT] INFO 16-02 10:03:27,331 - Copy rows to result - Finished processing (I=0, O=0, R=9, W=9, U=0, E=0) 10:03:27,336 INFO [STDOUT] INFO 16-02 10:03:27,336 - StageRequirements - Starting entry [StageRequirement] 10:03:27,336 INFO [STDOUT] INFO 16-02 10:03:27,336 - StageRequirements - exec(9, 0, StageRequirement.0) 10:03:27,336 INFO [STDOUT] INFO 16-02 10:03:27,336 - StageRequirement - Starting job entry 10:03:27,337 INFO [STDOUT] INFO 16-02 10:03:27,337 - StageRequirement - Loading job from repository : [/ : StageRequirement] 10:03:27,354 INFO [STDOUT] INFO 16-02 10:03:27,353 - StageRequirement - exec(10, 0, START.0) 10:03:27,354 INFO [STDOUT] INFO 16-02 10:03:27,354 - START - Starting job entry 10:03:27,355 INFO [STDOUT] INFO 16-02 10:03:27,355 - StageRequirement - Starting entry [SetRequirementStagingVariables] 10:03:27,355 INFO [STDOUT] INFO 16-02 10:03:27,355 - StageRequirement - exec(11, 0, SetRequirementStagingVariables.0) 10:03:27,355 INFO [STDOUT] INFO 16-02 10:03:27,355 - SetRequirementStagingVariables - Starting job entry 10:03:27,355 INFO [STDOUT] INFO 16-02 10:03:27,355 - SetRequirementStagingVariables - Opening transformation: [null] in directory [/] 10:03:27,355 INFO [STDOUT] INFO 16-02 10:03:27,355 - SetRequirementStagingVariables - Loading transformation from repository [SetRequirementStagingVariables] in directory [/] 10:03:27,375 INFO [STDOUT] INFO 16-02 10:03:27,375 - SetRequirementStagingVariables - Starting transformation...(file=null, name=SetRequirementStagingVariables, repinfo=null) 10:03:27,375 INFO [STDOUT] INFO 16-02 10:03:27,375 - SetRequirementStagingVariables - Transformation is pre-loaded. 10:03:27,375 INFO [STDOUT] INFO 16-02 10:03:27,375 - SetRequirementStagingVariables - Dispatching started for transformation [SetRequirementStagingVariables] 10:03:27,375 INFO [STDOUT] INFO 16-02 10:03:27,375 - SetRequirementStagingVariables - Nr of arguments detected:0 10:03:27,375 INFO [STDOUT] INFO 16-02 10:03:27,375 - SetRequirementStagingVariables - This is not a replay transformation 10:03:27,375 INFO [STDOUT] INFO 16-02 10:03:27,375 - SetRequirementStagingVariables - I found 2 different steps to launch. 10:03:27,376 INFO [STDOUT] INFO 16-02 10:03:27,376 - SetRequirementStagingVariables - Allocating rowsets... 10:03:27,376 INFO [STDOUT] INFO 16-02 10:03:27,376 - SetRequirementStagingVariables - Allocating rowsets for step 0 --> Get rows from result 10:03:27,376 INFO [STDOUT] INFO 16-02 10:03:27,376 - SetRequirementStagingVariables - prevcopies = 1, nextcopies=1 10:03:27,376 INFO [STDOUT] INFO 16-02 10:03:27,376 - SetRequirementStagingVariables - Transformation allocated new rowset [Get rows from result.0 - Set Variables.0] 10:03:27,376 INFO [STDOUT] INFO 16-02 10:03:27,376 - SetRequirementStagingVariables - Allocated 1 rowsets for step 0 --> Get rows from result 10:03:27,376 INFO [STDOUT] INFO 16-02 10:03:27,376 - SetRequirementStagingVariables - Allocating rowsets for step 1 --> Set Variables 10:03:27,376 INFO [STDOUT] INFO 16-02 10:03:27,376 - SetRequirementStagingVariables - Allocated 1 rowsets for step 1 --> Set Variables 10:03:27,376 INFO [STDOUT] INFO 16-02 10:03:27,376 - SetRequirementStagingVariables - Allocating Steps & StepData... 10:03:27,377 INFO [STDOUT] INFO 16-02 10:03:27,377 - SetRequirementStagingVariables - Transformation is about to allocate step [Get rows from result] of type [RowsFromResult] 10:03:27,377 INFO [STDOUT] INFO 16-02 10:03:27,377 - Get rows from result - distribution activated 10:03:27,377 INFO [STDOUT] INFO 16-02 10:03:27,377 - Get rows from result - Starting allocation of buffers & new threads... 10:03:27,377 INFO [STDOUT] INFO 16-02 10:03:27,377 - Get rows from result - Step info: nrinput=0 nroutput=1 10:03:27,377 INFO [STDOUT] INFO 16-02 10:03:27,377 - Get rows from result - output rel. is 1:1 10:03:27,377 INFO [STDOUT] INFO 16-02 10:03:27,377 - Get rows from result - Found output rowset [Get rows from result.0 - Set Variables.0] 10:03:27,377 INFO [STDOUT] INFO 16-02 10:03:27,377 - Get rows from result - Finished dispatching 10:03:27,378 INFO [STDOUT] INFO 16-02 10:03:27,378 - SetRequirementStagingVariables - Transformation has allocated a new step: [Get rows from result].0 10:03:27,378 INFO [STDOUT] INFO 16-02 10:03:27,378 - SetRequirementStagingVariables - Transformation is about to allocate step [Set Variables] of type [SetVariable] 10:03:27,378 INFO [STDOUT] INFO 16-02 10:03:27,378 - Set Variables - distribution activated 10:03:27,378 INFO [STDOUT] INFO 16-02 10:03:27,378 - Set Variables - Starting allocation of buffers & new threads... 10:03:27,378 INFO [STDOUT] INFO 16-02 10:03:27,378 - Set Variables - Step info: nrinput=1 nroutput=0 10:03:27,378 INFO [STDOUT] INFO 16-02 10:03:27,378 - Set Variables - Got previous step from [Set Variables] #0 --> Get rows from result 10:03:27,378 INFO [STDOUT] INFO 16-02 10:03:27,378 - Set Variables - input rel is 1:1 10:03:27,379 INFO [STDOUT] INFO 16-02 10:03:27,379 - Set Variables - Found input rowset [Get rows from result.0 - Set Variables.0] 10:03:27,379 INFO [STDOUT] INFO 16-02 10:03:27,379 - Set Variables - Finished dispatching 10:03:27,379 INFO [STDOUT] INFO 16-02 10:03:27,379 - SetRequirementStagingVariables - Transformation has allocated a new step: [Set Variables].0 10:03:27,379 INFO [STDOUT] INFO 16-02 10:03:27,379 - SetRequirementStagingVariables - This transformation can be replayed with replay date: 2012/02/16 10:03:27 10:03:27,379 INFO [STDOUT] INFO 16-02 10:03:27,379 - SetRequirementStagingVariables - Initialising 2 steps... 10:03:27,380 INFO [STDOUT] INFO 16-02 10:03:27,380 - Get rows from result - Running on slave server #0/1. 10:03:27,380 INFO [STDOUT] INFO 16-02 10:03:27,380 - Set Variables - Running on slave server #0/1. 10:03:27,380 INFO [STDOUT] INFO 16-02 10:03:27,380 - SetRequirementStagingVariables - Step [Get rows from result.0] initialized flawlessly. 10:03:27,380 INFO [STDOUT] INFO 16-02 10:03:27,380 - SetRequirementStagingVariables - Step [Set Variables.0] initialized flawlessly. 10:03:27,381 INFO [STDOUT] INFO 16-02 10:03:27,381 - SetRequirementStagingVariables - Transformation has allocated 2 threads and 1 rowsets. 10:03:27,384 INFO [STDOUT] INFO 16-02 10:03:27,384 - Get rows from result - Starting to run... 10:03:27,384 INFO [STDOUT] INFO 16-02 10:03:27,384 - Get rows from result - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 10:03:27,384 INFO [STDOUT] INFO 16-02 10:03:27,384 - Set Variables - Starting to run... 10:03:27,384 INFO [STDOUT] INFO 16-02 10:03:27,384 - Set Variables - Setting environment variables... 10:03:27,385 INFO [STDOUT] INFO 16-02 10:03:27,385 - Set Variables - Set variable STAGINGTABLENAME to value [dfStructureAccounts] 10:03:27,385 INFO [STDOUT] INFO 16-02 10:03:27,385 - Set Variables - Set variable QUERY to value [select a.id, a.description customerID, a.isActive from admaxCampaigns ac join tsacommon.accounts a on a.ID = ac.accountID group by ac.accountID] 10:03:27,385 INFO [STDOUT] INFO 16-02 10:03:27,385 - Set Variables - Set variable SHARDPATTERN to value [st-tracker] 10:03:27,399 INFO [STDOUT] INFO 16-02 10:03:27,399 - Set Variables - Finished after 1 rows. 10:03:27,399 INFO [STDOUT] INFO 16-02 10:03:27,399 - Set Variables - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 10:03:27,404 INFO [STDOUT] INFO 16-02 10:03:27,403 - StageRequirement - Starting entry [TruncateStagingTable] 10:03:27,404 INFO [STDOUT] INFO 16-02 10:03:27,404 - StageRequirement - exec(12, 0, TruncateStagingTable.0) 10:03:27,404 INFO [STDOUT] INFO 16-02 10:03:27,404 - TruncateStagingTable - Starting job entry 10:03:27,404 INFO [STDOUT] INFO 16-02 10:03:27,404 - TruncateStagingTable - Opening transformation: [null] in directory [/] 10:03:27,404 INFO [STDOUT] INFO 16-02 10:03:27,404 - TruncateStagingTable - Loading transformation from repository [TruncateStagingTable] in directory [/] 10:03:27,424 INFO [STDOUT] INFO 16-02 10:03:27,424 - TruncateStagingTable - Starting transformation...(file=null, name=TruncateStagingTable, repinfo=null) 10:03:27,424 INFO [STDOUT] INFO 16-02 10:03:27,424 - TruncateStagingTable - Transformation is pre-loaded. 10:03:27,425 INFO [STDOUT] INFO 16-02 10:03:27,425 - TruncateStagingTable - Dispatching started for transformation [TruncateStagingTable] 10:03:27,425 INFO [STDOUT] INFO 16-02 10:03:27,425 - TruncateStagingTable - Nr of arguments detected:0 10:03:27,425 INFO [STDOUT] INFO 16-02 10:03:27,425 - TruncateStagingTable - This is not a replay transformation 10:03:27,425 INFO [STDOUT] INFO 16-02 10:03:27,425 - TruncateStagingTable - I found 4 different steps to launch. 10:03:27,425 INFO [STDOUT] INFO 16-02 10:03:27,425 - TruncateStagingTable - Allocating rowsets... 10:03:27,425 INFO [STDOUT] INFO 16-02 10:03:27,425 - TruncateStagingTable - Allocating rowsets for step 0 --> Get Variables 10:03:27,425 INFO [STDOUT] INFO 16-02 10:03:27,425 - TruncateStagingTable - prevcopies = 1, nextcopies=1 10:03:27,426 INFO [STDOUT] INFO 16-02 10:03:27,426 - TruncateStagingTable - Transformation allocated new rowset [Get Variables.0 - Switch / Case.0] 10:03:27,426 INFO [STDOUT] INFO 16-02 10:03:27,426 - TruncateStagingTable - Allocated 1 rowsets for step 0 --> Get Variables 10:03:27,426 INFO [STDOUT] INFO 16-02 10:03:27,426 - TruncateStagingTable - Allocating rowsets for step 1 --> Switch / Case 10:03:27,426 INFO [STDOUT] INFO 16-02 10:03:27,426 - TruncateStagingTable - prevcopies = 1, nextcopies=1 10:03:27,426 INFO [STDOUT] INFO 16-02 10:03:27,426 - TruncateStagingTable - Transformation allocated new rowset [Switch / Case.0 - Execute SQL script trunc.0] 10:03:27,426 INFO [STDOUT] INFO 16-02 10:03:27,426 - TruncateStagingTable - prevcopies = 1, nextcopies=1 10:03:27,426 INFO [STDOUT] INFO 16-02 10:03:27,426 - TruncateStagingTable - Transformation allocated new rowset [Switch / Case.0 - Dummy (do nothing).0] 10:03:27,426 INFO [STDOUT] INFO 16-02 10:03:27,426 - TruncateStagingTable - Allocated 3 rowsets for step 1 --> Switch / Case 10:03:27,427 INFO [STDOUT] INFO 16-02 10:03:27,427 - TruncateStagingTable - Allocating rowsets for step 2 --> Execute SQL script trunc 10:03:27,427 INFO [STDOUT] INFO 16-02 10:03:27,427 - TruncateStagingTable - Allocated 3 rowsets for step 2 --> Execute SQL script trunc 10:03:27,427 INFO [STDOUT] INFO 16-02 10:03:27,427 - TruncateStagingTable - Allocating rowsets for step 3 --> Dummy (do nothing) 10:03:27,427 INFO [STDOUT] INFO 16-02 10:03:27,427 - TruncateStagingTable - Allocated 3 rowsets for step 3 --> Dummy (do nothing) 10:03:27,427 INFO [STDOUT] INFO 16-02 10:03:27,427 - TruncateStagingTable - Allocating Steps & StepData... 10:03:27,427 INFO [STDOUT] INFO 16-02 10:03:27,427 - TruncateStagingTable - Transformation is about to allocate step [Get Variables] of type [GetVariable] 10:03:27,427 INFO [STDOUT] INFO 16-02 10:03:27,427 - Get Variables - distribution activated 10:03:27,427 INFO [STDOUT] INFO 16-02 10:03:27,427 - Get Variables - Starting allocation of buffers & new threads... 10:03:27,428 INFO [STDOUT] INFO 16-02 10:03:27,428 - Get Variables - Step info: nrinput=0 nroutput=1 10:03:27,428 INFO [STDOUT] INFO 16-02 10:03:27,428 - Get Variables - output rel. is 1:1 10:03:27,428 INFO [STDOUT] INFO 16-02 10:03:27,428 - Get Variables - Found output rowset [Get Variables.0 - Switch / Case.0] 10:03:27,428 INFO [STDOUT] INFO 16-02 10:03:27,428 - Get Variables - Finished dispatching 10:03:27,428 INFO [STDOUT] INFO 16-02 10:03:27,428 - TruncateStagingTable - Transformation has allocated a new step: [Get Variables].0 10:03:27,428 INFO [STDOUT] INFO 16-02 10:03:27,428 - TruncateStagingTable - Transformation is about to allocate step [Switch / Case] of type [SwitchCase] 10:03:27,429 INFO [STDOUT] INFO 16-02 10:03:27,428 - Switch / Case - distribution activated 10:03:27,429 INFO [STDOUT] INFO 16-02 10:03:27,429 - Switch / Case - Starting allocation of buffers & new threads... 10:03:27,429 INFO [STDOUT] INFO 16-02 10:03:27,429 - Switch / Case - Step info: nrinput=1 nroutput=2 10:03:27,429 INFO [STDOUT] INFO 16-02 10:03:27,429 - Switch / Case - Got previous step from [Switch / Case] #0 --> Get Variables 10:03:27,429 INFO [STDOUT] INFO 16-02 10:03:27,429 - Switch / Case - input rel is 1:1 10:03:27,429 INFO [STDOUT] INFO 16-02 10:03:27,429 - Switch / Case - Found input rowset [Get Variables.0 - Switch / Case.0] 10:03:27,429 INFO [STDOUT] INFO 16-02 10:03:27,429 - Switch / Case - output rel. is 1:1 10:03:27,429 INFO [STDOUT] INFO 16-02 10:03:27,429 - Switch / Case - Found output rowset [Switch / Case.0 - Execute SQL script trunc.0] 10:03:27,430 INFO [STDOUT] INFO 16-02 10:03:27,429 - Switch / Case - output rel. is 1:1 10:03:27,430 INFO [STDOUT] INFO 16-02 10:03:27,430 - Switch / Case - Found output rowset [Switch / Case.0 - Dummy (do nothing).0] 10:03:27,430 INFO [STDOUT] INFO 16-02 10:03:27,430 - Switch / Case - Finished dispatching 10:03:27,430 INFO [STDOUT] INFO 16-02 10:03:27,430 - TruncateStagingTable - Transformation has allocated a new step: [Switch / Case].0 10:03:27,430 INFO [STDOUT] INFO 16-02 10:03:27,430 - TruncateStagingTable - Transformation is about to allocate step [Execute SQL script trunc] of type [ExecSQL] 10:03:27,430 INFO [STDOUT] INFO 16-02 10:03:27,430 - Execute SQL script trunc - distribution activated 10:03:27,430 INFO [STDOUT] INFO 16-02 10:03:27,430 - Execute SQL script trunc - Starting allocation of buffers & new threads... 10:03:27,430 INFO [STDOUT] INFO 16-02 10:03:27,430 - Execute SQL script trunc - Step info: nrinput=1 nroutput=0 10:03:27,431 INFO [STDOUT] INFO 16-02 10:03:27,431 - Execute SQL script trunc - Got previous step from [Execute SQL script trunc] #0 --> Switch / Case 10:03:27,431 INFO [STDOUT] INFO 16-02 10:03:27,431 - Execute SQL script trunc - input rel is 1:1 10:03:27,431 INFO [STDOUT] INFO 16-02 10:03:27,431 - Execute SQL script trunc - Found input rowset [Switch / Case.0 - Execute SQL script trunc.0] 10:03:27,431 INFO [STDOUT] INFO 16-02 10:03:27,431 - Execute SQL script trunc - Finished dispatching 10:03:27,431 INFO [STDOUT] INFO 16-02 10:03:27,431 - TruncateStagingTable - Transformation has allocated a new step: [Execute SQL script trunc].0 10:03:27,431 INFO [STDOUT] INFO 16-02 10:03:27,431 - TruncateStagingTable - Transformation is about to allocate step [Dummy (do nothing)] of type [Dummy] 10:03:27,431 INFO [STDOUT] INFO 16-02 10:03:27,431 - Dummy (do nothing) - distribution activated 10:03:27,432 INFO [STDOUT] INFO 16-02 10:03:27,432 - Dummy (do nothing) - Starting allocation of buffers & new threads... 10:03:27,432 INFO [STDOUT] INFO 16-02 10:03:27,432 - Dummy (do nothing) - Step info: nrinput=1 nroutput=0 10:03:27,432 INFO [STDOUT] INFO 16-02 10:03:27,432 - Dummy (do nothing) - Got previous step from [Dummy (do nothing)] #0 --> Switch / Case 10:03:27,432 INFO [STDOUT] INFO 16-02 10:03:27,432 - Dummy (do nothing) - input rel is 1:1 10:03:27,432 INFO [STDOUT] INFO 16-02 10:03:27,432 - Dummy (do nothing) - Found input rowset [Switch / Case.0 - Dummy (do nothing).0] 10:03:27,432 INFO [STDOUT] INFO 16-02 10:03:27,432 - Dummy (do nothing) - Finished dispatching 10:03:27,432 INFO [STDOUT] INFO 16-02 10:03:27,432 - TruncateStagingTable - Transformation has allocated a new step: [Dummy (do nothing)].0 10:03:27,433 INFO [STDOUT] INFO 16-02 10:03:27,433 - TruncateStagingTable - This transformation can be replayed with replay date: 2012/02/16 10:03:27 10:03:27,433 INFO [STDOUT] INFO 16-02 10:03:27,433 - TruncateStagingTable - Initialising 4 steps... 10:03:27,433 INFO [STDOUT] INFO 16-02 10:03:27,433 - Get Variables - Running on slave server #0/1. 10:03:27,433 INFO [STDOUT] INFO 16-02 10:03:27,433 - Switch / Case - Running on slave server #0/1. 10:03:27,434 INFO [STDOUT] INFO 16-02 10:03:27,434 - Execute SQL script trunc - Running on slave server #0/1. 10:03:27,434 INFO [STDOUT] INFO 16-02 10:03:27,434 - pdi_stage - New database connection defined 10:03:27,439 INFO [STDOUT] INFO 16-02 10:03:27,439 - Dummy (do nothing) - Running on slave server #0/1. 10:03:27,447 INFO [STDOUT] INFO 16-02 10:03:27,446 - pdi_stage - Connected to database. 10:03:27,447 INFO [STDOUT] INFO 16-02 10:03:27,447 - Execute SQL script trunc - Connected to database... 10:03:27,447 INFO [STDOUT] INFO 16-02 10:03:27,447 - pdi_stage - launch DDL statement: truncate dfStructureAccounts 10:03:27,472 INFO [STDOUT] INFO 16-02 10:03:27,471 - pdi_stage - 1 statement executed 10:03:27,472 INFO [STDOUT] INFO 16-02 10:03:27,472 - TruncateStagingTable - Step [Get Variables.0] initialized flawlessly. 10:03:27,472 INFO [STDOUT] INFO 16-02 10:03:27,472 - TruncateStagingTable - Step [Switch / Case.0] initialized flawlessly. 10:03:27,472 INFO [STDOUT] INFO 16-02 10:03:27,472 - TruncateStagingTable - Step [Execute SQL script trunc.0] initialized flawlessly. 10:03:27,472 INFO [STDOUT] INFO 16-02 10:03:27,472 - TruncateStagingTable - Step [Dummy (do nothing).0] initialized flawlessly. 10:03:27,473 INFO [STDOUT] INFO 16-02 10:03:27,473 - Get Variables - Starting to run... 10:03:27,473 INFO [STDOUT] INFO 16-02 10:03:27,473 - Get Variables - field [stagingTableName] has value [STAGINGTABLENAME] 10:03:27,473 INFO [STDOUT] INFO 16-02 10:03:27,473 - Get Variables - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 10:03:27,474 INFO [STDOUT] INFO 16-02 10:03:27,474 - Switch / Case - Starting to run... 10:03:27,474 INFO [STDOUT] INFO 16-02 10:03:27,474 - Execute SQL script trunc - Starting to run... 10:03:27,474 INFO [STDOUT] INFO 16-02 10:03:27,474 - Execute SQL script trunc - Finished reading query, closing connection. 10:03:27,475 INFO [STDOUT] INFO 16-02 10:03:27,475 - pdi_stage - Connection to database closed! 10:03:27,475 INFO [STDOUT] INFO 16-02 10:03:27,475 - Execute SQL script trunc - Finished processing (I=0, O=0, R=0, W=1, U=0, E=0) 10:03:27,475 INFO [STDOUT] INFO 16-02 10:03:27,475 - TruncateStagingTable - Transformation has allocated 4 threads and 3 rowsets. 10:03:27,480 INFO [STDOUT] INFO 16-02 10:03:27,480 - Dummy (do nothing) - Starting to run... 10:03:27,495 INFO [STDOUT] INFO 16-02 10:03:27,495 - Switch / Case - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 10:03:27,511 INFO [STDOUT] INFO 16-02 10:03:27,511 - Dummy (do nothing) - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0) 10:03:27,516 INFO [STDOUT] INFO 16-02 10:03:27,516 - StageRequirement - Starting entry [Simple evaluation] 10:03:27,516 INFO [STDOUT] INFO 16-02 10:03:27,516 - StageRequirement - exec(13, 0, Simple evaluation.0) 10:03:27,516 INFO [STDOUT] INFO 16-02 10:03:27,516 - Simple evaluation - Starting job entry 10:03:27,517 INFO [STDOUT] INFO 16-02 10:03:27,516 - Simple evaluation - Checking variable [${SHARDPATTERN}] ... 10:03:27,517 INFO [STDOUT] INFO 16-02 10:03:27,517 - Simple evaluation - Value to evaluate is st-tracker 10:03:27,517 INFO [STDOUT] INFO 16-02 10:03:27,517 - StageRequirement - Starting entry [Simple evaluation 2] 10:03:27,518 INFO [STDOUT] INFO 16-02 10:03:27,518 - StageRequirement - exec(14, 0, Simple evaluation 2.0) 10:03:27,518 INFO [STDOUT] INFO 16-02 10:03:27,518 - Simple evaluation - Starting job entry 10:03:27,518 INFO [STDOUT] INFO 16-02 10:03:27,518 - Simple evaluation - Checking variable [${SHARDPATTERN}] ... 10:03:27,518 INFO [STDOUT] INFO 16-02 10:03:27,518 - Simple evaluation - Value to evaluate is st-tracker 10:03:27,519 INFO [STDOUT] INFO 16-02 10:03:27,519 - StageRequirement - Starting entry [StageDataFromShards] 10:03:27,519 INFO [STDOUT] INFO 16-02 10:03:27,519 - StageRequirement - exec(15, 0, StageDataFromShards.0) 10:03:27,519 INFO [STDOUT] INFO 16-02 10:03:27,519 - StageDataFromShards - Starting job entry 10:03:27,520 INFO [STDOUT] INFO 16-02 10:03:27,519 - StageDataFromShards - Loading job from repository : [/ : StageDataFromShards] 10:03:27,535 INFO [STDOUT] INFO 16-02 10:03:27,535 - StageDataFromShards - exec(16, 0, START.0) 10:03:27,535 INFO [STDOUT] INFO 16-02 10:03:27,535 - START - Starting job entry 10:03:27,536 INFO [STDOUT] INFO 16-02 10:03:27,536 - StageDataFromShards - Starting entry [Write To Log] 10:03:27,536 INFO [STDOUT] INFO 16-02 10:03:27,536 - StageDataFromShards - exec(17, 0, Write To Log.0) 10:03:27,536 INFO [STDOUT] INFO 16-02 10:03:27,536 - Write To Log - Starting job entry 10:03:27,536 INFO [STDOUT] INFO 16-02 10:03:27,536 - End: - dfStructureAccounts select a.id, a.description customerID, a.isActive from admaxCampaigns ac join tsacommon.accounts a on a.ID = ac.accountID group by ac.accountID st-tracker 10:03:27,537 INFO [STDOUT] INFO 16-02 10:03:27,537 - StageDataFromShards - Starting entry [SelectShards] 10:03:27,537 INFO [STDOUT] INFO 16-02 10:03:27,537 - StageDataFromShards - exec(18, 0, SelectShards.0) 10:03:27,537 INFO [STDOUT] INFO 16-02 10:03:27,537 - SelectShards - Starting job entry 10:03:27,538 INFO [STDOUT] INFO 16-02 10:03:27,537 - SelectShards - Opening transformation: [null] in directory [/] 10:03:27,538 INFO [STDOUT] INFO 16-02 10:03:27,538 - SelectShards - Loading transformation from repository [SelectShards] in directory [/] 10:03:27,557 INFO [STDOUT] INFO 16-02 10:03:27,557 - SelectShards - Starting transformation...(file=null, name=SelectShards, repinfo=null) 10:03:27,557 INFO [STDOUT] INFO 16-02 10:03:27,557 - SelectShards - Transformation is pre-loaded. 10:03:27,557 INFO [STDOUT] INFO 16-02 10:03:27,557 - SelectShards - Dispatching started for transformation [SelectShards] 10:03:27,557 INFO [STDOUT] INFO 16-02 10:03:27,557 - SelectShards - Nr of arguments detected:0 10:03:27,557 INFO [STDOUT] INFO 16-02 10:03:27,557 - SelectShards - This is not a replay transformation 10:03:27,557 INFO [STDOUT] INFO 16-02 10:03:27,557 - SelectShards - I found 2 different steps to launch. 10:03:27,558 INFO [STDOUT] INFO 16-02 10:03:27,558 - SelectShards - Allocating rowsets... 10:03:27,558 INFO [STDOUT] INFO 16-02 10:03:27,558 - SelectShards - Allocating rowsets for step 0 --> Table input 10:03:27,558 INFO [STDOUT] INFO 16-02 10:03:27,558 - SelectShards - prevcopies = 1, nextcopies=1 10:03:27,558 INFO [STDOUT] INFO 16-02 10:03:27,558 - SelectShards - Transformation allocated new rowset [Table input.0 - Copy rows to result.0] 10:03:27,558 INFO [STDOUT] INFO 16-02 10:03:27,558 - SelectShards - Allocated 1 rowsets for step 0 --> Table input 10:03:27,558 INFO [STDOUT] INFO 16-02 10:03:27,558 - SelectShards - Allocating rowsets for step 1 --> Copy rows to result 10:03:27,558 INFO [STDOUT] INFO 16-02 10:03:27,558 - SelectShards - Allocated 1 rowsets for step 1 --> Copy rows to result 10:03:27,558 INFO [STDOUT] INFO 16-02 10:03:27,558 - SelectShards - Allocating Steps & StepData... 10:03:27,559 INFO [STDOUT] INFO 16-02 10:03:27,559 - SelectShards - Transformation is about to allocate step [Table input] of type [TableInput] 10:03:27,559 INFO [STDOUT] INFO 16-02 10:03:27,559 - Table input - distribution activated 10:03:27,559 INFO [STDOUT] INFO 16-02 10:03:27,559 - Table input - Starting allocation of buffers & new threads... 10:03:27,559 INFO [STDOUT] INFO 16-02 10:03:27,559 - Table input - Step info: nrinput=0 nroutput=1 10:03:27,559 INFO [STDOUT] INFO 16-02 10:03:27,559 - Table input - output rel. is 1:1 10:03:27,559 INFO [STDOUT] INFO 16-02 10:03:27,559 - Table input - Found output rowset [Table input.0 - Copy rows to result.0] 10:03:27,559 INFO [STDOUT] INFO 16-02 10:03:27,559 - Table input - Finished dispatching 10:03:27,560 INFO [STDOUT] INFO 16-02 10:03:27,560 - SelectShards - Transformation has allocated a new step: [Table input].0 10:03:27,560 INFO [STDOUT] INFO 16-02 10:03:27,560 - SelectShards - Transformation is about to allocate step [Copy rows to result] of type [RowsToResult] 10:03:27,560 INFO [STDOUT] INFO 16-02 10:03:27,560 - Copy rows to result - distribution activated 10:03:27,560 INFO [STDOUT] INFO 16-02 10:03:27,560 - Copy rows to result - Starting allocation of buffers & new threads... 10:03:27,560 INFO [STDOUT] INFO 16-02 10:03:27,560 - Copy rows to result - Step info: nrinput=1 nroutput=0 10:03:27,560 INFO [STDOUT] INFO 16-02 10:03:27,560 - Copy rows to result - Got previous step from [Copy rows to result] #0 --> Table input 10:03:27,560 INFO [STDOUT] INFO 16-02 10:03:27,560 - Copy rows to result - input rel is 1:1 10:03:27,561 INFO [STDOUT] INFO 16-02 10:03:27,561 - Copy rows to result - Found input rowset [Table input.0 - Copy rows to result.0] 10:03:27,561 INFO [STDOUT] INFO 16-02 10:03:27,561 - Copy rows to result - Finished dispatching 10:03:27,561 INFO [STDOUT] INFO 16-02 10:03:27,561 - SelectShards - Transformation has allocated a new step: [Copy rows to result].0 10:03:27,561 INFO [STDOUT] INFO 16-02 10:03:27,561 - SelectShards - This transformation can be replayed with replay date: 2012/02/16 10:03:27 10:03:27,561 INFO [STDOUT] INFO 16-02 10:03:27,561 - SelectShards - Initialising 2 steps... 10:03:27,562 INFO [STDOUT] INFO 16-02 10:03:27,562 - Table input - Running on slave server #0/1. 10:03:27,569 INFO [STDOUT] INFO 16-02 10:03:27,569 - tsacommon - New database connection defined 10:03:27,572 INFO [STDOUT] INFO 16-02 10:03:27,572 - Copy rows to result - Running on slave server #0/1. 10:03:27,581 INFO [STDOUT] INFO 16-02 10:03:27,581 - tsacommon - Connected to database. 10:03:27,581 INFO [STDOUT] INFO 16-02 10:03:27,581 - tsacommon - Auto commit off 10:03:27,581 INFO [STDOUT] INFO 16-02 10:03:27,581 - Table input - Connected to database... 10:03:27,581 INFO [STDOUT] INFO 16-02 10:03:27,581 - SelectShards - Step [Table input.0] initialized flawlessly. 10:03:27,582 INFO [STDOUT] INFO 16-02 10:03:27,582 - SelectShards - Step [Copy rows to result.0] initialized flawlessly. 10:03:27,582 INFO [STDOUT] INFO 16-02 10:03:27,582 - Table input - Starting to run... 10:03:27,582 INFO [STDOUT] INFO 16-02 10:03:27,582 - Table input - SQL query : SELECT id , name , description , type , `DATABASE` , host , port , access FROM databaseInstances WHERE `DATABASE` like "st-tracker" 10:03:27,586 INFO [STDOUT] INFO 16-02 10:03:27,586 - SelectShards - Transformation has allocated 2 threads and 1 rowsets. 10:03:27,587 INFO [STDOUT] INFO 16-02 10:03:27,587 - Copy rows to result - Starting to run... 10:03:27,588 INFO [STDOUT] INFO 16-02 10:03:27,588 - Table input - Finished reading query, closing connection. 10:03:27,590 INFO [STDOUT] INFO 16-02 10:03:27,590 - tsacommon - Connection to database closed! 10:03:27,590 INFO [STDOUT] INFO 16-02 10:03:27,590 - Table input - Finished processing (I=2, O=0, R=0, W=2, U=0, E=0) 10:03:27,611 INFO [STDOUT] INFO 16-02 10:03:27,611 - Copy rows to result - Finished processing (I=0, O=0, R=2, W=2, U=0, E=0) 10:03:27,616 INFO [STDOUT] INFO 16-02 10:03:27,616 - StageDataFromShards - Starting entry [StageDataFromShard] 10:03:27,616 INFO [STDOUT] INFO 16-02 10:03:27,616 - StageDataFromShards - exec(19, 0, StageDataFromShard.0) 10:03:27,616 INFO [STDOUT] INFO 16-02 10:03:27,616 - StageDataFromShard - Starting job entry 10:03:27,616 INFO [STDOUT] INFO 16-02 10:03:27,616 - StageDataFromShard - Loading job from repository : [/ : StageDataFromShard] 10:03:27,631 INFO [STDOUT] INFO 16-02 10:03:27,631 - StageDataFromShard - exec(20, 0, START.0) 10:03:27,631 INFO [STDOUT] INFO 16-02 10:03:27,631 - START - Starting job entry 10:03:27,632 INFO [STDOUT] INFO 16-02 10:03:27,632 - StageDataFromShard - Starting entry [SetShardConnectionVariables] 10:03:27,632 INFO [STDOUT] INFO 16-02 10:03:27,632 - StageDataFromShard - exec(21, 0, SetShardConnectionVariables.0) 10:03:27,633 INFO [STDOUT] INFO 16-02 10:03:27,633 - SetShardConnectionVariables - Starting job entry 10:03:27,633 INFO [STDOUT] INFO 16-02 10:03:27,633 - SetShardConnectionVariables - Opening transformation: [null] in directory [/] 10:03:27,633 INFO [STDOUT] INFO 16-02 10:03:27,633 - SetShardConnectionVariables - Loading transformation from repository [SetShardConnectionVariables] in directory [/] 10:03:27,651 INFO [STDOUT] INFO 16-02 10:03:27,651 - SetShardConnectionVariables - Starting transformation...(file=null, name=SetShardConnectionVariables, repinfo=null) 10:03:27,652 INFO [STDOUT] INFO 16-02 10:03:27,652 - SetShardConnectionVariables - Transformation is pre-loaded. 10:03:27,652 INFO [STDOUT] INFO 16-02 10:03:27,652 - SetShardConnectionVariables - Dispatching started for transformation [SetShardConnectionVariables] 10:03:27,653 INFO [STDOUT] INFO 16-02 10:03:27,653 - SetShardConnectionVariables - Nr of arguments detected:0 10:03:27,653 INFO [STDOUT] INFO 16-02 10:03:27,653 - SetShardConnectionVariables - This is not a replay transformation 10:03:27,653 INFO [STDOUT] INFO 16-02 10:03:27,653 - SetShardConnectionVariables - I found 2 different steps to launch. 10:03:27,653 INFO [STDOUT] INFO 16-02 10:03:27,653 - SetShardConnectionVariables - Allocating rowsets... 10:03:27,653 INFO [STDOUT] INFO 16-02 10:03:27,653 - SetShardConnectionVariables - Allocating rowsets for step 0 --> Get rows from result 10:03:27,653 INFO [STDOUT] INFO 16-02 10:03:27,653 - SetShardConnectionVariables - prevcopies = 1, nextcopies=1 10:03:27,653 INFO [STDOUT] INFO 16-02 10:03:27,653 - SetShardConnectionVariables - Transformation allocated new rowset [Get rows from result.0 - Set Variables.0] 10:03:27,653 INFO [STDOUT] INFO 16-02 10:03:27,653 - SetShardConnectionVariables - Allocated 1 rowsets for step 0 --> Get rows from result 10:03:27,654 INFO [STDOUT] INFO 16-02 10:03:27,654 - SetShardConnectionVariables - Allocating rowsets for step 1 --> Set Variables 10:03:27,654 INFO [STDOUT] INFO 16-02 10:03:27,654 - SetShardConnectionVariables - Allocated 1 rowsets for step 1 --> Set Variables 10:03:27,654 INFO [STDOUT] INFO 16-02 10:03:27,654 - SetShardConnectionVariables - Allocating Steps & StepData... 10:03:27,654 INFO [STDOUT] INFO 16-02 10:03:27,654 - SetShardConnectionVariables - Transformation is about to allocate step [Get rows from result] of type [RowsFromResult] 10:03:27,654 INFO [STDOUT] INFO 16-02 10:03:27,654 - Get rows from result - distribution activated 10:03:27,654 INFO [STDOUT] INFO 16-02 10:03:27,654 - Get rows from result - Starting allocation of buffers & new threads... 10:03:27,654 INFO [STDOUT] INFO 16-02 10:03:27,654 - Get rows from result - Step info: nrinput=0 nroutput=1 10:03:27,654 INFO [STDOUT] INFO 16-02 10:03:27,654 - Get rows from result - output rel. is 1:1 10:03:27,655 INFO [STDOUT] INFO 16-02 10:03:27,655 - Get rows from result - Found output rowset [Get rows from result.0 - Set Variables.0] 10:03:27,655 INFO [STDOUT] INFO 16-02 10:03:27,655 - Get rows from result - Finished dispatching 10:03:27,655 INFO [STDOUT] INFO 16-02 10:03:27,655 - SetShardConnectionVariables - Transformation has allocated a new step: [Get rows from result].0 10:03:27,655 INFO [STDOUT] INFO 16-02 10:03:27,655 - SetShardConnectionVariables - Transformation is about to allocate step [Set Variables] of type [SetVariable] 10:03:27,655 INFO [STDOUT] INFO 16-02 10:03:27,655 - Set Variables - distribution activated 10:03:27,655 INFO [STDOUT] INFO 16-02 10:03:27,655 - Set Variables - Starting allocation of buffers & new threads... 10:03:27,656 INFO [STDOUT] INFO 16-02 10:03:27,656 - Set Variables - Step info: nrinput=1 nroutput=0 10:03:27,656 INFO [STDOUT] INFO 16-02 10:03:27,656 - Set Variables - Got previous step from [Set Variables] #0 --> Get rows from result 10:03:27,656 INFO [STDOUT] INFO 16-02 10:03:27,656 - Set Variables - input rel is 1:1 10:03:27,656 INFO [STDOUT] INFO 16-02 10:03:27,656 - Set Variables - Found input rowset [Get rows from result.0 - Set Variables.0] 10:03:27,656 INFO [STDOUT] INFO 16-02 10:03:27,656 - Set Variables - Finished dispatching 10:03:27,656 INFO [STDOUT] INFO 16-02 10:03:27,656 - SetShardConnectionVariables - Transformation has allocated a new step: [Set Variables].0 10:03:27,657 INFO [STDOUT] INFO 16-02 10:03:27,656 - SetShardConnectionVariables - This transformation can be replayed with replay date: 2012/02/16 10:03:27 10:03:27,657 INFO [STDOUT] INFO 16-02 10:03:27,657 - SetShardConnectionVariables - Initialising 2 steps... 10:03:27,657 INFO [STDOUT] INFO 16-02 10:03:27,657 - Get rows from result - Running on slave server #0/1. 10:03:27,657 INFO [STDOUT] INFO 16-02 10:03:27,657 - Set Variables - Running on slave server #0/1. 10:03:27,658 INFO [STDOUT] INFO 16-02 10:03:27,658 - SetShardConnectionVariables - Step [Get rows from result.0] initialized flawlessly. 10:03:27,658 INFO [STDOUT] INFO 16-02 10:03:27,658 - SetShardConnectionVariables - Step [Set Variables.0] initialized flawlessly. 10:03:27,658 INFO [STDOUT] INFO 16-02 10:03:27,658 - Get rows from result - Starting to run... 10:03:27,658 INFO [STDOUT] INFO 16-02 10:03:27,658 - Get rows from result - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 10:03:27,659 INFO [STDOUT] INFO 16-02 10:03:27,659 - SetShardConnectionVariables - Transformation has allocated 2 threads and 1 rowsets. 10:03:27,659 INFO [STDOUT] INFO 16-02 10:03:27,659 - Set Variables - Starting to run... 10:03:27,659 INFO [STDOUT] INFO 16-02 10:03:27,659 - Set Variables - Setting environment variables... 10:03:27,659 INFO [STDOUT] INFO 16-02 10:03:27,659 - Set Variables - Set variable DATABASE to value [st-tracker] 10:03:27,659 INFO [STDOUT] INFO 16-02 10:03:27,659 - Set Variables - Set variable HOST to value [acctdb-01-write] 10:03:27,659 INFO [STDOUT] INFO 16-02 10:03:27,659 - Set Variables - Set variable PORT to value [3307] 10:03:27,675 INFO [STDOUT] INFO 16-02 10:03:27,675 - Set Variables - Finished after 1 rows. 10:03:27,675 INFO [STDOUT] INFO 16-02 10:03:27,675 - Set Variables - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 10:03:27,680 INFO [STDOUT] INFO 16-02 10:03:27,680 - StageDataFromShard - Starting entry [Write To Log] 10:03:27,680 INFO [STDOUT] INFO 16-02 10:03:27,680 - StageDataFromShard - exec(22, 0, Write To Log.0) 10:03:27,680 INFO [STDOUT] INFO 16-02 10:03:27,680 - Write To Log - Starting job entry 10:03:27,680 INFO [STDOUT] INFO 16-02 10:03:27,680 - connection: - st-tracker acctdb-01-write 3307 select a.id, a.description customerID, a.isActive from admaxCampaigns ac join tsacommon.accounts a on a.ID = ac.accountID group by ac.accountID 10:03:27,681 INFO [STDOUT] INFO 16-02 10:03:27,681 - StageDataFromShard - Starting entry [StageDataForShard] 10:03:27,681 INFO [STDOUT] INFO 16-02 10:03:27,681 - StageDataFromShard - exec(23, 0, StageDataForShard.0) 10:03:27,681 INFO [STDOUT] INFO 16-02 10:03:27,681 - StageDataForShard - Starting job entry 10:03:27,681 INFO [STDOUT] INFO 16-02 10:03:27,681 - StageDataForShard - Opening transformation: [null] in directory [/] 10:03:27,682 INFO [STDOUT] INFO 16-02 10:03:27,682 - StageDataForShard - Loading transformation from repository [StageDataForShard] in directory [/] 10:03:27,702 INFO [STDOUT] INFO 16-02 10:03:27,702 - StageDataForShard - Starting transformation...(file=null, name=StageDataForShard, repinfo=null) 10:03:27,702 INFO [STDOUT] INFO 16-02 10:03:27,702 - StageDataForShard - Transformation is pre-loaded. 10:03:27,702 INFO [STDOUT] INFO 16-02 10:03:27,702 - StageDataForShard - Dispatching started for transformation [StageDataForShard] 10:03:27,702 INFO [STDOUT] INFO 16-02 10:03:27,702 - StageDataForShard - Nr of arguments detected:0 10:03:27,703 INFO [STDOUT] INFO 16-02 10:03:27,703 - StageDataForShard - This is not a replay transformation 10:03:27,703 INFO [STDOUT] INFO 16-02 10:03:27,703 - StageDataForShard - I found 3 different steps to launch. 10:03:27,703 INFO [STDOUT] INFO 16-02 10:03:27,703 - StageDataForShard - Allocating rowsets... 10:03:27,703 INFO [STDOUT] INFO 16-02 10:03:27,703 - StageDataForShard - Allocating rowsets for step 0 --> Write to log 10:03:27,703 INFO [STDOUT] INFO 16-02 10:03:27,703 - StageDataForShard - prevcopies = 1, nextcopies=1 10:03:27,703 INFO [STDOUT] INFO 16-02 10:03:27,703 - StageDataForShard - Transformation allocated new rowset [Write to log.0 - Table input.0] 10:03:27,703 INFO [STDOUT] INFO 16-02 10:03:27,703 - StageDataForShard - Allocated 1 rowsets for step 0 --> Write to log 10:03:27,704 INFO [STDOUT] INFO 16-02 10:03:27,704 - StageDataForShard - Allocating rowsets for step 1 --> Table input 10:03:27,704 INFO [STDOUT] INFO 16-02 10:03:27,704 - StageDataForShard - prevcopies = 1, nextcopies=1 10:03:27,704 INFO [STDOUT] INFO 16-02 10:03:27,704 - StageDataForShard - Transformation allocated new rowset [Table input.0 - Table output.0] 10:03:27,704 INFO [STDOUT] INFO 16-02 10:03:27,704 - StageDataForShard - Allocated 2 rowsets for step 1 --> Table input 10:03:27,704 INFO [STDOUT] INFO 16-02 10:03:27,704 - StageDataForShard - Allocating rowsets for step 2 --> Table output 10:03:27,704 INFO [STDOUT] INFO 16-02 10:03:27,704 - StageDataForShard - Allocated 2 rowsets for step 2 --> Table output 10:03:27,704 INFO [STDOUT] INFO 16-02 10:03:27,704 - StageDataForShard - Allocating Steps & StepData... 10:03:27,704 INFO [STDOUT] INFO 16-02 10:03:27,704 - StageDataForShard - Transformation is about to allocate step [Write to log] of type [WriteToLog] 10:03:27,705 INFO [STDOUT] INFO 16-02 10:03:27,705 - Write to log - distribution activated 10:03:27,705 INFO [STDOUT] INFO 16-02 10:03:27,705 - Write to log - Starting allocation of buffers & new threads... 10:03:27,705 INFO [STDOUT] INFO 16-02 10:03:27,705 - Write to log - Step info: nrinput=0 nroutput=1 10:03:27,705 INFO [STDOUT] INFO 16-02 10:03:27,705 - Write to log - output rel. is 1:1 10:03:27,705 INFO [STDOUT] INFO 16-02 10:03:27,705 - Write to log - Found output rowset [Write to log.0 - Table input.0] 10:03:27,705 INFO [STDOUT] INFO 16-02 10:03:27,705 - Write to log - Finished dispatching 10:03:27,705 INFO [STDOUT] INFO 16-02 10:03:27,705 - StageDataForShard - Transformation has allocated a new step: [Write to log].0 10:03:27,706 INFO [STDOUT] INFO 16-02 10:03:27,706 - StageDataForShard - Transformation is about to allocate step [Table input] of type [TableInput] 10:03:27,706 INFO [STDOUT] INFO 16-02 10:03:27,706 - Table input - Starting allocation of buffers & new threads... 10:03:27,706 INFO [STDOUT] INFO 16-02 10:03:27,706 - Table input - Step info: nrinput=1 nroutput=1 10:03:27,706 INFO [STDOUT] INFO 16-02 10:03:27,706 - Table input - Got previous step from [Table input] #0 --> Write to log 10:03:27,706 INFO [STDOUT] INFO 16-02 10:03:27,706 - Table input - input rel is 1:1 10:03:27,706 INFO [STDOUT] INFO 16-02 10:03:27,706 - Table input - Found input rowset [Write to log.0 - Table input.0] 10:03:27,706 INFO [STDOUT] INFO 16-02 10:03:27,706 - Table input - output rel. is 1:1 10:03:27,706 INFO [STDOUT] INFO 16-02 10:03:27,706 - Table input - Found output rowset [Table input.0 - Table output.0] 10:03:27,707 INFO [STDOUT] INFO 16-02 10:03:27,707 - Table input - Finished dispatching 10:03:27,707 INFO [STDOUT] INFO 16-02 10:03:27,707 - StageDataForShard - Transformation has allocated a new step: [Table input].0 10:03:27,707 INFO [STDOUT] INFO 16-02 10:03:27,707 - StageDataForShard - Transformation is about to allocate step [Table output] of type [TableOutput] 10:03:27,707 INFO [STDOUT] INFO 16-02 10:03:27,707 - Table output - distribution activated 10:03:27,707 INFO [STDOUT] INFO 16-02 10:03:27,707 - Table output - Starting allocation of buffers & new threads... 10:03:27,707 INFO [STDOUT] INFO 16-02 10:03:27,707 - Table output - Step info: nrinput=1 nroutput=0 10:03:27,707 INFO [STDOUT] INFO 16-02 10:03:27,707 - Table output - Got previous step from [Table output] #0 --> Table input 10:03:27,708 INFO [STDOUT] INFO 16-02 10:03:27,708 - Table output - input rel is 1:1 10:03:27,708 INFO [STDOUT] INFO 16-02 10:03:27,708 - Table output - Found input rowset [Table input.0 - Table output.0] 10:03:27,708 INFO [STDOUT] INFO 16-02 10:03:27,708 - Table output - Finished dispatching 10:03:27,708 INFO [STDOUT] INFO 16-02 10:03:27,708 - StageDataForShard - Transformation has allocated a new step: [Table output].0 10:03:27,708 INFO [STDOUT] INFO 16-02 10:03:27,708 - StageDataForShard - This transformation can be replayed with replay date: 2012/02/16 10:03:27 10:03:27,708 INFO [STDOUT] INFO 16-02 10:03:27,708 - StageDataForShard - Initialising 3 steps... 10:03:27,709 INFO [STDOUT] INFO 16-02 10:03:27,709 - Write to log - Running on slave server #0/1. 10:03:27,709 INFO [STDOUT] INFO 16-02 10:03:27,709 - Table input - Running on slave server #0/1. 10:03:27,713 INFO [STDOUT] INFO 16-02 10:03:27,713 - Table output - Running on slave server #0/1. 10:03:27,714 INFO [STDOUT] INFO 16-02 10:03:27,714 - pdi_staging - New database connection defined 10:03:27,723 INFO [STDOUT] INFO 16-02 10:03:27,723 - pdi_staging - Connected to database. 10:03:27,723 INFO [STDOUT] INFO 16-02 10:03:27,723 - Table output - Connected to database [pdi_staging] (commit=10000) 10:03:27,723 INFO [STDOUT] INFO 16-02 10:03:27,723 - pdi_staging - Auto commit off 10:03:27,723 INFO [STDOUT] INFO 16-02 10:03:27,723 - Shard - New database connection defined 10:03:27,810 INFO [STDOUT] INFO 16-02 10:03:27,810 - Shard - Connected to database. 10:03:27,811 INFO [STDOUT] INFO 16-02 10:03:27,811 - Shard - Auto commit off 10:03:27,811 INFO [STDOUT] INFO 16-02 10:03:27,811 - Table input - Connected to database... 10:03:27,812 INFO [STDOUT] INFO 16-02 10:03:27,812 - StageDataForShard - Step [Write to log.0] initialized flawlessly. 10:03:27,812 INFO [STDOUT] INFO 16-02 10:03:27,812 - StageDataForShard - Step [Table input.0] initialized flawlessly. 10:03:27,812 INFO [STDOUT] INFO 16-02 10:03:27,812 - StageDataForShard - Step [Table output.0] initialized flawlessly. 10:03:27,812 INFO [STDOUT] INFO 16-02 10:03:27,812 - Write to log - Starting to run... 10:03:27,813 INFO [STDOUT] INFO 16-02 10:03:27,813 - Write to log - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0) 10:03:27,813 INFO [STDOUT] INFO 16-02 10:03:27,813 - Table input - Starting to run... 10:03:27,813 INFO [STDOUT] INFO 16-02 10:03:27,813 - Table input - SQL query : select a.id, a.description customerID, a.isActive from admaxCampaigns ac join tsacommon.accounts a on a.ID = ac.accountID group by ac.accountID 10:03:27,813 INFO [STDOUT] INFO 16-02 10:03:27,813 - StageDataForShard - Transformation has allocated 3 threads and 2 rowsets. 10:03:27,814 INFO [STDOUT] INFO 16-02 10:03:27,814 - Table output - Starting to run... 10:03:27,815 INFO [STDOUT] INFO 16-02 10:03:27,815 - Table input - Finished reading query, closing connection. 10:03:27,817 INFO [STDOUT] INFO 16-02 10:03:27,817 - Shard - Connection to database closed! 10:03:27,817 INFO [STDOUT] INFO 16-02 10:03:27,817 - Table input - Finished processing (I=4, O=0, R=0, W=4, U=0, E=0) 10:03:27,819 INFO [STDOUT] INFO 16-02 10:03:27,819 - Table output - Prepared statement : INSERT INTO dfStructureAccounts (id, customerID, isActive) VALUES ( ?, ?, ?) 10:03:27,838 INFO [STDOUT] INFO 16-02 10:03:27,838 - pdi_staging - Connection to database closed! 10:03:27,838 INFO [STDOUT] INFO 16-02 10:03:27,838 - Table output - Finished processing (I=0, O=4, R=4, W=4, U=0, E=0) 10:03:27,844 INFO [STDOUT] INFO 16-02 10:03:27,844 - StageDataFromShard - Finished job entry [StageDataForShard] (result=[true]) 10:03:27,844 INFO [STDOUT] INFO 16-02 10:03:27,844 - StageDataFromShard - Finished job entry [Write To Log] (result=[true]) 10:03:27,844 INFO [STDOUT] INFO 16-02 10:03:27,844 - StageDataFromShard - Finished job entry [SetShardConnectionVariables] (result=[true]) 10:03:27,845 INFO [STDOUT] INFO 16-02 10:03:27,845 - StageDataFromShard - exec(20, 0, START.0) 10:03:27,845 INFO [STDOUT] INFO 16-02 10:03:27,845 - START - Starting job entry 10:03:27,846 INFO [STDOUT] INFO 16-02 10:03:27,846 - StageDataFromShard - Starting entry [SetShardConnectionVariables] 10:03:27,846 INFO [STDOUT] INFO 16-02 10:03:27,846 - StageDataFromShard - exec(21, 0, SetShardConnectionVariables.0) 10:03:27,847 INFO [STDOUT] INFO 16-02 10:03:27,847 - SetShardConnectionVariables - Starting job entry 10:03:27,847 INFO [STDOUT] INFO 16-02 10:03:27,847 - SetShardConnectionVariables - Opening transformation: [null] in directory [/] 10:03:27,847 INFO [STDOUT] INFO 16-02 10:03:27,847 - SetShardConnectionVariables - Loading transformation from repository [SetShardConnectionVariables] in directory [/] 10:03:27,866 INFO [STDOUT] INFO 16-02 10:03:27,866 - SetShardConnectionVariables - Starting transformation...(file=null, name=SetShardConnectionVariables, repinfo=null) 10:03:27,867 INFO [STDOUT] INFO 16-02 10:03:27,867 - SetShardConnectionVariables - Transformation is pre-loaded. 10:03:27,867 INFO [STDOUT] INFO 16-02 10:03:27,867 - SetShardConnectionVariables - Dispatching started for transformation [SetShardConnectionVariables] 10:03:27,867 INFO [STDOUT] INFO 16-02 10:03:27,867 - SetShardConnectionVariables - Nr of arguments detected:0 10:03:27,867 INFO [STDOUT] INFO 16-02 10:03:27,867 - SetShardConnectionVariables - This is not a replay transformation 10:03:27,867 INFO [STDOUT] INFO 16-02 10:03:27,867 - SetShardConnectionVariables - I found 2 different steps to launch. 10:03:27,867 INFO [STDOUT] INFO 16-02 10:03:27,867 - SetShardConnectionVariables - Allocating rowsets... 10:03:27,867 INFO [STDOUT] INFO 16-02 10:03:27,867 - SetShardConnectionVariables - Allocating rowsets for step 0 --> Get rows from result 10:03:27,868 INFO [STDOUT] INFO 16-02 10:03:27,868 - SetShardConnectionVariables - prevcopies = 1, nextcopies=1 10:03:27,868 INFO [STDOUT] INFO 16-02 10:03:27,868 - SetShardConnectionVariables - Transformation allocated new rowset [Get rows from result.0 - Set Variables.0] 10:03:27,868 INFO [STDOUT] INFO 16-02 10:03:27,868 - SetShardConnectionVariables - Allocated 1 rowsets for step 0 --> Get rows from result 10:03:27,868 INFO [STDOUT] INFO 16-02 10:03:27,868 - SetShardConnectionVariables - Allocating rowsets for step 1 --> Set Variables 10:03:27,868 INFO [STDOUT] INFO 16-02 10:03:27,868 - SetShardConnectionVariables - Allocated 1 rowsets for step 1 --> Set Variables 10:03:27,868 INFO [STDOUT] INFO 16-02 10:03:27,868 - SetShardConnectionVariables - Allocating Steps & StepData... 10:03:27,868 INFO [STDOUT] INFO 16-02 10:03:27,868 - SetShardConnectionVariables - Transformation is about to allocate step [Get rows from result] of type [RowsFromResult] 10:03:27,869 INFO [STDOUT] INFO 16-02 10:03:27,868 - Get rows from result - distribution activated 10:03:27,869 INFO [STDOUT] INFO 16-02 10:03:27,869 - Get rows from result - Starting allocation of buffers & new threads... 10:03:27,869 INFO [STDOUT] INFO 16-02 10:03:27,869 - Get rows from result - Step info: nrinput=0 nroutput=1 10:03:27,869 INFO [STDOUT] INFO 16-02 10:03:27,869 - Get rows from result - output rel. is 1:1 10:03:27,869 INFO [STDOUT] INFO 16-02 10:03:27,869 - Get rows from result - Found output rowset [Get rows from result.0 - Set Variables.0] 10:03:27,869 INFO [STDOUT] INFO 16-02 10:03:27,869 - Get rows from result - Finished dispatching 10:03:27,869 INFO [STDOUT] INFO 16-02 10:03:27,869 - SetShardConnectionVariables - Transformation has allocated a new step: [Get rows from result].0 10:03:27,869 INFO [STDOUT] INFO 16-02 10:03:27,869 - SetShardConnectionVariables - Transformation is about to allocate step [Set Variables] of type [SetVariable] 10:03:27,870 INFO [STDOUT] INFO 16-02 10:03:27,869 - Set Variables - distribution activated 10:03:27,870 INFO [STDOUT] INFO 16-02 10:03:27,870 - Set Variables - Starting allocation of buffers & new threads... 10:03:27,870 INFO [STDOUT] INFO 16-02 10:03:27,870 - Set Variables - Step info: nrinput=1 nroutput=0 10:03:27,870 INFO [STDOUT] INFO 16-02 10:03:27,870 - Set Variables - Got previous step from [Set Variables] #0 --> Get rows from result 10:03:27,870 INFO [STDOUT] INFO 16-02 10:03:27,870 - Set Variables - input rel is 1:1 10:03:27,870 INFO [STDOUT] INFO 16-02 10:03:27,870 - Set Variables - Found input rowset [Get rows from result.0 - Set Variables.0] 10:03:27,870 INFO [STDOUT] INFO 16-02 10:03:27,870 - Set Variables - Finished dispatching 10:03:27,870 INFO [STDOUT] INFO 16-02 10:03:27,870 - SetShardConnectionVariables - Transformation has allocated a new step: [Set Variables].0 10:03:27,871 INFO [STDOUT] INFO 16-02 10:03:27,871 - SetShardConnectionVariables - This transformation can be replayed with replay date: 2012/02/16 10:03:27 10:03:27,871 INFO [STDOUT] INFO 16-02 10:03:27,871 - SetShardConnectionVariables - Initialising 2 steps... 10:03:27,871 INFO [STDOUT] INFO 16-02 10:03:27,871 - Get rows from result - Running on slave server #0/1. 10:03:27,871 INFO [STDOUT] INFO 16-02 10:03:27,871 - Set Variables - Running on slave server #0/1. 10:03:27,872 INFO [STDOUT] INFO 16-02 10:03:27,872 - SetShardConnectionVariables - Step [Get rows from result.0] initialized flawlessly. 10:03:27,872 INFO [STDOUT] INFO 16-02 10:03:27,872 - SetShardConnectionVariables - Step [Set Variables.0] initialized flawlessly. 10:03:27,872 INFO [STDOUT] INFO 16-02 10:03:27,872 - Get rows from result - Starting to run... 10:03:27,872 INFO [STDOUT] INFO 16-02 10:03:27,872 - Get rows from result - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 10:03:27,873 INFO [STDOUT] INFO 16-02 10:03:27,873 - SetShardConnectionVariables - Transformation has allocated 2 threads and 1 rowsets. 10:03:27,873 INFO [STDOUT] INFO 16-02 10:03:27,873 - Set Variables - Starting to run... 10:03:27,873 INFO [STDOUT] INFO 16-02 10:03:27,873 - Set Variables - Setting environment variables... 10:03:27,873 INFO [STDOUT] INFO 16-02 10:03:27,873 - Set Variables - Set variable DATABASE to value [st-tracker] 10:03:27,873 INFO [STDOUT] INFO 16-02 10:03:27,873 - Set Variables - Set variable HOST to value [acctdb-02-write] 10:03:27,874 INFO [STDOUT] INFO 16-02 10:03:27,874 - Set Variables - Set variable PORT to value [3310] 10:03:27,887 INFO [STDOUT] INFO 16-02 10:03:27,887 - Set Variables - Finished after 1 rows. 10:03:27,887 INFO [STDOUT] INFO 16-02 10:03:27,887 - Set Variables - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 10:03:27,896 INFO [STDOUT] INFO 16-02 10:03:27,896 - StageDataFromShard - Starting entry [Write To Log] 10:03:27,896 INFO [STDOUT] INFO 16-02 10:03:27,896 - StageDataFromShard - exec(22, 0, Write To Log.0) 10:03:27,896 INFO [STDOUT] INFO 16-02 10:03:27,896 - Write To Log - Starting job entry 10:03:27,897 INFO [STDOUT] INFO 16-02 10:03:27,897 - connection: - st-tracker acctdb-02-write 3310 select a.id, a.description customerID, a.isActive from admaxCampaigns ac join tsacommon.accounts a on a.ID = ac.accountID group by ac.accountID 10:03:27,897 INFO [STDOUT] INFO 16-02 10:03:27,897 - StageDataFromShard - Starting entry [StageDataForShard] 10:03:27,897 INFO [STDOUT] INFO 16-02 10:03:27,897 - StageDataFromShard - exec(23, 0, StageDataForShard.0) 10:03:27,898 INFO [STDOUT] INFO 16-02 10:03:27,897 - StageDataForShard - Starting job entry 10:03:27,898 INFO [STDOUT] INFO 16-02 10:03:27,898 - StageDataForShard - Opening transformation: [null] in directory [/] 10:03:27,898 INFO [STDOUT] INFO 16-02 10:03:27,898 - StageDataForShard - Loading transformation from repository [StageDataForShard] in directory [/] 10:03:27,917 INFO [STDOUT] INFO 16-02 10:03:27,917 - StageDataForShard - Starting transformation...(file=null, name=StageDataForShard, repinfo=null) 10:03:27,917 INFO [STDOUT] INFO 16-02 10:03:27,917 - StageDataForShard - Transformation is pre-loaded. 10:03:27,917 INFO [STDOUT] INFO 16-02 10:03:27,917 - StageDataForShard - Dispatching started for transformation [StageDataForShard] 10:03:27,917 INFO [STDOUT] INFO 16-02 10:03:27,917 - StageDataForShard - Nr of arguments detected:0 10:03:27,918 INFO [STDOUT] INFO 16-02 10:03:27,918 - StageDataForShard - This is not a replay transformation 10:03:27,918 INFO [STDOUT] INFO 16-02 10:03:27,918 - StageDataForShard - I found 3 different steps to launch. 10:03:27,918 INFO [STDOUT] INFO 16-02 10:03:27,918 - StageDataForShard - Allocating rowsets... 10:03:27,918 INFO [STDOUT] INFO 16-02 10:03:27,918 - StageDataForShard - Allocating rowsets for step 0 --> Write to log 10:03:27,918 INFO [STDOUT] INFO 16-02 10:03:27,918 - StageDataForShard - prevcopies = 1, nextcopies=1 10:03:27,918 INFO [STDOUT] INFO 16-02 10:03:27,918 - StageDataForShard - Transformation allocated new rowset [Write to log.0 - Table input.0] 10:03:27,918 INFO [STDOUT] INFO 16-02 10:03:27,918 - StageDataForShard - Allocated 1 rowsets for step 0 --> Write to log 10:03:27,918 INFO [STDOUT] INFO 16-02 10:03:27,918 - StageDataForShard - Allocating rowsets for step 1 --> Table input 10:03:27,918 INFO [STDOUT] INFO 16-02 10:03:27,918 - StageDataForShard - prevcopies = 1, nextcopies=1 10:03:27,919 INFO [STDOUT] INFO 16-02 10:03:27,919 - StageDataForShard - Transformation allocated new rowset [Table input.0 - Table output.0] 10:03:27,919 INFO [STDOUT] INFO 16-02 10:03:27,919 - StageDataForShard - Allocated 2 rowsets for step 1 --> Table input 10:03:27,919 INFO [STDOUT] INFO 16-02 10:03:27,919 - StageDataForShard - Allocating rowsets for step 2 --> Table output 10:03:27,919 INFO [STDOUT] INFO 16-02 10:03:27,919 - StageDataForShard - Allocated 2 rowsets for step 2 --> Table output 10:03:27,919 INFO [STDOUT] INFO 16-02 10:03:27,919 - StageDataForShard - Allocating Steps & StepData... 10:03:27,919 INFO [STDOUT] INFO 16-02 10:03:27,919 - StageDataForShard - Transformation is about to allocate step [Write to log] of type [WriteToLog] 10:03:27,919 INFO [STDOUT] INFO 16-02 10:03:27,919 - Write to log - distribution activated 10:03:27,919 INFO [STDOUT] INFO 16-02 10:03:27,919 - Write to log - Starting allocation of buffers & new threads... 10:03:27,920 INFO [STDOUT] INFO 16-02 10:03:27,920 - Write to log - Step info: nrinput=0 nroutput=1 10:03:27,920 INFO [STDOUT] INFO 16-02 10:03:27,920 - Write to log - output rel. is 1:1 10:03:27,920 INFO [STDOUT] INFO 16-02 10:03:27,920 - Write to log - Found output rowset [Write to log.0 - Table input.0] 10:03:27,920 INFO [STDOUT] INFO 16-02 10:03:27,920 - Write to log - Finished dispatching 10:03:27,920 INFO [STDOUT] INFO 16-02 10:03:27,920 - StageDataForShard - Transformation has allocated a new step: [Write to log].0 10:03:27,920 INFO [STDOUT] INFO 16-02 10:03:27,920 - StageDataForShard - Transformation is about to allocate step [Table input] of type [TableInput] 10:03:27,920 INFO [STDOUT] INFO 16-02 10:03:27,920 - Table input - Starting allocation of buffers & new threads... 10:03:27,920 INFO [STDOUT] INFO 16-02 10:03:27,920 - Table input - Step info: nrinput=1 nroutput=1 10:03:27,921 INFO [STDOUT] INFO 16-02 10:03:27,921 - Table input - Got previous step from [Table input] #0 --> Write to log 10:03:27,921 INFO [STDOUT] INFO 16-02 10:03:27,921 - Table input - input rel is 1:1 10:03:27,921 INFO [STDOUT] INFO 16-02 10:03:27,921 - Table input - Found input rowset [Write to log.0 - Table input.0] 10:03:27,921 INFO [STDOUT] INFO 16-02 10:03:27,921 - Table input - output rel. is 1:1 10:03:27,921 INFO [STDOUT] INFO 16-02 10:03:27,921 - Table input - Found output rowset [Table input.0 - Table output.0] 10:03:27,921 INFO [STDOUT] INFO 16-02 10:03:27,921 - Table input - Finished dispatching 10:03:27,921 INFO [STDOUT] INFO 16-02 10:03:27,921 - StageDataForShard - Transformation has allocated a new step: [Table input].0 10:03:27,921 INFO [STDOUT] INFO 16-02 10:03:27,921 - StageDataForShard - Transformation is about to allocate step [Table output] of type [TableOutput] 10:03:27,922 INFO [STDOUT] INFO 16-02 10:03:27,922 - Table output - distribution activated 10:03:27,922 INFO [STDOUT] INFO 16-02 10:03:27,922 - Table output - Starting allocation of buffers & new threads... 10:03:27,922 INFO [STDOUT] INFO 16-02 10:03:27,922 - Table output - Step info: nrinput=1 nroutput=0 10:03:27,922 INFO [STDOUT] INFO 16-02 10:03:27,922 - Table output - Got previous step from [Table output] #0 --> Table input 10:03:27,922 INFO [STDOUT] INFO 16-02 10:03:27,922 - Table output - input rel is 1:1 10:03:27,922 INFO [STDOUT] INFO 16-02 10:03:27,922 - Table output - Found input rowset [Table input.0 - Table output.0] 10:03:27,922 INFO [STDOUT] INFO 16-02 10:03:27,922 - Table output - Finished dispatching 10:03:27,922 INFO [STDOUT] INFO 16-02 10:03:27,922 - StageDataForShard - Transformation has allocated a new step: [Table output].0 10:03:27,923 INFO [STDOUT] INFO 16-02 10:03:27,923 - StageDataForShard - This transformation can be replayed with replay date: 2012/02/16 10:03:27 10:03:27,923 INFO [STDOUT] INFO 16-02 10:03:27,923 - StageDataForShard - Initialising 3 steps... 10:03:27,923 INFO [STDOUT] INFO 16-02 10:03:27,923 - Write to log - Running on slave server #0/1. 10:03:27,923 INFO [STDOUT] INFO 16-02 10:03:27,923 - Table input - Running on slave server #0/1. 10:03:27,928 INFO [STDOUT] INFO 16-02 10:03:27,928 - Table output - Running on slave server #0/1. 10:03:27,928 INFO [STDOUT] INFO 16-02 10:03:27,928 - pdi_staging - New database connection defined 10:03:27,929 INFO [STDOUT] INFO 16-02 10:03:27,929 - Shard - New database connection defined 10:03:27,939 INFO [STDOUT] INFO 16-02 10:03:27,939 - pdi_staging - Connected to database. 10:03:27,939 INFO [STDOUT] INFO 16-02 10:03:27,939 - Table output - Connected to database [pdi_staging] (commit=10000) 10:03:27,939 INFO [STDOUT] INFO 16-02 10:03:27,939 - pdi_staging - Auto commit off 10:03:27,958 INFO [STDOUT] INFO 16-02 10:03:27,958 - Shard - Connected to database. 10:03:27,959 INFO [STDOUT] INFO 16-02 10:03:27,959 - Shard - Auto commit off 10:03:27,959 INFO [STDOUT] INFO 16-02 10:03:27,959 - Table input - Connected to database... 10:03:27,959 INFO [STDOUT] INFO 16-02 10:03:27,959 - StageDataForShard - Step [Write to log.0] initialized flawlessly. 10:03:27,959 INFO [STDOUT] INFO 16-02 10:03:27,959 - StageDataForShard - Step [Table input.0] initialized flawlessly. 10:03:27,959 INFO [STDOUT] INFO 16-02 10:03:27,959 - StageDataForShard - Step [Table output.0] initialized flawlessly. 10:03:27,960 INFO [STDOUT] INFO 16-02 10:03:27,960 - Write to log - Starting to run... 10:03:27,960 INFO [STDOUT] INFO 16-02 10:03:27,960 - Write to log - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0) 10:03:27,960 INFO [STDOUT] INFO 16-02 10:03:27,960 - Table input - Starting to run... 10:03:27,961 INFO [STDOUT] INFO 16-02 10:03:27,961 - Table input - SQL query : select a.id, a.description customerID, a.isActive from admaxCampaigns ac join tsacommon.accounts a on a.ID = ac.accountID group by ac.accountID 10:03:27,961 INFO [STDOUT] INFO 16-02 10:03:27,961 - StageDataForShard - Transformation has allocated 3 threads and 2 rowsets. 10:03:27,961 INFO [STDOUT] INFO 16-02 10:03:27,961 - Table output - Starting to run... 10:03:27,963 INFO [STDOUT] INFO 16-02 10:03:27,963 - Table input - Finished reading query, closing connection. 10:03:27,965 INFO [STDOUT] INFO 16-02 10:03:27,965 - Shard - Connection to database closed! 10:03:27,965 INFO [STDOUT] INFO 16-02 10:03:27,965 - Table input - Finished processing (I=5, O=0, R=0, W=5, U=0, E=0) 10:03:27,967 INFO [STDOUT] INFO 16-02 10:03:27,967 - Table output - Prepared statement : INSERT INTO dfStructureAccounts (id, customerID, isActive) VALUES ( ?, ?, ?) 10:03:27,985 INFO [STDOUT] INFO 16-02 10:03:27,985 - pdi_staging - Connection to database closed! 10:03:27,985 INFO [STDOUT] INFO 16-02 10:03:27,985 - Table output - Finished processing (I=0, O=5, R=5, W=5, U=0, E=0) 10:03:27,992 INFO [STDOUT] INFO 16-02 10:03:27,992 - StageDataFromShard - Finished job entry [StageDataForShard] (result=[true]) 10:03:27,992 INFO [STDOUT] INFO 16-02 10:03:27,992 - StageDataFromShard - Finished job entry [Write To Log] (result=[true]) 10:03:27,992 INFO [STDOUT] INFO 16-02 10:03:27,992 - StageDataFromShard - Finished job entry [SetShardConnectionVariables] (result=[true]) 10:03:27,995 INFO [STDOUT] INFO 16-02 10:03:27,995 - StageDataFromShards - Finished job entry [StageDataFromShard] (result=[true]) 10:03:27,996 INFO [STDOUT] INFO 16-02 10:03:27,995 - StageDataFromShards - Finished job entry [SelectShards] (result=[true]) 10:03:27,996 INFO [STDOUT] INFO 16-02 10:03:27,996 - StageDataFromShards - Finished job entry [Write To Log] (result=[true]) 10:03:28,003 INFO [STDOUT] INFO 16-02 10:03:28,003 - StageRequirement - Finished job entry [StageDataFromShards] (result=[true]) 10:03:28,004 INFO [STDOUT] INFO 16-02 10:03:28,004 - StageRequirement - Finished job entry [Simple evaluation 2] (result=[true]) 10:03:28,004 INFO [STDOUT] INFO 16-02 10:03:28,004 - StageRequirement - Finished job entry [Simple evaluation] (result=[true]) 10:03:28,004 INFO [STDOUT] INFO 16-02 10:03:28,004 - StageRequirement - Finished job entry [TruncateStagingTable] (result=[true]) 10:03:28,004 INFO [STDOUT] INFO 16-02 10:03:28,004 - StageRequirement - Finished job entry [SetRequirementStagingVariables] (result=[true]) 10:03:28,011 INFO [STDOUT] INFO 16-02 10:03:28,011 - StageRequirement - exec(10, 0, START.0) 10:03:28,012 INFO [STDOUT] INFO 16-02 10:03:28,012 - START - Starting job entry 10:03:28,012 INFO [STDOUT] INFO 16-02 10:03:28,012 - StageRequirement - Starting entry [SetRequirementStagingVariables] 10:03:28,012 INFO [STDOUT] INFO 16-02 10:03:28,012 - StageRequirement - exec(11, 0, SetRequirementStagingVariables.0) 10:03:28,013 INFO [STDOUT] INFO 16-02 10:03:28,013 - SetRequirementStagingVariables - Starting job entry 10:03:28,013 INFO [STDOUT] INFO 16-02 10:03:28,013 - SetRequirementStagingVariables - Opening transformation: [null] in directory [/] 10:03:28,013 INFO [STDOUT] INFO 16-02 10:03:28,013 - SetRequirementStagingVariables - Loading transformation from repository [SetRequirementStagingVariables] in directory [/] 10:03:28,032 INFO [STDOUT] INFO 16-02 10:03:28,032 - SetRequirementStagingVariables - Starting transformation...(file=null, name=SetRequirementStagingVariables, repinfo=null) 10:03:28,033 INFO [STDOUT] INFO 16-02 10:03:28,033 - SetRequirementStagingVariables - Transformation is pre-loaded. 10:03:28,033 INFO [STDOUT] INFO 16-02 10:03:28,033 - SetRequirementStagingVariables - Dispatching started for transformation [SetRequirementStagingVariables] 10:03:28,033 INFO [STDOUT] INFO 16-02 10:03:28,033 - SetRequirementStagingVariables - Nr of arguments detected:0 10:03:28,033 INFO [STDOUT] INFO 16-02 10:03:28,033 - SetRequirementStagingVariables - This is not a replay transformation 10:03:28,033 INFO [STDOUT] INFO 16-02 10:03:28,033 - SetRequirementStagingVariables - I found 2 different steps to launch. 10:03:28,033 INFO [STDOUT] INFO 16-02 10:03:28,033 - SetRequirementStagingVariables - Allocating rowsets... 10:03:28,033 INFO [STDOUT] INFO 16-02 10:03:28,033 - SetRequirementStagingVariables - Allocating rowsets for step 0 --> Get rows from result 10:03:28,033 INFO [STDOUT] INFO 16-02 10:03:28,033 - SetRequirementStagingVariables - prevcopies = 1, nextcopies=1 10:03:28,034 INFO [STDOUT] INFO 16-02 10:03:28,034 - SetRequirementStagingVariables - Transformation allocated new rowset [Get rows from result.0 - Set Variables.0] 10:03:28,034 INFO [STDOUT] INFO 16-02 10:03:28,034 - SetRequirementStagingVariables - Allocated 1 rowsets for step 0 --> Get rows from result 10:03:28,034 INFO [STDOUT] INFO 16-02 10:03:28,034 - SetRequirementStagingVariables - Allocating rowsets for step 1 --> Set Variables 10:03:28,034 INFO [STDOUT] INFO 16-02 10:03:28,034 - SetRequirementStagingVariables - Allocated 1 rowsets for step 1 --> Set Variables 10:03:28,034 INFO [STDOUT] INFO 16-02 10:03:28,034 - SetRequirementStagingVariables - Allocating Steps & StepData... 10:03:28,034 INFO [STDOUT] INFO 16-02 10:03:28,034 - SetRequirementStagingVariables - Transformation is about to allocate step [Get rows from result] of type [RowsFromResult] 10:03:28,034 INFO [STDOUT] INFO 16-02 10:03:28,034 - Get rows from result - distribution activated 10:03:28,034 INFO [STDOUT] INFO 16-02 10:03:28,034 - Get rows from result - Starting allocation of buffers & new threads... 10:03:28,035 INFO [STDOUT] INFO 16-02 10:03:28,034 - Get rows from result - Step info: nrinput=0 nroutput=1 10:03:28,035 INFO [STDOUT] INFO 16-02 10:03:28,035 - Get rows from result - output rel. is 1:1 10:03:28,035 INFO [STDOUT] INFO 16-02 10:03:28,035 - Get rows from result - Found output rowset [Get rows from result.0 - Set Variables.0] 10:03:28,035 INFO [STDOUT] INFO 16-02 10:03:28,035 - Get rows from result - Finished dispatching 10:03:28,035 INFO [STDOUT] INFO 16-02 10:03:28,035 - SetRequirementStagingVariables - Transformation has allocated a new step: [Get rows from result].0 10:03:28,035 INFO [STDOUT] INFO 16-02 10:03:28,035 - SetRequirementStagingVariables - Transformation is about to allocate step [Set Variables] of type [SetVariable] 10:03:28,035 INFO [STDOUT] INFO 16-02 10:03:28,035 - Set Variables - distribution activated 10:03:28,035 INFO [STDOUT] INFO 16-02 10:03:28,035 - Set Variables - Starting allocation of buffers & new threads... 10:03:28,036 INFO [STDOUT] INFO 16-02 10:03:28,036 - Set Variables - Step info: nrinput=1 nroutput=0 10:03:28,036 INFO [STDOUT] INFO 16-02 10:03:28,036 - Set Variables - Got previous step from [Set Variables] #0 --> Get rows from result 10:03:28,036 INFO [STDOUT] INFO 16-02 10:03:28,036 - Set Variables - input rel is 1:1 10:03:28,036 INFO [STDOUT] INFO 16-02 10:03:28,036 - Set Variables - Found input rowset [Get rows from result.0 - Set Variables.0] 10:03:28,036 INFO [STDOUT] INFO 16-02 10:03:28,036 - Set Variables - Finished dispatching 10:03:28,036 INFO [STDOUT] INFO 16-02 10:03:28,036 - SetRequirementStagingVariables - Transformation has allocated a new step: [Set Variables].0 10:03:28,036 INFO [STDOUT] INFO 16-02 10:03:28,036 - SetRequirementStagingVariables - This transformation can be replayed with replay date: 2012/02/16 10:03:28 10:03:28,037 INFO [STDOUT] INFO 16-02 10:03:28,037 - SetRequirementStagingVariables - Initialising 2 steps... 10:03:28,037 INFO [STDOUT] INFO 16-02 10:03:28,037 - Get rows from result - Running on slave server #0/1. 10:03:28,037 INFO [STDOUT] INFO 16-02 10:03:28,037 - Set Variables - Running on slave server #0/1. 10:03:28,038 INFO [STDOUT] INFO 16-02 10:03:28,038 - SetRequirementStagingVariables - Step [Get rows from result.0] initialized flawlessly. 10:03:28,038 INFO [STDOUT] INFO 16-02 10:03:28,038 - SetRequirementStagingVariables - Step [Set Variables.0] initialized flawlessly. 10:03:28,038 INFO [STDOUT] INFO 16-02 10:03:28,038 - Get rows from result - Starting to run... 10:03:28,038 INFO [STDOUT] INFO 16-02 10:03:28,038 - Get rows from result - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 10:03:28,039 INFO [STDOUT] INFO 16-02 10:03:28,039 - SetRequirementStagingVariables - Transformation has allocated 2 threads and 1 rowsets. 10:03:28,039 INFO [STDOUT] INFO 16-02 10:03:28,039 - Set Variables - Starting to run... 10:03:28,039 INFO [STDOUT] INFO 16-02 10:03:28,039 - Set Variables - Setting environment variables... 10:03:28,039 INFO [STDOUT] INFO 16-02 10:03:28,039 - Set Variables - Set variable STAGINGTABLENAME to value [dfStructureAdMaxCampaigns] 10:03:28,039 INFO [STDOUT] INFO 16-02 10:03:28,039 - Set Variables - Set variable QUERY to value [select ac.id, ac.accountID, ac.description, cast(substring_index(substring_index(ac.description, '_', 2), '_', -1) as signed) businessAreaID, cast(substring_index(substring_index(ac.description, '_', 3), '_', -1) as signed) businessLocationID from admaxCampaigns ac] 10:03:28,039 INFO [STDOUT] INFO 16-02 10:03:28,039 - Set Variables - Set variable SHARDPATTERN to value [st-tracker] 10:03:28,055 INFO [STDOUT] INFO 16-02 10:03:28,055 - Set Variables - Finished after 1 rows. 10:03:28,055 INFO [STDOUT] INFO 16-02 10:03:28,055 - Set Variables - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 10:03:28,064 INFO [STDOUT] INFO 16-02 10:03:28,064 - StageRequirement - Starting entry [TruncateStagingTable] 10:03:28,064 INFO [STDOUT] INFO 16-02 10:03:28,064 - StageRequirement - exec(12, 0, TruncateStagingTable.0) 10:03:28,064 INFO [STDOUT] INFO 16-02 10:03:28,064 - TruncateStagingTable - Starting job entry 10:03:28,065 INFO [STDOUT] INFO 16-02 10:03:28,065 - TruncateStagingTable - Opening transformation: [null] in directory [/] 10:03:28,065 INFO [STDOUT] INFO 16-02 10:03:28,065 - TruncateStagingTable - Loading transformation from repository [TruncateStagingTable] in directory [/] 10:03:28,083 INFO [STDOUT] INFO 16-02 10:03:28,083 - TruncateStagingTable - Starting transformation...(file=null, name=TruncateStagingTable, repinfo=null) 10:03:28,083 INFO [STDOUT] INFO 16-02 10:03:28,083 - TruncateStagingTable - Transformation is pre-loaded. 10:03:28,083 INFO [STDOUT] INFO 16-02 10:03:28,083 - TruncateStagingTable - Dispatching started for transformation [TruncateStagingTable] 10:03:28,084 INFO [STDOUT] INFO 16-02 10:03:28,083 - TruncateStagingTable - Nr of arguments detected:0 10:03:28,084 INFO [STDOUT] INFO 16-02 10:03:28,084 - TruncateStagingTable - This is not a replay transformation 10:03:28,084 INFO [STDOUT] INFO 16-02 10:03:28,084 - TruncateStagingTable - I found 4 different steps to launch. 10:03:28,084 INFO [STDOUT] INFO 16-02 10:03:28,084 - TruncateStagingTable - Allocating rowsets... 10:03:28,084 INFO [STDOUT] INFO 16-02 10:03:28,084 - TruncateStagingTable - Allocating rowsets for step 0 --> Get Variables 10:03:28,084 INFO [STDOUT] INFO 16-02 10:03:28,084 - TruncateStagingTable - prevcopies = 1, nextcopies=1 10:03:28,084 INFO [STDOUT] INFO 16-02 10:03:28,084 - TruncateStagingTable - Transformation allocated new rowset [Get Variables.0 - Switch / Case.0] 10:03:28,084 INFO [STDOUT] INFO 16-02 10:03:28,084 - TruncateStagingTable - Allocated 1 rowsets for step 0 --> Get Variables 10:03:28,084 INFO [STDOUT] INFO 16-02 10:03:28,084 - TruncateStagingTable - Allocating rowsets for step 1 --> Switch / Case 10:03:28,085 INFO [STDOUT] INFO 16-02 10:03:28,085 - TruncateStagingTable - prevcopies = 1, nextcopies=1 10:03:28,085 INFO [STDOUT] INFO 16-02 10:03:28,085 - TruncateStagingTable - Transformation allocated new rowset [Switch / Case.0 - Execute SQL script trunc.0] 10:03:28,085 INFO [STDOUT] INFO 16-02 10:03:28,085 - TruncateStagingTable - prevcopies = 1, nextcopies=1 10:03:28,085 INFO [STDOUT] INFO 16-02 10:03:28,085 - TruncateStagingTable - Transformation allocated new rowset [Switch / Case.0 - Dummy (do nothing).0] 10:03:28,085 INFO [STDOUT] INFO 16-02 10:03:28,085 - TruncateStagingTable - Allocated 3 rowsets for step 1 --> Switch / Case 10:03:28,085 INFO [STDOUT] INFO 16-02 10:03:28,085 - TruncateStagingTable - Allocating rowsets for step 2 --> Execute SQL script trunc 10:03:28,085 INFO [STDOUT] INFO 16-02 10:03:28,085 - TruncateStagingTable - Allocated 3 rowsets for step 2 --> Execute SQL script trunc 10:03:28,085 INFO [STDOUT] INFO 16-02 10:03:28,085 - TruncateStagingTable - Allocating rowsets for step 3 --> Dummy (do nothing) 10:03:28,085 INFO [STDOUT] INFO 16-02 10:03:28,085 - TruncateStagingTable - Allocated 3 rowsets for step 3 --> Dummy (do nothing) 10:03:28,086 INFO [STDOUT] INFO 16-02 10:03:28,085 - TruncateStagingTable - Allocating Steps & StepData... 10:03:28,086 INFO [STDOUT] INFO 16-02 10:03:28,086 - TruncateStagingTable - Transformation is about to allocate step [Get Variables] of type [GetVariable] 10:03:28,086 INFO [STDOUT] INFO 16-02 10:03:28,086 - Get Variables - distribution activated 10:03:28,086 INFO [STDOUT] INFO 16-02 10:03:28,086 - Get Variables - Starting allocation of buffers & new threads... 10:03:28,086 INFO [STDOUT] INFO 16-02 10:03:28,086 - Get Variables - Step info: nrinput=0 nroutput=1 10:03:28,086 INFO [STDOUT] INFO 16-02 10:03:28,086 - Get Variables - output rel. is 1:1 10:03:28,086 INFO [STDOUT] INFO 16-02 10:03:28,086 - Get Variables - Found output rowset [Get Variables.0 - Switch / Case.0] 10:03:28,086 INFO [STDOUT] INFO 16-02 10:03:28,086 - Get Variables - Finished dispatching 10:03:28,087 INFO [STDOUT] INFO 16-02 10:03:28,087 - TruncateStagingTable - Transformation has allocated a new step: [Get Variables].0 10:03:28,087 INFO [STDOUT] INFO 16-02 10:03:28,087 - TruncateStagingTable - Transformation is about to allocate step [Switch / Case] of type [SwitchCase] 10:03:28,087 INFO [STDOUT] INFO 16-02 10:03:28,087 - Switch / Case - distribution activated 10:03:28,087 INFO [STDOUT] INFO 16-02 10:03:28,087 - Switch / Case - Starting allocation of buffers & new threads... 10:03:28,087 INFO [STDOUT] INFO 16-02 10:03:28,087 - Switch / Case - Step info: nrinput=1 nroutput=2 10:03:28,087 INFO [STDOUT] INFO 16-02 10:03:28,087 - Switch / Case - Got previous step from [Switch / Case] #0 --> Get Variables 10:03:28,087 INFO [STDOUT] INFO 16-02 10:03:28,087 - Switch / Case - input rel is 1:1 10:03:28,087 INFO [STDOUT] INFO 16-02 10:03:28,087 - Switch / Case - Found input rowset [Get Variables.0 - Switch / Case.0] 10:03:28,088 INFO [STDOUT] INFO 16-02 10:03:28,088 - Switch / Case - output rel. is 1:1 10:03:28,088 INFO [STDOUT] INFO 16-02 10:03:28,088 - Switch / Case - Found output rowset [Switch / Case.0 - Execute SQL script trunc.0] 10:03:28,088 INFO [STDOUT] INFO 16-02 10:03:28,088 - Switch / Case - output rel. is 1:1 10:03:28,088 INFO [STDOUT] INFO 16-02 10:03:28,088 - Switch / Case - Found output rowset [Switch / Case.0 - Dummy (do nothing).0] 10:03:28,088 INFO [STDOUT] INFO 16-02 10:03:28,088 - Switch / Case - Finished dispatching 10:03:28,089 INFO [STDOUT] INFO 16-02 10:03:28,088 - TruncateStagingTable - Transformation has allocated a new step: [Switch / Case].0 10:03:28,089 INFO [STDOUT] INFO 16-02 10:03:28,089 - TruncateStagingTable - Transformation is about to allocate step [Execute SQL script trunc] of type [ExecSQL] 10:03:28,089 INFO [STDOUT] INFO 16-02 10:03:28,089 - Execute SQL script trunc - distribution activated 10:03:28,089 INFO [STDOUT] INFO 16-02 10:03:28,089 - Execute SQL script trunc - Starting allocation of buffers & new threads... 10:03:28,089 INFO [STDOUT] INFO 16-02 10:03:28,089 - Execute SQL script trunc - Step info: nrinput=1 nroutput=0 10:03:28,089 INFO [STDOUT] INFO 16-02 10:03:28,089 - Execute SQL script trunc - Got previous step from [Execute SQL script trunc] #0 --> Switch / Case 10:03:28,090 INFO [STDOUT] INFO 16-02 10:03:28,089 - Execute SQL script trunc - input rel is 1:1 10:03:28,090 INFO [STDOUT] INFO 16-02 10:03:28,090 - Execute SQL script trunc - Found input rowset [Switch / Case.0 - Execute SQL script trunc.0] 10:03:28,090 INFO [STDOUT] INFO 16-02 10:03:28,090 - Execute SQL script trunc - Finished dispatching 10:03:28,090 INFO [STDOUT] INFO 16-02 10:03:28,090 - TruncateStagingTable - Transformation has allocated a new step: [Execute SQL script trunc].0 10:03:28,090 INFO [STDOUT] INFO 16-02 10:03:28,090 - TruncateStagingTable - Transformation is about to allocate step [Dummy (do nothing)] of type [Dummy] 10:03:28,090 INFO [STDOUT] INFO 16-02 10:03:28,090 - Dummy (do nothing) - distribution activated 10:03:28,090 INFO [STDOUT] INFO 16-02 10:03:28,090 - Dummy (do nothing) - Starting allocation of buffers & new threads... 10:03:28,090 INFO [STDOUT] INFO 16-02 10:03:28,090 - Dummy (do nothing) - Step info: nrinput=1 nroutput=0 10:03:28,091 INFO [STDOUT] INFO 16-02 10:03:28,090 - Dummy (do nothing) - Got previous step from [Dummy (do nothing)] #0 --> Switch / Case 10:03:28,091 INFO [STDOUT] INFO 16-02 10:03:28,091 - Dummy (do nothing) - input rel is 1:1 10:03:28,091 INFO [STDOUT] INFO 16-02 10:03:28,091 - Dummy (do nothing) - Found input rowset [Switch / Case.0 - Dummy (do nothing).0] 10:03:28,091 INFO [STDOUT] INFO 16-02 10:03:28,091 - Dummy (do nothing) - Finished dispatching 10:03:28,091 INFO [STDOUT] INFO 16-02 10:03:28,091 - TruncateStagingTable - Transformation has allocated a new step: [Dummy (do nothing)].0 10:03:28,091 INFO [STDOUT] INFO 16-02 10:03:28,091 - TruncateStagingTable - This transformation can be replayed with replay date: 2012/02/16 10:03:28 10:03:28,092 INFO [STDOUT] INFO 16-02 10:03:28,091 - TruncateStagingTable - Initialising 4 steps... 10:03:28,092 INFO [STDOUT] INFO 16-02 10:03:28,092 - Get Variables - Running on slave server #0/1. 10:03:28,092 INFO [STDOUT] INFO 16-02 10:03:28,092 - Switch / Case - Running on slave server #0/1. 10:03:28,093 INFO [STDOUT] INFO 16-02 10:03:28,093 - Execute SQL script trunc - Running on slave server #0/1. 10:03:28,093 INFO [STDOUT] INFO 16-02 10:03:28,093 - pdi_stage - New database connection defined 10:03:28,106 INFO [STDOUT] INFO 16-02 10:03:28,106 - pdi_stage - Connected to database. 10:03:28,106 INFO [STDOUT] INFO 16-02 10:03:28,106 - Execute SQL script trunc - Connected to database... 10:03:28,107 INFO [STDOUT] INFO 16-02 10:03:28,107 - pdi_stage - launch DDL statement: truncate dfStructureAdMaxCampaigns 10:03:28,108 INFO [STDOUT] INFO 16-02 10:03:28,108 - Dummy (do nothing) - Running on slave server #0/1. 10:03:28,123 INFO [STDOUT] INFO 16-02 10:03:28,123 - pdi_stage - 1 statement executed 10:03:28,123 INFO [STDOUT] INFO 16-02 10:03:28,123 - TruncateStagingTable - Step [Get Variables.0] initialized flawlessly. 10:03:28,123 INFO [STDOUT] INFO 16-02 10:03:28,123 - TruncateStagingTable - Step [Switch / Case.0] initialized flawlessly. 10:03:28,123 INFO [STDOUT] INFO 16-02 10:03:28,123 - TruncateStagingTable - Step [Execute SQL script trunc.0] initialized flawlessly. 10:03:28,123 INFO [STDOUT] INFO 16-02 10:03:28,123 - TruncateStagingTable - Step [Dummy (do nothing).0] initialized flawlessly. 10:03:28,124 INFO [STDOUT] INFO 16-02 10:03:28,124 - Get Variables - Starting to run... 10:03:28,124 INFO [STDOUT] INFO 16-02 10:03:28,124 - Get Variables - field [stagingTableName] has value [STAGINGTABLENAME] 10:03:28,124 INFO [STDOUT] INFO 16-02 10:03:28,124 - Get Variables - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 10:03:28,125 INFO [STDOUT] INFO 16-02 10:03:28,125 - Switch / Case - Starting to run... 10:03:28,125 INFO [STDOUT] INFO 16-02 10:03:28,125 - Execute SQL script trunc - Starting to run... 10:03:28,125 INFO [STDOUT] INFO 16-02 10:03:28,125 - Execute SQL script trunc - Finished reading query, closing connection. 10:03:28,126 INFO [STDOUT] INFO 16-02 10:03:28,125 - pdi_stage - Connection to database closed! 10:03:28,126 INFO [STDOUT] INFO 16-02 10:03:28,126 - Execute SQL script trunc - Finished processing (I=0, O=0, R=0, W=1, U=0, E=0) 10:03:28,126 INFO [STDOUT] INFO 16-02 10:03:28,126 - TruncateStagingTable - Transformation has allocated 4 threads and 3 rowsets. 10:03:28,130 INFO [STDOUT] INFO 16-02 10:03:28,130 - Dummy (do nothing) - Starting to run... 10:03:28,143 INFO [STDOUT] INFO 16-02 10:03:28,143 - Switch / Case - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 10:03:28,159 INFO [STDOUT] INFO 16-02 10:03:28,159 - Dummy (do nothing) - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0) 10:03:28,164 INFO [STDOUT] INFO 16-02 10:03:28,164 - StageRequirement - Starting entry [Simple evaluation] 10:03:28,164 INFO [STDOUT] INFO 16-02 10:03:28,164 - StageRequirement - exec(13, 0, Simple evaluation.0) 10:03:28,165 INFO [STDOUT] INFO 16-02 10:03:28,165 - Simple evaluation - Starting job entry 10:03:28,165 INFO [STDOUT] INFO 16-02 10:03:28,165 - Simple evaluation - Checking variable [${SHARDPATTERN}] ... 10:03:28,165 INFO [STDOUT] INFO 16-02 10:03:28,165 - Simple evaluation - Value to evaluate is st-tracker 10:03:28,166 INFO [STDOUT] INFO 16-02 10:03:28,166 - StageRequirement - Starting entry [Simple evaluation 2] 10:03:28,166 INFO [STDOUT] INFO 16-02 10:03:28,166 - StageRequirement - exec(14, 0, Simple evaluation 2.0) 10:03:28,166 INFO [STDOUT] INFO 16-02 10:03:28,166 - Simple evaluation - Starting job entry 10:03:28,166 INFO [STDOUT] INFO 16-02 10:03:28,166 - Simple evaluation - Checking variable [${SHARDPATTERN}] ... 10:03:28,166 INFO [STDOUT] INFO 16-02 10:03:28,166 - Simple evaluation - Value to evaluate is st-tracker 10:03:28,167 INFO [STDOUT] INFO 16-02 10:03:28,167 - StageRequirement - Starting entry [StageDataFromShards] 10:03:28,167 INFO [STDOUT] INFO 16-02 10:03:28,167 - StageRequirement - exec(15, 0, StageDataFromShards.0) 10:03:28,168 INFO [STDOUT] INFO 16-02 10:03:28,168 - StageDataFromShards - Starting job entry 10:03:28,168 INFO [STDOUT] INFO 16-02 10:03:28,168 - StageDataFromShards - Loading job from repository : [/ : StageDataFromShards] 10:03:28,182 INFO [STDOUT] INFO 16-02 10:03:28,181 - StageDataFromShards - exec(16, 0, START.0) 10:03:28,182 INFO [STDOUT] INFO 16-02 10:03:28,182 - START - Starting job entry 10:03:28,183 INFO [STDOUT] INFO 16-02 10:03:28,183 - StageDataFromShards - Starting entry [Write To Log] 10:03:28,183 INFO [STDOUT] INFO 16-02 10:03:28,183 - StageDataFromShards - exec(17, 0, Write To Log.0) 10:03:28,183 INFO [STDOUT] INFO 16-02 10:03:28,183 - Write To Log - Starting job entry 10:03:28,184 INFO [STDOUT] INFO 16-02 10:03:28,184 - End: - dfStructureAdMaxCampaigns select ac.id, ac.accountID, ac.description, cast(substring_index(substring_index(ac.description, '_', 2), '_', -1) as signed) businessAreaID, cast(substring_index(substring_index(ac.description, '_', 3), '_', -1) as signed) businessLocationID from admaxCampaigns ac st-tracker 10:03:28,184 INFO [STDOUT] INFO 16-02 10:03:28,184 - StageDataFromShards - Starting entry [SelectShards] 10:03:28,184 INFO [STDOUT] INFO 16-02 10:03:28,184 - StageDataFromShards - exec(18, 0, SelectShards.0) 10:03:28,185 INFO [STDOUT] INFO 16-02 10:03:28,185 - SelectShards - Starting job entry 10:03:28,185 INFO [STDOUT] INFO 16-02 10:03:28,185 - SelectShards - Opening transformation: [null] in directory [/] 10:03:28,185 INFO [STDOUT] INFO 16-02 10:03:28,185 - SelectShards - Loading transformation from repository [SelectShards] in directory [/] 10:03:28,203 INFO [STDOUT] INFO 16-02 10:03:28,202 - SelectShards - Starting transformation...(file=null, name=SelectShards, repinfo=null) 10:03:28,203 INFO [STDOUT] INFO 16-02 10:03:28,203 - SelectShards - Transformation is pre-loaded. 10:03:28,203 INFO [STDOUT] INFO 16-02 10:03:28,203 - SelectShards - Dispatching started for transformation [SelectShards] 10:03:28,203 INFO [STDOUT] INFO 16-02 10:03:28,203 - SelectShards - Nr of arguments detected:0 10:03:28,203 INFO [STDOUT] INFO 16-02 10:03:28,203 - SelectShards - This is not a replay transformation 10:03:28,203 INFO [STDOUT] INFO 16-02 10:03:28,203 - SelectShards - I found 2 different steps to launch. 10:03:28,203 INFO [STDOUT] INFO 16-02 10:03:28,203 - SelectShards - Allocating rowsets... 10:03:28,204 INFO [STDOUT] INFO 16-02 10:03:28,204 - SelectShards - Allocating rowsets for step 0 --> Table input 10:03:28,204 INFO [STDOUT] INFO 16-02 10:03:28,204 - SelectShards - prevcopies = 1, nextcopies=1 10:03:28,204 INFO [STDOUT] INFO 16-02 10:03:28,204 - SelectShards - Transformation allocated new rowset [Table input.0 - Copy rows to result.0] 10:03:28,204 INFO [STDOUT] INFO 16-02 10:03:28,204 - SelectShards - Allocated 1 rowsets for step 0 --> Table input 10:03:28,204 INFO [STDOUT] INFO 16-02 10:03:28,204 - SelectShards - Allocating rowsets for step 1 --> Copy rows to result 10:03:28,204 INFO [STDOUT] INFO 16-02 10:03:28,204 - SelectShards - Allocated 1 rowsets for step 1 --> Copy rows to result 10:03:28,204 INFO [STDOUT] INFO 16-02 10:03:28,204 - SelectShards - Allocating Steps & StepData... 10:03:28,204 INFO [STDOUT] INFO 16-02 10:03:28,204 - SelectShards - Transformation is about to allocate step [Table input] of type [TableInput] 10:03:28,205 INFO [STDOUT] INFO 16-02 10:03:28,205 - Table input - distribution activated 10:03:28,205 INFO [STDOUT] INFO 16-02 10:03:28,205 - Table input - Starting allocation of buffers & new threads... 10:03:28,205 INFO [STDOUT] INFO 16-02 10:03:28,205 - Table input - Step info: nrinput=0 nroutput=1 10:03:28,205 INFO [STDOUT] INFO 16-02 10:03:28,205 - Table input - output rel. is 1:1 10:03:28,205 INFO [STDOUT] INFO 16-02 10:03:28,205 - Table input - Found output rowset [Table input.0 - Copy rows to result.0] 10:03:28,205 INFO [STDOUT] INFO 16-02 10:03:28,205 - Table input - Finished dispatching 10:03:28,205 INFO [STDOUT] INFO 16-02 10:03:28,205 - SelectShards - Transformation has allocated a new step: [Table input].0 10:03:28,205 INFO [STDOUT] INFO 16-02 10:03:28,205 - SelectShards - Transformation is about to allocate step [Copy rows to result] of type [RowsToResult] 10:03:28,206 INFO [STDOUT] INFO 16-02 10:03:28,206 - Copy rows to result - distribution activated 10:03:28,206 INFO [STDOUT] INFO 16-02 10:03:28,206 - Copy rows to result - Starting allocation of buffers & new threads... 10:03:28,206 INFO [STDOUT] INFO 16-02 10:03:28,206 - Copy rows to result - Step info: nrinput=1 nroutput=0 10:03:28,206 INFO [STDOUT] INFO 16-02 10:03:28,206 - Copy rows to result - Got previous step from [Copy rows to result] #0 --> Table input 10:03:28,206 INFO [STDOUT] INFO 16-02 10:03:28,206 - Copy rows to result - input rel is 1:1 10:03:28,206 INFO [STDOUT] INFO 16-02 10:03:28,206 - Copy rows to result - Found input rowset [Table input.0 - Copy rows to result.0] 10:03:28,206 INFO [STDOUT] INFO 16-02 10:03:28,206 - Copy rows to result - Finished dispatching 10:03:28,206 INFO [STDOUT] INFO 16-02 10:03:28,206 - SelectShards - Transformation has allocated a new step: [Copy rows to result].0 10:03:28,207 INFO [STDOUT] INFO 16-02 10:03:28,207 - SelectShards - This transformation can be replayed with replay date: 2012/02/16 10:03:28 10:03:28,207 INFO [STDOUT] INFO 16-02 10:03:28,207 - SelectShards - Initialising 2 steps... 10:03:28,207 INFO [STDOUT] INFO 16-02 10:03:28,207 - Table input - Running on slave server #0/1. 10:03:28,212 INFO [STDOUT] INFO 16-02 10:03:28,211 - tsacommon - New database connection defined 10:03:28,214 INFO [STDOUT] INFO 16-02 10:03:28,214 - Copy rows to result - Running on slave server #0/1. 10:03:28,224 INFO [STDOUT] INFO 16-02 10:03:28,224 - tsacommon - Connected to database. 10:03:28,225 INFO [STDOUT] INFO 16-02 10:03:28,225 - tsacommon - Auto commit off 10:03:28,225 INFO [STDOUT] INFO 16-02 10:03:28,225 - Table input - Connected to database... 10:03:28,225 INFO [STDOUT] INFO 16-02 10:03:28,225 - SelectShards - Step [Table input.0] initialized flawlessly. 10:03:28,225 INFO [STDOUT] INFO 16-02 10:03:28,225 - SelectShards - Step [Copy rows to result.0] initialized flawlessly. 10:03:28,226 INFO [STDOUT] INFO 16-02 10:03:28,226 - Table input - Starting to run... 10:03:28,226 INFO [STDOUT] INFO 16-02 10:03:28,226 - Table input - SQL query : SELECT id , name , description , type , `DATABASE` , host , port , access FROM databaseInstances WHERE `DATABASE` like "st-tracker" 10:03:28,226 INFO [STDOUT] INFO 16-02 10:03:28,226 - SelectShards - Transformation has allocated 2 threads and 1 rowsets. 10:03:28,226 INFO [STDOUT] INFO 16-02 10:03:28,226 - Copy rows to result - Starting to run... 10:03:28,228 INFO [STDOUT] INFO 16-02 10:03:28,228 - Table input - Finished reading query, closing connection. 10:03:28,229 INFO [STDOUT] INFO 16-02 10:03:28,229 - tsacommon - Connection to database closed! 10:03:28,229 INFO [STDOUT] INFO 16-02 10:03:28,229 - Table input - Finished processing (I=2, O=0, R=0, W=2, U=0, E=0) 10:03:28,247 INFO [STDOUT] INFO 16-02 10:03:28,247 - Copy rows to result - Finished processing (I=0, O=0, R=2, W=2, U=0, E=0) 10:03:28,257 INFO [STDOUT] INFO 16-02 10:03:28,256 - StageDataFromShards - Starting entry [StageDataFromShard] 10:03:28,257 INFO [STDOUT] INFO 16-02 10:03:28,257 - StageDataFromShards - exec(19, 0, StageDataFromShard.0) 10:03:28,257 INFO [STDOUT] INFO 16-02 10:03:28,257 - StageDataFromShard - Starting job entry 10:03:28,257 INFO [STDOUT] INFO 16-02 10:03:28,257 - StageDataFromShard - Loading job from repository : [/ : StageDataFromShard] 10:03:28,271 INFO [STDOUT] INFO 16-02 10:03:28,271 - StageDataFromShard - exec(20, 0, START.0) 10:03:28,271 INFO [STDOUT] INFO 16-02 10:03:28,271 - START - Starting job entry 10:03:28,273 INFO [STDOUT] INFO 16-02 10:03:28,272 - StageDataFromShard - Starting entry [SetShardConnectionVariables] 10:03:28,273 INFO [STDOUT] INFO 16-02 10:03:28,273 - StageDataFromShard - exec(21, 0, SetShardConnectionVariables.0) 10:03:28,273 INFO [STDOUT] INFO 16-02 10:03:28,273 - SetShardConnectionVariables - Starting job entry 10:03:28,273 INFO [STDOUT] INFO 16-02 10:03:28,273 - SetShardConnectionVariables - Opening transformation: [null] in directory [/] 10:03:28,273 INFO [STDOUT] INFO 16-02 10:03:28,273 - SetShardConnectionVariables - Loading transformation from repository [SetShardConnectionVariables] in directory [/] 10:03:28,289 INFO [STDOUT] INFO 16-02 10:03:28,289 - SetShardConnectionVariables - Starting transformation...(file=null, name=SetShardConnectionVariables, repinfo=null) 10:03:28,289 INFO [STDOUT] INFO 16-02 10:03:28,289 - SetShardConnectionVariables - Transformation is pre-loaded. 10:03:28,289 INFO [STDOUT] INFO 16-02 10:03:28,289 - SetShardConnectionVariables - Dispatching started for transformation [SetShardConnectionVariables] 10:03:28,289 INFO [STDOUT] INFO 16-02 10:03:28,289 - SetShardConnectionVariables - Nr of arguments detected:0 10:03:28,289 INFO [STDOUT] INFO 16-02 10:03:28,289 - SetShardConnectionVariables - This is not a replay transformation 10:03:28,290 INFO [STDOUT] INFO 16-02 10:03:28,290 - SetShardConnectionVariables - I found 2 different steps to launch. 10:03:28,290 INFO [STDOUT] INFO 16-02 10:03:28,290 - SetShardConnectionVariables - Allocating rowsets... 10:03:28,290 INFO [STDOUT] INFO 16-02 10:03:28,290 - SetShardConnectionVariables - Allocating rowsets for step 0 --> Get rows from result 10:03:28,290 INFO [STDOUT] INFO 16-02 10:03:28,290 - SetShardConnectionVariables - prevcopies = 1, nextcopies=1 10:03:28,290 INFO [STDOUT] INFO 16-02 10:03:28,290 - SetShardConnectionVariables - Transformation allocated new rowset [Get rows from result.0 - Set Variables.0] 10:03:28,290 INFO [STDOUT] INFO 16-02 10:03:28,290 - SetShardConnectionVariables - Allocated 1 rowsets for step 0 --> Get rows from result 10:03:28,290 INFO [STDOUT] INFO 16-02 10:03:28,290 - SetShardConnectionVariables - Allocating rowsets for step 1 --> Set Variables 10:03:28,290 INFO [STDOUT] INFO 16-02 10:03:28,290 - SetShardConnectionVariables - Allocated 1 rowsets for step 1 --> Set Variables 10:03:28,290 INFO [STDOUT] INFO 16-02 10:03:28,290 - SetShardConnectionVariables - Allocating Steps & StepData... 10:03:28,291 INFO [STDOUT] INFO 16-02 10:03:28,291 - SetShardConnectionVariables - Transformation is about to allocate step [Get rows from result] of type [RowsFromResult] 10:03:28,291 INFO [STDOUT] INFO 16-02 10:03:28,291 - Get rows from result - distribution activated 10:03:28,291 INFO [STDOUT] INFO 16-02 10:03:28,291 - Get rows from result - Starting allocation of buffers & new threads... 10:03:28,291 INFO [STDOUT] INFO 16-02 10:03:28,291 - Get rows from result - Step info: nrinput=0 nroutput=1 10:03:28,291 INFO [STDOUT] INFO 16-02 10:03:28,291 - Get rows from result - output rel. is 1:1 10:03:28,291 INFO [STDOUT] INFO 16-02 10:03:28,291 - Get rows from result - Found output rowset [Get rows from result.0 - Set Variables.0] 10:03:28,291 INFO [STDOUT] INFO 16-02 10:03:28,291 - Get rows from result - Finished dispatching 10:03:28,292 INFO [STDOUT] INFO 16-02 10:03:28,292 - SetShardConnectionVariables - Transformation has allocated a new step: [Get rows from result].0 10:03:28,292 INFO [STDOUT] INFO 16-02 10:03:28,292 - SetShardConnectionVariables - Transformation is about to allocate step [Set Variables] of type [SetVariable] 10:03:28,292 INFO [STDOUT] INFO 16-02 10:03:28,292 - Set Variables - distribution activated 10:03:28,292 INFO [STDOUT] INFO 16-02 10:03:28,292 - Set Variables - Starting allocation of buffers & new threads... 10:03:28,292 INFO [STDOUT] INFO 16-02 10:03:28,292 - Set Variables - Step info: nrinput=1 nroutput=0 10:03:28,292 INFO [STDOUT] INFO 16-02 10:03:28,292 - Set Variables - Got previous step from [Set Variables] #0 --> Get rows from result 10:03:28,292 INFO [STDOUT] INFO 16-02 10:03:28,292 - Set Variables - input rel is 1:1 10:03:28,292 INFO [STDOUT] INFO 16-02 10:03:28,292 - Set Variables - Found input rowset [Get rows from result.0 - Set Variables.0] 10:03:28,292 INFO [STDOUT] INFO 16-02 10:03:28,292 - Set Variables - Finished dispatching 10:03:28,293 INFO [STDOUT] INFO 16-02 10:03:28,293 - SetShardConnectionVariables - Transformation has allocated a new step: [Set Variables].0 10:03:28,293 INFO [STDOUT] INFO 16-02 10:03:28,293 - SetShardConnectionVariables - This transformation can be replayed with replay date: 2012/02/16 10:03:28 10:03:28,293 INFO [STDOUT] INFO 16-02 10:03:28,293 - SetShardConnectionVariables - Initialising 2 steps... 10:03:28,293 INFO [STDOUT] INFO 16-02 10:03:28,293 - Get rows from result - Running on slave server #0/1. 10:03:28,294 INFO [STDOUT] INFO 16-02 10:03:28,294 - Set Variables - Running on slave server #0/1. 10:03:28,294 INFO [STDOUT] INFO 16-02 10:03:28,294 - SetShardConnectionVariables - Step [Get rows from result.0] initialized flawlessly. 10:03:28,294 INFO [STDOUT] INFO 16-02 10:03:28,294 - SetShardConnectionVariables - Step [Set Variables.0] initialized flawlessly. 10:03:28,294 INFO [STDOUT] INFO 16-02 10:03:28,294 - Get rows from result - Starting to run... 10:03:28,295 INFO [STDOUT] INFO 16-02 10:03:28,295 - Get rows from result - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 10:03:28,295 INFO [STDOUT] INFO 16-02 10:03:28,295 - SetShardConnectionVariables - Transformation has allocated 2 threads and 1 rowsets. 10:03:28,295 INFO [STDOUT] INFO 16-02 10:03:28,295 - Set Variables - Starting to run... 10:03:28,295 INFO [STDOUT] INFO 16-02 10:03:28,295 - Set Variables - Setting environment variables... 10:03:28,295 INFO [STDOUT] INFO 16-02 10:03:28,295 - Set Variables - Set variable DATABASE to value [st-tracker] 10:03:28,296 INFO [STDOUT] INFO 16-02 10:03:28,296 - Set Variables - Set variable HOST to value [acctdb-01-write] 10:03:28,296 INFO [STDOUT] INFO 16-02 10:03:28,296 - Set Variables - Set variable PORT to value [3307] 10:03:28,311 INFO [STDOUT] INFO 16-02 10:03:28,311 - Set Variables - Finished after 1 rows. 10:03:28,311 INFO [STDOUT] INFO 16-02 10:03:28,311 - Set Variables - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 10:03:28,320 INFO [STDOUT] INFO 16-02 10:03:28,320 - StageDataFromShard - Starting entry [Write To Log] 10:03:28,320 INFO [STDOUT] INFO 16-02 10:03:28,320 - StageDataFromShard - exec(22, 0, Write To Log.0) 10:03:28,320 INFO [STDOUT] INFO 16-02 10:03:28,320 - Write To Log - Starting job entry 10:03:28,321 INFO [STDOUT] INFO 16-02 10:03:28,321 - connection: - st-tracker acctdb-01-write 3307 select ac.id, ac.accountID, ac.description, cast(substring_index(substring_index(ac.description, '_', 2), '_', -1) as signed) businessAreaID, cast(substring_index(substring_index(ac.description, '_', 3), '_', -1) as signed) businessLocationID from admaxCampaigns ac 10:03:28,321 INFO [STDOUT] INFO 16-02 10:03:28,321 - StageDataFromShard - Starting entry [StageDataForShard] 10:03:28,321 INFO [STDOUT] INFO 16-02 10:03:28,321 - StageDataFromShard - exec(23, 0, StageDataForShard.0) 10:03:28,322 INFO [STDOUT] INFO 16-02 10:03:28,322 - StageDataForShard - Starting job entry 10:03:28,322 INFO [STDOUT] INFO 16-02 10:03:28,322 - StageDataForShard - Opening transformation: [null] in directory [/] 10:03:28,322 INFO [STDOUT] INFO 16-02 10:03:28,322 - StageDataForShard - Loading transformation from repository [StageDataForShard] in directory [/] 10:03:28,340 INFO [STDOUT] INFO 16-02 10:03:28,340 - StageDataForShard - Starting transformation...(file=null, name=StageDataForShard, repinfo=null) 10:03:28,340 INFO [STDOUT] INFO 16-02 10:03:28,340 - StageDataForShard - Transformation is pre-loaded. 10:03:28,340 INFO [STDOUT] INFO 16-02 10:03:28,340 - StageDataForShard - Dispatching started for transformation [StageDataForShard] 10:03:28,340 INFO [STDOUT] INFO 16-02 10:03:28,340 - StageDataForShard - Nr of arguments detected:0 10:03:28,341 INFO [STDOUT] INFO 16-02 10:03:28,341 - StageDataForShard - This is not a replay transformation 10:03:28,341 INFO [STDOUT] INFO 16-02 10:03:28,341 - StageDataForShard - I found 3 different steps to launch. 10:03:28,341 INFO [STDOUT] INFO 16-02 10:03:28,341 - StageDataForShard - Allocating rowsets... 10:03:28,341 INFO [STDOUT] INFO 16-02 10:03:28,341 - StageDataForShard - Allocating rowsets for step 0 --> Write to log 10:03:28,341 INFO [STDOUT] INFO 16-02 10:03:28,341 - StageDataForShard - prevcopies = 1, nextcopies=1 10:03:28,341 INFO [STDOUT] INFO 16-02 10:03:28,341 - StageDataForShard - Transformation allocated new rowset [Write to log.0 - Table input.0] 10:03:28,341 INFO [STDOUT] INFO 16-02 10:03:28,341 - StageDataForShard - Allocated 1 rowsets for step 0 --> Write to log 10:03:28,341 INFO [STDOUT] INFO 16-02 10:03:28,341 - StageDataForShard - Allocating rowsets for step 1 --> Table input 10:03:28,342 INFO [STDOUT] INFO 16-02 10:03:28,341 - StageDataForShard - prevcopies = 1, nextcopies=1 10:03:28,342 INFO [STDOUT] INFO 16-02 10:03:28,342 - StageDataForShard - Transformation allocated new rowset [Table input.0 - Table output.0] 10:03:28,342 INFO [STDOUT] INFO 16-02 10:03:28,342 - StageDataForShard - Allocated 2 rowsets for step 1 --> Table input 10:03:28,342 INFO [STDOUT] INFO 16-02 10:03:28,342 - StageDataForShard - Allocating rowsets for step 2 --> Table output 10:03:28,342 INFO [STDOUT] INFO 16-02 10:03:28,342 - StageDataForShard - Allocated 2 rowsets for step 2 --> Table output 10:03:28,342 INFO [STDOUT] INFO 16-02 10:03:28,342 - StageDataForShard - Allocating Steps & StepData... 10:03:28,342 INFO [STDOUT] INFO 16-02 10:03:28,342 - StageDataForShard - Transformation is about to allocate step [Write to log] of type [WriteToLog] 10:03:28,342 INFO [STDOUT] INFO 16-02 10:03:28,342 - Write to log - distribution activated 10:03:28,343 INFO [STDOUT] INFO 16-02 10:03:28,343 - Write to log - Starting allocation of buffers & new threads... 10:03:28,343 INFO [STDOUT] INFO 16-02 10:03:28,343 - Write to log - Step info: nrinput=0 nroutput=1 10:03:28,343 INFO [STDOUT] INFO 16-02 10:03:28,343 - Write to log - output rel. is 1:1 10:03:28,343 INFO [STDOUT] INFO 16-02 10:03:28,343 - Write to log - Found output rowset [Write to log.0 - Table input.0] 10:03:28,343 INFO [STDOUT] INFO 16-02 10:03:28,343 - Write to log - Finished dispatching 10:03:28,343 INFO [STDOUT] INFO 16-02 10:03:28,343 - StageDataForShard - Transformation has allocated a new step: [Write to log].0 10:03:28,343 INFO [STDOUT] INFO 16-02 10:03:28,343 - StageDataForShard - Transformation is about to allocate step [Table input] of type [TableInput] 10:03:28,344 INFO [STDOUT] INFO 16-02 10:03:28,343 - Table input - Starting allocation of buffers & new threads... 10:03:28,344 INFO [STDOUT] INFO 16-02 10:03:28,344 - Table input - Step info: nrinput=1 nroutput=1 10:03:28,344 INFO [STDOUT] INFO 16-02 10:03:28,344 - Table input - Got previous step from [Table input] #0 --> Write to log 10:03:28,344 INFO [STDOUT] INFO 16-02 10:03:28,344 - Table input - input rel is 1:1 10:03:28,344 INFO [STDOUT] INFO 16-02 10:03:28,344 - Table input - Found input rowset [Write to log.0 - Table input.0] 10:03:28,344 INFO [STDOUT] INFO 16-02 10:03:28,344 - Table input - output rel. is 1:1 10:03:28,344 INFO [STDOUT] INFO 16-02 10:03:28,344 - Table input - Found output rowset [Table input.0 - Table output.0] 10:03:28,344 INFO [STDOUT] INFO 16-02 10:03:28,344 - Table input - Finished dispatching 10:03:28,344 INFO [STDOUT] INFO 16-02 10:03:28,344 - StageDataForShard - Transformation has allocated a new step: [Table input].0 10:03:28,345 INFO [STDOUT] INFO 16-02 10:03:28,344 - StageDataForShard - Transformation is about to allocate step [Table output] of type [TableOutput] 10:03:28,345 INFO [STDOUT] INFO 16-02 10:03:28,345 - Table output - distribution activated 10:03:28,345 INFO [STDOUT] INFO 16-02 10:03:28,345 - Table output - Starting allocation of buffers & new threads... 10:03:28,345 INFO [STDOUT] INFO 16-02 10:03:28,345 - Table output - Step info: nrinput=1 nroutput=0 10:03:28,345 INFO [STDOUT] INFO 16-02 10:03:28,345 - Table output - Got previous step from [Table output] #0 --> Table input 10:03:28,345 INFO [STDOUT] INFO 16-02 10:03:28,345 - Table output - input rel is 1:1 10:03:28,345 INFO [STDOUT] INFO 16-02 10:03:28,345 - Table output - Found input rowset [Table input.0 - Table output.0] 10:03:28,345 INFO [STDOUT] INFO 16-02 10:03:28,345 - Table output - Finished dispatching 10:03:28,346 INFO [STDOUT] INFO 16-02 10:03:28,346 - StageDataForShard - Transformation has allocated a new step: [Table output].0 10:03:28,346 INFO [STDOUT] INFO 16-02 10:03:28,346 - StageDataForShard - This transformation can be replayed with replay date: 2012/02/16 10:03:28 10:03:28,346 INFO [STDOUT] INFO 16-02 10:03:28,346 - StageDataForShard - Initialising 3 steps... 10:03:28,346 INFO [STDOUT] INFO 16-02 10:03:28,346 - Write to log - Running on slave server #0/1. 10:03:28,347 INFO [STDOUT] INFO 16-02 10:03:28,347 - Table input - Running on slave server #0/1. 10:03:28,351 INFO [STDOUT] INFO 16-02 10:03:28,351 - Table output - Running on slave server #0/1. 10:03:28,352 INFO [STDOUT] INFO 16-02 10:03:28,352 - pdi_staging - New database connection defined 10:03:28,352 INFO [STDOUT] INFO 16-02 10:03:28,352 - Shard - New database connection defined 10:03:28,361 INFO [STDOUT] INFO 16-02 10:03:28,361 - pdi_staging - Connected to database. 10:03:28,362 INFO [STDOUT] INFO 16-02 10:03:28,361 - Table output - Connected to database [pdi_staging] (commit=10000) 10:03:28,362 INFO [STDOUT] INFO 16-02 10:03:28,362 - pdi_staging - Auto commit off 10:03:28,374 INFO [STDOUT] INFO 16-02 10:03:28,374 - Shard - Connected to database. 10:03:28,374 INFO [STDOUT] INFO 16-02 10:03:28,374 - Shard - Auto commit off 10:03:28,374 INFO [STDOUT] INFO 16-02 10:03:28,374 - Table input - Connected to database... 10:03:28,375 INFO [STDOUT] INFO 16-02 10:03:28,375 - StageDataForShard - Step [Write to log.0] initialized flawlessly. 10:03:28,375 INFO [STDOUT] INFO 16-02 10:03:28,375 - StageDataForShard - Step [Table input.0] initialized flawlessly. 10:03:28,375 INFO [STDOUT] INFO 16-02 10:03:28,375 - StageDataForShard - Step [Table output.0] initialized flawlessly. 10:03:28,375 INFO [STDOUT] INFO 16-02 10:03:28,375 - Write to log - Starting to run... 10:03:28,376 INFO [STDOUT] INFO 16-02 10:03:28,376 - Write to log - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0) 10:03:28,376 INFO [STDOUT] INFO 16-02 10:03:28,376 - Table input - Starting to run... 10:03:28,376 INFO [STDOUT] INFO 16-02 10:03:28,376 - Table input - SQL query : select ac.id, ac.accountID, ac.description, cast(substring_index(substring_index(ac.description, '_', 2), '_', -1) as signed) businessAreaID, cast(substring_index(substring_index(ac.description, '_', 3), '_', -1) as signed) businessLocationID from admaxCampaigns ac 10:03:28,376 INFO [STDOUT] INFO 16-02 10:03:28,376 - StageDataForShard - Transformation has allocated 3 threads and 2 rowsets. 10:03:28,377 INFO [STDOUT] INFO 16-02 10:03:28,377 - Table output - Starting to run... 10:03:28,379 INFO [STDOUT] INFO 16-02 10:03:28,379 - Table input - Finished reading query, closing connection. 10:03:28,380 INFO [STDOUT] INFO 16-02 10:03:28,380 - Shard - Connection to database closed! 10:03:28,380 INFO [STDOUT] INFO 16-02 10:03:28,380 - Table input - Finished processing (I=10, O=0, R=0, W=10, U=0, E=0) 10:03:28,383 INFO [STDOUT] INFO 16-02 10:03:28,383 - Table output - Prepared statement : INSERT INTO dfStructureAdMaxCampaigns (id, accountID, description, businessAreaID, businessLocationID) VALUES ( ?, ?, ?, ?, ?) 10:03:28,402 INFO [STDOUT] INFO 16-02 10:03:28,402 - pdi_staging - Connection to database closed! 10:03:28,402 INFO [STDOUT] INFO 16-02 10:03:28,402 - Table output - Finished processing (I=0, O=10, R=10, W=10, U=0, E=0) 10:03:28,408 INFO [STDOUT] INFO 16-02 10:03:28,408 - StageDataFromShard - Finished job entry [StageDataForShard] (result=[true]) 10:03:28,408 INFO [STDOUT] INFO 16-02 10:03:28,408 - StageDataFromShard - Finished job entry [Write To Log] (result=[true]) 10:03:28,408 INFO [STDOUT] INFO 16-02 10:03:28,408 - StageDataFromShard - Finished job entry [SetShardConnectionVariables] (result=[true]) 10:03:28,415 INFO [STDOUT] INFO 16-02 10:03:28,415 - StageDataFromShard - exec(20, 0, START.0) 10:03:28,416 INFO [STDOUT] INFO 16-02 10:03:28,416 - START - Starting job entry 10:03:28,417 INFO [STDOUT] INFO 16-02 10:03:28,416 - StageDataFromShard - Starting entry [SetShardConnectionVariables] 10:03:28,417 INFO [STDOUT] INFO 16-02 10:03:28,417 - StageDataFromShard - exec(21, 0, SetShardConnectionVariables.0) 10:03:28,417 INFO [STDOUT] INFO 16-02 10:03:28,417 - SetShardConnectionVariables - Starting job entry 10:03:28,417 INFO [STDOUT] INFO 16-02 10:03:28,417 - SetShardConnectionVariables - Opening transformation: [null] in directory [/] 10:03:28,417 INFO [STDOUT] INFO 16-02 10:03:28,417 - SetShardConnectionVariables - Loading transformation from repository [SetShardConnectionVariables] in directory [/] 10:03:28,436 INFO [STDOUT] INFO 16-02 10:03:28,436 - SetShardConnectionVariables - Starting transformation...(file=null, name=SetShardConnectionVariables, repinfo=null) 10:03:28,436 INFO [STDOUT] INFO 16-02 10:03:28,436 - SetShardConnectionVariables - Transformation is pre-loaded. 10:03:28,437 INFO [STDOUT] INFO 16-02 10:03:28,437 - SetShardConnectionVariables - Dispatching started for transformation [SetShardConnectionVariables] 10:03:28,437 INFO [STDOUT] INFO 16-02 10:03:28,437 - SetShardConnectionVariables - Nr of arguments detected:0 10:03:28,437 INFO [STDOUT] INFO 16-02 10:03:28,437 - SetShardConnectionVariables - This is not a replay transformation 10:03:28,437 INFO [STDOUT] INFO 16-02 10:03:28,437 - SetShardConnectionVariables - I found 2 different steps to launch. 10:03:28,437 INFO [STDOUT] INFO 16-02 10:03:28,437 - SetShardConnectionVariables - Allocating rowsets... 10:03:28,437 INFO [STDOUT] INFO 16-02 10:03:28,437 - SetShardConnectionVariables - Allocating rowsets for step 0 --> Get rows from result 10:03:28,438 INFO [STDOUT] INFO 16-02 10:03:28,437 - SetShardConnectionVariables - prevcopies = 1, nextcopies=1 10:03:28,438 INFO [STDOUT] INFO 16-02 10:03:28,438 - SetShardConnectionVariables - Transformation allocated new rowset [Get rows from result.0 - Set Variables.0] 10:03:28,438 INFO [STDOUT] INFO 16-02 10:03:28,438 - SetShardConnectionVariables - Allocated 1 rowsets for step 0 --> Get rows from result 10:03:28,438 INFO [STDOUT] INFO 16-02 10:03:28,438 - SetShardConnectionVariables - Allocating rowsets for step 1 --> Set Variables 10:03:28,438 INFO [STDOUT] INFO 16-02 10:03:28,438 - SetShardConnectionVariables - Allocated 1 rowsets for step 1 --> Set Variables 10:03:28,438 INFO [STDOUT] INFO 16-02 10:03:28,438 - SetShardConnectionVariables - Allocating Steps & StepData... 10:03:28,438 INFO [STDOUT] INFO 16-02 10:03:28,438 - SetShardConnectionVariables - Transformation is about to allocate step [Get rows from result] of type [RowsFromResult] 10:03:28,439 INFO [STDOUT] INFO 16-02 10:03:28,438 - Get rows from result - distribution activated 10:03:28,439 INFO [STDOUT] INFO 16-02 10:03:28,439 - Get rows from result - Starting allocation of buffers & new threads... 10:03:28,439 INFO [STDOUT] INFO 16-02 10:03:28,439 - Get rows from result - Step info: nrinput=0 nroutput=1 10:03:28,439 INFO [STDOUT] INFO 16-02 10:03:28,439 - Get rows from result - output rel. is 1:1 10:03:28,439 INFO [STDOUT] INFO 16-02 10:03:28,439 - Get rows from result - Found output rowset [Get rows from result.0 - Set Variables.0] 10:03:28,439 INFO [STDOUT] INFO 16-02 10:03:28,439 - Get rows from result - Finished dispatching 10:03:28,439 INFO [STDOUT] INFO 16-02 10:03:28,439 - SetShardConnectionVariables - Transformation has allocated a new step: [Get rows from result].0 10:03:28,439 INFO [STDOUT] INFO 16-02 10:03:28,439 - SetShardConnectionVariables - Transformation is about to allocate step [Set Variables] of type [SetVariable] 10:03:28,440 INFO [STDOUT] INFO 16-02 10:03:28,440 - Set Variables - distribution activated 10:03:28,440 INFO [STDOUT] INFO 16-02 10:03:28,440 - Set Variables - Starting allocation of buffers & new threads... 10:03:28,440 INFO [STDOUT] INFO 16-02 10:03:28,440 - Set Variables - Step info: nrinput=1 nroutput=0 10:03:28,440 INFO [STDOUT] INFO 16-02 10:03:28,440 - Set Variables - Got previous step from [Set Variables] #0 --> Get rows from result 10:03:28,440 INFO [STDOUT] INFO 16-02 10:03:28,440 - Set Variables - input rel is 1:1 10:03:28,440 INFO [STDOUT] INFO 16-02 10:03:28,440 - Set Variables - Found input rowset [Get rows from result.0 - Set Variables.0] 10:03:28,440 INFO [STDOUT] INFO 16-02 10:03:28,440 - Set Variables - Finished dispatching 10:03:28,441 INFO [STDOUT] INFO 16-02 10:03:28,440 - SetShardConnectionVariables - Transformation has allocated a new step: [Set Variables].0 10:03:28,441 INFO [STDOUT] INFO 16-02 10:03:28,441 - SetShardConnectionVariables - This transformation can be replayed with replay date: 2012/02/16 10:03:28 10:03:28,441 INFO [STDOUT] INFO 16-02 10:03:28,441 - SetShardConnectionVariables - Initialising 2 steps... 10:03:28,441 INFO [STDOUT] INFO 16-02 10:03:28,441 - Get rows from result - Running on slave server #0/1. 10:03:28,442 INFO [STDOUT] INFO 16-02 10:03:28,442 - Set Variables - Running on slave server #0/1. 10:03:28,442 INFO [STDOUT] INFO 16-02 10:03:28,442 - SetShardConnectionVariables - Step [Get rows from result.0] initialized flawlessly. 10:03:28,442 INFO [STDOUT] INFO 16-02 10:03:28,442 - SetShardConnectionVariables - Step [Set Variables.0] initialized flawlessly. 10:03:28,442 INFO [STDOUT] INFO 16-02 10:03:28,442 - Get rows from result - Starting to run... 10:03:28,443 INFO [STDOUT] INFO 16-02 10:03:28,443 - Get rows from result - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 10:03:28,443 INFO [STDOUT] INFO 16-02 10:03:28,443 - SetShardConnectionVariables - Transformation has allocated 2 threads and 1 rowsets. 10:03:28,443 INFO [STDOUT] INFO 16-02 10:03:28,443 - Set Variables - Starting to run... 10:03:28,443 INFO [STDOUT] INFO 16-02 10:03:28,443 - Set Variables - Setting environment variables... 10:03:28,443 INFO [STDOUT] INFO 16-02 10:03:28,443 - Set Variables - Set variable DATABASE to value [st-tracker] 10:03:28,444 INFO [STDOUT] INFO 16-02 10:03:28,443 - Set Variables - Set variable HOST to value [acctdb-02-write] 10:03:28,444 INFO [STDOUT] INFO 16-02 10:03:28,444 - Set Variables - Set variable PORT to value [3310] 10:03:28,459 INFO [STDOUT] INFO 16-02 10:03:28,459 - Set Variables - Finished after 1 rows. 10:03:28,459 INFO [STDOUT] INFO 16-02 10:03:28,459 - Set Variables - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 10:03:28,468 INFO [STDOUT] INFO 16-02 10:03:28,468 - StageDataFromShard - Starting entry [Write To Log] 10:03:28,468 INFO [STDOUT] INFO 16-02 10:03:28,468 - StageDataFromShard - exec(22, 0, Write To Log.0) 10:03:28,468 INFO [STDOUT] INFO 16-02 10:03:28,468 - Write To Log - Starting job entry 10:03:28,468 INFO [STDOUT] INFO 16-02 10:03:28,468 - connection: - st-tracker acctdb-02-write 3310 select ac.id, ac.accountID, ac.description, cast(substring_index(substring_index(ac.description, '_', 2), '_', -1) as signed) businessAreaID, cast(substring_index(substring_index(ac.description, '_', 3), '_', -1) as signed) businessLocationID from admaxCampaigns ac 10:03:28,469 INFO [STDOUT] INFO 16-02 10:03:28,469 - StageDataFromShard - Starting entry [StageDataForShard] 10:03:28,469 INFO [STDOUT] INFO 16-02 10:03:28,469 - StageDataFromShard - exec(23, 0, StageDataForShard.0) 10:03:28,470 INFO [STDOUT] INFO 16-02 10:03:28,470 - StageDataForShard - Starting job entry 10:03:28,470 INFO [STDOUT] INFO 16-02 10:03:28,470 - StageDataForShard - Opening transformation: [null] in directory [/] 10:03:28,470 INFO [STDOUT] INFO 16-02 10:03:28,470 - StageDataForShard - Loading transformation from repository [StageDataForShard] in directory [/] 10:03:28,491 INFO [STDOUT] INFO 16-02 10:03:28,490 - StageDataForShard - Starting transformation...(file=null, name=StageDataForShard, repinfo=null) 10:03:28,491 INFO [STDOUT] INFO 16-02 10:03:28,491 - StageDataForShard - Transformation is pre-loaded. 10:03:28,491 INFO [STDOUT] INFO 16-02 10:03:28,491 - StageDataForShard - Dispatching started for transformation [StageDataForShard] 10:03:28,491 INFO [STDOUT] INFO 16-02 10:03:28,491 - StageDataForShard - Nr of arguments detected:0 10:03:28,491 INFO [STDOUT] INFO 16-02 10:03:28,491 - StageDataForShard - This is not a replay transformation 10:03:28,491 INFO [STDOUT] INFO 16-02 10:03:28,491 - StageDataForShard - I found 3 different steps to launch. 10:03:28,491 INFO [STDOUT] INFO 16-02 10:03:28,491 - StageDataForShard - Allocating rowsets... 10:03:28,492 INFO [STDOUT] INFO 16-02 10:03:28,491 - StageDataForShard - Allocating rowsets for step 0 --> Write to log 10:03:28,492 INFO [STDOUT] INFO 16-02 10:03:28,492 - StageDataForShard - prevcopies = 1, nextcopies=1 10:03:28,492 INFO [STDOUT] INFO 16-02 10:03:28,492 - StageDataForShard - Transformation allocated new rowset [Write to log.0 - Table input.0] 10:03:28,492 INFO [STDOUT] INFO 16-02 10:03:28,492 - StageDataForShard - Allocated 1 rowsets for step 0 --> Write to log 10:03:28,492 INFO [STDOUT] INFO 16-02 10:03:28,492 - StageDataForShard - Allocating rowsets for step 1 --> Table input 10:03:28,492 INFO [STDOUT] INFO 16-02 10:03:28,492 - StageDataForShard - prevcopies = 1, nextcopies=1 10:03:28,492 INFO [STDOUT] INFO 16-02 10:03:28,492 - StageDataForShard - Transformation allocated new rowset [Table input.0 - Table output.0] 10:03:28,493 INFO [STDOUT] INFO 16-02 10:03:28,492 - StageDataForShard - Allocated 2 rowsets for step 1 --> Table input 10:03:28,493 INFO [STDOUT] INFO 16-02 10:03:28,493 - StageDataForShard - Allocating rowsets for step 2 --> Table output 10:03:28,493 INFO [STDOUT] INFO 16-02 10:03:28,493 - StageDataForShard - Allocated 2 rowsets for step 2 --> Table output 10:03:28,493 INFO [STDOUT] INFO 16-02 10:03:28,493 - StageDataForShard - Allocating Steps & StepData... 10:03:28,493 INFO [STDOUT] INFO 16-02 10:03:28,493 - StageDataForShard - Transformation is about to allocate step [Write to log] of type [WriteToLog] 10:03:28,493 INFO [STDOUT] INFO 16-02 10:03:28,493 - Write to log - distribution activated 10:03:28,494 INFO [STDOUT] INFO 16-02 10:03:28,493 - Write to log - Starting allocation of buffers & new threads... 10:03:28,494 INFO [STDOUT] INFO 16-02 10:03:28,494 - Write to log - Step info: nrinput=0 nroutput=1 10:03:28,494 INFO [STDOUT] INFO 16-02 10:03:28,494 - Write to log - output rel. is 1:1 10:03:28,494 INFO [STDOUT] INFO 16-02 10:03:28,494 - Write to log - Found output rowset [Write to log.0 - Table input.0] 10:03:28,494 INFO [STDOUT] INFO 16-02 10:03:28,494 - Write to log - Finished dispatching 10:03:28,494 INFO [STDOUT] INFO 16-02 10:03:28,494 - StageDataForShard - Transformation has allocated a new step: [Write to log].0 10:03:28,494 INFO [STDOUT] INFO 16-02 10:03:28,494 - StageDataForShard - Transformation is about to allocate step [Table input] of type [TableInput] 10:03:28,495 INFO [STDOUT] INFO 16-02 10:03:28,495 - Table input - Starting allocation of buffers & new threads... 10:03:28,495 INFO [STDOUT] INFO 16-02 10:03:28,495 - Table input - Step info: nrinput=1 nroutput=1 10:03:28,495 INFO [STDOUT] INFO 16-02 10:03:28,495 - Table input - Got previous step from [Table input] #0 --> Write to log 10:03:28,495 INFO [STDOUT] INFO 16-02 10:03:28,495 - Table input - input rel is 1:1 10:03:28,495 INFO [STDOUT] INFO 16-02 10:03:28,495 - Table input - Found input rowset [Write to log.0 - Table input.0] 10:03:28,495 INFO [STDOUT] INFO 16-02 10:03:28,495 - Table input - output rel. is 1:1 10:03:28,495 INFO [STDOUT] INFO 16-02 10:03:28,495 - Table input - Found output rowset [Table input.0 - Table output.0] 10:03:28,495 INFO [STDOUT] INFO 16-02 10:03:28,495 - Table input - Finished dispatching 10:03:28,496 INFO [STDOUT] INFO 16-02 10:03:28,496 - StageDataForShard - Transformation has allocated a new step: [Table input].0 10:03:28,496 INFO [STDOUT] INFO 16-02 10:03:28,496 - StageDataForShard - Transformation is about to allocate step [Table output] of type [TableOutput] 10:03:28,496 INFO [STDOUT] INFO 16-02 10:03:28,496 - Table output - distribution activated 10:03:28,496 INFO [STDOUT] INFO 16-02 10:03:28,496 - Table output - Starting allocation of buffers & new threads... 10:03:28,496 INFO [STDOUT] INFO 16-02 10:03:28,496 - Table output - Step info: nrinput=1 nroutput=0 10:03:28,496 INFO [STDOUT] INFO 16-02 10:03:28,496 - Table output - Got previous step from [Table output] #0 --> Table input 10:03:28,496 INFO [STDOUT] INFO 16-02 10:03:28,496 - Table output - input rel is 1:1 10:03:28,496 INFO [STDOUT] INFO 16-02 10:03:28,496 - Table output - Found input rowset [Table input.0 - Table output.0] 10:03:28,497 INFO [STDOUT] INFO 16-02 10:03:28,497 - Table output - Finished dispatching 10:03:28,497 INFO [STDOUT] INFO 16-02 10:03:28,497 - StageDataForShard - Transformation has allocated a new step: [Table output].0 10:03:28,497 INFO [STDOUT] INFO 16-02 10:03:28,497 - StageDataForShard - This transformation can be replayed with replay date: 2012/02/16 10:03:28 10:03:28,497 INFO [STDOUT] INFO 16-02 10:03:28,497 - StageDataForShard - Initialising 3 steps... 10:03:28,498 INFO [STDOUT] INFO 16-02 10:03:28,497 - Write to log - Running on slave server #0/1. 10:03:28,498 INFO [STDOUT] INFO 16-02 10:03:28,498 - Table input - Running on slave server #0/1. 10:03:28,499 INFO [STDOUT] INFO 16-02 10:03:28,499 - Shard - New database connection defined 10:03:28,502 INFO [STDOUT] INFO 16-02 10:03:28,502 - Table output - Running on slave server #0/1. 10:03:28,502 INFO [STDOUT] INFO 16-02 10:03:28,502 - pdi_staging - New database connection defined 10:03:28,511 INFO [STDOUT] INFO 16-02 10:03:28,511 - pdi_staging - Connected to database. 10:03:28,511 INFO [STDOUT] INFO 16-02 10:03:28,511 - Table output - Connected to database [pdi_staging] (commit=10000) 10:03:28,511 INFO [STDOUT] INFO 16-02 10:03:28,511 - pdi_staging - Auto commit off 10:03:28,514 INFO [STDOUT] INFO 16-02 10:03:28,514 - Shard - Connected to database. 10:03:28,515 INFO [STDOUT] INFO 16-02 10:03:28,515 - Shard - Auto commit off 10:03:28,515 INFO [STDOUT] INFO 16-02 10:03:28,515 - Table input - Connected to database... 10:03:28,515 INFO [STDOUT] INFO 16-02 10:03:28,515 - StageDataForShard - Step [Write to log.0] initialized flawlessly. 10:03:28,515 INFO [STDOUT] INFO 16-02 10:03:28,515 - StageDataForShard - Step [Table input.0] initialized flawlessly. 10:03:28,523 INFO [STDOUT] INFO 16-02 10:03:28,515 - StageDataForShard - Step [Table output.0] initialized flawlessly. 10:03:28,523 INFO [STDOUT] INFO 16-02 10:03:28,523 - Write to log - Starting to run... 10:03:28,524 INFO [STDOUT] INFO 16-02 10:03:28,524 - Write to log - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0) 10:03:28,524 INFO [STDOUT] INFO 16-02 10:03:28,524 - Table input - Starting to run... 10:03:28,524 INFO [STDOUT] INFO 16-02 10:03:28,524 - Table input - SQL query : select ac.id, ac.accountID, ac.description, cast(substring_index(substring_index(ac.description, '_', 2), '_', -1) as signed) businessAreaID, cast(substring_index(substring_index(ac.description, '_', 3), '_', -1) as signed) businessLocationID from admaxCampaigns ac 10:03:28,525 INFO [STDOUT] INFO 16-02 10:03:28,524 - StageDataForShard - Transformation has allocated 3 threads and 2 rowsets. 10:03:28,525 INFO [STDOUT] INFO 16-02 10:03:28,525 - Table output - Starting to run... 10:03:28,527 INFO [STDOUT] INFO 16-02 10:03:28,527 - Table input - Finished reading query, closing connection. 10:03:28,528 INFO [STDOUT] INFO 16-02 10:03:28,528 - Shard - Connection to database closed! 10:03:28,528 INFO [STDOUT] INFO 16-02 10:03:28,528 - Table input - Finished processing (I=11, O=0, R=0, W=11, U=0, E=0) 10:03:28,531 INFO [STDOUT] INFO 16-02 10:03:28,531 - Table output - Prepared statement : INSERT INTO dfStructureAdMaxCampaigns (id, accountID, description, businessAreaID, businessLocationID) VALUES ( ?, ?, ?, ?, ?) 10:03:28,550 INFO [STDOUT] ERROR 16-02 10:03:28,550 - Table output - Unexpected batch update error committing the database connection. 10:03:28,550 INFO [STDOUT] ERROR 16-02 10:03:28,550 - Table output - org.pentaho.di.core.exception.KettleDatabaseBatchException: Error updating batch Duplicate entry '10' for key 'PRIMARY' at org.pentaho.di.core.database.Database.emptyAndCommit(Database.java:1494) at org.pentaho.di.trans.steps.tableoutput.TableOutput.dispose(TableOutput.java:647) at org.pentaho.di.trans.step.RunThread.run(RunThread.java:69) at java.lang.Thread.run(Thread.java:662) Caused by: java.sql.BatchUpdateException: Duplicate entry '10' for key 'PRIMARY' at com.mysql.jdbc.ServerPreparedStatement.executeBatchSerially(ServerPreparedStatement.java:796) at com.mysql.jdbc.PreparedStatement.executeBatch(PreparedStatement.java:1449) at org.pentaho.di.core.database.Database.emptyAndCommit(Database.java:1477) ... 3 more 10:03:28,551 INFO [STDOUT] INFO 16-02 10:03:28,551 - pdi_staging - Connection to database closed! 10:03:28,552 INFO [STDOUT] INFO 16-02 10:03:28,552 - Table output - Finished processing (I=0, O=0, R=11, W=0, U=0, E=1) 10:03:28,552 INFO [STDOUT] INFO 16-02 10:03:28,552 - StageDataForShard - StageDataForShard 10:03:28,552 INFO [STDOUT] INFO 16-02 10:03:28,552 - StageDataForShard - StageDataForShard 10:03:28,555 INFO [STDOUT] ERROR 16-02 10:03:28,555 - StageDataForShard - Errors detected! 10:03:28,557 INFO [STDOUT] INFO 16-02 10:03:28,557 - StageDataFromShard - Finished job entry [StageDataForShard] (result=[false]) 10:03:28,557 INFO [STDOUT] INFO 16-02 10:03:28,557 - StageDataFromShard - Finished job entry [Write To Log] (result=[false]) 10:03:28,557 INFO [STDOUT] INFO 16-02 10:03:28,557 - StageDataFromShard - Finished job entry [SetShardConnectionVariables] (result=[false]) 10:03:28,564 INFO [STDOUT] INFO 16-02 10:03:28,564 - StageDataFromShards - Finished job entry [StageDataFromShard] (result=[false]) 10:03:28,564 INFO [STDOUT] INFO 16-02 10:03:28,564 - StageDataFromShards - Finished job entry [SelectShards] (result=[false]) 10:03:28,564 INFO [STDOUT] INFO 16-02 10:03:28,564 - StageDataFromShards - Finished job entry [Write To Log] (result=[false]) 10:03:28,572 INFO [STDOUT] INFO 16-02 10:03:28,572 - StageRequirement - Finished job entry [StageDataFromShards] (result=[false]) 10:03:28,572 INFO [STDOUT] INFO 16-02 10:03:28,572 - StageRequirement - Finished job entry [Simple evaluation 2] (result=[false]) 10:03:28,572 INFO [STDOUT] INFO 16-02 10:03:28,572 - StageRequirement - Finished job entry [Simple evaluation] (result=[false]) 10:03:28,572 INFO [STDOUT] INFO 16-02 10:03:28,572 - StageRequirement - Finished job entry [TruncateStagingTable] (result=[false]) 10:03:28,572 INFO [STDOUT] INFO 16-02 10:03:28,572 - StageRequirement - Finished job entry [SetRequirementStagingVariables] (result=[false]) 10:03:28,580 INFO [STDOUT] INFO 16-02 10:03:28,580 - StageRequirements - Finished job entry [StageRequirement] (result=[false]) 10:03:28,580 INFO [STDOUT] INFO 16-02 10:03:28,580 - StageRequirements - Finished job entry [SelectRequirements] (result=[false]) 10:03:28,580 INFO [STDOUT] INFO 16-02 10:03:28,580 - StageRequirements - Finished job entry [Write To Log] (result=[false]) 10:03:28,581 INFO [STDOUT] INFO 16-02 10:03:28,581 - ProcessDatafeeds - Finished job entry [StageRequirements] (result=[false]) 10:03:28,581 INFO [STDOUT] INFO 16-02 10:03:28,581 - ProcessDatafeeds - Finished job entry [SetDatafeedVariables] (result=[false]) 10:03:28,581 INFO [STDOUT] INFO 16-02 10:03:28,581 - ProcessDatafeeds - Finished job entry [GetDatafeeds] (result=[false]) 10:03:28,588 INFO [STDOUT] INFO 16-02 10:03:28,587 - Job 1 - Finished job entry [ProcessDatafeeds] (result=[false]) 10:03:28,588 INFO [STDOUT] INFO 16-02 10:03:28,588 - Job 1 - Job execution finished 10:03:28,588 INFO [PentahoEngine] Job Start [2012/02/16 10:03:26.964] , Job Stop [2012/02/16 10:03:28.588] 10:03:28,588 ERROR [PentahoEngine] There were errors during Job execution. For Job : Job 1 10:03:28,588 ERROR [InvocationHandlerJAXWS] Method invocation failed with exception: null java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.jboss.wsf.common.invocation.AbstractInvocationHandlerJSE.invoke(AbstractInvocationHandlerJSE.java:129) at org.jboss.wsf.stack.cxf.AbstractInvoker._invokeInternal(AbstractInvoker.java:164) at org.jboss.wsf.stack.cxf.AbstractInvoker.invoke(AbstractInvoker.java:112) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:58) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at org.apache.cxf.workqueue.SynchronousExecutor.execute(SynchronousExecutor.java:37) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:106) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:255) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:113) at org.apache.cxf.transport.servlet.ServletDestination.invoke(ServletDestination.java:97) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:461) at org.jboss.wsf.stack.cxf.ServletControllerExt.invoke(ServletControllerExt.java:172) at org.jboss.wsf.stack.cxf.RequestHandlerImpl.handleHttpRequest(RequestHandlerImpl.java:57) at org.jboss.wsf.stack.cxf.transport.ServletHelper.callRequestHandler(ServletHelper.java:162) at org.jboss.wsf.stack.cxf.CXFServletExt.invoke(CXFServletExt.java:90) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:179) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doPost(AbstractHTTPServlet.java:103) at javax.servlet.http.HttpServlet.service(HttpServlet.java:637) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:159) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:235) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:190) at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:92) at org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.process(SecurityContextEstablishmentValve.java:126) at org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.invoke(SecurityContextEstablishmentValve.java:70) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.jboss.web.tomcat.service.jca.CachedConnectionValve.invoke(CachedConnectionValve.java:158) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:330) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:829) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:598) at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447) at java.lang.Thread.run(Thread.java:662) Caused by: java.lang.RuntimeException: There were errors during Job execution. at com.thesearchagency.smb.common.pentaho.PentahoEngine.executeJob(PentahoEngine.java:121) at com.thesearchagency.smb.datafeed.service.component.DataFeedServiceImpl.executeJobFromFileSystemRepository(DataFeedServiceImpl.java:129) at com.thesearchagency.smb.datafeed.service.binding.DataFeedWSImpl.executeJobFromFileSystemRepository(DataFeedWSImpl.java:39) ... 45 more 10:03:28,589 WARN [PhaseInterceptorChain] Application {http://www.thesearchagency.com/smb/DataFeedService/}DataFeedService#{http://www.thesearchagency.com/smb/DataFeedService/}executeJobFromFileSystemRepository has thrown exception, unwinding now org.apache.cxf.interceptor.Fault: There were errors during Job execution. at org.jboss.wsf.stack.cxf.AbstractInvoker.createFault(AbstractInvoker.java:229) at org.jboss.wsf.stack.cxf.AbstractInvoker._invokeInternal(AbstractInvoker.java:184) at org.jboss.wsf.stack.cxf.AbstractInvoker.invoke(AbstractInvoker.java:112) at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:58) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at org.apache.cxf.workqueue.SynchronousExecutor.execute(SynchronousExecutor.java:37) at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:106) at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:255) at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:113) at org.apache.cxf.transport.servlet.ServletDestination.invoke(ServletDestination.java:97) at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:461) at org.jboss.wsf.stack.cxf.ServletControllerExt.invoke(ServletControllerExt.java:172) at org.jboss.wsf.stack.cxf.RequestHandlerImpl.handleHttpRequest(RequestHandlerImpl.java:57) at org.jboss.wsf.stack.cxf.transport.ServletHelper.callRequestHandler(ServletHelper.java:162) at org.jboss.wsf.stack.cxf.CXFServletExt.invoke(CXFServletExt.java:90) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:179) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doPost(AbstractHTTPServlet.java:103) at javax.servlet.http.HttpServlet.service(HttpServlet.java:637) at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:159) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:235) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:190) at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:92) at org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.process(SecurityContextEstablishmentValve.java:126) at org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.invoke(SecurityContextEstablishmentValve.java:70) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.jboss.web.tomcat.service.jca.CachedConnectionValve.invoke(CachedConnectionValve.java:158) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:330) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:829) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:598) at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447) at java.lang.Thread.run(Thread.java:662) Caused by: java.lang.RuntimeException: There were errors during Job execution. at com.thesearchagency.smb.common.pentaho.PentahoEngine.executeJob(PentahoEngine.java:121) at com.thesearchagency.smb.datafeed.service.component.DataFeedServiceImpl.executeJobFromFileSystemRepository(DataFeedServiceImpl.java:129) at com.thesearchagency.smb.datafeed.service.binding.DataFeedWSImpl.executeJobFromFileSystemRepository(DataFeedWSImpl.java:39) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.jboss.wsf.common.invocation.AbstractInvocationHandlerJSE.invoke(AbstractInvocationHandlerJSE.java:129) at org.jboss.wsf.stack.cxf.AbstractInvoker._invokeInternal(AbstractInvoker.java:164) ... 39 more