10:03:26,940 INFO [LoggingInInterceptor] Inbound Message
----------------------------
ID: 2
Address: /DataFeed/DataFeedService
Encoding: UTF-8
Content-Type: text/xml;charset=UTF-8
Headers: {content-type=[text/xml;charset=UTF-8], host=[localhost:9995], Content-Length=[641], SOAPAction=[""], user-agent=[Jakarta Commons-HttpClient/3.1], accept-encoding=[gzip,deflate], Content-Type=[text/xml;charset=UTF-8]}
Payload:
--------------------------------------
10:03:26,943 INFO [STDOUT] INFO 16-02 10:03:26,943 - RepositoriesMeta - Reading repositories XML file: /root/.kettle/repositories.xml
10:03:26,945 INFO [PentahoEngine] Finding repository : 1
10:03:26,964 INFO [DataFeedServiceImpl] Adding variables to job [Job 1]
10:03:26,964 INFO [DataFeedServiceImpl] Adding variable name [END_DATE] value [2012-01-05]
10:03:26,964 INFO [DataFeedServiceImpl] Adding variable name [START_DATE] value [2011-12-31]
10:03:26,965 INFO [PentahoEngine] Executing Job : Job 1
10:03:26,965 INFO [STDOUT] INFO 16-02 10:03:26,965 - Job 1 - Start of job execution
10:03:26,967 INFO [STDOUT] INFO 16-02 10:03:26,967 - Job 1 - exec(0, 0, START.0)
10:03:26,967 INFO [STDOUT] INFO 16-02 10:03:26,967 - START - Starting job entry
10:03:26,968 INFO [STDOUT] INFO 16-02 10:03:26,968 - Job 1 - Starting entry [ProcessDatafeeds]
10:03:26,968 INFO [STDOUT] INFO 16-02 10:03:26,968 - Job 1 - exec(1, 0, ProcessDatafeeds.0)
10:03:26,969 INFO [STDOUT] INFO 16-02 10:03:26,969 - ProcessDatafeeds - Starting job entry
10:03:26,969 INFO [STDOUT] INFO 16-02 10:03:26,969 - ProcessDatafeeds - Loading job from repository : [/ : ProcessDatafeeds]
10:03:26,992 INFO [STDOUT] INFO 16-02 10:03:26,992 - ProcessDatafeeds - exec(2, 0, START.0)
10:03:27,022 INFO [STDOUT] INFO 16-02 10:03:27,022 - START - Starting job entry
10:03:27,023 INFO [STDOUT] INFO 16-02 10:03:27,023 - ProcessDatafeeds - Starting entry [GetDatafeeds]
10:03:27,023 INFO [STDOUT] INFO 16-02 10:03:27,023 - ProcessDatafeeds - exec(3, 0, GetDatafeeds.0)
10:03:27,024 INFO [STDOUT] INFO 16-02 10:03:27,024 - GetDatafeeds - Starting job entry
10:03:27,024 INFO [STDOUT] INFO 16-02 10:03:27,024 - GetDatafeeds - Opening transformation: [null] in directory [/]
10:03:27,025 INFO [STDOUT] INFO 16-02 10:03:27,025 - GetDatafeeds - Loading transformation from repository [GetDatafeeds] in directory [/]
10:03:27,108 INFO [STDOUT] INFO 16-02 10:03:27,107 - GetDatafeeds - Starting transformation...(file=null, name=GetDatafeeds, repinfo=null)
10:03:27,108 INFO [STDOUT] INFO 16-02 10:03:27,108 - GetDatafeeds - Transformation is pre-loaded.
10:03:27,108 INFO [STDOUT] INFO 16-02 10:03:27,108 - GetDatafeeds - Dispatching started for transformation [GetDatafeeds]
10:03:27,108 INFO [STDOUT] INFO 16-02 10:03:27,108 - GetDatafeeds - Nr of arguments detected:0
10:03:27,109 INFO [STDOUT] INFO 16-02 10:03:27,109 - GetDatafeeds - This is not a replay transformation
10:03:27,109 INFO [STDOUT] INFO 16-02 10:03:27,109 - GetDatafeeds - I found 2 different steps to launch.
10:03:27,109 INFO [STDOUT] INFO 16-02 10:03:27,109 - GetDatafeeds - Allocating rowsets...
10:03:27,109 INFO [STDOUT] INFO 16-02 10:03:27,109 - GetDatafeeds - Allocating rowsets for step 0 --> SelectDatafeeds
10:03:27,109 INFO [STDOUT] INFO 16-02 10:03:27,109 - GetDatafeeds - prevcopies = 1, nextcopies=1
10:03:27,109 INFO [STDOUT] INFO 16-02 10:03:27,109 - GetDatafeeds - Transformation allocated new rowset [SelectDatafeeds.0 - Copy rows to result.0]
10:03:27,109 INFO [STDOUT] INFO 16-02 10:03:27,109 - GetDatafeeds - Allocated 1 rowsets for step 0 --> SelectDatafeeds
10:03:27,110 INFO [STDOUT] INFO 16-02 10:03:27,109 - GetDatafeeds - Allocating rowsets for step 1 --> Copy rows to result
10:03:27,110 INFO [STDOUT] INFO 16-02 10:03:27,110 - GetDatafeeds - Allocated 1 rowsets for step 1 --> Copy rows to result
10:03:27,110 INFO [STDOUT] INFO 16-02 10:03:27,110 - GetDatafeeds - Allocating Steps & StepData...
10:03:27,110 INFO [STDOUT] INFO 16-02 10:03:27,110 - GetDatafeeds - Transformation is about to allocate step [SelectDatafeeds] of type [TableInput]
10:03:27,110 INFO [STDOUT] INFO 16-02 10:03:27,110 - SelectDatafeeds - distribution activated
10:03:27,110 INFO [STDOUT] INFO 16-02 10:03:27,110 - SelectDatafeeds - Starting allocation of buffers & new threads...
10:03:27,110 INFO [STDOUT] INFO 16-02 10:03:27,110 - SelectDatafeeds - Step info: nrinput=0 nroutput=1
10:03:27,110 INFO [STDOUT] INFO 16-02 10:03:27,110 - SelectDatafeeds - output rel. is 1:1
10:03:27,111 INFO [STDOUT] INFO 16-02 10:03:27,111 - SelectDatafeeds - Found output rowset [SelectDatafeeds.0 - Copy rows to result.0]
10:03:27,111 INFO [STDOUT] INFO 16-02 10:03:27,111 - SelectDatafeeds - Finished dispatching
10:03:27,111 INFO [STDOUT] INFO 16-02 10:03:27,111 - GetDatafeeds - Transformation has allocated a new step: [SelectDatafeeds].0
10:03:27,111 INFO [STDOUT] INFO 16-02 10:03:27,111 - GetDatafeeds - Transformation is about to allocate step [Copy rows to result] of type [RowsToResult]
10:03:27,111 INFO [STDOUT] INFO 16-02 10:03:27,111 - Copy rows to result - distribution activated
10:03:27,111 INFO [STDOUT] INFO 16-02 10:03:27,111 - Copy rows to result - Starting allocation of buffers & new threads...
10:03:27,111 INFO [STDOUT] INFO 16-02 10:03:27,111 - Copy rows to result - Step info: nrinput=1 nroutput=0
10:03:27,112 INFO [STDOUT] INFO 16-02 10:03:27,112 - Copy rows to result - Got previous step from [Copy rows to result] #0 --> SelectDatafeeds
10:03:27,112 INFO [STDOUT] INFO 16-02 10:03:27,112 - Copy rows to result - input rel is 1:1
10:03:27,112 INFO [STDOUT] INFO 16-02 10:03:27,112 - Copy rows to result - Found input rowset [SelectDatafeeds.0 - Copy rows to result.0]
10:03:27,112 INFO [STDOUT] INFO 16-02 10:03:27,112 - Copy rows to result - Finished dispatching
10:03:27,112 INFO [STDOUT] INFO 16-02 10:03:27,112 - GetDatafeeds - Transformation has allocated a new step: [Copy rows to result].0
10:03:27,112 INFO [STDOUT] INFO 16-02 10:03:27,112 - GetDatafeeds - This transformation can be replayed with replay date: 2012/02/16 10:03:27
10:03:27,113 INFO [STDOUT] INFO 16-02 10:03:27,113 - GetDatafeeds - Initialising 2 steps...
10:03:27,113 INFO [STDOUT] INFO 16-02 10:03:27,113 - SelectDatafeeds - Running on slave server #0/1.
10:03:27,114 INFO [STDOUT] INFO 16-02 10:03:27,114 - PDI - New database connection defined
10:03:27,124 INFO [STDOUT] INFO 16-02 10:03:27,123 - PDI - Connected to database.
10:03:27,124 INFO [STDOUT] INFO 16-02 10:03:27,124 - PDI - Auto commit off
10:03:27,125 INFO [STDOUT] INFO 16-02 10:03:27,125 - SelectDatafeeds - Connected to database...
10:03:27,125 INFO [STDOUT] INFO 16-02 10:03:27,125 - Copy rows to result - Running on slave server #0/1.
10:03:27,125 INFO [STDOUT] INFO 16-02 10:03:27,125 - GetDatafeeds - Step [SelectDatafeeds.0] initialized flawlessly.
10:03:27,125 INFO [STDOUT] INFO 16-02 10:03:27,125 - GetDatafeeds - Step [Copy rows to result.0] initialized flawlessly.
10:03:27,126 INFO [STDOUT] INFO 16-02 10:03:27,126 - SelectDatafeeds - Starting to run...
10:03:27,126 INFO [STDOUT] INFO 16-02 10:03:27,126 - SelectDatafeeds - SQL query : SELECT
id
, name
, description
FROM datafeeds
10:03:27,128 INFO [STDOUT] INFO 16-02 10:03:27,128 - SelectDatafeeds - Finished reading query, closing connection.
10:03:27,129 INFO [STDOUT] INFO 16-02 10:03:27,129 - PDI - Connection to database closed!
10:03:27,129 INFO [STDOUT] INFO 16-02 10:03:27,129 - SelectDatafeeds - Finished processing (I=1, O=0, R=0, W=1, U=0, E=0)
10:03:27,129 INFO [STDOUT] INFO 16-02 10:03:27,129 - GetDatafeeds - Transformation has allocated 2 threads and 1 rowsets.
10:03:27,130 INFO [STDOUT] INFO 16-02 10:03:27,130 - Copy rows to result - Starting to run...
10:03:27,143 INFO [STDOUT] INFO 16-02 10:03:27,143 - Copy rows to result - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
10:03:27,152 INFO [STDOUT] INFO 16-02 10:03:27,152 - ProcessDatafeeds - Starting entry [SetDatafeedVariables]
10:03:27,152 INFO [STDOUT] INFO 16-02 10:03:27,152 - ProcessDatafeeds - exec(4, 0, SetDatafeedVariables.0)
10:03:27,153 INFO [STDOUT] INFO 16-02 10:03:27,153 - SetDatafeedVariables - Starting job entry
10:03:27,153 INFO [STDOUT] INFO 16-02 10:03:27,153 - SetDatafeedVariables - Opening transformation: [null] in directory [/]
10:03:27,153 INFO [STDOUT] INFO 16-02 10:03:27,153 - SetDatafeedVariables - Loading transformation from repository [SetDatafeedVariables] in directory [/]
10:03:27,181 INFO [STDOUT] INFO 16-02 10:03:27,181 - SetDatafeedVariables - Starting transformation...(file=null, name=SetDatafeedVariables, repinfo=null)
10:03:27,181 INFO [STDOUT] INFO 16-02 10:03:27,181 - SetDatafeedVariables - Transformation is pre-loaded.
10:03:27,181 INFO [STDOUT] INFO 16-02 10:03:27,181 - SetDatafeedVariables - Dispatching started for transformation [SetDatafeedVariables]
10:03:27,182 INFO [STDOUT] INFO 16-02 10:03:27,181 - SetDatafeedVariables - Nr of arguments detected:0
10:03:27,182 INFO [STDOUT] INFO 16-02 10:03:27,182 - SetDatafeedVariables - This is not a replay transformation
10:03:27,182 INFO [STDOUT] INFO 16-02 10:03:27,182 - SetDatafeedVariables - I found 2 different steps to launch.
10:03:27,182 INFO [STDOUT] INFO 16-02 10:03:27,182 - SetDatafeedVariables - Allocating rowsets...
10:03:27,182 INFO [STDOUT] INFO 16-02 10:03:27,182 - SetDatafeedVariables - Allocating rowsets for step 0 --> Get rows from result
10:03:27,182 INFO [STDOUT] INFO 16-02 10:03:27,182 - SetDatafeedVariables - prevcopies = 1, nextcopies=1
10:03:27,182 INFO [STDOUT] INFO 16-02 10:03:27,182 - SetDatafeedVariables - Transformation allocated new rowset [Get rows from result.0 - Set Variables.0]
10:03:27,183 INFO [STDOUT] INFO 16-02 10:03:27,182 - SetDatafeedVariables - Allocated 1 rowsets for step 0 --> Get rows from result
10:03:27,183 INFO [STDOUT] INFO 16-02 10:03:27,183 - SetDatafeedVariables - Allocating rowsets for step 1 --> Set Variables
10:03:27,183 INFO [STDOUT] INFO 16-02 10:03:27,183 - SetDatafeedVariables - Allocated 1 rowsets for step 1 --> Set Variables
10:03:27,183 INFO [STDOUT] INFO 16-02 10:03:27,183 - SetDatafeedVariables - Allocating Steps & StepData...
10:03:27,183 INFO [STDOUT] INFO 16-02 10:03:27,183 - SetDatafeedVariables - Transformation is about to allocate step [Get rows from result] of type [RowsFromResult]
10:03:27,183 INFO [STDOUT] INFO 16-02 10:03:27,183 - Get rows from result - distribution activated
10:03:27,183 INFO [STDOUT] INFO 16-02 10:03:27,183 - Get rows from result - Starting allocation of buffers & new threads...
10:03:27,184 INFO [STDOUT] INFO 16-02 10:03:27,183 - Get rows from result - Step info: nrinput=0 nroutput=1
10:03:27,184 INFO [STDOUT] INFO 16-02 10:03:27,184 - Get rows from result - output rel. is 1:1
10:03:27,184 INFO [STDOUT] INFO 16-02 10:03:27,184 - Get rows from result - Found output rowset [Get rows from result.0 - Set Variables.0]
10:03:27,184 INFO [STDOUT] INFO 16-02 10:03:27,184 - Get rows from result - Finished dispatching
10:03:27,184 INFO [STDOUT] INFO 16-02 10:03:27,184 - SetDatafeedVariables - Transformation has allocated a new step: [Get rows from result].0
10:03:27,184 INFO [STDOUT] INFO 16-02 10:03:27,184 - SetDatafeedVariables - Transformation is about to allocate step [Set Variables] of type [SetVariable]
10:03:27,184 INFO [STDOUT] INFO 16-02 10:03:27,184 - Set Variables - distribution activated
10:03:27,185 INFO [STDOUT] INFO 16-02 10:03:27,185 - Set Variables - Starting allocation of buffers & new threads...
10:03:27,185 INFO [STDOUT] INFO 16-02 10:03:27,185 - Set Variables - Step info: nrinput=1 nroutput=0
10:03:27,185 INFO [STDOUT] INFO 16-02 10:03:27,185 - Set Variables - Got previous step from [Set Variables] #0 --> Get rows from result
10:03:27,185 INFO [STDOUT] INFO 16-02 10:03:27,185 - Set Variables - input rel is 1:1
10:03:27,185 INFO [STDOUT] INFO 16-02 10:03:27,185 - Set Variables - Found input rowset [Get rows from result.0 - Set Variables.0]
10:03:27,185 INFO [STDOUT] INFO 16-02 10:03:27,185 - Set Variables - Finished dispatching
10:03:27,185 INFO [STDOUT] INFO 16-02 10:03:27,185 - SetDatafeedVariables - Transformation has allocated a new step: [Set Variables].0
10:03:27,186 INFO [STDOUT] INFO 16-02 10:03:27,186 - SetDatafeedVariables - This transformation can be replayed with replay date: 2012/02/16 10:03:27
10:03:27,186 INFO [STDOUT] INFO 16-02 10:03:27,186 - SetDatafeedVariables - Initialising 2 steps...
10:03:27,186 INFO [STDOUT] INFO 16-02 10:03:27,186 - Get rows from result - Running on slave server #0/1.
10:03:27,187 INFO [STDOUT] INFO 16-02 10:03:27,187 - Set Variables - Running on slave server #0/1.
10:03:27,187 INFO [STDOUT] INFO 16-02 10:03:27,187 - SetDatafeedVariables - Step [Get rows from result.0] initialized flawlessly.
10:03:27,187 INFO [STDOUT] INFO 16-02 10:03:27,187 - SetDatafeedVariables - Step [Set Variables.0] initialized flawlessly.
10:03:27,187 INFO [STDOUT] INFO 16-02 10:03:27,187 - Get rows from result - Starting to run...
10:03:27,188 INFO [STDOUT] INFO 16-02 10:03:27,188 - Get rows from result - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
10:03:27,188 INFO [STDOUT] INFO 16-02 10:03:27,188 - SetDatafeedVariables - Transformation has allocated 2 threads and 1 rowsets.
10:03:27,188 INFO [STDOUT] INFO 16-02 10:03:27,188 - Set Variables - Starting to run...
10:03:27,188 INFO [STDOUT] INFO 16-02 10:03:27,188 - Set Variables - Setting environment variables...
10:03:27,189 INFO [STDOUT] INFO 16-02 10:03:27,189 - Set Variables - Set variable DATAFEEDID to value [1]
10:03:27,203 INFO [STDOUT] INFO 16-02 10:03:27,203 - Set Variables - Finished after 1 rows.
10:03:27,203 INFO [STDOUT] INFO 16-02 10:03:27,203 - Set Variables - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
10:03:27,212 INFO [STDOUT] INFO 16-02 10:03:27,212 - ProcessDatafeeds - Starting entry [StageRequirements]
10:03:27,212 INFO [STDOUT] INFO 16-02 10:03:27,212 - ProcessDatafeeds - exec(5, 0, StageRequirements.0)
10:03:27,212 INFO [STDOUT] INFO 16-02 10:03:27,212 - StageRequirements - Starting job entry
10:03:27,212 INFO [STDOUT] INFO 16-02 10:03:27,212 - StageRequirements - Loading job from repository : [/ : StageRequirements]
10:03:27,230 INFO [STDOUT] INFO 16-02 10:03:27,230 - StageRequirements - exec(6, 0, START.0)
10:03:27,230 INFO [STDOUT] INFO 16-02 10:03:27,230 - START - Starting job entry
10:03:27,231 INFO [STDOUT] INFO 16-02 10:03:27,231 - StageRequirements - Starting entry [Write To Log]
10:03:27,231 INFO [STDOUT] INFO 16-02 10:03:27,231 - StageRequirements - exec(7, 0, Write To Log.0)
10:03:27,232 INFO [STDOUT] INFO 16-02 10:03:27,232 - Write To Log - Starting job entry
10:03:27,232 INFO [STDOUT] INFO 16-02 10:03:27,232 - Stuff - Things 1
10:03:27,232 INFO [STDOUT] INFO 16-02 10:03:27,232 - StageRequirements - Starting entry [SelectRequirements]
10:03:27,232 INFO [STDOUT] INFO 16-02 10:03:27,232 - StageRequirements - exec(8, 0, SelectRequirements.0)
10:03:27,233 INFO [STDOUT] INFO 16-02 10:03:27,233 - SelectRequirements - Starting job entry
10:03:27,233 INFO [STDOUT] INFO 16-02 10:03:27,233 - SelectRequirements - Opening transformation: [null] in directory [/]
10:03:27,233 INFO [STDOUT] INFO 16-02 10:03:27,233 - SelectRequirements - Loading transformation from repository [SelectRequirements] in directory [/]
10:03:27,254 INFO [STDOUT] INFO 16-02 10:03:27,254 - SelectRequirements - Starting transformation...(file=null, name=SelectRequirements, repinfo=null)
10:03:27,254 INFO [STDOUT] INFO 16-02 10:03:27,254 - SelectRequirements - Transformation is pre-loaded.
10:03:27,255 INFO [STDOUT] INFO 16-02 10:03:27,254 - SelectRequirements - Dispatching started for transformation [SelectRequirements]
10:03:27,255 INFO [STDOUT] INFO 16-02 10:03:27,255 - SelectRequirements - Nr of arguments detected:0
10:03:27,255 INFO [STDOUT] INFO 16-02 10:03:27,255 - SelectRequirements - This is not a replay transformation
10:03:27,255 INFO [STDOUT] INFO 16-02 10:03:27,255 - SelectRequirements - I found 3 different steps to launch.
10:03:27,255 INFO [STDOUT] INFO 16-02 10:03:27,255 - SelectRequirements - Allocating rowsets...
10:03:27,255 INFO [STDOUT] INFO 16-02 10:03:27,255 - SelectRequirements - Allocating rowsets for step 0 --> Table input
10:03:27,255 INFO [STDOUT] INFO 16-02 10:03:27,255 - SelectRequirements - prevcopies = 1, nextcopies=1
10:03:27,255 INFO [STDOUT] INFO 16-02 10:03:27,255 - SelectRequirements - Transformation allocated new rowset [Table input.0 - Write to log.0]
10:03:27,256 INFO [STDOUT] INFO 16-02 10:03:27,256 - SelectRequirements - Allocated 1 rowsets for step 0 --> Table input
10:03:27,256 INFO [STDOUT] INFO 16-02 10:03:27,256 - SelectRequirements - Allocating rowsets for step 1 --> Write to log
10:03:27,256 INFO [STDOUT] INFO 16-02 10:03:27,256 - SelectRequirements - prevcopies = 1, nextcopies=1
10:03:27,256 INFO [STDOUT] INFO 16-02 10:03:27,256 - SelectRequirements - Transformation allocated new rowset [Write to log.0 - Copy rows to result.0]
10:03:27,256 INFO [STDOUT] INFO 16-02 10:03:27,256 - SelectRequirements - Allocated 2 rowsets for step 1 --> Write to log
10:03:27,256 INFO [STDOUT] INFO 16-02 10:03:27,256 - SelectRequirements - Allocating rowsets for step 2 --> Copy rows to result
10:03:27,256 INFO [STDOUT] INFO 16-02 10:03:27,256 - SelectRequirements - Allocated 2 rowsets for step 2 --> Copy rows to result
10:03:27,257 INFO [STDOUT] INFO 16-02 10:03:27,256 - SelectRequirements - Allocating Steps & StepData...
10:03:27,257 INFO [STDOUT] INFO 16-02 10:03:27,257 - SelectRequirements - Transformation is about to allocate step [Table input] of type [TableInput]
10:03:27,257 INFO [STDOUT] INFO 16-02 10:03:27,257 - Table input - distribution activated
10:03:27,257 INFO [STDOUT] INFO 16-02 10:03:27,257 - Table input - Starting allocation of buffers & new threads...
10:03:27,257 INFO [STDOUT] INFO 16-02 10:03:27,257 - Table input - Step info: nrinput=0 nroutput=1
10:03:27,257 INFO [STDOUT] INFO 16-02 10:03:27,257 - Table input - output rel. is 1:1
10:03:27,257 INFO [STDOUT] INFO 16-02 10:03:27,257 - Table input - Found output rowset [Table input.0 - Write to log.0]
10:03:27,257 INFO [STDOUT] INFO 16-02 10:03:27,257 - Table input - Finished dispatching
10:03:27,258 INFO [STDOUT] INFO 16-02 10:03:27,258 - SelectRequirements - Transformation has allocated a new step: [Table input].0
10:03:27,258 INFO [STDOUT] INFO 16-02 10:03:27,258 - SelectRequirements - Transformation is about to allocate step [Write to log] of type [WriteToLog]
10:03:27,258 INFO [STDOUT] INFO 16-02 10:03:27,258 - Write to log - distribution activated
10:03:27,258 INFO [STDOUT] INFO 16-02 10:03:27,258 - Write to log - Starting allocation of buffers & new threads...
10:03:27,258 INFO [STDOUT] INFO 16-02 10:03:27,258 - Write to log - Step info: nrinput=1 nroutput=1
10:03:27,258 INFO [STDOUT] INFO 16-02 10:03:27,258 - Write to log - Got previous step from [Write to log] #0 --> Table input
10:03:27,259 INFO [STDOUT] INFO 16-02 10:03:27,259 - Write to log - input rel is 1:1
10:03:27,259 INFO [STDOUT] INFO 16-02 10:03:27,259 - Write to log - Found input rowset [Table input.0 - Write to log.0]
10:03:27,259 INFO [STDOUT] INFO 16-02 10:03:27,259 - Write to log - output rel. is 1:1
10:03:27,259 INFO [STDOUT] INFO 16-02 10:03:27,259 - Write to log - Found output rowset [Write to log.0 - Copy rows to result.0]
10:03:27,259 INFO [STDOUT] INFO 16-02 10:03:27,259 - Write to log - Finished dispatching
10:03:27,259 INFO [STDOUT] INFO 16-02 10:03:27,259 - SelectRequirements - Transformation has allocated a new step: [Write to log].0
10:03:27,259 INFO [STDOUT] INFO 16-02 10:03:27,259 - SelectRequirements - Transformation is about to allocate step [Copy rows to result] of type [RowsToResult]
10:03:27,260 INFO [STDOUT] INFO 16-02 10:03:27,260 - Copy rows to result - distribution activated
10:03:27,260 INFO [STDOUT] INFO 16-02 10:03:27,260 - Copy rows to result - Starting allocation of buffers & new threads...
10:03:27,260 INFO [STDOUT] INFO 16-02 10:03:27,260 - Copy rows to result - Step info: nrinput=1 nroutput=0
10:03:27,260 INFO [STDOUT] INFO 16-02 10:03:27,260 - Copy rows to result - Got previous step from [Copy rows to result] #0 --> Write to log
10:03:27,260 INFO [STDOUT] INFO 16-02 10:03:27,260 - Copy rows to result - input rel is 1:1
10:03:27,260 INFO [STDOUT] INFO 16-02 10:03:27,260 - Copy rows to result - Found input rowset [Write to log.0 - Copy rows to result.0]
10:03:27,260 INFO [STDOUT] INFO 16-02 10:03:27,260 - Copy rows to result - Finished dispatching
10:03:27,261 INFO [STDOUT] INFO 16-02 10:03:27,261 - SelectRequirements - Transformation has allocated a new step: [Copy rows to result].0
10:03:27,261 INFO [STDOUT] INFO 16-02 10:03:27,261 - SelectRequirements - This transformation can be replayed with replay date: 2012/02/16 10:03:27
10:03:27,261 INFO [STDOUT] INFO 16-02 10:03:27,261 - SelectRequirements - Initialising 3 steps...
10:03:27,262 INFO [STDOUT] INFO 16-02 10:03:27,262 - Table input - Running on slave server #0/1.
10:03:27,262 INFO [STDOUT] INFO 16-02 10:03:27,262 - Write to log - Running on slave server #0/1.
10:03:27,262 INFO [STDOUT] INFO 16-02 10:03:27,262 - Copy rows to result - Running on slave server #0/1.
10:03:27,275 INFO [STDOUT] INFO 16-02 10:03:27,275 - pdi - New database connection defined
10:03:27,286 INFO [STDOUT] INFO 16-02 10:03:27,286 - pdi - Connected to database.
10:03:27,286 INFO [STDOUT] INFO 16-02 10:03:27,286 - pdi - Auto commit off
10:03:27,286 INFO [STDOUT] INFO 16-02 10:03:27,286 - Table input - Connected to database...
10:03:27,286 INFO [STDOUT] INFO 16-02 10:03:27,286 - SelectRequirements - Step [Table input.0] initialized flawlessly.
10:03:27,287 INFO [STDOUT] INFO 16-02 10:03:27,286 - SelectRequirements - Step [Write to log.0] initialized flawlessly.
10:03:27,287 INFO [STDOUT] INFO 16-02 10:03:27,287 - SelectRequirements - Step [Copy rows to result.0] initialized flawlessly.
10:03:27,287 INFO [STDOUT] INFO 16-02 10:03:27,287 - Table input - Starting to run...
10:03:27,287 INFO [STDOUT] INFO 16-02 10:03:27,287 - Table input - SQL query : SELECT
datafeedID
, requirementID
, stagingTableName
, query
, shardPattern
FROM datafeedRequirements
WHERE datafeedID=1
ORDER BY requirementID
10:03:27,289 INFO [STDOUT] INFO 16-02 10:03:27,289 - Table input - Finished reading query, closing connection.
10:03:27,290 INFO [STDOUT] INFO 16-02 10:03:27,290 - pdi - Connection to database closed!
10:03:27,290 INFO [STDOUT] INFO 16-02 10:03:27,290 - Table input - Finished processing (I=9, O=0, R=0, W=9, U=0, E=0)
10:03:27,291 INFO [STDOUT] INFO 16-02 10:03:27,291 - Write to log - Starting to run...
10:03:27,291 INFO [STDOUT] INFO 16-02 10:03:27,291 - Write to log -
------------> Linenr 1------------------------------
Selected Requirements
datafeedID = 1
requirementID = 1
stagingTableName = dfStructureAccounts
query = select a.id, a.description customerID, a.isActive from admaxCampaigns ac join tsacommon.accounts a on a.ID = ac.accountID group by ac.accountID
shardPattern = st-tracker
====================
10:03:27,292 INFO [STDOUT] INFO 16-02 10:03:27,292 - Write to log -
------------> Linenr 2------------------------------
Selected Requirements
datafeedID = 1
requirementID = 2
stagingTableName = dfStructureAdMaxCampaigns
query = select ac.id, ac.accountID, ac.description, cast(substring_index(substring_index(ac.description, '_', 2), '_', -1) as signed) businessAreaID, cast(substring_index(substring_index(ac.description, '_', 3), '_', -1) as signed) businessLocationID from admaxCampaigns ac
shardPattern = st-tracker
====================
10:03:27,292 INFO [STDOUT] INFO 16-02 10:03:27,292 - Write to log -
------------> Linenr 3------------------------------
Selected Requirements
datafeedID = 1
requirementID = 3
stagingTableName = dfStructureSearchEngineAccounts
query = select aseam.searchEngineAccountID ID, aseam.admaxCampaignID from admaxSearchEngineAccountMap aseam
shardPattern = st-tracker
====================
10:03:27,292 INFO [STDOUT] INFO 16-02 10:03:27,292 - Write to log -
------------> Linenr 4------------------------------
Selected Requirements
datafeedID = 1
requirementID = 4
stagingTableName = dfStructureBusinessLocationIDMap
query = select blim.businessLocationID, blim.systemBusinessLocationID from optus.businessLocationIDMap blim
shardPattern = CDS|smb-services-01-write|smb_services|6WJMMA3638zpqWQq|3306|optus
====================
10:03:27,292 INFO [STDOUT] INFO 16-02 10:03:27,292 - Write to log -
------------> Linenr 5------------------------------
Selected Requirements
datafeedID = 1
requirementID = 5
stagingTableName = dfDataAdMaxCampaignStatus
query = select ac.ID admaxCampaignID, date(now()) date, ac.status, acbas.status budgetAccrualStatus from admaxCampaigns ac join admaxCampaignBudgetAccrualStatus acbas on acbas.admaxCampaignID = ac.ID and acbas.startDate = (select max(acbas2.startDate) from admaxCampaignBudgetAccrualStatus acbas2 where acbas2.admaxCampaignID = ac.ID)
shardPattern = st-tracker
====================
10:03:27,292 INFO [STDOUT] INFO 16-02 10:03:27,292 - Write to log -
------------> Linenr 6------------------------------
Selected Requirements
datafeedID = 1
requirementID = 6
stagingTableName = dfDataAdMaxCampaignBudgets
query = select ac.ID admaxCampaignID, d.day date, coalesce(anmb.budget, 0) nominalMonthlyBudget, coalesce(c.dedicatedCarryover, 0) dedicatedCarryover, coalesce(c.commonCarryover, 0) commonCarryover from `st-tracker`.admaxCampaigns ac join pdi_staging.dates d on d.day between '${START_DATE}' and '${END_DATE}' left join `st-tracker`.admaxNominalMonthlyBudgets anmb on anmb.admaxCampaignID = ac.ID and anmb.startDate <= d.day and (anmb.endDate >= d.day or anmb.endDate is null) left join `st-tracker`.admaxCarryovers c on c.admaxCampaignID = ac.ID and c.type = 'boosted' and c.date = least(d.day, (select if(ac.status = 'Deleted', max(c2.date), d.day) from admaxCarryovers c2 where c2.admaxCampaignID = ac.ID and c2.type = 'boosted'))
shardPattern = st-tracker
====================
10:03:27,292 INFO [STDOUT] INFO 16-02 10:03:27,292 - Write to log -
------------> Linenr 7------------------------------
Selected Requirements
datafeedID = 1
requirementID = 7
stagingTableName = products
query = select p.accountID, p.productCode, p.ID from products p
shardPattern = st-tracker
====================
10:03:27,293 INFO [STDOUT] INFO 16-02 10:03:27,293 - Write to log -
------------> Linenr 8------------------------------
Selected Requirements
datafeedID = 1
requirementID = 8
stagingTableName = accountPerfSum_rsData
query = Report d false ColumnLabelText Account Channel Campaign ViewBy 1 Impressions Impressions false None 2 Prod Conv Prod Conv true None 4 Clicks Clicks false None 72 SEAID SEAID false None 208 Status Status false None 58 AdCost AdCost false None ${CONTACT_PROD}contact_uscontact_ustrueConv${FB_PROD}fb_likefb_liketrueConv${GP_PROD}gp_likegp_liketrueConv${VIEW_PROD}page_viewpage_viewtrueConv${TW_PROD}tw_liketw_liketrueConv${VANITY_PROD}vanity_urlvanity_urltrueConv${CALL_PROD}callscallstrueConv 1true7369trueAllfalse0${ACCOUNTID} Daily ${END_DATE}T23:59:59-08:00 ${START_DATE}T00:00:00-08:00 1 Day
shardPattern = REPORT_SERVICE
====================
10:03:27,293 INFO [STDOUT] INFO 16-02 10:03:27,293 - Write to log -
------------> Linenr 9------------------------------
Selected Requirements
datafeedID = 1
requirementID = 9
stagingTableName = customerDatamart
query = insert into customerDatamart select * from (select dfsa.customerID CustomerID, d2.day Date, coalesce(sum(if(apsrsd.channelDesc='Paid Search',apsrsd.adCost,0)),0) PaidSearchCost, coalesce(sum(if(apsrsd.channelDesc='Paid Search',apsrsd.pageViews,0)),0) PaidSearchVisitors, coalesce(sum(if(apsrsd.channelDesc!='Paid Search',apsrsd.pageViews,0)),0) NaturalSearchVisitors, coalesce(sum(apsrsd.vanity_url),0) ClickThruLeads, coalesce(sum(apsrsd.contact),0) EmailLeads, coalesce(sum(apsrsd.calls),0) CallLeads from dfStructureAccounts dfsa inner join (select day from dates d where d.day between '${START_DATE}' and '${END_DATE}') d2 left join accountPerfSum_rsData apsrsd on apsrsd.accountDesc = dfsa.customerID and apsrsd.dataDate = d2.day group by dfsa.customerID, d2.day) data on duplicate key update paidSearchCost = data.PaidSearchCost, paidSearchVisitors = data.PaidSearchVisitors, naturalSearchVisitors = data.NaturalSearchVisitors, clickThruLeads = data.ClickThruLeads, emailLeads = data.EmailLeads, callLeads = data.CallLeads
shardPattern = CDS|smb_pdi|smb_services|6WJMMA3638zpqWQq|3306|pdi_staging
====================
10:03:27,297 INFO [STDOUT] INFO 16-02 10:03:27,293 - SelectRequirements - Transformation has allocated 3 threads and 2 rowsets.
10:03:27,299 INFO [STDOUT] INFO 16-02 10:03:27,298 - Copy rows to result - Starting to run...
10:03:27,311 INFO [STDOUT] INFO 16-02 10:03:27,311 - Write to log - Finished processing (I=0, O=0, R=9, W=9, U=0, E=0)
10:03:27,331 INFO [STDOUT] INFO 16-02 10:03:27,331 - Copy rows to result - Finished processing (I=0, O=0, R=9, W=9, U=0, E=0)
10:03:27,336 INFO [STDOUT] INFO 16-02 10:03:27,336 - StageRequirements - Starting entry [StageRequirement]
10:03:27,336 INFO [STDOUT] INFO 16-02 10:03:27,336 - StageRequirements - exec(9, 0, StageRequirement.0)
10:03:27,336 INFO [STDOUT] INFO 16-02 10:03:27,336 - StageRequirement - Starting job entry
10:03:27,337 INFO [STDOUT] INFO 16-02 10:03:27,337 - StageRequirement - Loading job from repository : [/ : StageRequirement]
10:03:27,354 INFO [STDOUT] INFO 16-02 10:03:27,353 - StageRequirement - exec(10, 0, START.0)
10:03:27,354 INFO [STDOUT] INFO 16-02 10:03:27,354 - START - Starting job entry
10:03:27,355 INFO [STDOUT] INFO 16-02 10:03:27,355 - StageRequirement - Starting entry [SetRequirementStagingVariables]
10:03:27,355 INFO [STDOUT] INFO 16-02 10:03:27,355 - StageRequirement - exec(11, 0, SetRequirementStagingVariables.0)
10:03:27,355 INFO [STDOUT] INFO 16-02 10:03:27,355 - SetRequirementStagingVariables - Starting job entry
10:03:27,355 INFO [STDOUT] INFO 16-02 10:03:27,355 - SetRequirementStagingVariables - Opening transformation: [null] in directory [/]
10:03:27,355 INFO [STDOUT] INFO 16-02 10:03:27,355 - SetRequirementStagingVariables - Loading transformation from repository [SetRequirementStagingVariables] in directory [/]
10:03:27,375 INFO [STDOUT] INFO 16-02 10:03:27,375 - SetRequirementStagingVariables - Starting transformation...(file=null, name=SetRequirementStagingVariables, repinfo=null)
10:03:27,375 INFO [STDOUT] INFO 16-02 10:03:27,375 - SetRequirementStagingVariables - Transformation is pre-loaded.
10:03:27,375 INFO [STDOUT] INFO 16-02 10:03:27,375 - SetRequirementStagingVariables - Dispatching started for transformation [SetRequirementStagingVariables]
10:03:27,375 INFO [STDOUT] INFO 16-02 10:03:27,375 - SetRequirementStagingVariables - Nr of arguments detected:0
10:03:27,375 INFO [STDOUT] INFO 16-02 10:03:27,375 - SetRequirementStagingVariables - This is not a replay transformation
10:03:27,375 INFO [STDOUT] INFO 16-02 10:03:27,375 - SetRequirementStagingVariables - I found 2 different steps to launch.
10:03:27,376 INFO [STDOUT] INFO 16-02 10:03:27,376 - SetRequirementStagingVariables - Allocating rowsets...
10:03:27,376 INFO [STDOUT] INFO 16-02 10:03:27,376 - SetRequirementStagingVariables - Allocating rowsets for step 0 --> Get rows from result
10:03:27,376 INFO [STDOUT] INFO 16-02 10:03:27,376 - SetRequirementStagingVariables - prevcopies = 1, nextcopies=1
10:03:27,376 INFO [STDOUT] INFO 16-02 10:03:27,376 - SetRequirementStagingVariables - Transformation allocated new rowset [Get rows from result.0 - Set Variables.0]
10:03:27,376 INFO [STDOUT] INFO 16-02 10:03:27,376 - SetRequirementStagingVariables - Allocated 1 rowsets for step 0 --> Get rows from result
10:03:27,376 INFO [STDOUT] INFO 16-02 10:03:27,376 - SetRequirementStagingVariables - Allocating rowsets for step 1 --> Set Variables
10:03:27,376 INFO [STDOUT] INFO 16-02 10:03:27,376 - SetRequirementStagingVariables - Allocated 1 rowsets for step 1 --> Set Variables
10:03:27,376 INFO [STDOUT] INFO 16-02 10:03:27,376 - SetRequirementStagingVariables - Allocating Steps & StepData...
10:03:27,377 INFO [STDOUT] INFO 16-02 10:03:27,377 - SetRequirementStagingVariables - Transformation is about to allocate step [Get rows from result] of type [RowsFromResult]
10:03:27,377 INFO [STDOUT] INFO 16-02 10:03:27,377 - Get rows from result - distribution activated
10:03:27,377 INFO [STDOUT] INFO 16-02 10:03:27,377 - Get rows from result - Starting allocation of buffers & new threads...
10:03:27,377 INFO [STDOUT] INFO 16-02 10:03:27,377 - Get rows from result - Step info: nrinput=0 nroutput=1
10:03:27,377 INFO [STDOUT] INFO 16-02 10:03:27,377 - Get rows from result - output rel. is 1:1
10:03:27,377 INFO [STDOUT] INFO 16-02 10:03:27,377 - Get rows from result - Found output rowset [Get rows from result.0 - Set Variables.0]
10:03:27,377 INFO [STDOUT] INFO 16-02 10:03:27,377 - Get rows from result - Finished dispatching
10:03:27,378 INFO [STDOUT] INFO 16-02 10:03:27,378 - SetRequirementStagingVariables - Transformation has allocated a new step: [Get rows from result].0
10:03:27,378 INFO [STDOUT] INFO 16-02 10:03:27,378 - SetRequirementStagingVariables - Transformation is about to allocate step [Set Variables] of type [SetVariable]
10:03:27,378 INFO [STDOUT] INFO 16-02 10:03:27,378 - Set Variables - distribution activated
10:03:27,378 INFO [STDOUT] INFO 16-02 10:03:27,378 - Set Variables - Starting allocation of buffers & new threads...
10:03:27,378 INFO [STDOUT] INFO 16-02 10:03:27,378 - Set Variables - Step info: nrinput=1 nroutput=0
10:03:27,378 INFO [STDOUT] INFO 16-02 10:03:27,378 - Set Variables - Got previous step from [Set Variables] #0 --> Get rows from result
10:03:27,378 INFO [STDOUT] INFO 16-02 10:03:27,378 - Set Variables - input rel is 1:1
10:03:27,379 INFO [STDOUT] INFO 16-02 10:03:27,379 - Set Variables - Found input rowset [Get rows from result.0 - Set Variables.0]
10:03:27,379 INFO [STDOUT] INFO 16-02 10:03:27,379 - Set Variables - Finished dispatching
10:03:27,379 INFO [STDOUT] INFO 16-02 10:03:27,379 - SetRequirementStagingVariables - Transformation has allocated a new step: [Set Variables].0
10:03:27,379 INFO [STDOUT] INFO 16-02 10:03:27,379 - SetRequirementStagingVariables - This transformation can be replayed with replay date: 2012/02/16 10:03:27
10:03:27,379 INFO [STDOUT] INFO 16-02 10:03:27,379 - SetRequirementStagingVariables - Initialising 2 steps...
10:03:27,380 INFO [STDOUT] INFO 16-02 10:03:27,380 - Get rows from result - Running on slave server #0/1.
10:03:27,380 INFO [STDOUT] INFO 16-02 10:03:27,380 - Set Variables - Running on slave server #0/1.
10:03:27,380 INFO [STDOUT] INFO 16-02 10:03:27,380 - SetRequirementStagingVariables - Step [Get rows from result.0] initialized flawlessly.
10:03:27,380 INFO [STDOUT] INFO 16-02 10:03:27,380 - SetRequirementStagingVariables - Step [Set Variables.0] initialized flawlessly.
10:03:27,381 INFO [STDOUT] INFO 16-02 10:03:27,381 - SetRequirementStagingVariables - Transformation has allocated 2 threads and 1 rowsets.
10:03:27,384 INFO [STDOUT] INFO 16-02 10:03:27,384 - Get rows from result - Starting to run...
10:03:27,384 INFO [STDOUT] INFO 16-02 10:03:27,384 - Get rows from result - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
10:03:27,384 INFO [STDOUT] INFO 16-02 10:03:27,384 - Set Variables - Starting to run...
10:03:27,384 INFO [STDOUT] INFO 16-02 10:03:27,384 - Set Variables - Setting environment variables...
10:03:27,385 INFO [STDOUT] INFO 16-02 10:03:27,385 - Set Variables - Set variable STAGINGTABLENAME to value [dfStructureAccounts]
10:03:27,385 INFO [STDOUT] INFO 16-02 10:03:27,385 - Set Variables - Set variable QUERY to value [select a.id, a.description customerID, a.isActive from admaxCampaigns ac join tsacommon.accounts a on a.ID = ac.accountID group by ac.accountID]
10:03:27,385 INFO [STDOUT] INFO 16-02 10:03:27,385 - Set Variables - Set variable SHARDPATTERN to value [st-tracker]
10:03:27,399 INFO [STDOUT] INFO 16-02 10:03:27,399 - Set Variables - Finished after 1 rows.
10:03:27,399 INFO [STDOUT] INFO 16-02 10:03:27,399 - Set Variables - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
10:03:27,404 INFO [STDOUT] INFO 16-02 10:03:27,403 - StageRequirement - Starting entry [TruncateStagingTable]
10:03:27,404 INFO [STDOUT] INFO 16-02 10:03:27,404 - StageRequirement - exec(12, 0, TruncateStagingTable.0)
10:03:27,404 INFO [STDOUT] INFO 16-02 10:03:27,404 - TruncateStagingTable - Starting job entry
10:03:27,404 INFO [STDOUT] INFO 16-02 10:03:27,404 - TruncateStagingTable - Opening transformation: [null] in directory [/]
10:03:27,404 INFO [STDOUT] INFO 16-02 10:03:27,404 - TruncateStagingTable - Loading transformation from repository [TruncateStagingTable] in directory [/]
10:03:27,424 INFO [STDOUT] INFO 16-02 10:03:27,424 - TruncateStagingTable - Starting transformation...(file=null, name=TruncateStagingTable, repinfo=null)
10:03:27,424 INFO [STDOUT] INFO 16-02 10:03:27,424 - TruncateStagingTable - Transformation is pre-loaded.
10:03:27,425 INFO [STDOUT] INFO 16-02 10:03:27,425 - TruncateStagingTable - Dispatching started for transformation [TruncateStagingTable]
10:03:27,425 INFO [STDOUT] INFO 16-02 10:03:27,425 - TruncateStagingTable - Nr of arguments detected:0
10:03:27,425 INFO [STDOUT] INFO 16-02 10:03:27,425 - TruncateStagingTable - This is not a replay transformation
10:03:27,425 INFO [STDOUT] INFO 16-02 10:03:27,425 - TruncateStagingTable - I found 4 different steps to launch.
10:03:27,425 INFO [STDOUT] INFO 16-02 10:03:27,425 - TruncateStagingTable - Allocating rowsets...
10:03:27,425 INFO [STDOUT] INFO 16-02 10:03:27,425 - TruncateStagingTable - Allocating rowsets for step 0 --> Get Variables
10:03:27,425 INFO [STDOUT] INFO 16-02 10:03:27,425 - TruncateStagingTable - prevcopies = 1, nextcopies=1
10:03:27,426 INFO [STDOUT] INFO 16-02 10:03:27,426 - TruncateStagingTable - Transformation allocated new rowset [Get Variables.0 - Switch / Case.0]
10:03:27,426 INFO [STDOUT] INFO 16-02 10:03:27,426 - TruncateStagingTable - Allocated 1 rowsets for step 0 --> Get Variables
10:03:27,426 INFO [STDOUT] INFO 16-02 10:03:27,426 - TruncateStagingTable - Allocating rowsets for step 1 --> Switch / Case
10:03:27,426 INFO [STDOUT] INFO 16-02 10:03:27,426 - TruncateStagingTable - prevcopies = 1, nextcopies=1
10:03:27,426 INFO [STDOUT] INFO 16-02 10:03:27,426 - TruncateStagingTable - Transformation allocated new rowset [Switch / Case.0 - Execute SQL script trunc.0]
10:03:27,426 INFO [STDOUT] INFO 16-02 10:03:27,426 - TruncateStagingTable - prevcopies = 1, nextcopies=1
10:03:27,426 INFO [STDOUT] INFO 16-02 10:03:27,426 - TruncateStagingTable - Transformation allocated new rowset [Switch / Case.0 - Dummy (do nothing).0]
10:03:27,426 INFO [STDOUT] INFO 16-02 10:03:27,426 - TruncateStagingTable - Allocated 3 rowsets for step 1 --> Switch / Case
10:03:27,427 INFO [STDOUT] INFO 16-02 10:03:27,427 - TruncateStagingTable - Allocating rowsets for step 2 --> Execute SQL script trunc
10:03:27,427 INFO [STDOUT] INFO 16-02 10:03:27,427 - TruncateStagingTable - Allocated 3 rowsets for step 2 --> Execute SQL script trunc
10:03:27,427 INFO [STDOUT] INFO 16-02 10:03:27,427 - TruncateStagingTable - Allocating rowsets for step 3 --> Dummy (do nothing)
10:03:27,427 INFO [STDOUT] INFO 16-02 10:03:27,427 - TruncateStagingTable - Allocated 3 rowsets for step 3 --> Dummy (do nothing)
10:03:27,427 INFO [STDOUT] INFO 16-02 10:03:27,427 - TruncateStagingTable - Allocating Steps & StepData...
10:03:27,427 INFO [STDOUT] INFO 16-02 10:03:27,427 - TruncateStagingTable - Transformation is about to allocate step [Get Variables] of type [GetVariable]
10:03:27,427 INFO [STDOUT] INFO 16-02 10:03:27,427 - Get Variables - distribution activated
10:03:27,427 INFO [STDOUT] INFO 16-02 10:03:27,427 - Get Variables - Starting allocation of buffers & new threads...
10:03:27,428 INFO [STDOUT] INFO 16-02 10:03:27,428 - Get Variables - Step info: nrinput=0 nroutput=1
10:03:27,428 INFO [STDOUT] INFO 16-02 10:03:27,428 - Get Variables - output rel. is 1:1
10:03:27,428 INFO [STDOUT] INFO 16-02 10:03:27,428 - Get Variables - Found output rowset [Get Variables.0 - Switch / Case.0]
10:03:27,428 INFO [STDOUT] INFO 16-02 10:03:27,428 - Get Variables - Finished dispatching
10:03:27,428 INFO [STDOUT] INFO 16-02 10:03:27,428 - TruncateStagingTable - Transformation has allocated a new step: [Get Variables].0
10:03:27,428 INFO [STDOUT] INFO 16-02 10:03:27,428 - TruncateStagingTable - Transformation is about to allocate step [Switch / Case] of type [SwitchCase]
10:03:27,429 INFO [STDOUT] INFO 16-02 10:03:27,428 - Switch / Case - distribution activated
10:03:27,429 INFO [STDOUT] INFO 16-02 10:03:27,429 - Switch / Case - Starting allocation of buffers & new threads...
10:03:27,429 INFO [STDOUT] INFO 16-02 10:03:27,429 - Switch / Case - Step info: nrinput=1 nroutput=2
10:03:27,429 INFO [STDOUT] INFO 16-02 10:03:27,429 - Switch / Case - Got previous step from [Switch / Case] #0 --> Get Variables
10:03:27,429 INFO [STDOUT] INFO 16-02 10:03:27,429 - Switch / Case - input rel is 1:1
10:03:27,429 INFO [STDOUT] INFO 16-02 10:03:27,429 - Switch / Case - Found input rowset [Get Variables.0 - Switch / Case.0]
10:03:27,429 INFO [STDOUT] INFO 16-02 10:03:27,429 - Switch / Case - output rel. is 1:1
10:03:27,429 INFO [STDOUT] INFO 16-02 10:03:27,429 - Switch / Case - Found output rowset [Switch / Case.0 - Execute SQL script trunc.0]
10:03:27,430 INFO [STDOUT] INFO 16-02 10:03:27,429 - Switch / Case - output rel. is 1:1
10:03:27,430 INFO [STDOUT] INFO 16-02 10:03:27,430 - Switch / Case - Found output rowset [Switch / Case.0 - Dummy (do nothing).0]
10:03:27,430 INFO [STDOUT] INFO 16-02 10:03:27,430 - Switch / Case - Finished dispatching
10:03:27,430 INFO [STDOUT] INFO 16-02 10:03:27,430 - TruncateStagingTable - Transformation has allocated a new step: [Switch / Case].0
10:03:27,430 INFO [STDOUT] INFO 16-02 10:03:27,430 - TruncateStagingTable - Transformation is about to allocate step [Execute SQL script trunc] of type [ExecSQL]
10:03:27,430 INFO [STDOUT] INFO 16-02 10:03:27,430 - Execute SQL script trunc - distribution activated
10:03:27,430 INFO [STDOUT] INFO 16-02 10:03:27,430 - Execute SQL script trunc - Starting allocation of buffers & new threads...
10:03:27,430 INFO [STDOUT] INFO 16-02 10:03:27,430 - Execute SQL script trunc - Step info: nrinput=1 nroutput=0
10:03:27,431 INFO [STDOUT] INFO 16-02 10:03:27,431 - Execute SQL script trunc - Got previous step from [Execute SQL script trunc] #0 --> Switch / Case
10:03:27,431 INFO [STDOUT] INFO 16-02 10:03:27,431 - Execute SQL script trunc - input rel is 1:1
10:03:27,431 INFO [STDOUT] INFO 16-02 10:03:27,431 - Execute SQL script trunc - Found input rowset [Switch / Case.0 - Execute SQL script trunc.0]
10:03:27,431 INFO [STDOUT] INFO 16-02 10:03:27,431 - Execute SQL script trunc - Finished dispatching
10:03:27,431 INFO [STDOUT] INFO 16-02 10:03:27,431 - TruncateStagingTable - Transformation has allocated a new step: [Execute SQL script trunc].0
10:03:27,431 INFO [STDOUT] INFO 16-02 10:03:27,431 - TruncateStagingTable - Transformation is about to allocate step [Dummy (do nothing)] of type [Dummy]
10:03:27,431 INFO [STDOUT] INFO 16-02 10:03:27,431 - Dummy (do nothing) - distribution activated
10:03:27,432 INFO [STDOUT] INFO 16-02 10:03:27,432 - Dummy (do nothing) - Starting allocation of buffers & new threads...
10:03:27,432 INFO [STDOUT] INFO 16-02 10:03:27,432 - Dummy (do nothing) - Step info: nrinput=1 nroutput=0
10:03:27,432 INFO [STDOUT] INFO 16-02 10:03:27,432 - Dummy (do nothing) - Got previous step from [Dummy (do nothing)] #0 --> Switch / Case
10:03:27,432 INFO [STDOUT] INFO 16-02 10:03:27,432 - Dummy (do nothing) - input rel is 1:1
10:03:27,432 INFO [STDOUT] INFO 16-02 10:03:27,432 - Dummy (do nothing) - Found input rowset [Switch / Case.0 - Dummy (do nothing).0]
10:03:27,432 INFO [STDOUT] INFO 16-02 10:03:27,432 - Dummy (do nothing) - Finished dispatching
10:03:27,432 INFO [STDOUT] INFO 16-02 10:03:27,432 - TruncateStagingTable - Transformation has allocated a new step: [Dummy (do nothing)].0
10:03:27,433 INFO [STDOUT] INFO 16-02 10:03:27,433 - TruncateStagingTable - This transformation can be replayed with replay date: 2012/02/16 10:03:27
10:03:27,433 INFO [STDOUT] INFO 16-02 10:03:27,433 - TruncateStagingTable - Initialising 4 steps...
10:03:27,433 INFO [STDOUT] INFO 16-02 10:03:27,433 - Get Variables - Running on slave server #0/1.
10:03:27,433 INFO [STDOUT] INFO 16-02 10:03:27,433 - Switch / Case - Running on slave server #0/1.
10:03:27,434 INFO [STDOUT] INFO 16-02 10:03:27,434 - Execute SQL script trunc - Running on slave server #0/1.
10:03:27,434 INFO [STDOUT] INFO 16-02 10:03:27,434 - pdi_stage - New database connection defined
10:03:27,439 INFO [STDOUT] INFO 16-02 10:03:27,439 - Dummy (do nothing) - Running on slave server #0/1.
10:03:27,447 INFO [STDOUT] INFO 16-02 10:03:27,446 - pdi_stage - Connected to database.
10:03:27,447 INFO [STDOUT] INFO 16-02 10:03:27,447 - Execute SQL script trunc - Connected to database...
10:03:27,447 INFO [STDOUT] INFO 16-02 10:03:27,447 - pdi_stage - launch DDL statement:
truncate dfStructureAccounts
10:03:27,472 INFO [STDOUT] INFO 16-02 10:03:27,471 - pdi_stage - 1 statement executed
10:03:27,472 INFO [STDOUT] INFO 16-02 10:03:27,472 - TruncateStagingTable - Step [Get Variables.0] initialized flawlessly.
10:03:27,472 INFO [STDOUT] INFO 16-02 10:03:27,472 - TruncateStagingTable - Step [Switch / Case.0] initialized flawlessly.
10:03:27,472 INFO [STDOUT] INFO 16-02 10:03:27,472 - TruncateStagingTable - Step [Execute SQL script trunc.0] initialized flawlessly.
10:03:27,472 INFO [STDOUT] INFO 16-02 10:03:27,472 - TruncateStagingTable - Step [Dummy (do nothing).0] initialized flawlessly.
10:03:27,473 INFO [STDOUT] INFO 16-02 10:03:27,473 - Get Variables - Starting to run...
10:03:27,473 INFO [STDOUT] INFO 16-02 10:03:27,473 - Get Variables - field [stagingTableName] has value [STAGINGTABLENAME]
10:03:27,473 INFO [STDOUT] INFO 16-02 10:03:27,473 - Get Variables - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
10:03:27,474 INFO [STDOUT] INFO 16-02 10:03:27,474 - Switch / Case - Starting to run...
10:03:27,474 INFO [STDOUT] INFO 16-02 10:03:27,474 - Execute SQL script trunc - Starting to run...
10:03:27,474 INFO [STDOUT] INFO 16-02 10:03:27,474 - Execute SQL script trunc - Finished reading query, closing connection.
10:03:27,475 INFO [STDOUT] INFO 16-02 10:03:27,475 - pdi_stage - Connection to database closed!
10:03:27,475 INFO [STDOUT] INFO 16-02 10:03:27,475 - Execute SQL script trunc - Finished processing (I=0, O=0, R=0, W=1, U=0, E=0)
10:03:27,475 INFO [STDOUT] INFO 16-02 10:03:27,475 - TruncateStagingTable - Transformation has allocated 4 threads and 3 rowsets.
10:03:27,480 INFO [STDOUT] INFO 16-02 10:03:27,480 - Dummy (do nothing) - Starting to run...
10:03:27,495 INFO [STDOUT] INFO 16-02 10:03:27,495 - Switch / Case - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
10:03:27,511 INFO [STDOUT] INFO 16-02 10:03:27,511 - Dummy (do nothing) - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0)
10:03:27,516 INFO [STDOUT] INFO 16-02 10:03:27,516 - StageRequirement - Starting entry [Simple evaluation]
10:03:27,516 INFO [STDOUT] INFO 16-02 10:03:27,516 - StageRequirement - exec(13, 0, Simple evaluation.0)
10:03:27,516 INFO [STDOUT] INFO 16-02 10:03:27,516 - Simple evaluation - Starting job entry
10:03:27,517 INFO [STDOUT] INFO 16-02 10:03:27,516 - Simple evaluation - Checking variable [${SHARDPATTERN}] ...
10:03:27,517 INFO [STDOUT] INFO 16-02 10:03:27,517 - Simple evaluation - Value to evaluate is st-tracker
10:03:27,517 INFO [STDOUT] INFO 16-02 10:03:27,517 - StageRequirement - Starting entry [Simple evaluation 2]
10:03:27,518 INFO [STDOUT] INFO 16-02 10:03:27,518 - StageRequirement - exec(14, 0, Simple evaluation 2.0)
10:03:27,518 INFO [STDOUT] INFO 16-02 10:03:27,518 - Simple evaluation - Starting job entry
10:03:27,518 INFO [STDOUT] INFO 16-02 10:03:27,518 - Simple evaluation - Checking variable [${SHARDPATTERN}] ...
10:03:27,518 INFO [STDOUT] INFO 16-02 10:03:27,518 - Simple evaluation - Value to evaluate is st-tracker
10:03:27,519 INFO [STDOUT] INFO 16-02 10:03:27,519 - StageRequirement - Starting entry [StageDataFromShards]
10:03:27,519 INFO [STDOUT] INFO 16-02 10:03:27,519 - StageRequirement - exec(15, 0, StageDataFromShards.0)
10:03:27,519 INFO [STDOUT] INFO 16-02 10:03:27,519 - StageDataFromShards - Starting job entry
10:03:27,520 INFO [STDOUT] INFO 16-02 10:03:27,519 - StageDataFromShards - Loading job from repository : [/ : StageDataFromShards]
10:03:27,535 INFO [STDOUT] INFO 16-02 10:03:27,535 - StageDataFromShards - exec(16, 0, START.0)
10:03:27,535 INFO [STDOUT] INFO 16-02 10:03:27,535 - START - Starting job entry
10:03:27,536 INFO [STDOUT] INFO 16-02 10:03:27,536 - StageDataFromShards - Starting entry [Write To Log]
10:03:27,536 INFO [STDOUT] INFO 16-02 10:03:27,536 - StageDataFromShards - exec(17, 0, Write To Log.0)
10:03:27,536 INFO [STDOUT] INFO 16-02 10:03:27,536 - Write To Log - Starting job entry
10:03:27,536 INFO [STDOUT] INFO 16-02 10:03:27,536 - End: - dfStructureAccounts
select a.id, a.description customerID, a.isActive from admaxCampaigns ac join tsacommon.accounts a on a.ID = ac.accountID group by ac.accountID
st-tracker
10:03:27,537 INFO [STDOUT] INFO 16-02 10:03:27,537 - StageDataFromShards - Starting entry [SelectShards]
10:03:27,537 INFO [STDOUT] INFO 16-02 10:03:27,537 - StageDataFromShards - exec(18, 0, SelectShards.0)
10:03:27,537 INFO [STDOUT] INFO 16-02 10:03:27,537 - SelectShards - Starting job entry
10:03:27,538 INFO [STDOUT] INFO 16-02 10:03:27,537 - SelectShards - Opening transformation: [null] in directory [/]
10:03:27,538 INFO [STDOUT] INFO 16-02 10:03:27,538 - SelectShards - Loading transformation from repository [SelectShards] in directory [/]
10:03:27,557 INFO [STDOUT] INFO 16-02 10:03:27,557 - SelectShards - Starting transformation...(file=null, name=SelectShards, repinfo=null)
10:03:27,557 INFO [STDOUT] INFO 16-02 10:03:27,557 - SelectShards - Transformation is pre-loaded.
10:03:27,557 INFO [STDOUT] INFO 16-02 10:03:27,557 - SelectShards - Dispatching started for transformation [SelectShards]
10:03:27,557 INFO [STDOUT] INFO 16-02 10:03:27,557 - SelectShards - Nr of arguments detected:0
10:03:27,557 INFO [STDOUT] INFO 16-02 10:03:27,557 - SelectShards - This is not a replay transformation
10:03:27,557 INFO [STDOUT] INFO 16-02 10:03:27,557 - SelectShards - I found 2 different steps to launch.
10:03:27,558 INFO [STDOUT] INFO 16-02 10:03:27,558 - SelectShards - Allocating rowsets...
10:03:27,558 INFO [STDOUT] INFO 16-02 10:03:27,558 - SelectShards - Allocating rowsets for step 0 --> Table input
10:03:27,558 INFO [STDOUT] INFO 16-02 10:03:27,558 - SelectShards - prevcopies = 1, nextcopies=1
10:03:27,558 INFO [STDOUT] INFO 16-02 10:03:27,558 - SelectShards - Transformation allocated new rowset [Table input.0 - Copy rows to result.0]
10:03:27,558 INFO [STDOUT] INFO 16-02 10:03:27,558 - SelectShards - Allocated 1 rowsets for step 0 --> Table input
10:03:27,558 INFO [STDOUT] INFO 16-02 10:03:27,558 - SelectShards - Allocating rowsets for step 1 --> Copy rows to result
10:03:27,558 INFO [STDOUT] INFO 16-02 10:03:27,558 - SelectShards - Allocated 1 rowsets for step 1 --> Copy rows to result
10:03:27,558 INFO [STDOUT] INFO 16-02 10:03:27,558 - SelectShards - Allocating Steps & StepData...
10:03:27,559 INFO [STDOUT] INFO 16-02 10:03:27,559 - SelectShards - Transformation is about to allocate step [Table input] of type [TableInput]
10:03:27,559 INFO [STDOUT] INFO 16-02 10:03:27,559 - Table input - distribution activated
10:03:27,559 INFO [STDOUT] INFO 16-02 10:03:27,559 - Table input - Starting allocation of buffers & new threads...
10:03:27,559 INFO [STDOUT] INFO 16-02 10:03:27,559 - Table input - Step info: nrinput=0 nroutput=1
10:03:27,559 INFO [STDOUT] INFO 16-02 10:03:27,559 - Table input - output rel. is 1:1
10:03:27,559 INFO [STDOUT] INFO 16-02 10:03:27,559 - Table input - Found output rowset [Table input.0 - Copy rows to result.0]
10:03:27,559 INFO [STDOUT] INFO 16-02 10:03:27,559 - Table input - Finished dispatching
10:03:27,560 INFO [STDOUT] INFO 16-02 10:03:27,560 - SelectShards - Transformation has allocated a new step: [Table input].0
10:03:27,560 INFO [STDOUT] INFO 16-02 10:03:27,560 - SelectShards - Transformation is about to allocate step [Copy rows to result] of type [RowsToResult]
10:03:27,560 INFO [STDOUT] INFO 16-02 10:03:27,560 - Copy rows to result - distribution activated
10:03:27,560 INFO [STDOUT] INFO 16-02 10:03:27,560 - Copy rows to result - Starting allocation of buffers & new threads...
10:03:27,560 INFO [STDOUT] INFO 16-02 10:03:27,560 - Copy rows to result - Step info: nrinput=1 nroutput=0
10:03:27,560 INFO [STDOUT] INFO 16-02 10:03:27,560 - Copy rows to result - Got previous step from [Copy rows to result] #0 --> Table input
10:03:27,560 INFO [STDOUT] INFO 16-02 10:03:27,560 - Copy rows to result - input rel is 1:1
10:03:27,561 INFO [STDOUT] INFO 16-02 10:03:27,561 - Copy rows to result - Found input rowset [Table input.0 - Copy rows to result.0]
10:03:27,561 INFO [STDOUT] INFO 16-02 10:03:27,561 - Copy rows to result - Finished dispatching
10:03:27,561 INFO [STDOUT] INFO 16-02 10:03:27,561 - SelectShards - Transformation has allocated a new step: [Copy rows to result].0
10:03:27,561 INFO [STDOUT] INFO 16-02 10:03:27,561 - SelectShards - This transformation can be replayed with replay date: 2012/02/16 10:03:27
10:03:27,561 INFO [STDOUT] INFO 16-02 10:03:27,561 - SelectShards - Initialising 2 steps...
10:03:27,562 INFO [STDOUT] INFO 16-02 10:03:27,562 - Table input - Running on slave server #0/1.
10:03:27,569 INFO [STDOUT] INFO 16-02 10:03:27,569 - tsacommon - New database connection defined
10:03:27,572 INFO [STDOUT] INFO 16-02 10:03:27,572 - Copy rows to result - Running on slave server #0/1.
10:03:27,581 INFO [STDOUT] INFO 16-02 10:03:27,581 - tsacommon - Connected to database.
10:03:27,581 INFO [STDOUT] INFO 16-02 10:03:27,581 - tsacommon - Auto commit off
10:03:27,581 INFO [STDOUT] INFO 16-02 10:03:27,581 - Table input - Connected to database...
10:03:27,581 INFO [STDOUT] INFO 16-02 10:03:27,581 - SelectShards - Step [Table input.0] initialized flawlessly.
10:03:27,582 INFO [STDOUT] INFO 16-02 10:03:27,582 - SelectShards - Step [Copy rows to result.0] initialized flawlessly.
10:03:27,582 INFO [STDOUT] INFO 16-02 10:03:27,582 - Table input - Starting to run...
10:03:27,582 INFO [STDOUT] INFO 16-02 10:03:27,582 - Table input - SQL query : SELECT
id
, name
, description
, type
, `DATABASE`
, host
, port
, access
FROM databaseInstances
WHERE `DATABASE` like "st-tracker"
10:03:27,586 INFO [STDOUT] INFO 16-02 10:03:27,586 - SelectShards - Transformation has allocated 2 threads and 1 rowsets.
10:03:27,587 INFO [STDOUT] INFO 16-02 10:03:27,587 - Copy rows to result - Starting to run...
10:03:27,588 INFO [STDOUT] INFO 16-02 10:03:27,588 - Table input - Finished reading query, closing connection.
10:03:27,590 INFO [STDOUT] INFO 16-02 10:03:27,590 - tsacommon - Connection to database closed!
10:03:27,590 INFO [STDOUT] INFO 16-02 10:03:27,590 - Table input - Finished processing (I=2, O=0, R=0, W=2, U=0, E=0)
10:03:27,611 INFO [STDOUT] INFO 16-02 10:03:27,611 - Copy rows to result - Finished processing (I=0, O=0, R=2, W=2, U=0, E=0)
10:03:27,616 INFO [STDOUT] INFO 16-02 10:03:27,616 - StageDataFromShards - Starting entry [StageDataFromShard]
10:03:27,616 INFO [STDOUT] INFO 16-02 10:03:27,616 - StageDataFromShards - exec(19, 0, StageDataFromShard.0)
10:03:27,616 INFO [STDOUT] INFO 16-02 10:03:27,616 - StageDataFromShard - Starting job entry
10:03:27,616 INFO [STDOUT] INFO 16-02 10:03:27,616 - StageDataFromShard - Loading job from repository : [/ : StageDataFromShard]
10:03:27,631 INFO [STDOUT] INFO 16-02 10:03:27,631 - StageDataFromShard - exec(20, 0, START.0)
10:03:27,631 INFO [STDOUT] INFO 16-02 10:03:27,631 - START - Starting job entry
10:03:27,632 INFO [STDOUT] INFO 16-02 10:03:27,632 - StageDataFromShard - Starting entry [SetShardConnectionVariables]
10:03:27,632 INFO [STDOUT] INFO 16-02 10:03:27,632 - StageDataFromShard - exec(21, 0, SetShardConnectionVariables.0)
10:03:27,633 INFO [STDOUT] INFO 16-02 10:03:27,633 - SetShardConnectionVariables - Starting job entry
10:03:27,633 INFO [STDOUT] INFO 16-02 10:03:27,633 - SetShardConnectionVariables - Opening transformation: [null] in directory [/]
10:03:27,633 INFO [STDOUT] INFO 16-02 10:03:27,633 - SetShardConnectionVariables - Loading transformation from repository [SetShardConnectionVariables] in directory [/]
10:03:27,651 INFO [STDOUT] INFO 16-02 10:03:27,651 - SetShardConnectionVariables - Starting transformation...(file=null, name=SetShardConnectionVariables, repinfo=null)
10:03:27,652 INFO [STDOUT] INFO 16-02 10:03:27,652 - SetShardConnectionVariables - Transformation is pre-loaded.
10:03:27,652 INFO [STDOUT] INFO 16-02 10:03:27,652 - SetShardConnectionVariables - Dispatching started for transformation [SetShardConnectionVariables]
10:03:27,653 INFO [STDOUT] INFO 16-02 10:03:27,653 - SetShardConnectionVariables - Nr of arguments detected:0
10:03:27,653 INFO [STDOUT] INFO 16-02 10:03:27,653 - SetShardConnectionVariables - This is not a replay transformation
10:03:27,653 INFO [STDOUT] INFO 16-02 10:03:27,653 - SetShardConnectionVariables - I found 2 different steps to launch.
10:03:27,653 INFO [STDOUT] INFO 16-02 10:03:27,653 - SetShardConnectionVariables - Allocating rowsets...
10:03:27,653 INFO [STDOUT] INFO 16-02 10:03:27,653 - SetShardConnectionVariables - Allocating rowsets for step 0 --> Get rows from result
10:03:27,653 INFO [STDOUT] INFO 16-02 10:03:27,653 - SetShardConnectionVariables - prevcopies = 1, nextcopies=1
10:03:27,653 INFO [STDOUT] INFO 16-02 10:03:27,653 - SetShardConnectionVariables - Transformation allocated new rowset [Get rows from result.0 - Set Variables.0]
10:03:27,653 INFO [STDOUT] INFO 16-02 10:03:27,653 - SetShardConnectionVariables - Allocated 1 rowsets for step 0 --> Get rows from result
10:03:27,654 INFO [STDOUT] INFO 16-02 10:03:27,654 - SetShardConnectionVariables - Allocating rowsets for step 1 --> Set Variables
10:03:27,654 INFO [STDOUT] INFO 16-02 10:03:27,654 - SetShardConnectionVariables - Allocated 1 rowsets for step 1 --> Set Variables
10:03:27,654 INFO [STDOUT] INFO 16-02 10:03:27,654 - SetShardConnectionVariables - Allocating Steps & StepData...
10:03:27,654 INFO [STDOUT] INFO 16-02 10:03:27,654 - SetShardConnectionVariables - Transformation is about to allocate step [Get rows from result] of type [RowsFromResult]
10:03:27,654 INFO [STDOUT] INFO 16-02 10:03:27,654 - Get rows from result - distribution activated
10:03:27,654 INFO [STDOUT] INFO 16-02 10:03:27,654 - Get rows from result - Starting allocation of buffers & new threads...
10:03:27,654 INFO [STDOUT] INFO 16-02 10:03:27,654 - Get rows from result - Step info: nrinput=0 nroutput=1
10:03:27,654 INFO [STDOUT] INFO 16-02 10:03:27,654 - Get rows from result - output rel. is 1:1
10:03:27,655 INFO [STDOUT] INFO 16-02 10:03:27,655 - Get rows from result - Found output rowset [Get rows from result.0 - Set Variables.0]
10:03:27,655 INFO [STDOUT] INFO 16-02 10:03:27,655 - Get rows from result - Finished dispatching
10:03:27,655 INFO [STDOUT] INFO 16-02 10:03:27,655 - SetShardConnectionVariables - Transformation has allocated a new step: [Get rows from result].0
10:03:27,655 INFO [STDOUT] INFO 16-02 10:03:27,655 - SetShardConnectionVariables - Transformation is about to allocate step [Set Variables] of type [SetVariable]
10:03:27,655 INFO [STDOUT] INFO 16-02 10:03:27,655 - Set Variables - distribution activated
10:03:27,655 INFO [STDOUT] INFO 16-02 10:03:27,655 - Set Variables - Starting allocation of buffers & new threads...
10:03:27,656 INFO [STDOUT] INFO 16-02 10:03:27,656 - Set Variables - Step info: nrinput=1 nroutput=0
10:03:27,656 INFO [STDOUT] INFO 16-02 10:03:27,656 - Set Variables - Got previous step from [Set Variables] #0 --> Get rows from result
10:03:27,656 INFO [STDOUT] INFO 16-02 10:03:27,656 - Set Variables - input rel is 1:1
10:03:27,656 INFO [STDOUT] INFO 16-02 10:03:27,656 - Set Variables - Found input rowset [Get rows from result.0 - Set Variables.0]
10:03:27,656 INFO [STDOUT] INFO 16-02 10:03:27,656 - Set Variables - Finished dispatching
10:03:27,656 INFO [STDOUT] INFO 16-02 10:03:27,656 - SetShardConnectionVariables - Transformation has allocated a new step: [Set Variables].0
10:03:27,657 INFO [STDOUT] INFO 16-02 10:03:27,656 - SetShardConnectionVariables - This transformation can be replayed with replay date: 2012/02/16 10:03:27
10:03:27,657 INFO [STDOUT] INFO 16-02 10:03:27,657 - SetShardConnectionVariables - Initialising 2 steps...
10:03:27,657 INFO [STDOUT] INFO 16-02 10:03:27,657 - Get rows from result - Running on slave server #0/1.
10:03:27,657 INFO [STDOUT] INFO 16-02 10:03:27,657 - Set Variables - Running on slave server #0/1.
10:03:27,658 INFO [STDOUT] INFO 16-02 10:03:27,658 - SetShardConnectionVariables - Step [Get rows from result.0] initialized flawlessly.
10:03:27,658 INFO [STDOUT] INFO 16-02 10:03:27,658 - SetShardConnectionVariables - Step [Set Variables.0] initialized flawlessly.
10:03:27,658 INFO [STDOUT] INFO 16-02 10:03:27,658 - Get rows from result - Starting to run...
10:03:27,658 INFO [STDOUT] INFO 16-02 10:03:27,658 - Get rows from result - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
10:03:27,659 INFO [STDOUT] INFO 16-02 10:03:27,659 - SetShardConnectionVariables - Transformation has allocated 2 threads and 1 rowsets.
10:03:27,659 INFO [STDOUT] INFO 16-02 10:03:27,659 - Set Variables - Starting to run...
10:03:27,659 INFO [STDOUT] INFO 16-02 10:03:27,659 - Set Variables - Setting environment variables...
10:03:27,659 INFO [STDOUT] INFO 16-02 10:03:27,659 - Set Variables - Set variable DATABASE to value [st-tracker]
10:03:27,659 INFO [STDOUT] INFO 16-02 10:03:27,659 - Set Variables - Set variable HOST to value [acctdb-01-write]
10:03:27,659 INFO [STDOUT] INFO 16-02 10:03:27,659 - Set Variables - Set variable PORT to value [3307]
10:03:27,675 INFO [STDOUT] INFO 16-02 10:03:27,675 - Set Variables - Finished after 1 rows.
10:03:27,675 INFO [STDOUT] INFO 16-02 10:03:27,675 - Set Variables - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
10:03:27,680 INFO [STDOUT] INFO 16-02 10:03:27,680 - StageDataFromShard - Starting entry [Write To Log]
10:03:27,680 INFO [STDOUT] INFO 16-02 10:03:27,680 - StageDataFromShard - exec(22, 0, Write To Log.0)
10:03:27,680 INFO [STDOUT] INFO 16-02 10:03:27,680 - Write To Log - Starting job entry
10:03:27,680 INFO [STDOUT] INFO 16-02 10:03:27,680 - connection: - st-tracker
acctdb-01-write
3307
select a.id, a.description customerID, a.isActive from admaxCampaigns ac join tsacommon.accounts a on a.ID = ac.accountID group by ac.accountID
10:03:27,681 INFO [STDOUT] INFO 16-02 10:03:27,681 - StageDataFromShard - Starting entry [StageDataForShard]
10:03:27,681 INFO [STDOUT] INFO 16-02 10:03:27,681 - StageDataFromShard - exec(23, 0, StageDataForShard.0)
10:03:27,681 INFO [STDOUT] INFO 16-02 10:03:27,681 - StageDataForShard - Starting job entry
10:03:27,681 INFO [STDOUT] INFO 16-02 10:03:27,681 - StageDataForShard - Opening transformation: [null] in directory [/]
10:03:27,682 INFO [STDOUT] INFO 16-02 10:03:27,682 - StageDataForShard - Loading transformation from repository [StageDataForShard] in directory [/]
10:03:27,702 INFO [STDOUT] INFO 16-02 10:03:27,702 - StageDataForShard - Starting transformation...(file=null, name=StageDataForShard, repinfo=null)
10:03:27,702 INFO [STDOUT] INFO 16-02 10:03:27,702 - StageDataForShard - Transformation is pre-loaded.
10:03:27,702 INFO [STDOUT] INFO 16-02 10:03:27,702 - StageDataForShard - Dispatching started for transformation [StageDataForShard]
10:03:27,702 INFO [STDOUT] INFO 16-02 10:03:27,702 - StageDataForShard - Nr of arguments detected:0
10:03:27,703 INFO [STDOUT] INFO 16-02 10:03:27,703 - StageDataForShard - This is not a replay transformation
10:03:27,703 INFO [STDOUT] INFO 16-02 10:03:27,703 - StageDataForShard - I found 3 different steps to launch.
10:03:27,703 INFO [STDOUT] INFO 16-02 10:03:27,703 - StageDataForShard - Allocating rowsets...
10:03:27,703 INFO [STDOUT] INFO 16-02 10:03:27,703 - StageDataForShard - Allocating rowsets for step 0 --> Write to log
10:03:27,703 INFO [STDOUT] INFO 16-02 10:03:27,703 - StageDataForShard - prevcopies = 1, nextcopies=1
10:03:27,703 INFO [STDOUT] INFO 16-02 10:03:27,703 - StageDataForShard - Transformation allocated new rowset [Write to log.0 - Table input.0]
10:03:27,703 INFO [STDOUT] INFO 16-02 10:03:27,703 - StageDataForShard - Allocated 1 rowsets for step 0 --> Write to log
10:03:27,704 INFO [STDOUT] INFO 16-02 10:03:27,704 - StageDataForShard - Allocating rowsets for step 1 --> Table input
10:03:27,704 INFO [STDOUT] INFO 16-02 10:03:27,704 - StageDataForShard - prevcopies = 1, nextcopies=1
10:03:27,704 INFO [STDOUT] INFO 16-02 10:03:27,704 - StageDataForShard - Transformation allocated new rowset [Table input.0 - Table output.0]
10:03:27,704 INFO [STDOUT] INFO 16-02 10:03:27,704 - StageDataForShard - Allocated 2 rowsets for step 1 --> Table input
10:03:27,704 INFO [STDOUT] INFO 16-02 10:03:27,704 - StageDataForShard - Allocating rowsets for step 2 --> Table output
10:03:27,704 INFO [STDOUT] INFO 16-02 10:03:27,704 - StageDataForShard - Allocated 2 rowsets for step 2 --> Table output
10:03:27,704 INFO [STDOUT] INFO 16-02 10:03:27,704 - StageDataForShard - Allocating Steps & StepData...
10:03:27,704 INFO [STDOUT] INFO 16-02 10:03:27,704 - StageDataForShard - Transformation is about to allocate step [Write to log] of type [WriteToLog]
10:03:27,705 INFO [STDOUT] INFO 16-02 10:03:27,705 - Write to log - distribution activated
10:03:27,705 INFO [STDOUT] INFO 16-02 10:03:27,705 - Write to log - Starting allocation of buffers & new threads...
10:03:27,705 INFO [STDOUT] INFO 16-02 10:03:27,705 - Write to log - Step info: nrinput=0 nroutput=1
10:03:27,705 INFO [STDOUT] INFO 16-02 10:03:27,705 - Write to log - output rel. is 1:1
10:03:27,705 INFO [STDOUT] INFO 16-02 10:03:27,705 - Write to log - Found output rowset [Write to log.0 - Table input.0]
10:03:27,705 INFO [STDOUT] INFO 16-02 10:03:27,705 - Write to log - Finished dispatching
10:03:27,705 INFO [STDOUT] INFO 16-02 10:03:27,705 - StageDataForShard - Transformation has allocated a new step: [Write to log].0
10:03:27,706 INFO [STDOUT] INFO 16-02 10:03:27,706 - StageDataForShard - Transformation is about to allocate step [Table input] of type [TableInput]
10:03:27,706 INFO [STDOUT] INFO 16-02 10:03:27,706 - Table input - Starting allocation of buffers & new threads...
10:03:27,706 INFO [STDOUT] INFO 16-02 10:03:27,706 - Table input - Step info: nrinput=1 nroutput=1
10:03:27,706 INFO [STDOUT] INFO 16-02 10:03:27,706 - Table input - Got previous step from [Table input] #0 --> Write to log
10:03:27,706 INFO [STDOUT] INFO 16-02 10:03:27,706 - Table input - input rel is 1:1
10:03:27,706 INFO [STDOUT] INFO 16-02 10:03:27,706 - Table input - Found input rowset [Write to log.0 - Table input.0]
10:03:27,706 INFO [STDOUT] INFO 16-02 10:03:27,706 - Table input - output rel. is 1:1
10:03:27,706 INFO [STDOUT] INFO 16-02 10:03:27,706 - Table input - Found output rowset [Table input.0 - Table output.0]
10:03:27,707 INFO [STDOUT] INFO 16-02 10:03:27,707 - Table input - Finished dispatching
10:03:27,707 INFO [STDOUT] INFO 16-02 10:03:27,707 - StageDataForShard - Transformation has allocated a new step: [Table input].0
10:03:27,707 INFO [STDOUT] INFO 16-02 10:03:27,707 - StageDataForShard - Transformation is about to allocate step [Table output] of type [TableOutput]
10:03:27,707 INFO [STDOUT] INFO 16-02 10:03:27,707 - Table output - distribution activated
10:03:27,707 INFO [STDOUT] INFO 16-02 10:03:27,707 - Table output - Starting allocation of buffers & new threads...
10:03:27,707 INFO [STDOUT] INFO 16-02 10:03:27,707 - Table output - Step info: nrinput=1 nroutput=0
10:03:27,707 INFO [STDOUT] INFO 16-02 10:03:27,707 - Table output - Got previous step from [Table output] #0 --> Table input
10:03:27,708 INFO [STDOUT] INFO 16-02 10:03:27,708 - Table output - input rel is 1:1
10:03:27,708 INFO [STDOUT] INFO 16-02 10:03:27,708 - Table output - Found input rowset [Table input.0 - Table output.0]
10:03:27,708 INFO [STDOUT] INFO 16-02 10:03:27,708 - Table output - Finished dispatching
10:03:27,708 INFO [STDOUT] INFO 16-02 10:03:27,708 - StageDataForShard - Transformation has allocated a new step: [Table output].0
10:03:27,708 INFO [STDOUT] INFO 16-02 10:03:27,708 - StageDataForShard - This transformation can be replayed with replay date: 2012/02/16 10:03:27
10:03:27,708 INFO [STDOUT] INFO 16-02 10:03:27,708 - StageDataForShard - Initialising 3 steps...
10:03:27,709 INFO [STDOUT] INFO 16-02 10:03:27,709 - Write to log - Running on slave server #0/1.
10:03:27,709 INFO [STDOUT] INFO 16-02 10:03:27,709 - Table input - Running on slave server #0/1.
10:03:27,713 INFO [STDOUT] INFO 16-02 10:03:27,713 - Table output - Running on slave server #0/1.
10:03:27,714 INFO [STDOUT] INFO 16-02 10:03:27,714 - pdi_staging - New database connection defined
10:03:27,723 INFO [STDOUT] INFO 16-02 10:03:27,723 - pdi_staging - Connected to database.
10:03:27,723 INFO [STDOUT] INFO 16-02 10:03:27,723 - Table output - Connected to database [pdi_staging] (commit=10000)
10:03:27,723 INFO [STDOUT] INFO 16-02 10:03:27,723 - pdi_staging - Auto commit off
10:03:27,723 INFO [STDOUT] INFO 16-02 10:03:27,723 - Shard - New database connection defined
10:03:27,810 INFO [STDOUT] INFO 16-02 10:03:27,810 - Shard - Connected to database.
10:03:27,811 INFO [STDOUT] INFO 16-02 10:03:27,811 - Shard - Auto commit off
10:03:27,811 INFO [STDOUT] INFO 16-02 10:03:27,811 - Table input - Connected to database...
10:03:27,812 INFO [STDOUT] INFO 16-02 10:03:27,812 - StageDataForShard - Step [Write to log.0] initialized flawlessly.
10:03:27,812 INFO [STDOUT] INFO 16-02 10:03:27,812 - StageDataForShard - Step [Table input.0] initialized flawlessly.
10:03:27,812 INFO [STDOUT] INFO 16-02 10:03:27,812 - StageDataForShard - Step [Table output.0] initialized flawlessly.
10:03:27,812 INFO [STDOUT] INFO 16-02 10:03:27,812 - Write to log - Starting to run...
10:03:27,813 INFO [STDOUT] INFO 16-02 10:03:27,813 - Write to log - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0)
10:03:27,813 INFO [STDOUT] INFO 16-02 10:03:27,813 - Table input - Starting to run...
10:03:27,813 INFO [STDOUT] INFO 16-02 10:03:27,813 - Table input - SQL query : select a.id, a.description customerID, a.isActive from admaxCampaigns ac join tsacommon.accounts a on a.ID = ac.accountID group by ac.accountID
10:03:27,813 INFO [STDOUT] INFO 16-02 10:03:27,813 - StageDataForShard - Transformation has allocated 3 threads and 2 rowsets.
10:03:27,814 INFO [STDOUT] INFO 16-02 10:03:27,814 - Table output - Starting to run...
10:03:27,815 INFO [STDOUT] INFO 16-02 10:03:27,815 - Table input - Finished reading query, closing connection.
10:03:27,817 INFO [STDOUT] INFO 16-02 10:03:27,817 - Shard - Connection to database closed!
10:03:27,817 INFO [STDOUT] INFO 16-02 10:03:27,817 - Table input - Finished processing (I=4, O=0, R=0, W=4, U=0, E=0)
10:03:27,819 INFO [STDOUT] INFO 16-02 10:03:27,819 - Table output - Prepared statement : INSERT INTO dfStructureAccounts (id, customerID, isActive) VALUES ( ?, ?, ?)
10:03:27,838 INFO [STDOUT] INFO 16-02 10:03:27,838 - pdi_staging - Connection to database closed!
10:03:27,838 INFO [STDOUT] INFO 16-02 10:03:27,838 - Table output - Finished processing (I=0, O=4, R=4, W=4, U=0, E=0)
10:03:27,844 INFO [STDOUT] INFO 16-02 10:03:27,844 - StageDataFromShard - Finished job entry [StageDataForShard] (result=[true])
10:03:27,844 INFO [STDOUT] INFO 16-02 10:03:27,844 - StageDataFromShard - Finished job entry [Write To Log] (result=[true])
10:03:27,844 INFO [STDOUT] INFO 16-02 10:03:27,844 - StageDataFromShard - Finished job entry [SetShardConnectionVariables] (result=[true])
10:03:27,845 INFO [STDOUT] INFO 16-02 10:03:27,845 - StageDataFromShard - exec(20, 0, START.0)
10:03:27,845 INFO [STDOUT] INFO 16-02 10:03:27,845 - START - Starting job entry
10:03:27,846 INFO [STDOUT] INFO 16-02 10:03:27,846 - StageDataFromShard - Starting entry [SetShardConnectionVariables]
10:03:27,846 INFO [STDOUT] INFO 16-02 10:03:27,846 - StageDataFromShard - exec(21, 0, SetShardConnectionVariables.0)
10:03:27,847 INFO [STDOUT] INFO 16-02 10:03:27,847 - SetShardConnectionVariables - Starting job entry
10:03:27,847 INFO [STDOUT] INFO 16-02 10:03:27,847 - SetShardConnectionVariables - Opening transformation: [null] in directory [/]
10:03:27,847 INFO [STDOUT] INFO 16-02 10:03:27,847 - SetShardConnectionVariables - Loading transformation from repository [SetShardConnectionVariables] in directory [/]
10:03:27,866 INFO [STDOUT] INFO 16-02 10:03:27,866 - SetShardConnectionVariables - Starting transformation...(file=null, name=SetShardConnectionVariables, repinfo=null)
10:03:27,867 INFO [STDOUT] INFO 16-02 10:03:27,867 - SetShardConnectionVariables - Transformation is pre-loaded.
10:03:27,867 INFO [STDOUT] INFO 16-02 10:03:27,867 - SetShardConnectionVariables - Dispatching started for transformation [SetShardConnectionVariables]
10:03:27,867 INFO [STDOUT] INFO 16-02 10:03:27,867 - SetShardConnectionVariables - Nr of arguments detected:0
10:03:27,867 INFO [STDOUT] INFO 16-02 10:03:27,867 - SetShardConnectionVariables - This is not a replay transformation
10:03:27,867 INFO [STDOUT] INFO 16-02 10:03:27,867 - SetShardConnectionVariables - I found 2 different steps to launch.
10:03:27,867 INFO [STDOUT] INFO 16-02 10:03:27,867 - SetShardConnectionVariables - Allocating rowsets...
10:03:27,867 INFO [STDOUT] INFO 16-02 10:03:27,867 - SetShardConnectionVariables - Allocating rowsets for step 0 --> Get rows from result
10:03:27,868 INFO [STDOUT] INFO 16-02 10:03:27,868 - SetShardConnectionVariables - prevcopies = 1, nextcopies=1
10:03:27,868 INFO [STDOUT] INFO 16-02 10:03:27,868 - SetShardConnectionVariables - Transformation allocated new rowset [Get rows from result.0 - Set Variables.0]
10:03:27,868 INFO [STDOUT] INFO 16-02 10:03:27,868 - SetShardConnectionVariables - Allocated 1 rowsets for step 0 --> Get rows from result
10:03:27,868 INFO [STDOUT] INFO 16-02 10:03:27,868 - SetShardConnectionVariables - Allocating rowsets for step 1 --> Set Variables
10:03:27,868 INFO [STDOUT] INFO 16-02 10:03:27,868 - SetShardConnectionVariables - Allocated 1 rowsets for step 1 --> Set Variables
10:03:27,868 INFO [STDOUT] INFO 16-02 10:03:27,868 - SetShardConnectionVariables - Allocating Steps & StepData...
10:03:27,868 INFO [STDOUT] INFO 16-02 10:03:27,868 - SetShardConnectionVariables - Transformation is about to allocate step [Get rows from result] of type [RowsFromResult]
10:03:27,869 INFO [STDOUT] INFO 16-02 10:03:27,868 - Get rows from result - distribution activated
10:03:27,869 INFO [STDOUT] INFO 16-02 10:03:27,869 - Get rows from result - Starting allocation of buffers & new threads...
10:03:27,869 INFO [STDOUT] INFO 16-02 10:03:27,869 - Get rows from result - Step info: nrinput=0 nroutput=1
10:03:27,869 INFO [STDOUT] INFO 16-02 10:03:27,869 - Get rows from result - output rel. is 1:1
10:03:27,869 INFO [STDOUT] INFO 16-02 10:03:27,869 - Get rows from result - Found output rowset [Get rows from result.0 - Set Variables.0]
10:03:27,869 INFO [STDOUT] INFO 16-02 10:03:27,869 - Get rows from result - Finished dispatching
10:03:27,869 INFO [STDOUT] INFO 16-02 10:03:27,869 - SetShardConnectionVariables - Transformation has allocated a new step: [Get rows from result].0
10:03:27,869 INFO [STDOUT] INFO 16-02 10:03:27,869 - SetShardConnectionVariables - Transformation is about to allocate step [Set Variables] of type [SetVariable]
10:03:27,870 INFO [STDOUT] INFO 16-02 10:03:27,869 - Set Variables - distribution activated
10:03:27,870 INFO [STDOUT] INFO 16-02 10:03:27,870 - Set Variables - Starting allocation of buffers & new threads...
10:03:27,870 INFO [STDOUT] INFO 16-02 10:03:27,870 - Set Variables - Step info: nrinput=1 nroutput=0
10:03:27,870 INFO [STDOUT] INFO 16-02 10:03:27,870 - Set Variables - Got previous step from [Set Variables] #0 --> Get rows from result
10:03:27,870 INFO [STDOUT] INFO 16-02 10:03:27,870 - Set Variables - input rel is 1:1
10:03:27,870 INFO [STDOUT] INFO 16-02 10:03:27,870 - Set Variables - Found input rowset [Get rows from result.0 - Set Variables.0]
10:03:27,870 INFO [STDOUT] INFO 16-02 10:03:27,870 - Set Variables - Finished dispatching
10:03:27,870 INFO [STDOUT] INFO 16-02 10:03:27,870 - SetShardConnectionVariables - Transformation has allocated a new step: [Set Variables].0
10:03:27,871 INFO [STDOUT] INFO 16-02 10:03:27,871 - SetShardConnectionVariables - This transformation can be replayed with replay date: 2012/02/16 10:03:27
10:03:27,871 INFO [STDOUT] INFO 16-02 10:03:27,871 - SetShardConnectionVariables - Initialising 2 steps...
10:03:27,871 INFO [STDOUT] INFO 16-02 10:03:27,871 - Get rows from result - Running on slave server #0/1.
10:03:27,871 INFO [STDOUT] INFO 16-02 10:03:27,871 - Set Variables - Running on slave server #0/1.
10:03:27,872 INFO [STDOUT] INFO 16-02 10:03:27,872 - SetShardConnectionVariables - Step [Get rows from result.0] initialized flawlessly.
10:03:27,872 INFO [STDOUT] INFO 16-02 10:03:27,872 - SetShardConnectionVariables - Step [Set Variables.0] initialized flawlessly.
10:03:27,872 INFO [STDOUT] INFO 16-02 10:03:27,872 - Get rows from result - Starting to run...
10:03:27,872 INFO [STDOUT] INFO 16-02 10:03:27,872 - Get rows from result - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
10:03:27,873 INFO [STDOUT] INFO 16-02 10:03:27,873 - SetShardConnectionVariables - Transformation has allocated 2 threads and 1 rowsets.
10:03:27,873 INFO [STDOUT] INFO 16-02 10:03:27,873 - Set Variables - Starting to run...
10:03:27,873 INFO [STDOUT] INFO 16-02 10:03:27,873 - Set Variables - Setting environment variables...
10:03:27,873 INFO [STDOUT] INFO 16-02 10:03:27,873 - Set Variables - Set variable DATABASE to value [st-tracker]
10:03:27,873 INFO [STDOUT] INFO 16-02 10:03:27,873 - Set Variables - Set variable HOST to value [acctdb-02-write]
10:03:27,874 INFO [STDOUT] INFO 16-02 10:03:27,874 - Set Variables - Set variable PORT to value [3310]
10:03:27,887 INFO [STDOUT] INFO 16-02 10:03:27,887 - Set Variables - Finished after 1 rows.
10:03:27,887 INFO [STDOUT] INFO 16-02 10:03:27,887 - Set Variables - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
10:03:27,896 INFO [STDOUT] INFO 16-02 10:03:27,896 - StageDataFromShard - Starting entry [Write To Log]
10:03:27,896 INFO [STDOUT] INFO 16-02 10:03:27,896 - StageDataFromShard - exec(22, 0, Write To Log.0)
10:03:27,896 INFO [STDOUT] INFO 16-02 10:03:27,896 - Write To Log - Starting job entry
10:03:27,897 INFO [STDOUT] INFO 16-02 10:03:27,897 - connection: - st-tracker
acctdb-02-write
3310
select a.id, a.description customerID, a.isActive from admaxCampaigns ac join tsacommon.accounts a on a.ID = ac.accountID group by ac.accountID
10:03:27,897 INFO [STDOUT] INFO 16-02 10:03:27,897 - StageDataFromShard - Starting entry [StageDataForShard]
10:03:27,897 INFO [STDOUT] INFO 16-02 10:03:27,897 - StageDataFromShard - exec(23, 0, StageDataForShard.0)
10:03:27,898 INFO [STDOUT] INFO 16-02 10:03:27,897 - StageDataForShard - Starting job entry
10:03:27,898 INFO [STDOUT] INFO 16-02 10:03:27,898 - StageDataForShard - Opening transformation: [null] in directory [/]
10:03:27,898 INFO [STDOUT] INFO 16-02 10:03:27,898 - StageDataForShard - Loading transformation from repository [StageDataForShard] in directory [/]
10:03:27,917 INFO [STDOUT] INFO 16-02 10:03:27,917 - StageDataForShard - Starting transformation...(file=null, name=StageDataForShard, repinfo=null)
10:03:27,917 INFO [STDOUT] INFO 16-02 10:03:27,917 - StageDataForShard - Transformation is pre-loaded.
10:03:27,917 INFO [STDOUT] INFO 16-02 10:03:27,917 - StageDataForShard - Dispatching started for transformation [StageDataForShard]
10:03:27,917 INFO [STDOUT] INFO 16-02 10:03:27,917 - StageDataForShard - Nr of arguments detected:0
10:03:27,918 INFO [STDOUT] INFO 16-02 10:03:27,918 - StageDataForShard - This is not a replay transformation
10:03:27,918 INFO [STDOUT] INFO 16-02 10:03:27,918 - StageDataForShard - I found 3 different steps to launch.
10:03:27,918 INFO [STDOUT] INFO 16-02 10:03:27,918 - StageDataForShard - Allocating rowsets...
10:03:27,918 INFO [STDOUT] INFO 16-02 10:03:27,918 - StageDataForShard - Allocating rowsets for step 0 --> Write to log
10:03:27,918 INFO [STDOUT] INFO 16-02 10:03:27,918 - StageDataForShard - prevcopies = 1, nextcopies=1
10:03:27,918 INFO [STDOUT] INFO 16-02 10:03:27,918 - StageDataForShard - Transformation allocated new rowset [Write to log.0 - Table input.0]
10:03:27,918 INFO [STDOUT] INFO 16-02 10:03:27,918 - StageDataForShard - Allocated 1 rowsets for step 0 --> Write to log
10:03:27,918 INFO [STDOUT] INFO 16-02 10:03:27,918 - StageDataForShard - Allocating rowsets for step 1 --> Table input
10:03:27,918 INFO [STDOUT] INFO 16-02 10:03:27,918 - StageDataForShard - prevcopies = 1, nextcopies=1
10:03:27,919 INFO [STDOUT] INFO 16-02 10:03:27,919 - StageDataForShard - Transformation allocated new rowset [Table input.0 - Table output.0]
10:03:27,919 INFO [STDOUT] INFO 16-02 10:03:27,919 - StageDataForShard - Allocated 2 rowsets for step 1 --> Table input
10:03:27,919 INFO [STDOUT] INFO 16-02 10:03:27,919 - StageDataForShard - Allocating rowsets for step 2 --> Table output
10:03:27,919 INFO [STDOUT] INFO 16-02 10:03:27,919 - StageDataForShard - Allocated 2 rowsets for step 2 --> Table output
10:03:27,919 INFO [STDOUT] INFO 16-02 10:03:27,919 - StageDataForShard - Allocating Steps & StepData...
10:03:27,919 INFO [STDOUT] INFO 16-02 10:03:27,919 - StageDataForShard - Transformation is about to allocate step [Write to log] of type [WriteToLog]
10:03:27,919 INFO [STDOUT] INFO 16-02 10:03:27,919 - Write to log - distribution activated
10:03:27,919 INFO [STDOUT] INFO 16-02 10:03:27,919 - Write to log - Starting allocation of buffers & new threads...
10:03:27,920 INFO [STDOUT] INFO 16-02 10:03:27,920 - Write to log - Step info: nrinput=0 nroutput=1
10:03:27,920 INFO [STDOUT] INFO 16-02 10:03:27,920 - Write to log - output rel. is 1:1
10:03:27,920 INFO [STDOUT] INFO 16-02 10:03:27,920 - Write to log - Found output rowset [Write to log.0 - Table input.0]
10:03:27,920 INFO [STDOUT] INFO 16-02 10:03:27,920 - Write to log - Finished dispatching
10:03:27,920 INFO [STDOUT] INFO 16-02 10:03:27,920 - StageDataForShard - Transformation has allocated a new step: [Write to log].0
10:03:27,920 INFO [STDOUT] INFO 16-02 10:03:27,920 - StageDataForShard - Transformation is about to allocate step [Table input] of type [TableInput]
10:03:27,920 INFO [STDOUT] INFO 16-02 10:03:27,920 - Table input - Starting allocation of buffers & new threads...
10:03:27,920 INFO [STDOUT] INFO 16-02 10:03:27,920 - Table input - Step info: nrinput=1 nroutput=1
10:03:27,921 INFO [STDOUT] INFO 16-02 10:03:27,921 - Table input - Got previous step from [Table input] #0 --> Write to log
10:03:27,921 INFO [STDOUT] INFO 16-02 10:03:27,921 - Table input - input rel is 1:1
10:03:27,921 INFO [STDOUT] INFO 16-02 10:03:27,921 - Table input - Found input rowset [Write to log.0 - Table input.0]
10:03:27,921 INFO [STDOUT] INFO 16-02 10:03:27,921 - Table input - output rel. is 1:1
10:03:27,921 INFO [STDOUT] INFO 16-02 10:03:27,921 - Table input - Found output rowset [Table input.0 - Table output.0]
10:03:27,921 INFO [STDOUT] INFO 16-02 10:03:27,921 - Table input - Finished dispatching
10:03:27,921 INFO [STDOUT] INFO 16-02 10:03:27,921 - StageDataForShard - Transformation has allocated a new step: [Table input].0
10:03:27,921 INFO [STDOUT] INFO 16-02 10:03:27,921 - StageDataForShard - Transformation is about to allocate step [Table output] of type [TableOutput]
10:03:27,922 INFO [STDOUT] INFO 16-02 10:03:27,922 - Table output - distribution activated
10:03:27,922 INFO [STDOUT] INFO 16-02 10:03:27,922 - Table output - Starting allocation of buffers & new threads...
10:03:27,922 INFO [STDOUT] INFO 16-02 10:03:27,922 - Table output - Step info: nrinput=1 nroutput=0
10:03:27,922 INFO [STDOUT] INFO 16-02 10:03:27,922 - Table output - Got previous step from [Table output] #0 --> Table input
10:03:27,922 INFO [STDOUT] INFO 16-02 10:03:27,922 - Table output - input rel is 1:1
10:03:27,922 INFO [STDOUT] INFO 16-02 10:03:27,922 - Table output - Found input rowset [Table input.0 - Table output.0]
10:03:27,922 INFO [STDOUT] INFO 16-02 10:03:27,922 - Table output - Finished dispatching
10:03:27,922 INFO [STDOUT] INFO 16-02 10:03:27,922 - StageDataForShard - Transformation has allocated a new step: [Table output].0
10:03:27,923 INFO [STDOUT] INFO 16-02 10:03:27,923 - StageDataForShard - This transformation can be replayed with replay date: 2012/02/16 10:03:27
10:03:27,923 INFO [STDOUT] INFO 16-02 10:03:27,923 - StageDataForShard - Initialising 3 steps...
10:03:27,923 INFO [STDOUT] INFO 16-02 10:03:27,923 - Write to log - Running on slave server #0/1.
10:03:27,923 INFO [STDOUT] INFO 16-02 10:03:27,923 - Table input - Running on slave server #0/1.
10:03:27,928 INFO [STDOUT] INFO 16-02 10:03:27,928 - Table output - Running on slave server #0/1.
10:03:27,928 INFO [STDOUT] INFO 16-02 10:03:27,928 - pdi_staging - New database connection defined
10:03:27,929 INFO [STDOUT] INFO 16-02 10:03:27,929 - Shard - New database connection defined
10:03:27,939 INFO [STDOUT] INFO 16-02 10:03:27,939 - pdi_staging - Connected to database.
10:03:27,939 INFO [STDOUT] INFO 16-02 10:03:27,939 - Table output - Connected to database [pdi_staging] (commit=10000)
10:03:27,939 INFO [STDOUT] INFO 16-02 10:03:27,939 - pdi_staging - Auto commit off
10:03:27,958 INFO [STDOUT] INFO 16-02 10:03:27,958 - Shard - Connected to database.
10:03:27,959 INFO [STDOUT] INFO 16-02 10:03:27,959 - Shard - Auto commit off
10:03:27,959 INFO [STDOUT] INFO 16-02 10:03:27,959 - Table input - Connected to database...
10:03:27,959 INFO [STDOUT] INFO 16-02 10:03:27,959 - StageDataForShard - Step [Write to log.0] initialized flawlessly.
10:03:27,959 INFO [STDOUT] INFO 16-02 10:03:27,959 - StageDataForShard - Step [Table input.0] initialized flawlessly.
10:03:27,959 INFO [STDOUT] INFO 16-02 10:03:27,959 - StageDataForShard - Step [Table output.0] initialized flawlessly.
10:03:27,960 INFO [STDOUT] INFO 16-02 10:03:27,960 - Write to log - Starting to run...
10:03:27,960 INFO [STDOUT] INFO 16-02 10:03:27,960 - Write to log - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0)
10:03:27,960 INFO [STDOUT] INFO 16-02 10:03:27,960 - Table input - Starting to run...
10:03:27,961 INFO [STDOUT] INFO 16-02 10:03:27,961 - Table input - SQL query : select a.id, a.description customerID, a.isActive from admaxCampaigns ac join tsacommon.accounts a on a.ID = ac.accountID group by ac.accountID
10:03:27,961 INFO [STDOUT] INFO 16-02 10:03:27,961 - StageDataForShard - Transformation has allocated 3 threads and 2 rowsets.
10:03:27,961 INFO [STDOUT] INFO 16-02 10:03:27,961 - Table output - Starting to run...
10:03:27,963 INFO [STDOUT] INFO 16-02 10:03:27,963 - Table input - Finished reading query, closing connection.
10:03:27,965 INFO [STDOUT] INFO 16-02 10:03:27,965 - Shard - Connection to database closed!
10:03:27,965 INFO [STDOUT] INFO 16-02 10:03:27,965 - Table input - Finished processing (I=5, O=0, R=0, W=5, U=0, E=0)
10:03:27,967 INFO [STDOUT] INFO 16-02 10:03:27,967 - Table output - Prepared statement : INSERT INTO dfStructureAccounts (id, customerID, isActive) VALUES ( ?, ?, ?)
10:03:27,985 INFO [STDOUT] INFO 16-02 10:03:27,985 - pdi_staging - Connection to database closed!
10:03:27,985 INFO [STDOUT] INFO 16-02 10:03:27,985 - Table output - Finished processing (I=0, O=5, R=5, W=5, U=0, E=0)
10:03:27,992 INFO [STDOUT] INFO 16-02 10:03:27,992 - StageDataFromShard - Finished job entry [StageDataForShard] (result=[true])
10:03:27,992 INFO [STDOUT] INFO 16-02 10:03:27,992 - StageDataFromShard - Finished job entry [Write To Log] (result=[true])
10:03:27,992 INFO [STDOUT] INFO 16-02 10:03:27,992 - StageDataFromShard - Finished job entry [SetShardConnectionVariables] (result=[true])
10:03:27,995 INFO [STDOUT] INFO 16-02 10:03:27,995 - StageDataFromShards - Finished job entry [StageDataFromShard] (result=[true])
10:03:27,996 INFO [STDOUT] INFO 16-02 10:03:27,995 - StageDataFromShards - Finished job entry [SelectShards] (result=[true])
10:03:27,996 INFO [STDOUT] INFO 16-02 10:03:27,996 - StageDataFromShards - Finished job entry [Write To Log] (result=[true])
10:03:28,003 INFO [STDOUT] INFO 16-02 10:03:28,003 - StageRequirement - Finished job entry [StageDataFromShards] (result=[true])
10:03:28,004 INFO [STDOUT] INFO 16-02 10:03:28,004 - StageRequirement - Finished job entry [Simple evaluation 2] (result=[true])
10:03:28,004 INFO [STDOUT] INFO 16-02 10:03:28,004 - StageRequirement - Finished job entry [Simple evaluation] (result=[true])
10:03:28,004 INFO [STDOUT] INFO 16-02 10:03:28,004 - StageRequirement - Finished job entry [TruncateStagingTable] (result=[true])
10:03:28,004 INFO [STDOUT] INFO 16-02 10:03:28,004 - StageRequirement - Finished job entry [SetRequirementStagingVariables] (result=[true])
10:03:28,011 INFO [STDOUT] INFO 16-02 10:03:28,011 - StageRequirement - exec(10, 0, START.0)
10:03:28,012 INFO [STDOUT] INFO 16-02 10:03:28,012 - START - Starting job entry
10:03:28,012 INFO [STDOUT] INFO 16-02 10:03:28,012 - StageRequirement - Starting entry [SetRequirementStagingVariables]
10:03:28,012 INFO [STDOUT] INFO 16-02 10:03:28,012 - StageRequirement - exec(11, 0, SetRequirementStagingVariables.0)
10:03:28,013 INFO [STDOUT] INFO 16-02 10:03:28,013 - SetRequirementStagingVariables - Starting job entry
10:03:28,013 INFO [STDOUT] INFO 16-02 10:03:28,013 - SetRequirementStagingVariables - Opening transformation: [null] in directory [/]
10:03:28,013 INFO [STDOUT] INFO 16-02 10:03:28,013 - SetRequirementStagingVariables - Loading transformation from repository [SetRequirementStagingVariables] in directory [/]
10:03:28,032 INFO [STDOUT] INFO 16-02 10:03:28,032 - SetRequirementStagingVariables - Starting transformation...(file=null, name=SetRequirementStagingVariables, repinfo=null)
10:03:28,033 INFO [STDOUT] INFO 16-02 10:03:28,033 - SetRequirementStagingVariables - Transformation is pre-loaded.
10:03:28,033 INFO [STDOUT] INFO 16-02 10:03:28,033 - SetRequirementStagingVariables - Dispatching started for transformation [SetRequirementStagingVariables]
10:03:28,033 INFO [STDOUT] INFO 16-02 10:03:28,033 - SetRequirementStagingVariables - Nr of arguments detected:0
10:03:28,033 INFO [STDOUT] INFO 16-02 10:03:28,033 - SetRequirementStagingVariables - This is not a replay transformation
10:03:28,033 INFO [STDOUT] INFO 16-02 10:03:28,033 - SetRequirementStagingVariables - I found 2 different steps to launch.
10:03:28,033 INFO [STDOUT] INFO 16-02 10:03:28,033 - SetRequirementStagingVariables - Allocating rowsets...
10:03:28,033 INFO [STDOUT] INFO 16-02 10:03:28,033 - SetRequirementStagingVariables - Allocating rowsets for step 0 --> Get rows from result
10:03:28,033 INFO [STDOUT] INFO 16-02 10:03:28,033 - SetRequirementStagingVariables - prevcopies = 1, nextcopies=1
10:03:28,034 INFO [STDOUT] INFO 16-02 10:03:28,034 - SetRequirementStagingVariables - Transformation allocated new rowset [Get rows from result.0 - Set Variables.0]
10:03:28,034 INFO [STDOUT] INFO 16-02 10:03:28,034 - SetRequirementStagingVariables - Allocated 1 rowsets for step 0 --> Get rows from result
10:03:28,034 INFO [STDOUT] INFO 16-02 10:03:28,034 - SetRequirementStagingVariables - Allocating rowsets for step 1 --> Set Variables
10:03:28,034 INFO [STDOUT] INFO 16-02 10:03:28,034 - SetRequirementStagingVariables - Allocated 1 rowsets for step 1 --> Set Variables
10:03:28,034 INFO [STDOUT] INFO 16-02 10:03:28,034 - SetRequirementStagingVariables - Allocating Steps & StepData...
10:03:28,034 INFO [STDOUT] INFO 16-02 10:03:28,034 - SetRequirementStagingVariables - Transformation is about to allocate step [Get rows from result] of type [RowsFromResult]
10:03:28,034 INFO [STDOUT] INFO 16-02 10:03:28,034 - Get rows from result - distribution activated
10:03:28,034 INFO [STDOUT] INFO 16-02 10:03:28,034 - Get rows from result - Starting allocation of buffers & new threads...
10:03:28,035 INFO [STDOUT] INFO 16-02 10:03:28,034 - Get rows from result - Step info: nrinput=0 nroutput=1
10:03:28,035 INFO [STDOUT] INFO 16-02 10:03:28,035 - Get rows from result - output rel. is 1:1
10:03:28,035 INFO [STDOUT] INFO 16-02 10:03:28,035 - Get rows from result - Found output rowset [Get rows from result.0 - Set Variables.0]
10:03:28,035 INFO [STDOUT] INFO 16-02 10:03:28,035 - Get rows from result - Finished dispatching
10:03:28,035 INFO [STDOUT] INFO 16-02 10:03:28,035 - SetRequirementStagingVariables - Transformation has allocated a new step: [Get rows from result].0
10:03:28,035 INFO [STDOUT] INFO 16-02 10:03:28,035 - SetRequirementStagingVariables - Transformation is about to allocate step [Set Variables] of type [SetVariable]
10:03:28,035 INFO [STDOUT] INFO 16-02 10:03:28,035 - Set Variables - distribution activated
10:03:28,035 INFO [STDOUT] INFO 16-02 10:03:28,035 - Set Variables - Starting allocation of buffers & new threads...
10:03:28,036 INFO [STDOUT] INFO 16-02 10:03:28,036 - Set Variables - Step info: nrinput=1 nroutput=0
10:03:28,036 INFO [STDOUT] INFO 16-02 10:03:28,036 - Set Variables - Got previous step from [Set Variables] #0 --> Get rows from result
10:03:28,036 INFO [STDOUT] INFO 16-02 10:03:28,036 - Set Variables - input rel is 1:1
10:03:28,036 INFO [STDOUT] INFO 16-02 10:03:28,036 - Set Variables - Found input rowset [Get rows from result.0 - Set Variables.0]
10:03:28,036 INFO [STDOUT] INFO 16-02 10:03:28,036 - Set Variables - Finished dispatching
10:03:28,036 INFO [STDOUT] INFO 16-02 10:03:28,036 - SetRequirementStagingVariables - Transformation has allocated a new step: [Set Variables].0
10:03:28,036 INFO [STDOUT] INFO 16-02 10:03:28,036 - SetRequirementStagingVariables - This transformation can be replayed with replay date: 2012/02/16 10:03:28
10:03:28,037 INFO [STDOUT] INFO 16-02 10:03:28,037 - SetRequirementStagingVariables - Initialising 2 steps...
10:03:28,037 INFO [STDOUT] INFO 16-02 10:03:28,037 - Get rows from result - Running on slave server #0/1.
10:03:28,037 INFO [STDOUT] INFO 16-02 10:03:28,037 - Set Variables - Running on slave server #0/1.
10:03:28,038 INFO [STDOUT] INFO 16-02 10:03:28,038 - SetRequirementStagingVariables - Step [Get rows from result.0] initialized flawlessly.
10:03:28,038 INFO [STDOUT] INFO 16-02 10:03:28,038 - SetRequirementStagingVariables - Step [Set Variables.0] initialized flawlessly.
10:03:28,038 INFO [STDOUT] INFO 16-02 10:03:28,038 - Get rows from result - Starting to run...
10:03:28,038 INFO [STDOUT] INFO 16-02 10:03:28,038 - Get rows from result - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
10:03:28,039 INFO [STDOUT] INFO 16-02 10:03:28,039 - SetRequirementStagingVariables - Transformation has allocated 2 threads and 1 rowsets.
10:03:28,039 INFO [STDOUT] INFO 16-02 10:03:28,039 - Set Variables - Starting to run...
10:03:28,039 INFO [STDOUT] INFO 16-02 10:03:28,039 - Set Variables - Setting environment variables...
10:03:28,039 INFO [STDOUT] INFO 16-02 10:03:28,039 - Set Variables - Set variable STAGINGTABLENAME to value [dfStructureAdMaxCampaigns]
10:03:28,039 INFO [STDOUT] INFO 16-02 10:03:28,039 - Set Variables - Set variable QUERY to value [select ac.id, ac.accountID, ac.description, cast(substring_index(substring_index(ac.description, '_', 2), '_', -1) as signed) businessAreaID, cast(substring_index(substring_index(ac.description, '_', 3), '_', -1) as signed) businessLocationID from admaxCampaigns ac]
10:03:28,039 INFO [STDOUT] INFO 16-02 10:03:28,039 - Set Variables - Set variable SHARDPATTERN to value [st-tracker]
10:03:28,055 INFO [STDOUT] INFO 16-02 10:03:28,055 - Set Variables - Finished after 1 rows.
10:03:28,055 INFO [STDOUT] INFO 16-02 10:03:28,055 - Set Variables - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
10:03:28,064 INFO [STDOUT] INFO 16-02 10:03:28,064 - StageRequirement - Starting entry [TruncateStagingTable]
10:03:28,064 INFO [STDOUT] INFO 16-02 10:03:28,064 - StageRequirement - exec(12, 0, TruncateStagingTable.0)
10:03:28,064 INFO [STDOUT] INFO 16-02 10:03:28,064 - TruncateStagingTable - Starting job entry
10:03:28,065 INFO [STDOUT] INFO 16-02 10:03:28,065 - TruncateStagingTable - Opening transformation: [null] in directory [/]
10:03:28,065 INFO [STDOUT] INFO 16-02 10:03:28,065 - TruncateStagingTable - Loading transformation from repository [TruncateStagingTable] in directory [/]
10:03:28,083 INFO [STDOUT] INFO 16-02 10:03:28,083 - TruncateStagingTable - Starting transformation...(file=null, name=TruncateStagingTable, repinfo=null)
10:03:28,083 INFO [STDOUT] INFO 16-02 10:03:28,083 - TruncateStagingTable - Transformation is pre-loaded.
10:03:28,083 INFO [STDOUT] INFO 16-02 10:03:28,083 - TruncateStagingTable - Dispatching started for transformation [TruncateStagingTable]
10:03:28,084 INFO [STDOUT] INFO 16-02 10:03:28,083 - TruncateStagingTable - Nr of arguments detected:0
10:03:28,084 INFO [STDOUT] INFO 16-02 10:03:28,084 - TruncateStagingTable - This is not a replay transformation
10:03:28,084 INFO [STDOUT] INFO 16-02 10:03:28,084 - TruncateStagingTable - I found 4 different steps to launch.
10:03:28,084 INFO [STDOUT] INFO 16-02 10:03:28,084 - TruncateStagingTable - Allocating rowsets...
10:03:28,084 INFO [STDOUT] INFO 16-02 10:03:28,084 - TruncateStagingTable - Allocating rowsets for step 0 --> Get Variables
10:03:28,084 INFO [STDOUT] INFO 16-02 10:03:28,084 - TruncateStagingTable - prevcopies = 1, nextcopies=1
10:03:28,084 INFO [STDOUT] INFO 16-02 10:03:28,084 - TruncateStagingTable - Transformation allocated new rowset [Get Variables.0 - Switch / Case.0]
10:03:28,084 INFO [STDOUT] INFO 16-02 10:03:28,084 - TruncateStagingTable - Allocated 1 rowsets for step 0 --> Get Variables
10:03:28,084 INFO [STDOUT] INFO 16-02 10:03:28,084 - TruncateStagingTable - Allocating rowsets for step 1 --> Switch / Case
10:03:28,085 INFO [STDOUT] INFO 16-02 10:03:28,085 - TruncateStagingTable - prevcopies = 1, nextcopies=1
10:03:28,085 INFO [STDOUT] INFO 16-02 10:03:28,085 - TruncateStagingTable - Transformation allocated new rowset [Switch / Case.0 - Execute SQL script trunc.0]
10:03:28,085 INFO [STDOUT] INFO 16-02 10:03:28,085 - TruncateStagingTable - prevcopies = 1, nextcopies=1
10:03:28,085 INFO [STDOUT] INFO 16-02 10:03:28,085 - TruncateStagingTable - Transformation allocated new rowset [Switch / Case.0 - Dummy (do nothing).0]
10:03:28,085 INFO [STDOUT] INFO 16-02 10:03:28,085 - TruncateStagingTable - Allocated 3 rowsets for step 1 --> Switch / Case
10:03:28,085 INFO [STDOUT] INFO 16-02 10:03:28,085 - TruncateStagingTable - Allocating rowsets for step 2 --> Execute SQL script trunc
10:03:28,085 INFO [STDOUT] INFO 16-02 10:03:28,085 - TruncateStagingTable - Allocated 3 rowsets for step 2 --> Execute SQL script trunc
10:03:28,085 INFO [STDOUT] INFO 16-02 10:03:28,085 - TruncateStagingTable - Allocating rowsets for step 3 --> Dummy (do nothing)
10:03:28,085 INFO [STDOUT] INFO 16-02 10:03:28,085 - TruncateStagingTable - Allocated 3 rowsets for step 3 --> Dummy (do nothing)
10:03:28,086 INFO [STDOUT] INFO 16-02 10:03:28,085 - TruncateStagingTable - Allocating Steps & StepData...
10:03:28,086 INFO [STDOUT] INFO 16-02 10:03:28,086 - TruncateStagingTable - Transformation is about to allocate step [Get Variables] of type [GetVariable]
10:03:28,086 INFO [STDOUT] INFO 16-02 10:03:28,086 - Get Variables - distribution activated
10:03:28,086 INFO [STDOUT] INFO 16-02 10:03:28,086 - Get Variables - Starting allocation of buffers & new threads...
10:03:28,086 INFO [STDOUT] INFO 16-02 10:03:28,086 - Get Variables - Step info: nrinput=0 nroutput=1
10:03:28,086 INFO [STDOUT] INFO 16-02 10:03:28,086 - Get Variables - output rel. is 1:1
10:03:28,086 INFO [STDOUT] INFO 16-02 10:03:28,086 - Get Variables - Found output rowset [Get Variables.0 - Switch / Case.0]
10:03:28,086 INFO [STDOUT] INFO 16-02 10:03:28,086 - Get Variables - Finished dispatching
10:03:28,087 INFO [STDOUT] INFO 16-02 10:03:28,087 - TruncateStagingTable - Transformation has allocated a new step: [Get Variables].0
10:03:28,087 INFO [STDOUT] INFO 16-02 10:03:28,087 - TruncateStagingTable - Transformation is about to allocate step [Switch / Case] of type [SwitchCase]
10:03:28,087 INFO [STDOUT] INFO 16-02 10:03:28,087 - Switch / Case - distribution activated
10:03:28,087 INFO [STDOUT] INFO 16-02 10:03:28,087 - Switch / Case - Starting allocation of buffers & new threads...
10:03:28,087 INFO [STDOUT] INFO 16-02 10:03:28,087 - Switch / Case - Step info: nrinput=1 nroutput=2
10:03:28,087 INFO [STDOUT] INFO 16-02 10:03:28,087 - Switch / Case - Got previous step from [Switch / Case] #0 --> Get Variables
10:03:28,087 INFO [STDOUT] INFO 16-02 10:03:28,087 - Switch / Case - input rel is 1:1
10:03:28,087 INFO [STDOUT] INFO 16-02 10:03:28,087 - Switch / Case - Found input rowset [Get Variables.0 - Switch / Case.0]
10:03:28,088 INFO [STDOUT] INFO 16-02 10:03:28,088 - Switch / Case - output rel. is 1:1
10:03:28,088 INFO [STDOUT] INFO 16-02 10:03:28,088 - Switch / Case - Found output rowset [Switch / Case.0 - Execute SQL script trunc.0]
10:03:28,088 INFO [STDOUT] INFO 16-02 10:03:28,088 - Switch / Case - output rel. is 1:1
10:03:28,088 INFO [STDOUT] INFO 16-02 10:03:28,088 - Switch / Case - Found output rowset [Switch / Case.0 - Dummy (do nothing).0]
10:03:28,088 INFO [STDOUT] INFO 16-02 10:03:28,088 - Switch / Case - Finished dispatching
10:03:28,089 INFO [STDOUT] INFO 16-02 10:03:28,088 - TruncateStagingTable - Transformation has allocated a new step: [Switch / Case].0
10:03:28,089 INFO [STDOUT] INFO 16-02 10:03:28,089 - TruncateStagingTable - Transformation is about to allocate step [Execute SQL script trunc] of type [ExecSQL]
10:03:28,089 INFO [STDOUT] INFO 16-02 10:03:28,089 - Execute SQL script trunc - distribution activated
10:03:28,089 INFO [STDOUT] INFO 16-02 10:03:28,089 - Execute SQL script trunc - Starting allocation of buffers & new threads...
10:03:28,089 INFO [STDOUT] INFO 16-02 10:03:28,089 - Execute SQL script trunc - Step info: nrinput=1 nroutput=0
10:03:28,089 INFO [STDOUT] INFO 16-02 10:03:28,089 - Execute SQL script trunc - Got previous step from [Execute SQL script trunc] #0 --> Switch / Case
10:03:28,090 INFO [STDOUT] INFO 16-02 10:03:28,089 - Execute SQL script trunc - input rel is 1:1
10:03:28,090 INFO [STDOUT] INFO 16-02 10:03:28,090 - Execute SQL script trunc - Found input rowset [Switch / Case.0 - Execute SQL script trunc.0]
10:03:28,090 INFO [STDOUT] INFO 16-02 10:03:28,090 - Execute SQL script trunc - Finished dispatching
10:03:28,090 INFO [STDOUT] INFO 16-02 10:03:28,090 - TruncateStagingTable - Transformation has allocated a new step: [Execute SQL script trunc].0
10:03:28,090 INFO [STDOUT] INFO 16-02 10:03:28,090 - TruncateStagingTable - Transformation is about to allocate step [Dummy (do nothing)] of type [Dummy]
10:03:28,090 INFO [STDOUT] INFO 16-02 10:03:28,090 - Dummy (do nothing) - distribution activated
10:03:28,090 INFO [STDOUT] INFO 16-02 10:03:28,090 - Dummy (do nothing) - Starting allocation of buffers & new threads...
10:03:28,090 INFO [STDOUT] INFO 16-02 10:03:28,090 - Dummy (do nothing) - Step info: nrinput=1 nroutput=0
10:03:28,091 INFO [STDOUT] INFO 16-02 10:03:28,090 - Dummy (do nothing) - Got previous step from [Dummy (do nothing)] #0 --> Switch / Case
10:03:28,091 INFO [STDOUT] INFO 16-02 10:03:28,091 - Dummy (do nothing) - input rel is 1:1
10:03:28,091 INFO [STDOUT] INFO 16-02 10:03:28,091 - Dummy (do nothing) - Found input rowset [Switch / Case.0 - Dummy (do nothing).0]
10:03:28,091 INFO [STDOUT] INFO 16-02 10:03:28,091 - Dummy (do nothing) - Finished dispatching
10:03:28,091 INFO [STDOUT] INFO 16-02 10:03:28,091 - TruncateStagingTable - Transformation has allocated a new step: [Dummy (do nothing)].0
10:03:28,091 INFO [STDOUT] INFO 16-02 10:03:28,091 - TruncateStagingTable - This transformation can be replayed with replay date: 2012/02/16 10:03:28
10:03:28,092 INFO [STDOUT] INFO 16-02 10:03:28,091 - TruncateStagingTable - Initialising 4 steps...
10:03:28,092 INFO [STDOUT] INFO 16-02 10:03:28,092 - Get Variables - Running on slave server #0/1.
10:03:28,092 INFO [STDOUT] INFO 16-02 10:03:28,092 - Switch / Case - Running on slave server #0/1.
10:03:28,093 INFO [STDOUT] INFO 16-02 10:03:28,093 - Execute SQL script trunc - Running on slave server #0/1.
10:03:28,093 INFO [STDOUT] INFO 16-02 10:03:28,093 - pdi_stage - New database connection defined
10:03:28,106 INFO [STDOUT] INFO 16-02 10:03:28,106 - pdi_stage - Connected to database.
10:03:28,106 INFO [STDOUT] INFO 16-02 10:03:28,106 - Execute SQL script trunc - Connected to database...
10:03:28,107 INFO [STDOUT] INFO 16-02 10:03:28,107 - pdi_stage - launch DDL statement:
truncate dfStructureAdMaxCampaigns
10:03:28,108 INFO [STDOUT] INFO 16-02 10:03:28,108 - Dummy (do nothing) - Running on slave server #0/1.
10:03:28,123 INFO [STDOUT] INFO 16-02 10:03:28,123 - pdi_stage - 1 statement executed
10:03:28,123 INFO [STDOUT] INFO 16-02 10:03:28,123 - TruncateStagingTable - Step [Get Variables.0] initialized flawlessly.
10:03:28,123 INFO [STDOUT] INFO 16-02 10:03:28,123 - TruncateStagingTable - Step [Switch / Case.0] initialized flawlessly.
10:03:28,123 INFO [STDOUT] INFO 16-02 10:03:28,123 - TruncateStagingTable - Step [Execute SQL script trunc.0] initialized flawlessly.
10:03:28,123 INFO [STDOUT] INFO 16-02 10:03:28,123 - TruncateStagingTable - Step [Dummy (do nothing).0] initialized flawlessly.
10:03:28,124 INFO [STDOUT] INFO 16-02 10:03:28,124 - Get Variables - Starting to run...
10:03:28,124 INFO [STDOUT] INFO 16-02 10:03:28,124 - Get Variables - field [stagingTableName] has value [STAGINGTABLENAME]
10:03:28,124 INFO [STDOUT] INFO 16-02 10:03:28,124 - Get Variables - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
10:03:28,125 INFO [STDOUT] INFO 16-02 10:03:28,125 - Switch / Case - Starting to run...
10:03:28,125 INFO [STDOUT] INFO 16-02 10:03:28,125 - Execute SQL script trunc - Starting to run...
10:03:28,125 INFO [STDOUT] INFO 16-02 10:03:28,125 - Execute SQL script trunc - Finished reading query, closing connection.
10:03:28,126 INFO [STDOUT] INFO 16-02 10:03:28,125 - pdi_stage - Connection to database closed!
10:03:28,126 INFO [STDOUT] INFO 16-02 10:03:28,126 - Execute SQL script trunc - Finished processing (I=0, O=0, R=0, W=1, U=0, E=0)
10:03:28,126 INFO [STDOUT] INFO 16-02 10:03:28,126 - TruncateStagingTable - Transformation has allocated 4 threads and 3 rowsets.
10:03:28,130 INFO [STDOUT] INFO 16-02 10:03:28,130 - Dummy (do nothing) - Starting to run...
10:03:28,143 INFO [STDOUT] INFO 16-02 10:03:28,143 - Switch / Case - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
10:03:28,159 INFO [STDOUT] INFO 16-02 10:03:28,159 - Dummy (do nothing) - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0)
10:03:28,164 INFO [STDOUT] INFO 16-02 10:03:28,164 - StageRequirement - Starting entry [Simple evaluation]
10:03:28,164 INFO [STDOUT] INFO 16-02 10:03:28,164 - StageRequirement - exec(13, 0, Simple evaluation.0)
10:03:28,165 INFO [STDOUT] INFO 16-02 10:03:28,165 - Simple evaluation - Starting job entry
10:03:28,165 INFO [STDOUT] INFO 16-02 10:03:28,165 - Simple evaluation - Checking variable [${SHARDPATTERN}] ...
10:03:28,165 INFO [STDOUT] INFO 16-02 10:03:28,165 - Simple evaluation - Value to evaluate is st-tracker
10:03:28,166 INFO [STDOUT] INFO 16-02 10:03:28,166 - StageRequirement - Starting entry [Simple evaluation 2]
10:03:28,166 INFO [STDOUT] INFO 16-02 10:03:28,166 - StageRequirement - exec(14, 0, Simple evaluation 2.0)
10:03:28,166 INFO [STDOUT] INFO 16-02 10:03:28,166 - Simple evaluation - Starting job entry
10:03:28,166 INFO [STDOUT] INFO 16-02 10:03:28,166 - Simple evaluation - Checking variable [${SHARDPATTERN}] ...
10:03:28,166 INFO [STDOUT] INFO 16-02 10:03:28,166 - Simple evaluation - Value to evaluate is st-tracker
10:03:28,167 INFO [STDOUT] INFO 16-02 10:03:28,167 - StageRequirement - Starting entry [StageDataFromShards]
10:03:28,167 INFO [STDOUT] INFO 16-02 10:03:28,167 - StageRequirement - exec(15, 0, StageDataFromShards.0)
10:03:28,168 INFO [STDOUT] INFO 16-02 10:03:28,168 - StageDataFromShards - Starting job entry
10:03:28,168 INFO [STDOUT] INFO 16-02 10:03:28,168 - StageDataFromShards - Loading job from repository : [/ : StageDataFromShards]
10:03:28,182 INFO [STDOUT] INFO 16-02 10:03:28,181 - StageDataFromShards - exec(16, 0, START.0)
10:03:28,182 INFO [STDOUT] INFO 16-02 10:03:28,182 - START - Starting job entry
10:03:28,183 INFO [STDOUT] INFO 16-02 10:03:28,183 - StageDataFromShards - Starting entry [Write To Log]
10:03:28,183 INFO [STDOUT] INFO 16-02 10:03:28,183 - StageDataFromShards - exec(17, 0, Write To Log.0)
10:03:28,183 INFO [STDOUT] INFO 16-02 10:03:28,183 - Write To Log - Starting job entry
10:03:28,184 INFO [STDOUT] INFO 16-02 10:03:28,184 - End: - dfStructureAdMaxCampaigns
select ac.id, ac.accountID, ac.description, cast(substring_index(substring_index(ac.description, '_', 2), '_', -1) as signed) businessAreaID, cast(substring_index(substring_index(ac.description, '_', 3), '_', -1) as signed) businessLocationID from admaxCampaigns ac
st-tracker
10:03:28,184 INFO [STDOUT] INFO 16-02 10:03:28,184 - StageDataFromShards - Starting entry [SelectShards]
10:03:28,184 INFO [STDOUT] INFO 16-02 10:03:28,184 - StageDataFromShards - exec(18, 0, SelectShards.0)
10:03:28,185 INFO [STDOUT] INFO 16-02 10:03:28,185 - SelectShards - Starting job entry
10:03:28,185 INFO [STDOUT] INFO 16-02 10:03:28,185 - SelectShards - Opening transformation: [null] in directory [/]
10:03:28,185 INFO [STDOUT] INFO 16-02 10:03:28,185 - SelectShards - Loading transformation from repository [SelectShards] in directory [/]
10:03:28,203 INFO [STDOUT] INFO 16-02 10:03:28,202 - SelectShards - Starting transformation...(file=null, name=SelectShards, repinfo=null)
10:03:28,203 INFO [STDOUT] INFO 16-02 10:03:28,203 - SelectShards - Transformation is pre-loaded.
10:03:28,203 INFO [STDOUT] INFO 16-02 10:03:28,203 - SelectShards - Dispatching started for transformation [SelectShards]
10:03:28,203 INFO [STDOUT] INFO 16-02 10:03:28,203 - SelectShards - Nr of arguments detected:0
10:03:28,203 INFO [STDOUT] INFO 16-02 10:03:28,203 - SelectShards - This is not a replay transformation
10:03:28,203 INFO [STDOUT] INFO 16-02 10:03:28,203 - SelectShards - I found 2 different steps to launch.
10:03:28,203 INFO [STDOUT] INFO 16-02 10:03:28,203 - SelectShards - Allocating rowsets...
10:03:28,204 INFO [STDOUT] INFO 16-02 10:03:28,204 - SelectShards - Allocating rowsets for step 0 --> Table input
10:03:28,204 INFO [STDOUT] INFO 16-02 10:03:28,204 - SelectShards - prevcopies = 1, nextcopies=1
10:03:28,204 INFO [STDOUT] INFO 16-02 10:03:28,204 - SelectShards - Transformation allocated new rowset [Table input.0 - Copy rows to result.0]
10:03:28,204 INFO [STDOUT] INFO 16-02 10:03:28,204 - SelectShards - Allocated 1 rowsets for step 0 --> Table input
10:03:28,204 INFO [STDOUT] INFO 16-02 10:03:28,204 - SelectShards - Allocating rowsets for step 1 --> Copy rows to result
10:03:28,204 INFO [STDOUT] INFO 16-02 10:03:28,204 - SelectShards - Allocated 1 rowsets for step 1 --> Copy rows to result
10:03:28,204 INFO [STDOUT] INFO 16-02 10:03:28,204 - SelectShards - Allocating Steps & StepData...
10:03:28,204 INFO [STDOUT] INFO 16-02 10:03:28,204 - SelectShards - Transformation is about to allocate step [Table input] of type [TableInput]
10:03:28,205 INFO [STDOUT] INFO 16-02 10:03:28,205 - Table input - distribution activated
10:03:28,205 INFO [STDOUT] INFO 16-02 10:03:28,205 - Table input - Starting allocation of buffers & new threads...
10:03:28,205 INFO [STDOUT] INFO 16-02 10:03:28,205 - Table input - Step info: nrinput=0 nroutput=1
10:03:28,205 INFO [STDOUT] INFO 16-02 10:03:28,205 - Table input - output rel. is 1:1
10:03:28,205 INFO [STDOUT] INFO 16-02 10:03:28,205 - Table input - Found output rowset [Table input.0 - Copy rows to result.0]
10:03:28,205 INFO [STDOUT] INFO 16-02 10:03:28,205 - Table input - Finished dispatching
10:03:28,205 INFO [STDOUT] INFO 16-02 10:03:28,205 - SelectShards - Transformation has allocated a new step: [Table input].0
10:03:28,205 INFO [STDOUT] INFO 16-02 10:03:28,205 - SelectShards - Transformation is about to allocate step [Copy rows to result] of type [RowsToResult]
10:03:28,206 INFO [STDOUT] INFO 16-02 10:03:28,206 - Copy rows to result - distribution activated
10:03:28,206 INFO [STDOUT] INFO 16-02 10:03:28,206 - Copy rows to result - Starting allocation of buffers & new threads...
10:03:28,206 INFO [STDOUT] INFO 16-02 10:03:28,206 - Copy rows to result - Step info: nrinput=1 nroutput=0
10:03:28,206 INFO [STDOUT] INFO 16-02 10:03:28,206 - Copy rows to result - Got previous step from [Copy rows to result] #0 --> Table input
10:03:28,206 INFO [STDOUT] INFO 16-02 10:03:28,206 - Copy rows to result - input rel is 1:1
10:03:28,206 INFO [STDOUT] INFO 16-02 10:03:28,206 - Copy rows to result - Found input rowset [Table input.0 - Copy rows to result.0]
10:03:28,206 INFO [STDOUT] INFO 16-02 10:03:28,206 - Copy rows to result - Finished dispatching
10:03:28,206 INFO [STDOUT] INFO 16-02 10:03:28,206 - SelectShards - Transformation has allocated a new step: [Copy rows to result].0
10:03:28,207 INFO [STDOUT] INFO 16-02 10:03:28,207 - SelectShards - This transformation can be replayed with replay date: 2012/02/16 10:03:28
10:03:28,207 INFO [STDOUT] INFO 16-02 10:03:28,207 - SelectShards - Initialising 2 steps...
10:03:28,207 INFO [STDOUT] INFO 16-02 10:03:28,207 - Table input - Running on slave server #0/1.
10:03:28,212 INFO [STDOUT] INFO 16-02 10:03:28,211 - tsacommon - New database connection defined
10:03:28,214 INFO [STDOUT] INFO 16-02 10:03:28,214 - Copy rows to result - Running on slave server #0/1.
10:03:28,224 INFO [STDOUT] INFO 16-02 10:03:28,224 - tsacommon - Connected to database.
10:03:28,225 INFO [STDOUT] INFO 16-02 10:03:28,225 - tsacommon - Auto commit off
10:03:28,225 INFO [STDOUT] INFO 16-02 10:03:28,225 - Table input - Connected to database...
10:03:28,225 INFO [STDOUT] INFO 16-02 10:03:28,225 - SelectShards - Step [Table input.0] initialized flawlessly.
10:03:28,225 INFO [STDOUT] INFO 16-02 10:03:28,225 - SelectShards - Step [Copy rows to result.0] initialized flawlessly.
10:03:28,226 INFO [STDOUT] INFO 16-02 10:03:28,226 - Table input - Starting to run...
10:03:28,226 INFO [STDOUT] INFO 16-02 10:03:28,226 - Table input - SQL query : SELECT
id
, name
, description
, type
, `DATABASE`
, host
, port
, access
FROM databaseInstances
WHERE `DATABASE` like "st-tracker"
10:03:28,226 INFO [STDOUT] INFO 16-02 10:03:28,226 - SelectShards - Transformation has allocated 2 threads and 1 rowsets.
10:03:28,226 INFO [STDOUT] INFO 16-02 10:03:28,226 - Copy rows to result - Starting to run...
10:03:28,228 INFO [STDOUT] INFO 16-02 10:03:28,228 - Table input - Finished reading query, closing connection.
10:03:28,229 INFO [STDOUT] INFO 16-02 10:03:28,229 - tsacommon - Connection to database closed!
10:03:28,229 INFO [STDOUT] INFO 16-02 10:03:28,229 - Table input - Finished processing (I=2, O=0, R=0, W=2, U=0, E=0)
10:03:28,247 INFO [STDOUT] INFO 16-02 10:03:28,247 - Copy rows to result - Finished processing (I=0, O=0, R=2, W=2, U=0, E=0)
10:03:28,257 INFO [STDOUT] INFO 16-02 10:03:28,256 - StageDataFromShards - Starting entry [StageDataFromShard]
10:03:28,257 INFO [STDOUT] INFO 16-02 10:03:28,257 - StageDataFromShards - exec(19, 0, StageDataFromShard.0)
10:03:28,257 INFO [STDOUT] INFO 16-02 10:03:28,257 - StageDataFromShard - Starting job entry
10:03:28,257 INFO [STDOUT] INFO 16-02 10:03:28,257 - StageDataFromShard - Loading job from repository : [/ : StageDataFromShard]
10:03:28,271 INFO [STDOUT] INFO 16-02 10:03:28,271 - StageDataFromShard - exec(20, 0, START.0)
10:03:28,271 INFO [STDOUT] INFO 16-02 10:03:28,271 - START - Starting job entry
10:03:28,273 INFO [STDOUT] INFO 16-02 10:03:28,272 - StageDataFromShard - Starting entry [SetShardConnectionVariables]
10:03:28,273 INFO [STDOUT] INFO 16-02 10:03:28,273 - StageDataFromShard - exec(21, 0, SetShardConnectionVariables.0)
10:03:28,273 INFO [STDOUT] INFO 16-02 10:03:28,273 - SetShardConnectionVariables - Starting job entry
10:03:28,273 INFO [STDOUT] INFO 16-02 10:03:28,273 - SetShardConnectionVariables - Opening transformation: [null] in directory [/]
10:03:28,273 INFO [STDOUT] INFO 16-02 10:03:28,273 - SetShardConnectionVariables - Loading transformation from repository [SetShardConnectionVariables] in directory [/]
10:03:28,289 INFO [STDOUT] INFO 16-02 10:03:28,289 - SetShardConnectionVariables - Starting transformation...(file=null, name=SetShardConnectionVariables, repinfo=null)
10:03:28,289 INFO [STDOUT] INFO 16-02 10:03:28,289 - SetShardConnectionVariables - Transformation is pre-loaded.
10:03:28,289 INFO [STDOUT] INFO 16-02 10:03:28,289 - SetShardConnectionVariables - Dispatching started for transformation [SetShardConnectionVariables]
10:03:28,289 INFO [STDOUT] INFO 16-02 10:03:28,289 - SetShardConnectionVariables - Nr of arguments detected:0
10:03:28,289 INFO [STDOUT] INFO 16-02 10:03:28,289 - SetShardConnectionVariables - This is not a replay transformation
10:03:28,290 INFO [STDOUT] INFO 16-02 10:03:28,290 - SetShardConnectionVariables - I found 2 different steps to launch.
10:03:28,290 INFO [STDOUT] INFO 16-02 10:03:28,290 - SetShardConnectionVariables - Allocating rowsets...
10:03:28,290 INFO [STDOUT] INFO 16-02 10:03:28,290 - SetShardConnectionVariables - Allocating rowsets for step 0 --> Get rows from result
10:03:28,290 INFO [STDOUT] INFO 16-02 10:03:28,290 - SetShardConnectionVariables - prevcopies = 1, nextcopies=1
10:03:28,290 INFO [STDOUT] INFO 16-02 10:03:28,290 - SetShardConnectionVariables - Transformation allocated new rowset [Get rows from result.0 - Set Variables.0]
10:03:28,290 INFO [STDOUT] INFO 16-02 10:03:28,290 - SetShardConnectionVariables - Allocated 1 rowsets for step 0 --> Get rows from result
10:03:28,290 INFO [STDOUT] INFO 16-02 10:03:28,290 - SetShardConnectionVariables - Allocating rowsets for step 1 --> Set Variables
10:03:28,290 INFO [STDOUT] INFO 16-02 10:03:28,290 - SetShardConnectionVariables - Allocated 1 rowsets for step 1 --> Set Variables
10:03:28,290 INFO [STDOUT] INFO 16-02 10:03:28,290 - SetShardConnectionVariables - Allocating Steps & StepData...
10:03:28,291 INFO [STDOUT] INFO 16-02 10:03:28,291 - SetShardConnectionVariables - Transformation is about to allocate step [Get rows from result] of type [RowsFromResult]
10:03:28,291 INFO [STDOUT] INFO 16-02 10:03:28,291 - Get rows from result - distribution activated
10:03:28,291 INFO [STDOUT] INFO 16-02 10:03:28,291 - Get rows from result - Starting allocation of buffers & new threads...
10:03:28,291 INFO [STDOUT] INFO 16-02 10:03:28,291 - Get rows from result - Step info: nrinput=0 nroutput=1
10:03:28,291 INFO [STDOUT] INFO 16-02 10:03:28,291 - Get rows from result - output rel. is 1:1
10:03:28,291 INFO [STDOUT] INFO 16-02 10:03:28,291 - Get rows from result - Found output rowset [Get rows from result.0 - Set Variables.0]
10:03:28,291 INFO [STDOUT] INFO 16-02 10:03:28,291 - Get rows from result - Finished dispatching
10:03:28,292 INFO [STDOUT] INFO 16-02 10:03:28,292 - SetShardConnectionVariables - Transformation has allocated a new step: [Get rows from result].0
10:03:28,292 INFO [STDOUT] INFO 16-02 10:03:28,292 - SetShardConnectionVariables - Transformation is about to allocate step [Set Variables] of type [SetVariable]
10:03:28,292 INFO [STDOUT] INFO 16-02 10:03:28,292 - Set Variables - distribution activated
10:03:28,292 INFO [STDOUT] INFO 16-02 10:03:28,292 - Set Variables - Starting allocation of buffers & new threads...
10:03:28,292 INFO [STDOUT] INFO 16-02 10:03:28,292 - Set Variables - Step info: nrinput=1 nroutput=0
10:03:28,292 INFO [STDOUT] INFO 16-02 10:03:28,292 - Set Variables - Got previous step from [Set Variables] #0 --> Get rows from result
10:03:28,292 INFO [STDOUT] INFO 16-02 10:03:28,292 - Set Variables - input rel is 1:1
10:03:28,292 INFO [STDOUT] INFO 16-02 10:03:28,292 - Set Variables - Found input rowset [Get rows from result.0 - Set Variables.0]
10:03:28,292 INFO [STDOUT] INFO 16-02 10:03:28,292 - Set Variables - Finished dispatching
10:03:28,293 INFO [STDOUT] INFO 16-02 10:03:28,293 - SetShardConnectionVariables - Transformation has allocated a new step: [Set Variables].0
10:03:28,293 INFO [STDOUT] INFO 16-02 10:03:28,293 - SetShardConnectionVariables - This transformation can be replayed with replay date: 2012/02/16 10:03:28
10:03:28,293 INFO [STDOUT] INFO 16-02 10:03:28,293 - SetShardConnectionVariables - Initialising 2 steps...
10:03:28,293 INFO [STDOUT] INFO 16-02 10:03:28,293 - Get rows from result - Running on slave server #0/1.
10:03:28,294 INFO [STDOUT] INFO 16-02 10:03:28,294 - Set Variables - Running on slave server #0/1.
10:03:28,294 INFO [STDOUT] INFO 16-02 10:03:28,294 - SetShardConnectionVariables - Step [Get rows from result.0] initialized flawlessly.
10:03:28,294 INFO [STDOUT] INFO 16-02 10:03:28,294 - SetShardConnectionVariables - Step [Set Variables.0] initialized flawlessly.
10:03:28,294 INFO [STDOUT] INFO 16-02 10:03:28,294 - Get rows from result - Starting to run...
10:03:28,295 INFO [STDOUT] INFO 16-02 10:03:28,295 - Get rows from result - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
10:03:28,295 INFO [STDOUT] INFO 16-02 10:03:28,295 - SetShardConnectionVariables - Transformation has allocated 2 threads and 1 rowsets.
10:03:28,295 INFO [STDOUT] INFO 16-02 10:03:28,295 - Set Variables - Starting to run...
10:03:28,295 INFO [STDOUT] INFO 16-02 10:03:28,295 - Set Variables - Setting environment variables...
10:03:28,295 INFO [STDOUT] INFO 16-02 10:03:28,295 - Set Variables - Set variable DATABASE to value [st-tracker]
10:03:28,296 INFO [STDOUT] INFO 16-02 10:03:28,296 - Set Variables - Set variable HOST to value [acctdb-01-write]
10:03:28,296 INFO [STDOUT] INFO 16-02 10:03:28,296 - Set Variables - Set variable PORT to value [3307]
10:03:28,311 INFO [STDOUT] INFO 16-02 10:03:28,311 - Set Variables - Finished after 1 rows.
10:03:28,311 INFO [STDOUT] INFO 16-02 10:03:28,311 - Set Variables - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
10:03:28,320 INFO [STDOUT] INFO 16-02 10:03:28,320 - StageDataFromShard - Starting entry [Write To Log]
10:03:28,320 INFO [STDOUT] INFO 16-02 10:03:28,320 - StageDataFromShard - exec(22, 0, Write To Log.0)
10:03:28,320 INFO [STDOUT] INFO 16-02 10:03:28,320 - Write To Log - Starting job entry
10:03:28,321 INFO [STDOUT] INFO 16-02 10:03:28,321 - connection: - st-tracker
acctdb-01-write
3307
select ac.id, ac.accountID, ac.description, cast(substring_index(substring_index(ac.description, '_', 2), '_', -1) as signed) businessAreaID, cast(substring_index(substring_index(ac.description, '_', 3), '_', -1) as signed) businessLocationID from admaxCampaigns ac
10:03:28,321 INFO [STDOUT] INFO 16-02 10:03:28,321 - StageDataFromShard - Starting entry [StageDataForShard]
10:03:28,321 INFO [STDOUT] INFO 16-02 10:03:28,321 - StageDataFromShard - exec(23, 0, StageDataForShard.0)
10:03:28,322 INFO [STDOUT] INFO 16-02 10:03:28,322 - StageDataForShard - Starting job entry
10:03:28,322 INFO [STDOUT] INFO 16-02 10:03:28,322 - StageDataForShard - Opening transformation: [null] in directory [/]
10:03:28,322 INFO [STDOUT] INFO 16-02 10:03:28,322 - StageDataForShard - Loading transformation from repository [StageDataForShard] in directory [/]
10:03:28,340 INFO [STDOUT] INFO 16-02 10:03:28,340 - StageDataForShard - Starting transformation...(file=null, name=StageDataForShard, repinfo=null)
10:03:28,340 INFO [STDOUT] INFO 16-02 10:03:28,340 - StageDataForShard - Transformation is pre-loaded.
10:03:28,340 INFO [STDOUT] INFO 16-02 10:03:28,340 - StageDataForShard - Dispatching started for transformation [StageDataForShard]
10:03:28,340 INFO [STDOUT] INFO 16-02 10:03:28,340 - StageDataForShard - Nr of arguments detected:0
10:03:28,341 INFO [STDOUT] INFO 16-02 10:03:28,341 - StageDataForShard - This is not a replay transformation
10:03:28,341 INFO [STDOUT] INFO 16-02 10:03:28,341 - StageDataForShard - I found 3 different steps to launch.
10:03:28,341 INFO [STDOUT] INFO 16-02 10:03:28,341 - StageDataForShard - Allocating rowsets...
10:03:28,341 INFO [STDOUT] INFO 16-02 10:03:28,341 - StageDataForShard - Allocating rowsets for step 0 --> Write to log
10:03:28,341 INFO [STDOUT] INFO 16-02 10:03:28,341 - StageDataForShard - prevcopies = 1, nextcopies=1
10:03:28,341 INFO [STDOUT] INFO 16-02 10:03:28,341 - StageDataForShard - Transformation allocated new rowset [Write to log.0 - Table input.0]
10:03:28,341 INFO [STDOUT] INFO 16-02 10:03:28,341 - StageDataForShard - Allocated 1 rowsets for step 0 --> Write to log
10:03:28,341 INFO [STDOUT] INFO 16-02 10:03:28,341 - StageDataForShard - Allocating rowsets for step 1 --> Table input
10:03:28,342 INFO [STDOUT] INFO 16-02 10:03:28,341 - StageDataForShard - prevcopies = 1, nextcopies=1
10:03:28,342 INFO [STDOUT] INFO 16-02 10:03:28,342 - StageDataForShard - Transformation allocated new rowset [Table input.0 - Table output.0]
10:03:28,342 INFO [STDOUT] INFO 16-02 10:03:28,342 - StageDataForShard - Allocated 2 rowsets for step 1 --> Table input
10:03:28,342 INFO [STDOUT] INFO 16-02 10:03:28,342 - StageDataForShard - Allocating rowsets for step 2 --> Table output
10:03:28,342 INFO [STDOUT] INFO 16-02 10:03:28,342 - StageDataForShard - Allocated 2 rowsets for step 2 --> Table output
10:03:28,342 INFO [STDOUT] INFO 16-02 10:03:28,342 - StageDataForShard - Allocating Steps & StepData...
10:03:28,342 INFO [STDOUT] INFO 16-02 10:03:28,342 - StageDataForShard - Transformation is about to allocate step [Write to log] of type [WriteToLog]
10:03:28,342 INFO [STDOUT] INFO 16-02 10:03:28,342 - Write to log - distribution activated
10:03:28,343 INFO [STDOUT] INFO 16-02 10:03:28,343 - Write to log - Starting allocation of buffers & new threads...
10:03:28,343 INFO [STDOUT] INFO 16-02 10:03:28,343 - Write to log - Step info: nrinput=0 nroutput=1
10:03:28,343 INFO [STDOUT] INFO 16-02 10:03:28,343 - Write to log - output rel. is 1:1
10:03:28,343 INFO [STDOUT] INFO 16-02 10:03:28,343 - Write to log - Found output rowset [Write to log.0 - Table input.0]
10:03:28,343 INFO [STDOUT] INFO 16-02 10:03:28,343 - Write to log - Finished dispatching
10:03:28,343 INFO [STDOUT] INFO 16-02 10:03:28,343 - StageDataForShard - Transformation has allocated a new step: [Write to log].0
10:03:28,343 INFO [STDOUT] INFO 16-02 10:03:28,343 - StageDataForShard - Transformation is about to allocate step [Table input] of type [TableInput]
10:03:28,344 INFO [STDOUT] INFO 16-02 10:03:28,343 - Table input - Starting allocation of buffers & new threads...
10:03:28,344 INFO [STDOUT] INFO 16-02 10:03:28,344 - Table input - Step info: nrinput=1 nroutput=1
10:03:28,344 INFO [STDOUT] INFO 16-02 10:03:28,344 - Table input - Got previous step from [Table input] #0 --> Write to log
10:03:28,344 INFO [STDOUT] INFO 16-02 10:03:28,344 - Table input - input rel is 1:1
10:03:28,344 INFO [STDOUT] INFO 16-02 10:03:28,344 - Table input - Found input rowset [Write to log.0 - Table input.0]
10:03:28,344 INFO [STDOUT] INFO 16-02 10:03:28,344 - Table input - output rel. is 1:1
10:03:28,344 INFO [STDOUT] INFO 16-02 10:03:28,344 - Table input - Found output rowset [Table input.0 - Table output.0]
10:03:28,344 INFO [STDOUT] INFO 16-02 10:03:28,344 - Table input - Finished dispatching
10:03:28,344 INFO [STDOUT] INFO 16-02 10:03:28,344 - StageDataForShard - Transformation has allocated a new step: [Table input].0
10:03:28,345 INFO [STDOUT] INFO 16-02 10:03:28,344 - StageDataForShard - Transformation is about to allocate step [Table output] of type [TableOutput]
10:03:28,345 INFO [STDOUT] INFO 16-02 10:03:28,345 - Table output - distribution activated
10:03:28,345 INFO [STDOUT] INFO 16-02 10:03:28,345 - Table output - Starting allocation of buffers & new threads...
10:03:28,345 INFO [STDOUT] INFO 16-02 10:03:28,345 - Table output - Step info: nrinput=1 nroutput=0
10:03:28,345 INFO [STDOUT] INFO 16-02 10:03:28,345 - Table output - Got previous step from [Table output] #0 --> Table input
10:03:28,345 INFO [STDOUT] INFO 16-02 10:03:28,345 - Table output - input rel is 1:1
10:03:28,345 INFO [STDOUT] INFO 16-02 10:03:28,345 - Table output - Found input rowset [Table input.0 - Table output.0]
10:03:28,345 INFO [STDOUT] INFO 16-02 10:03:28,345 - Table output - Finished dispatching
10:03:28,346 INFO [STDOUT] INFO 16-02 10:03:28,346 - StageDataForShard - Transformation has allocated a new step: [Table output].0
10:03:28,346 INFO [STDOUT] INFO 16-02 10:03:28,346 - StageDataForShard - This transformation can be replayed with replay date: 2012/02/16 10:03:28
10:03:28,346 INFO [STDOUT] INFO 16-02 10:03:28,346 - StageDataForShard - Initialising 3 steps...
10:03:28,346 INFO [STDOUT] INFO 16-02 10:03:28,346 - Write to log - Running on slave server #0/1.
10:03:28,347 INFO [STDOUT] INFO 16-02 10:03:28,347 - Table input - Running on slave server #0/1.
10:03:28,351 INFO [STDOUT] INFO 16-02 10:03:28,351 - Table output - Running on slave server #0/1.
10:03:28,352 INFO [STDOUT] INFO 16-02 10:03:28,352 - pdi_staging - New database connection defined
10:03:28,352 INFO [STDOUT] INFO 16-02 10:03:28,352 - Shard - New database connection defined
10:03:28,361 INFO [STDOUT] INFO 16-02 10:03:28,361 - pdi_staging - Connected to database.
10:03:28,362 INFO [STDOUT] INFO 16-02 10:03:28,361 - Table output - Connected to database [pdi_staging] (commit=10000)
10:03:28,362 INFO [STDOUT] INFO 16-02 10:03:28,362 - pdi_staging - Auto commit off
10:03:28,374 INFO [STDOUT] INFO 16-02 10:03:28,374 - Shard - Connected to database.
10:03:28,374 INFO [STDOUT] INFO 16-02 10:03:28,374 - Shard - Auto commit off
10:03:28,374 INFO [STDOUT] INFO 16-02 10:03:28,374 - Table input - Connected to database...
10:03:28,375 INFO [STDOUT] INFO 16-02 10:03:28,375 - StageDataForShard - Step [Write to log.0] initialized flawlessly.
10:03:28,375 INFO [STDOUT] INFO 16-02 10:03:28,375 - StageDataForShard - Step [Table input.0] initialized flawlessly.
10:03:28,375 INFO [STDOUT] INFO 16-02 10:03:28,375 - StageDataForShard - Step [Table output.0] initialized flawlessly.
10:03:28,375 INFO [STDOUT] INFO 16-02 10:03:28,375 - Write to log - Starting to run...
10:03:28,376 INFO [STDOUT] INFO 16-02 10:03:28,376 - Write to log - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0)
10:03:28,376 INFO [STDOUT] INFO 16-02 10:03:28,376 - Table input - Starting to run...
10:03:28,376 INFO [STDOUT] INFO 16-02 10:03:28,376 - Table input - SQL query : select ac.id, ac.accountID, ac.description, cast(substring_index(substring_index(ac.description, '_', 2), '_', -1) as signed) businessAreaID, cast(substring_index(substring_index(ac.description, '_', 3), '_', -1) as signed) businessLocationID from admaxCampaigns ac
10:03:28,376 INFO [STDOUT] INFO 16-02 10:03:28,376 - StageDataForShard - Transformation has allocated 3 threads and 2 rowsets.
10:03:28,377 INFO [STDOUT] INFO 16-02 10:03:28,377 - Table output - Starting to run...
10:03:28,379 INFO [STDOUT] INFO 16-02 10:03:28,379 - Table input - Finished reading query, closing connection.
10:03:28,380 INFO [STDOUT] INFO 16-02 10:03:28,380 - Shard - Connection to database closed!
10:03:28,380 INFO [STDOUT] INFO 16-02 10:03:28,380 - Table input - Finished processing (I=10, O=0, R=0, W=10, U=0, E=0)
10:03:28,383 INFO [STDOUT] INFO 16-02 10:03:28,383 - Table output - Prepared statement : INSERT INTO dfStructureAdMaxCampaigns (id, accountID, description, businessAreaID, businessLocationID) VALUES ( ?, ?, ?, ?, ?)
10:03:28,402 INFO [STDOUT] INFO 16-02 10:03:28,402 - pdi_staging - Connection to database closed!
10:03:28,402 INFO [STDOUT] INFO 16-02 10:03:28,402 - Table output - Finished processing (I=0, O=10, R=10, W=10, U=0, E=0)
10:03:28,408 INFO [STDOUT] INFO 16-02 10:03:28,408 - StageDataFromShard - Finished job entry [StageDataForShard] (result=[true])
10:03:28,408 INFO [STDOUT] INFO 16-02 10:03:28,408 - StageDataFromShard - Finished job entry [Write To Log] (result=[true])
10:03:28,408 INFO [STDOUT] INFO 16-02 10:03:28,408 - StageDataFromShard - Finished job entry [SetShardConnectionVariables] (result=[true])
10:03:28,415 INFO [STDOUT] INFO 16-02 10:03:28,415 - StageDataFromShard - exec(20, 0, START.0)
10:03:28,416 INFO [STDOUT] INFO 16-02 10:03:28,416 - START - Starting job entry
10:03:28,417 INFO [STDOUT] INFO 16-02 10:03:28,416 - StageDataFromShard - Starting entry [SetShardConnectionVariables]
10:03:28,417 INFO [STDOUT] INFO 16-02 10:03:28,417 - StageDataFromShard - exec(21, 0, SetShardConnectionVariables.0)
10:03:28,417 INFO [STDOUT] INFO 16-02 10:03:28,417 - SetShardConnectionVariables - Starting job entry
10:03:28,417 INFO [STDOUT] INFO 16-02 10:03:28,417 - SetShardConnectionVariables - Opening transformation: [null] in directory [/]
10:03:28,417 INFO [STDOUT] INFO 16-02 10:03:28,417 - SetShardConnectionVariables - Loading transformation from repository [SetShardConnectionVariables] in directory [/]
10:03:28,436 INFO [STDOUT] INFO 16-02 10:03:28,436 - SetShardConnectionVariables - Starting transformation...(file=null, name=SetShardConnectionVariables, repinfo=null)
10:03:28,436 INFO [STDOUT] INFO 16-02 10:03:28,436 - SetShardConnectionVariables - Transformation is pre-loaded.
10:03:28,437 INFO [STDOUT] INFO 16-02 10:03:28,437 - SetShardConnectionVariables - Dispatching started for transformation [SetShardConnectionVariables]
10:03:28,437 INFO [STDOUT] INFO 16-02 10:03:28,437 - SetShardConnectionVariables - Nr of arguments detected:0
10:03:28,437 INFO [STDOUT] INFO 16-02 10:03:28,437 - SetShardConnectionVariables - This is not a replay transformation
10:03:28,437 INFO [STDOUT] INFO 16-02 10:03:28,437 - SetShardConnectionVariables - I found 2 different steps to launch.
10:03:28,437 INFO [STDOUT] INFO 16-02 10:03:28,437 - SetShardConnectionVariables - Allocating rowsets...
10:03:28,437 INFO [STDOUT] INFO 16-02 10:03:28,437 - SetShardConnectionVariables - Allocating rowsets for step 0 --> Get rows from result
10:03:28,438 INFO [STDOUT] INFO 16-02 10:03:28,437 - SetShardConnectionVariables - prevcopies = 1, nextcopies=1
10:03:28,438 INFO [STDOUT] INFO 16-02 10:03:28,438 - SetShardConnectionVariables - Transformation allocated new rowset [Get rows from result.0 - Set Variables.0]
10:03:28,438 INFO [STDOUT] INFO 16-02 10:03:28,438 - SetShardConnectionVariables - Allocated 1 rowsets for step 0 --> Get rows from result
10:03:28,438 INFO [STDOUT] INFO 16-02 10:03:28,438 - SetShardConnectionVariables - Allocating rowsets for step 1 --> Set Variables
10:03:28,438 INFO [STDOUT] INFO 16-02 10:03:28,438 - SetShardConnectionVariables - Allocated 1 rowsets for step 1 --> Set Variables
10:03:28,438 INFO [STDOUT] INFO 16-02 10:03:28,438 - SetShardConnectionVariables - Allocating Steps & StepData...
10:03:28,438 INFO [STDOUT] INFO 16-02 10:03:28,438 - SetShardConnectionVariables - Transformation is about to allocate step [Get rows from result] of type [RowsFromResult]
10:03:28,439 INFO [STDOUT] INFO 16-02 10:03:28,438 - Get rows from result - distribution activated
10:03:28,439 INFO [STDOUT] INFO 16-02 10:03:28,439 - Get rows from result - Starting allocation of buffers & new threads...
10:03:28,439 INFO [STDOUT] INFO 16-02 10:03:28,439 - Get rows from result - Step info: nrinput=0 nroutput=1
10:03:28,439 INFO [STDOUT] INFO 16-02 10:03:28,439 - Get rows from result - output rel. is 1:1
10:03:28,439 INFO [STDOUT] INFO 16-02 10:03:28,439 - Get rows from result - Found output rowset [Get rows from result.0 - Set Variables.0]
10:03:28,439 INFO [STDOUT] INFO 16-02 10:03:28,439 - Get rows from result - Finished dispatching
10:03:28,439 INFO [STDOUT] INFO 16-02 10:03:28,439 - SetShardConnectionVariables - Transformation has allocated a new step: [Get rows from result].0
10:03:28,439 INFO [STDOUT] INFO 16-02 10:03:28,439 - SetShardConnectionVariables - Transformation is about to allocate step [Set Variables] of type [SetVariable]
10:03:28,440 INFO [STDOUT] INFO 16-02 10:03:28,440 - Set Variables - distribution activated
10:03:28,440 INFO [STDOUT] INFO 16-02 10:03:28,440 - Set Variables - Starting allocation of buffers & new threads...
10:03:28,440 INFO [STDOUT] INFO 16-02 10:03:28,440 - Set Variables - Step info: nrinput=1 nroutput=0
10:03:28,440 INFO [STDOUT] INFO 16-02 10:03:28,440 - Set Variables - Got previous step from [Set Variables] #0 --> Get rows from result
10:03:28,440 INFO [STDOUT] INFO 16-02 10:03:28,440 - Set Variables - input rel is 1:1
10:03:28,440 INFO [STDOUT] INFO 16-02 10:03:28,440 - Set Variables - Found input rowset [Get rows from result.0 - Set Variables.0]
10:03:28,440 INFO [STDOUT] INFO 16-02 10:03:28,440 - Set Variables - Finished dispatching
10:03:28,441 INFO [STDOUT] INFO 16-02 10:03:28,440 - SetShardConnectionVariables - Transformation has allocated a new step: [Set Variables].0
10:03:28,441 INFO [STDOUT] INFO 16-02 10:03:28,441 - SetShardConnectionVariables - This transformation can be replayed with replay date: 2012/02/16 10:03:28
10:03:28,441 INFO [STDOUT] INFO 16-02 10:03:28,441 - SetShardConnectionVariables - Initialising 2 steps...
10:03:28,441 INFO [STDOUT] INFO 16-02 10:03:28,441 - Get rows from result - Running on slave server #0/1.
10:03:28,442 INFO [STDOUT] INFO 16-02 10:03:28,442 - Set Variables - Running on slave server #0/1.
10:03:28,442 INFO [STDOUT] INFO 16-02 10:03:28,442 - SetShardConnectionVariables - Step [Get rows from result.0] initialized flawlessly.
10:03:28,442 INFO [STDOUT] INFO 16-02 10:03:28,442 - SetShardConnectionVariables - Step [Set Variables.0] initialized flawlessly.
10:03:28,442 INFO [STDOUT] INFO 16-02 10:03:28,442 - Get rows from result - Starting to run...
10:03:28,443 INFO [STDOUT] INFO 16-02 10:03:28,443 - Get rows from result - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
10:03:28,443 INFO [STDOUT] INFO 16-02 10:03:28,443 - SetShardConnectionVariables - Transformation has allocated 2 threads and 1 rowsets.
10:03:28,443 INFO [STDOUT] INFO 16-02 10:03:28,443 - Set Variables - Starting to run...
10:03:28,443 INFO [STDOUT] INFO 16-02 10:03:28,443 - Set Variables - Setting environment variables...
10:03:28,443 INFO [STDOUT] INFO 16-02 10:03:28,443 - Set Variables - Set variable DATABASE to value [st-tracker]
10:03:28,444 INFO [STDOUT] INFO 16-02 10:03:28,443 - Set Variables - Set variable HOST to value [acctdb-02-write]
10:03:28,444 INFO [STDOUT] INFO 16-02 10:03:28,444 - Set Variables - Set variable PORT to value [3310]
10:03:28,459 INFO [STDOUT] INFO 16-02 10:03:28,459 - Set Variables - Finished after 1 rows.
10:03:28,459 INFO [STDOUT] INFO 16-02 10:03:28,459 - Set Variables - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
10:03:28,468 INFO [STDOUT] INFO 16-02 10:03:28,468 - StageDataFromShard - Starting entry [Write To Log]
10:03:28,468 INFO [STDOUT] INFO 16-02 10:03:28,468 - StageDataFromShard - exec(22, 0, Write To Log.0)
10:03:28,468 INFO [STDOUT] INFO 16-02 10:03:28,468 - Write To Log - Starting job entry
10:03:28,468 INFO [STDOUT] INFO 16-02 10:03:28,468 - connection: - st-tracker
acctdb-02-write
3310
select ac.id, ac.accountID, ac.description, cast(substring_index(substring_index(ac.description, '_', 2), '_', -1) as signed) businessAreaID, cast(substring_index(substring_index(ac.description, '_', 3), '_', -1) as signed) businessLocationID from admaxCampaigns ac
10:03:28,469 INFO [STDOUT] INFO 16-02 10:03:28,469 - StageDataFromShard - Starting entry [StageDataForShard]
10:03:28,469 INFO [STDOUT] INFO 16-02 10:03:28,469 - StageDataFromShard - exec(23, 0, StageDataForShard.0)
10:03:28,470 INFO [STDOUT] INFO 16-02 10:03:28,470 - StageDataForShard - Starting job entry
10:03:28,470 INFO [STDOUT] INFO 16-02 10:03:28,470 - StageDataForShard - Opening transformation: [null] in directory [/]
10:03:28,470 INFO [STDOUT] INFO 16-02 10:03:28,470 - StageDataForShard - Loading transformation from repository [StageDataForShard] in directory [/]
10:03:28,491 INFO [STDOUT] INFO 16-02 10:03:28,490 - StageDataForShard - Starting transformation...(file=null, name=StageDataForShard, repinfo=null)
10:03:28,491 INFO [STDOUT] INFO 16-02 10:03:28,491 - StageDataForShard - Transformation is pre-loaded.
10:03:28,491 INFO [STDOUT] INFO 16-02 10:03:28,491 - StageDataForShard - Dispatching started for transformation [StageDataForShard]
10:03:28,491 INFO [STDOUT] INFO 16-02 10:03:28,491 - StageDataForShard - Nr of arguments detected:0
10:03:28,491 INFO [STDOUT] INFO 16-02 10:03:28,491 - StageDataForShard - This is not a replay transformation
10:03:28,491 INFO [STDOUT] INFO 16-02 10:03:28,491 - StageDataForShard - I found 3 different steps to launch.
10:03:28,491 INFO [STDOUT] INFO 16-02 10:03:28,491 - StageDataForShard - Allocating rowsets...
10:03:28,492 INFO [STDOUT] INFO 16-02 10:03:28,491 - StageDataForShard - Allocating rowsets for step 0 --> Write to log
10:03:28,492 INFO [STDOUT] INFO 16-02 10:03:28,492 - StageDataForShard - prevcopies = 1, nextcopies=1
10:03:28,492 INFO [STDOUT] INFO 16-02 10:03:28,492 - StageDataForShard - Transformation allocated new rowset [Write to log.0 - Table input.0]
10:03:28,492 INFO [STDOUT] INFO 16-02 10:03:28,492 - StageDataForShard - Allocated 1 rowsets for step 0 --> Write to log
10:03:28,492 INFO [STDOUT] INFO 16-02 10:03:28,492 - StageDataForShard - Allocating rowsets for step 1 --> Table input
10:03:28,492 INFO [STDOUT] INFO 16-02 10:03:28,492 - StageDataForShard - prevcopies = 1, nextcopies=1
10:03:28,492 INFO [STDOUT] INFO 16-02 10:03:28,492 - StageDataForShard - Transformation allocated new rowset [Table input.0 - Table output.0]
10:03:28,493 INFO [STDOUT] INFO 16-02 10:03:28,492 - StageDataForShard - Allocated 2 rowsets for step 1 --> Table input
10:03:28,493 INFO [STDOUT] INFO 16-02 10:03:28,493 - StageDataForShard - Allocating rowsets for step 2 --> Table output
10:03:28,493 INFO [STDOUT] INFO 16-02 10:03:28,493 - StageDataForShard - Allocated 2 rowsets for step 2 --> Table output
10:03:28,493 INFO [STDOUT] INFO 16-02 10:03:28,493 - StageDataForShard - Allocating Steps & StepData...
10:03:28,493 INFO [STDOUT] INFO 16-02 10:03:28,493 - StageDataForShard - Transformation is about to allocate step [Write to log] of type [WriteToLog]
10:03:28,493 INFO [STDOUT] INFO 16-02 10:03:28,493 - Write to log - distribution activated
10:03:28,494 INFO [STDOUT] INFO 16-02 10:03:28,493 - Write to log - Starting allocation of buffers & new threads...
10:03:28,494 INFO [STDOUT] INFO 16-02 10:03:28,494 - Write to log - Step info: nrinput=0 nroutput=1
10:03:28,494 INFO [STDOUT] INFO 16-02 10:03:28,494 - Write to log - output rel. is 1:1
10:03:28,494 INFO [STDOUT] INFO 16-02 10:03:28,494 - Write to log - Found output rowset [Write to log.0 - Table input.0]
10:03:28,494 INFO [STDOUT] INFO 16-02 10:03:28,494 - Write to log - Finished dispatching
10:03:28,494 INFO [STDOUT] INFO 16-02 10:03:28,494 - StageDataForShard - Transformation has allocated a new step: [Write to log].0
10:03:28,494 INFO [STDOUT] INFO 16-02 10:03:28,494 - StageDataForShard - Transformation is about to allocate step [Table input] of type [TableInput]
10:03:28,495 INFO [STDOUT] INFO 16-02 10:03:28,495 - Table input - Starting allocation of buffers & new threads...
10:03:28,495 INFO [STDOUT] INFO 16-02 10:03:28,495 - Table input - Step info: nrinput=1 nroutput=1
10:03:28,495 INFO [STDOUT] INFO 16-02 10:03:28,495 - Table input - Got previous step from [Table input] #0 --> Write to log
10:03:28,495 INFO [STDOUT] INFO 16-02 10:03:28,495 - Table input - input rel is 1:1
10:03:28,495 INFO [STDOUT] INFO 16-02 10:03:28,495 - Table input - Found input rowset [Write to log.0 - Table input.0]
10:03:28,495 INFO [STDOUT] INFO 16-02 10:03:28,495 - Table input - output rel. is 1:1
10:03:28,495 INFO [STDOUT] INFO 16-02 10:03:28,495 - Table input - Found output rowset [Table input.0 - Table output.0]
10:03:28,495 INFO [STDOUT] INFO 16-02 10:03:28,495 - Table input - Finished dispatching
10:03:28,496 INFO [STDOUT] INFO 16-02 10:03:28,496 - StageDataForShard - Transformation has allocated a new step: [Table input].0
10:03:28,496 INFO [STDOUT] INFO 16-02 10:03:28,496 - StageDataForShard - Transformation is about to allocate step [Table output] of type [TableOutput]
10:03:28,496 INFO [STDOUT] INFO 16-02 10:03:28,496 - Table output - distribution activated
10:03:28,496 INFO [STDOUT] INFO 16-02 10:03:28,496 - Table output - Starting allocation of buffers & new threads...
10:03:28,496 INFO [STDOUT] INFO 16-02 10:03:28,496 - Table output - Step info: nrinput=1 nroutput=0
10:03:28,496 INFO [STDOUT] INFO 16-02 10:03:28,496 - Table output - Got previous step from [Table output] #0 --> Table input
10:03:28,496 INFO [STDOUT] INFO 16-02 10:03:28,496 - Table output - input rel is 1:1
10:03:28,496 INFO [STDOUT] INFO 16-02 10:03:28,496 - Table output - Found input rowset [Table input.0 - Table output.0]
10:03:28,497 INFO [STDOUT] INFO 16-02 10:03:28,497 - Table output - Finished dispatching
10:03:28,497 INFO [STDOUT] INFO 16-02 10:03:28,497 - StageDataForShard - Transformation has allocated a new step: [Table output].0
10:03:28,497 INFO [STDOUT] INFO 16-02 10:03:28,497 - StageDataForShard - This transformation can be replayed with replay date: 2012/02/16 10:03:28
10:03:28,497 INFO [STDOUT] INFO 16-02 10:03:28,497 - StageDataForShard - Initialising 3 steps...
10:03:28,498 INFO [STDOUT] INFO 16-02 10:03:28,497 - Write to log - Running on slave server #0/1.
10:03:28,498 INFO [STDOUT] INFO 16-02 10:03:28,498 - Table input - Running on slave server #0/1.
10:03:28,499 INFO [STDOUT] INFO 16-02 10:03:28,499 - Shard - New database connection defined
10:03:28,502 INFO [STDOUT] INFO 16-02 10:03:28,502 - Table output - Running on slave server #0/1.
10:03:28,502 INFO [STDOUT] INFO 16-02 10:03:28,502 - pdi_staging - New database connection defined
10:03:28,511 INFO [STDOUT] INFO 16-02 10:03:28,511 - pdi_staging - Connected to database.
10:03:28,511 INFO [STDOUT] INFO 16-02 10:03:28,511 - Table output - Connected to database [pdi_staging] (commit=10000)
10:03:28,511 INFO [STDOUT] INFO 16-02 10:03:28,511 - pdi_staging - Auto commit off
10:03:28,514 INFO [STDOUT] INFO 16-02 10:03:28,514 - Shard - Connected to database.
10:03:28,515 INFO [STDOUT] INFO 16-02 10:03:28,515 - Shard - Auto commit off
10:03:28,515 INFO [STDOUT] INFO 16-02 10:03:28,515 - Table input - Connected to database...
10:03:28,515 INFO [STDOUT] INFO 16-02 10:03:28,515 - StageDataForShard - Step [Write to log.0] initialized flawlessly.
10:03:28,515 INFO [STDOUT] INFO 16-02 10:03:28,515 - StageDataForShard - Step [Table input.0] initialized flawlessly.
10:03:28,523 INFO [STDOUT] INFO 16-02 10:03:28,515 - StageDataForShard - Step [Table output.0] initialized flawlessly.
10:03:28,523 INFO [STDOUT] INFO 16-02 10:03:28,523 - Write to log - Starting to run...
10:03:28,524 INFO [STDOUT] INFO 16-02 10:03:28,524 - Write to log - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0)
10:03:28,524 INFO [STDOUT] INFO 16-02 10:03:28,524 - Table input - Starting to run...
10:03:28,524 INFO [STDOUT] INFO 16-02 10:03:28,524 - Table input - SQL query : select ac.id, ac.accountID, ac.description, cast(substring_index(substring_index(ac.description, '_', 2), '_', -1) as signed) businessAreaID, cast(substring_index(substring_index(ac.description, '_', 3), '_', -1) as signed) businessLocationID from admaxCampaigns ac
10:03:28,525 INFO [STDOUT] INFO 16-02 10:03:28,524 - StageDataForShard - Transformation has allocated 3 threads and 2 rowsets.
10:03:28,525 INFO [STDOUT] INFO 16-02 10:03:28,525 - Table output - Starting to run...
10:03:28,527 INFO [STDOUT] INFO 16-02 10:03:28,527 - Table input - Finished reading query, closing connection.
10:03:28,528 INFO [STDOUT] INFO 16-02 10:03:28,528 - Shard - Connection to database closed!
10:03:28,528 INFO [STDOUT] INFO 16-02 10:03:28,528 - Table input - Finished processing (I=11, O=0, R=0, W=11, U=0, E=0)
10:03:28,531 INFO [STDOUT] INFO 16-02 10:03:28,531 - Table output - Prepared statement : INSERT INTO dfStructureAdMaxCampaigns (id, accountID, description, businessAreaID, businessLocationID) VALUES ( ?, ?, ?, ?, ?)
10:03:28,550 INFO [STDOUT] ERROR 16-02 10:03:28,550 - Table output - Unexpected batch update error committing the database connection.
10:03:28,550 INFO [STDOUT] ERROR 16-02 10:03:28,550 - Table output - org.pentaho.di.core.exception.KettleDatabaseBatchException:
Error updating batch
Duplicate entry '10' for key 'PRIMARY'
at org.pentaho.di.core.database.Database.emptyAndCommit(Database.java:1494)
at org.pentaho.di.trans.steps.tableoutput.TableOutput.dispose(TableOutput.java:647)
at org.pentaho.di.trans.step.RunThread.run(RunThread.java:69)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.sql.BatchUpdateException: Duplicate entry '10' for key 'PRIMARY'
at com.mysql.jdbc.ServerPreparedStatement.executeBatchSerially(ServerPreparedStatement.java:796)
at com.mysql.jdbc.PreparedStatement.executeBatch(PreparedStatement.java:1449)
at org.pentaho.di.core.database.Database.emptyAndCommit(Database.java:1477)
... 3 more
10:03:28,551 INFO [STDOUT] INFO 16-02 10:03:28,551 - pdi_staging - Connection to database closed!
10:03:28,552 INFO [STDOUT] INFO 16-02 10:03:28,552 - Table output - Finished processing (I=0, O=0, R=11, W=0, U=0, E=1)
10:03:28,552 INFO [STDOUT] INFO 16-02 10:03:28,552 - StageDataForShard - StageDataForShard
10:03:28,552 INFO [STDOUT] INFO 16-02 10:03:28,552 - StageDataForShard - StageDataForShard
10:03:28,555 INFO [STDOUT] ERROR 16-02 10:03:28,555 - StageDataForShard - Errors detected!
10:03:28,557 INFO [STDOUT] INFO 16-02 10:03:28,557 - StageDataFromShard - Finished job entry [StageDataForShard] (result=[false])
10:03:28,557 INFO [STDOUT] INFO 16-02 10:03:28,557 - StageDataFromShard - Finished job entry [Write To Log] (result=[false])
10:03:28,557 INFO [STDOUT] INFO 16-02 10:03:28,557 - StageDataFromShard - Finished job entry [SetShardConnectionVariables] (result=[false])
10:03:28,564 INFO [STDOUT] INFO 16-02 10:03:28,564 - StageDataFromShards - Finished job entry [StageDataFromShard] (result=[false])
10:03:28,564 INFO [STDOUT] INFO 16-02 10:03:28,564 - StageDataFromShards - Finished job entry [SelectShards] (result=[false])
10:03:28,564 INFO [STDOUT] INFO 16-02 10:03:28,564 - StageDataFromShards - Finished job entry [Write To Log] (result=[false])
10:03:28,572 INFO [STDOUT] INFO 16-02 10:03:28,572 - StageRequirement - Finished job entry [StageDataFromShards] (result=[false])
10:03:28,572 INFO [STDOUT] INFO 16-02 10:03:28,572 - StageRequirement - Finished job entry [Simple evaluation 2] (result=[false])
10:03:28,572 INFO [STDOUT] INFO 16-02 10:03:28,572 - StageRequirement - Finished job entry [Simple evaluation] (result=[false])
10:03:28,572 INFO [STDOUT] INFO 16-02 10:03:28,572 - StageRequirement - Finished job entry [TruncateStagingTable] (result=[false])
10:03:28,572 INFO [STDOUT] INFO 16-02 10:03:28,572 - StageRequirement - Finished job entry [SetRequirementStagingVariables] (result=[false])
10:03:28,580 INFO [STDOUT] INFO 16-02 10:03:28,580 - StageRequirements - Finished job entry [StageRequirement] (result=[false])
10:03:28,580 INFO [STDOUT] INFO 16-02 10:03:28,580 - StageRequirements - Finished job entry [SelectRequirements] (result=[false])
10:03:28,580 INFO [STDOUT] INFO 16-02 10:03:28,580 - StageRequirements - Finished job entry [Write To Log] (result=[false])
10:03:28,581 INFO [STDOUT] INFO 16-02 10:03:28,581 - ProcessDatafeeds - Finished job entry [StageRequirements] (result=[false])
10:03:28,581 INFO [STDOUT] INFO 16-02 10:03:28,581 - ProcessDatafeeds - Finished job entry [SetDatafeedVariables] (result=[false])
10:03:28,581 INFO [STDOUT] INFO 16-02 10:03:28,581 - ProcessDatafeeds - Finished job entry [GetDatafeeds] (result=[false])
10:03:28,588 INFO [STDOUT] INFO 16-02 10:03:28,587 - Job 1 - Finished job entry [ProcessDatafeeds] (result=[false])
10:03:28,588 INFO [STDOUT] INFO 16-02 10:03:28,588 - Job 1 - Job execution finished
10:03:28,588 INFO [PentahoEngine] Job Start [2012/02/16 10:03:26.964] , Job Stop [2012/02/16 10:03:28.588]
10:03:28,588 ERROR [PentahoEngine] There were errors during Job execution. For Job : Job 1
10:03:28,588 ERROR [InvocationHandlerJAXWS] Method invocation failed with exception: null
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.wsf.common.invocation.AbstractInvocationHandlerJSE.invoke(AbstractInvocationHandlerJSE.java:129)
at org.jboss.wsf.stack.cxf.AbstractInvoker._invokeInternal(AbstractInvoker.java:164)
at org.jboss.wsf.stack.cxf.AbstractInvoker.invoke(AbstractInvoker.java:112)
at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:58)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at org.apache.cxf.workqueue.SynchronousExecutor.execute(SynchronousExecutor.java:37)
at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:106)
at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:255)
at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:113)
at org.apache.cxf.transport.servlet.ServletDestination.invoke(ServletDestination.java:97)
at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:461)
at org.jboss.wsf.stack.cxf.ServletControllerExt.invoke(ServletControllerExt.java:172)
at org.jboss.wsf.stack.cxf.RequestHandlerImpl.handleHttpRequest(RequestHandlerImpl.java:57)
at org.jboss.wsf.stack.cxf.transport.ServletHelper.callRequestHandler(ServletHelper.java:162)
at org.jboss.wsf.stack.cxf.CXFServletExt.invoke(CXFServletExt.java:90)
at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:179)
at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doPost(AbstractHTTPServlet.java:103)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:159)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:235)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:190)
at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:92)
at org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.process(SecurityContextEstablishmentValve.java:126)
at org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.invoke(SecurityContextEstablishmentValve.java:70)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.jboss.web.tomcat.service.jca.CachedConnectionValve.invoke(CachedConnectionValve.java:158)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:330)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:829)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:598)
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.RuntimeException: There were errors during Job execution.
at com.thesearchagency.smb.common.pentaho.PentahoEngine.executeJob(PentahoEngine.java:121)
at com.thesearchagency.smb.datafeed.service.component.DataFeedServiceImpl.executeJobFromFileSystemRepository(DataFeedServiceImpl.java:129)
at com.thesearchagency.smb.datafeed.service.binding.DataFeedWSImpl.executeJobFromFileSystemRepository(DataFeedWSImpl.java:39)
... 45 more
10:03:28,589 WARN [PhaseInterceptorChain] Application {http://www.thesearchagency.com/smb/DataFeedService/}DataFeedService#{http://www.thesearchagency.com/smb/DataFeedService/}executeJobFromFileSystemRepository has thrown exception, unwinding now
org.apache.cxf.interceptor.Fault: There were errors during Job execution.
at org.jboss.wsf.stack.cxf.AbstractInvoker.createFault(AbstractInvoker.java:229)
at org.jboss.wsf.stack.cxf.AbstractInvoker._invokeInternal(AbstractInvoker.java:184)
at org.jboss.wsf.stack.cxf.AbstractInvoker.invoke(AbstractInvoker.java:112)
at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:58)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at org.apache.cxf.workqueue.SynchronousExecutor.execute(SynchronousExecutor.java:37)
at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:106)
at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:255)
at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:113)
at org.apache.cxf.transport.servlet.ServletDestination.invoke(ServletDestination.java:97)
at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:461)
at org.jboss.wsf.stack.cxf.ServletControllerExt.invoke(ServletControllerExt.java:172)
at org.jboss.wsf.stack.cxf.RequestHandlerImpl.handleHttpRequest(RequestHandlerImpl.java:57)
at org.jboss.wsf.stack.cxf.transport.ServletHelper.callRequestHandler(ServletHelper.java:162)
at org.jboss.wsf.stack.cxf.CXFServletExt.invoke(CXFServletExt.java:90)
at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:179)
at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doPost(AbstractHTTPServlet.java:103)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:159)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:235)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:190)
at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:92)
at org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.process(SecurityContextEstablishmentValve.java:126)
at org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.invoke(SecurityContextEstablishmentValve.java:70)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.jboss.web.tomcat.service.jca.CachedConnectionValve.invoke(CachedConnectionValve.java:158)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:330)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:829)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:598)
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.RuntimeException: There were errors during Job execution.
at com.thesearchagency.smb.common.pentaho.PentahoEngine.executeJob(PentahoEngine.java:121)
at com.thesearchagency.smb.datafeed.service.component.DataFeedServiceImpl.executeJobFromFileSystemRepository(DataFeedServiceImpl.java:129)
at com.thesearchagency.smb.datafeed.service.binding.DataFeedWSImpl.executeJobFromFileSystemRepository(DataFeedWSImpl.java:39)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.jboss.wsf.common.invocation.AbstractInvocationHandlerJSE.invoke(AbstractInvocationHandlerJSE.java:129)
at org.jboss.wsf.stack.cxf.AbstractInvoker._invokeInternal(AbstractInvoker.java:164)
... 39 more