Uploaded image for project: 'AdMaxLocal'
  1. AdMaxLocal
  2. AML-3499

Warehouse summarizer does not populate warehouse DB for Y!P

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: Rushmore
    • Fix Version/s: None
    • Component/s: Data Summarization
    • Labels:
      None
    • Environment:

      Rushmore Final Builds

      Description

      Warehouse summarizer does not populate warehouse DB for Y!P and throws exception

      tmp.searchEngineActivitySummary201505 has fields "maxCpc" and "maxCpcSource" which is not applicable for Yahoo Japan systems and hence is not populated. Due to this the following error is seen on running whsumm.sh and there is no data being populated in
      whDailyGroupPerf
      whDailyGroupAttr
      whDailySourcePerf
      whDailySourceAttr

      whsumm is run on highgran
      Log error is as follows

      2015-05-12 07:26:54.117 (4) [P1T1]: preparing SQL statement [INSERT INTO `tmp`.`tmp1`(perfID,startTime,accountID,type,campaignID,distributionID,searchEngineAccountID,searchEngineGroupID,searchEngineListingID,searchEngineMatchType,bidTargetID,altKeyID,altKey,identifierID,searchEngineIdentifier,descriptionID,description,productID,scope,avgPosition,seImpressions,seClicks,seAdCost,seConversions,seValue,bidTypeID,qualityScore,firstPageCpc,maxCpc,maxCpcSource) VALUES (?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?)]
      2015-05-12 07:26:54.128 (1) [P1T1]: Exception [Error on line 1: 0 2014-12-05 11 1 0 178 61 1977 0 broad 0 0 YJAUTOBROAD_+???????_+??_+??? 0 748387449 0 +??????? +?? +??? 0 cart 9.000 2 2 60.000 0 0 0 6.000 8 0 ]:java.sql.SQLException: No value specified for parameter 30
      at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1078)
      at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:989)
      at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:975)
      at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:920)
      at com.mysql.jdbc.PreparedStatement.checkAllParametersSet(PreparedStatement.java:2611)
      at com.mysql.jdbc.PreparedStatement.addBatch(PreparedStatement.java:1032)
      at com.thesearchagency.db.util.BatchInsertUtil.parseFileUsingSplit(BatchInsertUtil.java:332)
      at com.thesearchagency.db.util.BatchInsertUtil.batchInsertFromFile(BatchInsertUtil.java:156)
      at com.thesearchagency.db.util.BatchInsertUtil.batchInsertFromFile(BatchInsertUtil.java:83)
      at com.thesearchagency.db.util.BatchInsertUtil.batchInsertFromFile(BatchInsertUtil.java:60)
      at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.createStagingTempTable(WarehouseSummarizer.java:3393)
      at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.createStagingTempTable(WarehouseSummarizer.java:3296)
      at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.createStagingTempTable(WarehouseSummarizer.java:3290)
      at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.processSearchEngineActivity(WarehouseSummarizer.java:1192)
      at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.call(WarehouseSummarizer.java:625)
      at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.call(WarehouseSummarizer.java:471)
      at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
      at java.util.concurrent.FutureTask.run(FutureTask.java:138)
      at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
      at java.lang.Thread.run(Thread.java:662)

      2015-05-12 07:26:54.129 (1) [P1T1]: Exception [error inserting SQL rows into `tmp`.`tmp1` from file /tmp/11seActivity14177376000002947048634308029751.tmp]:java.sql.SQLException: No value specified for parameter 30
      at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1078)
      at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:989)
      at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:975)
      at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:920)
      at com.mysql.jdbc.PreparedStatement.checkAllParametersSet(PreparedStatement.java:2611)
      at com.mysql.jdbc.PreparedStatement.addBatch(PreparedStatement.java:1032)
      at com.thesearchagency.db.util.BatchInsertUtil.parseFileUsingSplit(BatchInsertUtil.java:332)
      at com.thesearchagency.db.util.BatchInsertUtil.batchInsertFromFile(BatchInsertUtil.java:156)
      at com.thesearchagency.db.util.BatchInsertUtil.batchInsertFromFile(BatchInsertUtil.java:83)
      at com.thesearchagency.db.util.BatchInsertUtil.batchInsertFromFile(BatchInsertUtil.java:60)
      at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.createStagingTempTable(WarehouseSummarizer.java:3393)
      at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.createStagingTempTable(WarehouseSummarizer.java:3296)
      at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.createStagingTempTable(WarehouseSummarizer.java:3290)
      at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.processSearchEngineActivity(WarehouseSummarizer.java:1192)
      at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.call(WarehouseSummarizer.java:625)
      at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.call(WarehouseSummarizer.java:471)
      at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
      at java.util.concurrent.FutureTask.run(FutureTask.java:138)
      at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
      at java.lang.Thread.run(Thread.java:662)

      Note: This is not seen on Google system

        Attachments

          Activity

            People

            • Assignee:
              therouxj Jeff Theroux
              Reporter:
              varshini.padmanabhan Varshini Padmanabhan (Inactive)
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: