Details
-
Type: Bug
-
Status: Closed
-
Priority: Major
-
Resolution: Fixed
-
Affects Version/s: Artemis
-
Fix Version/s: Kensei_Hotfix_1
-
Component/s: Data Summarization
-
Labels:None
-
Environment:
QA7
bidmgr-distribution-2.9.4-dev-t20160822-1046
Description
Yahoo Japan report is failing for the account which have "--" quality score
Steps:
1.Get performance account - a245
2.Run yahoojapanreport
/usr/local/tsa/bidmgr/yahoojapanreport.sh --seuser 259 --date 2016-08-01 -rt performance
snippet of debug log:
2016-12-19 12:39:32.786 (3) [P1T1]: Parsing /var/local/tsa/sedata/yahoojapan/tsa-yj-report-performance-2016-08-01-U259.xml.zip into staging database
2016-12-19 12:39:32.827 (3) [P1T1]: JDBC Driver Version: 5.1 (com.mysql.jdbc.Driver)
2016-12-19 12:39:32.834 (3) [P1T1]: DatabasePool with a limit of 3 created
2016-12-19 12:39:32.856 (3) [P1T1]: JDBC Driver Version: 5.1 (com.mysql.jdbc.Driver)
2016-12-19 12:39:32.869 (3) [P1T1]: Deleting existing records where ((`startTime`="2016-08-01") and (`campaignid` in ("1193273","1193274","1193275","1193276","1193282","1193283","1193310","1193311","1193312","1193313","1193319","1193321","1193323","1193324","1193343","1193344","1193345","1193346","1193360","1193361","1193362","1193363","1193364","1193365","1193366","1193367","1193729","1193730","1193731","1193732","1193809","1193810","1226134","1226135","1243762","1243763","1244827","1244828","1244850","1244851","1245353","1245354","1254123","1255704","1255705","1265526","1265527","1284041","1284042","853664","853665")))
2016-12-19 12:39:32.871 (3) [P1T1]: Inserting new data into `staging`.`yahooJPerformanceReports`
2016-12-19 12:39:32.894 (1) [P1T1]: Exception [Error on line 1: 2016-08-01 1255704 260883632 1343589021 ???? ???? ?? BROAD 0.0000 13 0 0 4.5 -- 30]:java.lang.NumberFormatException: For input string: "--"
at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1222)
at java.lang.Double.valueOf(Double.java:475)
at com.thesearchagency.db.util.BatchInsertUtil.getTypeValue(BatchInsertUtil.java:393)
at com.thesearchagency.db.util.BatchInsertUtil.parseFileUsingSplit(BatchInsertUtil.java:327)
at com.thesearchagency.db.util.BatchInsertUtil.batchInsertFromFile(BatchInsertUtil.java:156)
at com.thesearchagency.db.util.BatchInsertUtil.batchInsertFromFile(BatchInsertUtil.java:83)
at com.thesearchagency.db.util.BatchInsertUtil.batchInsertFromFile(BatchInsertUtil.java:60)
at com.thesearchagency.searchengines.yahoojapan.YahooJapanSearchEngine.parseReport(YahooJapanSearchEngine.java:1023)
at com.thesearchagency.searchengines.yahoojapan.reporting.YahooJapanReportSEUserWorker.call(YahooJapanReportSEUserWorker.java:112)
at com.thesearchagency.searchengines.yahoojapan.reporting.YahooJapanReportSEUserWorker.call(YahooJapanReportSEUserWorker.java:30)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
2016-12-19 12:39:32.894 (1) [P1T1]: Exception [error inserting SQL rows into `staging`.`yahooJPerformanceReports` from file /tmp/temp_2016-08-011515216653556041394.tmp]:java.lang.NumberFormatException: For input string: "--"
at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1222)
at java.lang.Double.valueOf(Double.java:475)
at com.thesearchagency.db.util.BatchInsertUtil.getTypeValue(BatchInsertUtil.java:393)
at com.thesearchagency.db.util.BatchInsertUtil.parseFileUsingSplit(BatchInsertUtil.java:327)
at com.thesearchagency.db.util.BatchInsertUtil.batchInsertFromFile(BatchInsertUtil.java:156)
at com.thesearchagency.db.util.BatchInsertUtil.batchInsertFromFile(BatchInsertUtil.java:83)
at com.thesearchagency.db.util.BatchInsertUtil.batchInsertFromFile(BatchInsertUtil.java:60)
at com.thesearchagency.searchengines.yahoojapan.YahooJapanSearchEngine.parseReport(YahooJapanSearchEngine.java:1023)
at com.thesearchagency.searchengines.yahoojapan.reporting.YahooJapanReportSEUserWorker.call(YahooJapanReportSEUserWorker.java:112)
at com.thesearchagency.searchengines.yahoojapan.reporting.YahooJapanReportSEUserWorker.call(YahooJapanReportSEUserWorker.java:30)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Actual Result:
Report script is unable to parse the quality score having value "--" in the reports.
Expected result:
Yahoojapan report should run successfully and insert the data to TSA staging database - tables "yahooJPerformanceReports" and "yahooJAdMax"