[TSAApp@aml-qa4-core1 bidmgr]$ ./bingreport.sh -d5 -rt performance -T2016-12-25 -U1848 2017-03-02 10:36:07.257 (3) [main]: Debug Level set to 3 ------- Loaded DatabaseAccounts properties from file:/usr/local/tsa/bidmgr-distribution-2.9.9-dev-t20170228-1046/libs/deployment-bidmgr-shaded-jar-2.9.9.jar!/core-jdb-datasource.properties ------- {datasource-user=spike, datasource-password=tar63t} 2017-03-02 10:36:07.345 (3) [main]: Debug Level set to 5 2017-03-02 10:36:07.419 (3) [main]: LicensingFileRefresher: modification detected on 1450252197000 for licensing.properties 2017-03-02 10:36:07.419 (3) [main]: Licensing environment detected, loading configuration. 2017-03-02 10:36:07.420 (3) [main]: Loaded property: distribution-service-url=http://aml-qa4-front1:8080/distribution 2017-03-02 10:36:07.420 (3) [main]: Loaded property: distribution-service-username=readwrite 2017-03-02 10:36:07.420 (3) [main]: Loaded property: distribution-service-password=readwrite 2017-03-02 10:36:07.420 (3) [main]: Loaded property: sapi-auth-url=http://aml-qa4-front1:8080/sapi/rest/security/tokens 2017-03-02 10:36:07.420 (3) [main]: Loaded property: sapi-merchant-service-url=http://aml-qa4-front1:8080/sapi/rest/merchants 2017-03-02 10:36:07.420 (3) [main]: Loaded property: sapi-reseller-service-url=http://aml-qa4-front1:8080/sapi/rest/resellers 2017-03-02 10:36:07.420 (3) [main]: Loaded property: sapi-username=admin+tsa@thesearchagency.com 2017-03-02 10:36:07.420 (3) [main]: Loaded property: sapi-password=admin 2017-03-02 10:36:07.421 (3) [main]: Loaded property: sapi-realm=thesearchagency 2017-03-02 10:36:07.421 (3) [main]: Loaded property: tsa.google.mcc.developerToken=ojCnjZaM6RD1h0yt_DOJZg 2017-03-02 10:36:07.421 (3) [main]: Loaded property: tsa.google.mcc.isReseller=true 2017-03-02 10:36:07.421 (3) [main]: Loaded property: tsa.google.mcc.userAgent=AdMaxLocal AdWords Software TSA QA 2017-03-02 10:36:07.421 (3) [main]: Loaded property: tsa.timezone=UTC 2017-03-02 10:36:07.426 (3) [main]: =============== Starting BingReport ================ 2017-03-02 10:36:07.426 (3) [main]: ----------------BingReport starting 2017-03-02 10:36:07.429 (4) [main]: no account, or instance for databaseInstance, skipping lookup... 2017-03-02 10:36:07.669 (3) [main]: JDBC Driver Version: 5.1 (com.mysql.jdbc.Driver) 2017-03-02 10:36:07.670 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true] 2017-03-02 10:36:07.686 (5) [main]: quoteValue(), nothing special about it=>[0], type=class java.lang.Integer 2017-03-02 10:36:07.688 (5) [main]: ProfilerRec.start("db",true) in Thread [main] 2017-03-02 10:36:07.688 (4) [main]: spike: SQL->[select * from `searchEngineUsers` join `accounts` on ((`tsacommon`.`accounts`.`id`=`tsacommon`.`searchEngineUsers`.`accountID`)) where ((`enabled`="true") and (`tsacommon`.`accounts`.`isActive`="true") and (`tsacommon`.`searchEngineUsers`.`id` in ("1848")) and (`tsacommon`.`searchEngineUsers`.`distributionID`="147") and (`tsacommon`.`searchEngineUsers`.`accountID`!=0)) order by `tsacommon`.`accounts`.`tier` asc,`tsacommon`.`accounts`.`priority` asc,`tsacommon`.`accounts`.`id` desc] 2017-03-02 10:36:07.693 (5) [main]: recordAsSubs("db", 5, "main") 2017-03-02 10:36:07.693 (5) [main]: ProfilerRec.end("db", true): ret=5 2017-03-02 10:36:07.694 (4) [main]: time=0.0050 2017-03-02 10:36:07.695 (4) [main]: Query executed in 0.005s 2017-03-02 10:36:07.698 (5) [main]: loading 35 columns from result set: 2017-03-02 10:36:07.699 (5) [main]: loaded column: searchEngineUsers.id->1848 2017-03-02 10:36:07.700 (5) [main]: loaded column: searchEngineUsers.accountID->1438 2017-03-02 10:36:07.700 (5) [main]: loaded column: searchEngineUsers.distributionID->147 2017-03-02 10:36:07.701 (5) [main]: loaded column: searchEngineUsers.searchEngineIdentifier->54064815 2017-03-02 10:36:07.701 (5) [main]: loaded column: searchEngineUsers.description->b7d676e7-ded9-4e23-9b44-562da48ca842_2_qa4amltest_Performance_Account_2 2017-03-02 10:36:07.701 (5) [main]: loaded column: searchEngineUsers.username-> 2017-03-02 10:36:07.702 (5) [main]: loaded column: searchEngineUsers.password-> 2017-03-02 10:36:07.702 (5) [main]: loaded column: searchEngineUsers.enabled->true 2017-03-02 10:36:07.702 (5) [main]: loaded column: searchEngineUsers.inTsaMcc->true 2017-03-02 10:36:07.702 (5) [main]: loaded column: searchEngineUsers.apiKey->25162148 2017-03-02 10:36:07.702 (5) [main]: loaded column: searchEngineUsers.managerUsernames->null 2017-03-02 10:36:07.702 (5) [main]: loaded column: searchEngineUsers.managerIDs->5121009 2017-03-02 10:36:07.710 (5) [main]: loaded column: searchEngineUsers.lastChecked->2016-12-16 07:07:44.0 2017-03-02 10:36:07.710 (5) [main]: loaded column: searchEngineUsers.lastInMcc->null 2017-03-02 10:36:07.711 (5) [main]: skipping invalid column: accounts.id 2017-03-02 10:36:07.711 (5) [main]: skipping invalid column: accounts.description 2017-03-02 10:36:07.711 (5) [main]: skipping invalid column: accounts.tier 2017-03-02 10:36:07.711 (5) [main]: skipping invalid column: accounts.priority 2017-03-02 10:36:07.711 (5) [main]: skipping invalid column: accounts.reportClicksOut 2017-03-02 10:36:07.711 (5) [main]: skipping invalid column: accounts.reportConversions 2017-03-02 10:36:07.711 (5) [main]: skipping invalid column: accounts.conversionTypes 2017-03-02 10:36:07.712 (5) [main]: skipping invalid column: accounts.isBidManaged 2017-03-02 10:36:07.712 (5) [main]: skipping invalid column: accounts.isActive 2017-03-02 10:36:07.712 (5) [main]: skipping invalid column: accounts.perfMetric 2017-03-02 10:36:07.712 (5) [main]: skipping invalid column: accounts.providesConversionData 2017-03-02 10:36:07.712 (5) [main]: skipping invalid column: accounts.addConversionData 2017-03-02 10:36:07.712 (5) [main]: skipping invalid column: accounts.fractionalConversionCounts 2017-03-02 10:36:07.712 (5) [main]: skipping invalid column: accounts.hideNullSources 2017-03-02 10:36:07.713 (5) [main]: skipping invalid column: accounts.nowTime 2017-03-02 10:36:07.713 (5) [main]: skipping invalid column: accounts.warehouseDatabase 2017-03-02 10:36:07.713 (5) [main]: skipping invalid column: accounts.databaseInstance 2017-03-02 10:36:07.713 (5) [main]: skipping invalid column: accounts.warehouseInstance 2017-03-02 10:36:07.713 (5) [main]: skipping invalid column: accounts.isOnline 2017-03-02 10:36:07.713 (5) [main]: skipping invalid column: accounts.currencyCode 2017-03-02 10:36:07.713 (5) [main]: skipping invalid column: accounts.timeZoneID 2017-03-02 10:36:07.717 (3) [P1T1]: === Starting BingReportSearchEngineUserWorker for search engine user #1848 b7d676e7-ded9-4e23-9b44-562da48ca842_2_qa4amltest_Performance_Account_2, search engine identifier 54064815 === 2017-03-02 10:36:07.718 (3) [P1T1]: Using file name /var/local/tsa/sedata/bing/tsa-bing-report-kwperformance-2016-12-25-U1848.xml.zip 2017-03-02 10:36:07.718 (3) [P1T1]: Local copy of /var/local/tsa/sedata/bing/tsa-bing-report-kwperformance-2016-12-25-U1848.xml.zip found. Deleting existing file. 2017-03-02 10:36:07.718 (3) [P1T1]: Using file name /var/local/tsa/sedata/bing/tsa-bing-report-clickperformance-2016-12-25-U1848.xml.zip 2017-03-02 10:36:07.718 (3) [P1T1]: Local copy of /var/local/tsa/sedata/bing/tsa-bing-report-clickperformance-2016-12-25-U1848.xml.zip found. Deleting existing file. 2017-03-02 10:36:08.051 (5) [P1T1]: quoteValue(), nothing special about it=>[1438], type=class java.lang.Integer 2017-03-02 10:36:08.051 (5) [P1T1]: ProfilerRec.start("db",true) in Thread [P1T1] 2017-03-02 10:36:08.052 (4) [P1T1]: spike: SQL->[select * from `tsacommon`.`accounts` where (`id`=1438) limit 1] 2017-03-02 10:36:08.053 (5) [P1T1]: recordAsSubs("db", 1, "P1T1") 2017-03-02 10:36:08.053 (5) [P1T1]: ProfilerRec.end("db", true): ret=1 2017-03-02 10:36:08.053 (4) [P1T1]: time=0.0010 2017-03-02 10:36:08.054 (4) [P1T1]: Query executed in 0.001s 2017-03-02 10:36:08.054 (5) [P1T1]: loading 21 columns from result set: 2017-03-02 10:36:08.054 (5) [P1T1]: loaded column: accounts.id->1438 2017-03-02 10:36:08.054 (5) [P1T1]: loaded column: accounts.description->b7d676e7-ded9-4e23-9b44-562da48ca842 2017-03-02 10:36:08.054 (5) [P1T1]: loaded column: accounts.tier->1 2017-03-02 10:36:08.054 (5) [P1T1]: loaded column: accounts.priority->50 2017-03-02 10:36:08.054 (5) [P1T1]: loaded column: accounts.reportClicksOut->false 2017-03-02 10:36:08.055 (5) [P1T1]: loaded column: accounts.reportConversions->false 2017-03-02 10:36:08.055 (5) [P1T1]: loaded column: accounts.conversionTypes->paid 2017-03-02 10:36:08.055 (5) [P1T1]: loaded column: accounts.isBidManaged->true 2017-03-02 10:36:08.055 (5) [P1T1]: loaded column: accounts.isActive->true 2017-03-02 10:36:08.055 (5) [P1T1]: loaded column: accounts.perfMetric->cpa 2017-03-02 10:36:08.055 (5) [P1T1]: loaded column: accounts.providesConversionData->true 2017-03-02 10:36:08.055 (5) [P1T1]: loaded column: accounts.addConversionData->true 2017-03-02 10:36:08.056 (5) [P1T1]: loaded column: accounts.fractionalConversionCounts->false 2017-03-02 10:36:08.056 (5) [P1T1]: loaded column: accounts.hideNullSources->false 2017-03-02 10:36:08.059 (5) [P1T1]: loaded column: accounts.nowTime->null 2017-03-02 10:36:08.059 (5) [P1T1]: skipping invalid column: accounts.warehouseDatabase 2017-03-02 10:36:08.059 (5) [P1T1]: loaded column: accounts.databaseInstance->1 2017-03-02 10:36:08.059 (5) [P1T1]: loaded column: accounts.warehouseInstance->1 2017-03-02 10:36:08.059 (5) [P1T1]: loaded column: accounts.isOnline->true 2017-03-02 10:36:08.060 (5) [P1T1]: loaded column: accounts.currencyCode->USD 2017-03-02 10:36:08.060 (5) [P1T1]: loaded column: accounts.timeZoneID->America/New_York 2017-03-02 10:36:08.060 (4) [P1T1]: Record Loaded 2017-03-02 10:36:08,939 [P1T1] DEBUG c.t.searchengines.bing.BingApiUtils - Getting Bing properties using distribution service 2017-03-02 10:36:09,059 [P1T1] INFO c.t.s.c.b.impl.BingAdsServiceFactory - USING PRODUCTION ENVIRONMENT 2017-03-02 10:36:09,061 [P1T1] DEBUG c.t.s.client.bing.impl.BingAdsClient - Created BingAdsClient for 54064815 2017-03-02 10:36:09.062 (5) [P1T1]: parseInteger->[1438] 2017-03-02 10:36:09.063 (5) [P1T1]: parseInteger<-[1438] 2017-03-02 10:36:09.063 (4) [P1T1]: preparing SQL statement [select currencyCode from `tsacommon`.`accounts` where id = ?] 2017-03-02 10:36:09,084 [P1T1] DEBUG c.t.s.c.b.i.s.ReportServiceClient - ReportServiceClient - Submitting generate report request for reportType: KEYWORD_PERFORMANCE, Accounts:[54064815] 2017-03-02 10:36:09,167 [P1T1] INFO o.a.c.w.s.f.ReflectionServiceFactoryBean - Creating Service {https://bingads.microsoft.com/Reporting/v9}ReportingService from class com.microsoft.bingads.reporting.IReportingService 2017-03-02 10:36:11,272 [P1T1] INFO o.a.c.w.s.f.ReflectionServiceFactoryBean - Creating Service {https://bingads.microsoft.com/Reporting/v9}ReportingService from class com.microsoft.bingads.reporting.IReportingService 2017-03-02 10:36:12,111 [P1T1] INFO o.a.c.s.R.I.IReportingService - Outbound Message --------------------------- ID: 1 Address: https://api.bingads.microsoft.com/Api/Advertiser/Reporting/v9/ReportingService.svc Encoding: UTF-8 Http-Method: POST Content-Type: text/xml Headers: {Accept=[*/*], SOAPAction=[SubmitGenerateReport]} Payload: 5406481525162148Pa55w0rdDN8ELHL3API_TheSearchAgencyXmlEnglishBing Keyword PerformanceDailyCampaignIdAdGroupIdAdIdKeywordIdKeywordBidMatchTypeAverageCpcImpressionsClicksSpendAveragePositionQualityScore54064815 -------------------------------------- 2017-03-02 10:36:12,903 [P1T1] INFO o.a.c.s.R.I.IReportingService - Inbound Message ---------------------------- ID: 1 Response-Code: 200 Encoding: UTF-8 Content-Type: text/xml; charset=utf-8 Headers: {Content-Length=[397], content-type=[text/xml; charset=utf-8], Date=[Thu, 02 Mar 2017 10:36:12 GMT], Server=[Microsoft-IIS/8.0], X-Powered-By=[ASP.NET]} Payload: 83f6834c-1e0e-4740-9b17-00dc3a0d896a30000000568409541 -------------------------------------- 2017-03-02 10:36:13,000 [P1T1] INFO c.t.s.c.b.i.s.ReportServiceClient - Successfully submitted generate report request for reportType: KEYWORD_PERFORMANCE, accounts:[54064815] 2017-03-02 10:36:13,002 [P1T1] DEBUG c.t.s.c.b.i.s.ReportServiceClient - ReportServiceClient - Polling requested Report for report ID 30000000568409541 2017-03-02 10:36:13,005 [P1T1] INFO o.a.c.s.R.I.IReportingService - Outbound Message --------------------------- ID: 2 Address: https://api.bingads.microsoft.com/Api/Advertiser/Reporting/v9/ReportingService.svc Encoding: UTF-8 Http-Method: POST Content-Type: text/xml Headers: {Accept=[*/*], SOAPAction=[PollGenerateReport]} Payload: 5406481525162148Pa55w0rdDN8ELHL3API_TheSearchAgency30000000568409541 -------------------------------------- 2017-03-02 10:36:13,219 [P1T1] INFO o.a.c.s.R.I.IReportingService - Inbound Message ---------------------------- ID: 2 Response-Code: 200 Encoding: UTF-8 Content-Type: text/xml; charset=utf-8 Headers: {Content-Length=[493], content-type=[text/xml; charset=utf-8], Date=[Thu, 02 Mar 2017 10:36:12 GMT], Server=[Microsoft-IIS/8.0], X-Powered-By=[ASP.NET]} Payload: 0403054a-28fc-4c5d-bd61-0d95fdfdaca7Pending -------------------------------------- 2017-03-02 10:36:13,223 [P1T1] INFO c.t.s.c.b.i.s.ReportServiceClient - Successfully polled report request for report ID: 30000000568409541 2017-03-02 10:36:13,224 [P1T1] DEBUG c.t.s.client.bing.impl.BingAdsClient - Bing Report '/var/local/tsa/sedata/bing/tsa-bing-report-kwperformance-2016-12-25-U1848.xml.zip' is not ready for download. Waiting 20 seconds. 2017-03-02 10:36:33,224 [P1T1] DEBUG c.t.s.c.b.i.s.ReportServiceClient - ReportServiceClient - Polling requested Report for report ID 30000000568409541 2017-03-02 10:36:33,227 [P1T1] INFO o.a.c.s.R.I.IReportingService - Outbound Message --------------------------- ID: 3 Address: https://api.bingads.microsoft.com/Api/Advertiser/Reporting/v9/ReportingService.svc Encoding: UTF-8 Http-Method: POST Content-Type: text/xml Headers: {Accept=[*/*], SOAPAction=[PollGenerateReport]} Payload: 5406481525162148Pa55w0rdDN8ELHL3API_TheSearchAgency30000000568409541 -------------------------------------- 2017-03-02 10:36:33,865 [P1T1] INFO o.a.c.s.R.I.IReportingService - Inbound Message ---------------------------- ID: 3 Response-Code: 200 Encoding: UTF-8 Content-Type: text/xml; charset=utf-8 Headers: {Content-Length=[1621], content-type=[text/xml; charset=utf-8], Date=[Thu, 02 Mar 2017 10:36:33 GMT], Server=[Microsoft-IIS/8.0], X-Powered-By=[ASP.NET]} Payload: 04bade9a-f140-4e29-80a8-71078af47be7https://dvsrdl.api.bingads.microsoft.com/ReportDownload/Download.aspx?q=uyQQEx07K%2fP4Cl55JJMODydJfX7hEzUYu2eKR3gdYdevyxYhz7usLI0jQfOv%2bg4nflbZQr2sMczvdbVQ4Jivx6aa5TXOPaMroHSXjdljZ1oP4CnuboD1dge6ir44LnhsxwYwCODWJi5MUaO%2ffFmMUSNub1%2b0dvE4BoERFErPpq4oTYn3ajs%2bljG7ZDQ9v8k%2b27D3IQdCmorfh3GXPxzQPpmv9N1Hly1YuLNPZ5dOLb%2fkwq8N8P32zlkTl%2fUaBeuzJ0FY3VTdF1bj9Js5NE6wL%2b9GK7cHZ1x%2fWHc86pxO7F9am0SfpMdYWeK%2fr34Jbno2o0LRMsnT5V37oV7P5oMXnjgmGewVvdOOLAJ3ixlY1%2faV6l93rUie%2ba5MiEaUmTPNGNgk646XTQkbZtZ1MFIb9Cqkklt2ewiwLp4otcbUhhQVH5n4bkNGtJmIeQGEr836X9b3n7zTXCPrdqsvpp9q%2bJ%2b34rKmk%2bsC%2f958aHWs4hgfqzCHowKApH%2bpDmuI8QySZ16iWjtAhQ%2bAkm0RoV7753167FBNRxyGI4M0Idb5bBWZmYi2GIpO7ar9%2foemFaXDVyS%2fkZVRfzB8EXb5FvTjkBfDzpgkXVnQ9u0tW6RTPJHFEid%2fpw509JVz8%2f0CkwoitdybvEgriLjRo%2fZ%2bk6KyemJXcNgqU%2bFCk2gslruEJjd3iMVtY2dRHCpgpouE6Od2iYSMmkrYfnZLZ5eXVQM9RdGrEdX20N2D5B5UnawTu68%2bTPhqDRVIvrR3s5n7zX%2fmgyQD4QobO7eXPUNJ7MdQSRsJgEAGihTbTO6NY2bpkJFbQJWZczKib%2bVW1P3nuEg7js55Ik0kgqyS7VcveVaCjXEnRUlskobC0r98YXl6T%2bdPAVCsUcW48jIZpeBanX1fMVY2ppQGdm0Lc9FJ6ZbgOio%2bmf9QxSvBjgN%2fWRxMbLOtN07mYqs2cFBBYvfvzoKkk3dqh3RAuI4OIfv0IoWPgh0%3dSuccess -------------------------------------- 2017-03-02 10:36:33,868 [P1T1] INFO c.t.s.c.b.i.s.ReportServiceClient - Successfully polled report request for report ID: 30000000568409541 2017-03-02 10:36:33,868 [P1T1] DEBUG c.t.s.client.bing.impl.BingAdsClient - Downloading report '/var/local/tsa/sedata/bing/tsa-bing-report-kwperformance-2016-12-25-U1848.xml.zip' with download URL https://dvsrdl.api.bingads.microsoft.com/ReportDownload/Download.aspx?q=uyQQEx07K%2fP4Cl55JJMODydJfX7hEzUYu2eKR3gdYdevyxYhz7usLI0jQfOv%2bg4nflbZQr2sMczvdbVQ4Jivx6aa5TXOPaMroHSXjdljZ1oP4CnuboD1dge6ir44LnhsxwYwCODWJi5MUaO%2ffFmMUSNub1%2b0dvE4BoERFErPpq4oTYn3ajs%2bljG7ZDQ9v8k%2b27D3IQdCmorfh3GXPxzQPpmv9N1Hly1YuLNPZ5dOLb%2fkwq8N8P32zlkTl%2fUaBeuzJ0FY3VTdF1bj9Js5NE6wL%2b9GK7cHZ1x%2fWHc86pxO7F9am0SfpMdYWeK%2fr34Jbno2o0LRMsnT5V37oV7P5oMXnjgmGewVvdOOLAJ3ixlY1%2faV6l93rUie%2ba5MiEaUmTPNGNgk646XTQkbZtZ1MFIb9Cqkklt2ewiwLp4otcbUhhQVH5n4bkNGtJmIeQGEr836X9b3n7zTXCPrdqsvpp9q%2bJ%2b34rKmk%2bsC%2f958aHWs4hgfqzCHowKApH%2bpDmuI8QySZ16iWjtAhQ%2bAkm0RoV7753167FBNRxyGI4M0Idb5bBWZmYi2GIpO7ar9%2foemFaXDVyS%2fkZVRfzB8EXb5FvTjkBfDzpgkXVnQ9u0tW6RTPJHFEid%2fpw509JVz8%2f0CkwoitdybvEgriLjRo%2fZ%2bk6KyemJXcNgqU%2bFCk2gslruEJjd3iMVtY2dRHCpgpouE6Od2iYSMmkrYfnZLZ5eXVQM9RdGrEdX20N2D5B5UnawTu68%2bTPhqDRVIvrR3s5n7zX%2fmgyQD4QobO7eXPUNJ7MdQSRsJgEAGihTbTO6NY2bpkJFbQJWZczKib%2bVW1P3nuEg7js55Ik0kgqyS7VcveVaCjXEnRUlskobC0r98YXl6T%2bdPAVCsUcW48jIZpeBanX1fMVY2ppQGdm0Lc9FJ6ZbgOio%2bmf9QxSvBjgN%2fWRxMbLOtN07mYqs2cFBBYvfvzoKkk3dqh3RAuI4OIfv0IoWPgh0%3d 2017-03-02 10:36:34,793 [P1T1] DEBUG c.t.s.client.bing.impl.BingAdsClient - Report downloaded 2017-03-02 10:36:34,794 [P1T1] DEBUG c.t.s.c.b.i.s.ReportServiceClient - ReportServiceClient - Submitting generate report request for reportType: CLICK_PERFORMANCE_KEYWORD, Accounts:[54064815] 2017-03-02 10:36:34,799 [P1T1] INFO o.a.c.s.R.I.IReportingService - Outbound Message --------------------------- ID: 4 Address: https://api.bingads.microsoft.com/Api/Advertiser/Reporting/v9/ReportingService.svc Encoding: UTF-8 Http-Method: POST Content-Type: text/xml Headers: {Accept=[*/*], SOAPAction=[SubmitGenerateReport]} Payload: 5406481525162148Pa55w0rdDN8ELHL3API_TheSearchAgencyXmlEnglishBing AdExtension Performance Keyword ReportDailyCampaignIdAdGroupIdKeywordIdKeywordNetworkAdExtensionTypeClickTypeDeviceTypeClicks54064815 -------------------------------------- 2017-03-02 10:36:35,391 [P1T1] INFO o.a.c.s.R.I.IReportingService - Inbound Message ---------------------------- ID: 4 Response-Code: 200 Encoding: UTF-8 Content-Type: text/xml; charset=utf-8 Headers: {Content-Length=[397], content-type=[text/xml; charset=utf-8], Date=[Thu, 02 Mar 2017 10:36:35 GMT], Server=[Microsoft-IIS/8.0], X-Powered-By=[ASP.NET]} Payload: e4cf6231-cf42-4e9b-87c0-fb83ade0023f30000000568410238 -------------------------------------- 2017-03-02 10:36:35,393 [P1T1] INFO c.t.s.c.b.i.s.ReportServiceClient - Successfully submitted generate report request for reportType: CLICK_PERFORMANCE_KEYWORD, accounts:[54064815] 2017-03-02 10:36:35,394 [P1T1] DEBUG c.t.s.c.b.i.s.ReportServiceClient - ReportServiceClient - Polling requested Report for report ID 30000000568410238 2017-03-02 10:36:35,395 [P1T1] INFO o.a.c.s.R.I.IReportingService - Outbound Message --------------------------- ID: 5 Address: https://api.bingads.microsoft.com/Api/Advertiser/Reporting/v9/ReportingService.svc Encoding: UTF-8 Http-Method: POST Content-Type: text/xml Headers: {Accept=[*/*], SOAPAction=[PollGenerateReport]} Payload: 5406481525162148Pa55w0rdDN8ELHL3API_TheSearchAgency30000000568410238 -------------------------------------- 2017-03-02 10:36:35,615 [P1T1] INFO o.a.c.s.R.I.IReportingService - Inbound Message ---------------------------- ID: 5 Response-Code: 200 Encoding: UTF-8 Content-Type: text/xml; charset=utf-8 Headers: {Content-Length=[493], content-type=[text/xml; charset=utf-8], Date=[Thu, 02 Mar 2017 10:36:35 GMT], Server=[Microsoft-IIS/8.0], X-Powered-By=[ASP.NET]} Payload: f9b3de96-9458-4a89-ab8f-7d3a7d51d70dPending -------------------------------------- 2017-03-02 10:36:35,617 [P1T1] INFO c.t.s.c.b.i.s.ReportServiceClient - Successfully polled report request for report ID: 30000000568410238 2017-03-02 10:36:35,617 [P1T1] DEBUG c.t.s.client.bing.impl.BingAdsClient - Bing Report '/var/local/tsa/sedata/bing/tsa-bing-report-clickperformance-2016-12-25-U1848.xml.zip' is not ready for download. Waiting 20 seconds. 2017-03-02 10:36:55,618 [P1T1] DEBUG c.t.s.c.b.i.s.ReportServiceClient - ReportServiceClient - Polling requested Report for report ID 30000000568410238 2017-03-02 10:36:55,620 [P1T1] INFO o.a.c.s.R.I.IReportingService - Outbound Message --------------------------- ID: 6 Address: https://api.bingads.microsoft.com/Api/Advertiser/Reporting/v9/ReportingService.svc Encoding: UTF-8 Http-Method: POST Content-Type: text/xml Headers: {Accept=[*/*], SOAPAction=[PollGenerateReport]} Payload: 5406481525162148Pa55w0rdDN8ELHL3API_TheSearchAgency30000000568410238 -------------------------------------- 2017-03-02 10:36:56,381 [P1T1] INFO o.a.c.s.R.I.IReportingService - Inbound Message ---------------------------- ID: 6 Response-Code: 200 Encoding: UTF-8 Content-Type: text/xml; charset=utf-8 Headers: {Content-Length=[1637], content-type=[text/xml; charset=utf-8], Date=[Thu, 02 Mar 2017 10:36:56 GMT], Server=[Microsoft-IIS/8.0], X-Powered-By=[ASP.NET]} Payload: ffdf4be3-9f3a-40bd-80a3-45f49e9d5efchttps://dvsrdl.api.bingads.microsoft.com/ReportDownload/Download.aspx?q=DorqVrbv%2bhTNob7zXYP1hAXKS6WaFEIRqENGYlnYtuZrWk3Px%2bdWHopE5ZJJvaooUi4i2PI0VI0fROLLpcroy55w4PMpyyppMMCH1SDGbVSW9V4jkdmTAp33%2f5b6CEu9jq9y1TcpU1TVxUrkpbk%2fnCk%2fMuWGsJZIyCO%2fvJailDJHBzYuc5k%2fhp4xLKBJbOmn%2bxFOifsDytoAPJFklmrvx6lH%2fVQ5jSyw9cBlR8aLmHtCvOSPzu2rIEvOGZcjLopWLcjENVCxYVlK7LyBASWZ0DdURoJzzOSy5wPlM1Zf4Tv7KrwzDxzS%2f6%2bVDk21nck4TC9hmDHO%2bGVPBM5LlIGxSf9vSeFr0gJnP8W%2b3u3WR7FM09z2HEXmnFAY7IvEJhpOWnf0w1hwgGaIKqLTGDBr9DxbjnZK5V7jBGD6z6m9F1r27EiU1RVoZBU0Ms4oyoyR%2fetBjltZ80qcTEYR5XpYDnJSHSSBPOgtIAsnN79tV7GMLDueFf5%2frbj64oRC7nVPjQD58nEbYkJVRQqtVnArdieaTCJT%2bE1ZejaT9syZ0AFvl3TzI572X2W4UQnglW3asVEH9%2bTP4f%2bcFS3OEKDn29BQW8tdURG5%2fgbHQYJfsoad%2ffIw7TtyogXHSR0VP5P6P7a%2buCK74WHHbB%2b2Nw2iFfcdPFdkhBVpKVKoni74G9BGwZ4Uc%2b7hR1mOAQBZzVIdfrkqfoVUPL6T9BWOZ6RUCTq0o93St2uFuvkBWUhgLQyPsb3liQKeCYWpQFAXslMaKs0nviI58FDsHHLKt76Y9m55OF5hhBoxRy9FoPA49j%2bIDKlFeDHa6RlBUrKIsEMT3FFDi%2bSTXNILhMS%2fVN%2f1rJ6nE%2b5qq%2b0xATNTWHv3Et26xEjtU0LmitNmNQf8kszzAFEmBHQQ91SkMoQJG%2fALvy9Es93QIf8zyhKKNxz6eKpZ2ZJOUaXzAo%2b9NzEogteN9brQ0m2hEnqdeXMmlcGfisbgEQ2YtNG7EvstiDhNuKDVSuccess -------------------------------------- 2017-03-02 10:36:56,383 [P1T1] INFO c.t.s.c.b.i.s.ReportServiceClient - Successfully polled report request for report ID: 30000000568410238 2017-03-02 10:36:56,383 [P1T1] DEBUG c.t.s.client.bing.impl.BingAdsClient - Downloading report '/var/local/tsa/sedata/bing/tsa-bing-report-clickperformance-2016-12-25-U1848.xml.zip' with download URL https://dvsrdl.api.bingads.microsoft.com/ReportDownload/Download.aspx?q=DorqVrbv%2bhTNob7zXYP1hAXKS6WaFEIRqENGYlnYtuZrWk3Px%2bdWHopE5ZJJvaooUi4i2PI0VI0fROLLpcroy55w4PMpyyppMMCH1SDGbVSW9V4jkdmTAp33%2f5b6CEu9jq9y1TcpU1TVxUrkpbk%2fnCk%2fMuWGsJZIyCO%2fvJailDJHBzYuc5k%2fhp4xLKBJbOmn%2bxFOifsDytoAPJFklmrvx6lH%2fVQ5jSyw9cBlR8aLmHtCvOSPzu2rIEvOGZcjLopWLcjENVCxYVlK7LyBASWZ0DdURoJzzOSy5wPlM1Zf4Tv7KrwzDxzS%2f6%2bVDk21nck4TC9hmDHO%2bGVPBM5LlIGxSf9vSeFr0gJnP8W%2b3u3WR7FM09z2HEXmnFAY7IvEJhpOWnf0w1hwgGaIKqLTGDBr9DxbjnZK5V7jBGD6z6m9F1r27EiU1RVoZBU0Ms4oyoyR%2fetBjltZ80qcTEYR5XpYDnJSHSSBPOgtIAsnN79tV7GMLDueFf5%2frbj64oRC7nVPjQD58nEbYkJVRQqtVnArdieaTCJT%2bE1ZejaT9syZ0AFvl3TzI572X2W4UQnglW3asVEH9%2bTP4f%2bcFS3OEKDn29BQW8tdURG5%2fgbHQYJfsoad%2ffIw7TtyogXHSR0VP5P6P7a%2buCK74WHHbB%2b2Nw2iFfcdPFdkhBVpKVKoni74G9BGwZ4Uc%2b7hR1mOAQBZzVIdfrkqfoVUPL6T9BWOZ6RUCTq0o93St2uFuvkBWUhgLQyPsb3liQKeCYWpQFAXslMaKs0nviI58FDsHHLKt76Y9m55OF5hhBoxRy9FoPA49j%2bIDKlFeDHa6RlBUrKIsEMT3FFDi%2bSTXNILhMS%2fVN%2f1rJ6nE%2b5qq%2b0xATNTWHv3Et26xEjtU0LmitNmNQf8kszzAFEmBHQQ91SkMoQJG%2fALvy9Es93QIf8zyhKKNxz6eKpZ2ZJOUaXzAo%2b9NzEogteN9brQ0m2hEnqdeXMmlcGfisbgEQ2YtNG7EvstiDhNuKDV 2017-03-02 10:36:57,027 [P1T1] DEBUG c.t.s.client.bing.impl.BingAdsClient - Report downloaded 2017-03-02 10:36:57.028 (3) [P1T1]: Parsing /var/local/tsa/sedata/bing/tsa-bing-report-kwperformance-2016-12-25-U1848.xml.zip into staging database 2017-03-02 10:36:57.031 (4) [P1T1]: Found column 'CampaignId' 2017-03-02 10:36:57.031 (4) [P1T1]: Found column 'AdGroupId' 2017-03-02 10:36:57.031 (4) [P1T1]: Found column 'AdId' 2017-03-02 10:36:57.031 (4) [P1T1]: Found column 'KeywordId' 2017-03-02 10:36:57.031 (4) [P1T1]: Found column 'Keyword' 2017-03-02 10:36:57.031 (4) [P1T1]: Found column 'BiddedMatchType' 2017-03-02 10:36:57.032 (4) [P1T1]: Found column 'AverageCpc' 2017-03-02 10:36:57.032 (4) [P1T1]: Found column 'Impressions' 2017-03-02 10:36:57.032 (4) [P1T1]: Found column 'Clicks' 2017-03-02 10:36:57.032 (4) [P1T1]: Found column 'Spend' 2017-03-02 10:36:57.032 (4) [P1T1]: Found column 'AveragePosition' 2017-03-02 10:36:57.032 (4) [P1T1]: Found column 'QualityScore' 2017-03-02 10:36:57.046 (4) [P1T1]: no account, or instance for databaseInstance, skipping lookup... 2017-03-02 10:36:57.066 (3) [P1T1]: JDBC Driver Version: 5.1 (com.mysql.jdbc.Driver) 2017-03-02 10:36:57.066 (4) [P1T1]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true] 2017-03-02 10:36:57.068 (5) [P1T1]: ProfilerRec.start("db",true) in Thread [P1T1] 2017-03-02 10:36:57.068 (4) [P1T1]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`name`="global-staging") and (`type`="mysql")) limit 1] 2017-03-02 10:36:57.069 (5) [P1T1]: recordAsSubs("db", 1, "P1T1") 2017-03-02 10:36:57.069 (5) [P1T1]: ProfilerRec.end("db", true): ret=1 2017-03-02 10:36:57.069 (4) [P1T1]: time=0.0010 2017-03-02 10:36:57.070 (4) [P1T1]: Query executed in 0.001s 2017-03-02 10:36:57.070 (5) [P1T1]: loading 8 columns from result set: 2017-03-02 10:36:57.070 (5) [P1T1]: loaded column: databaseInstances.id->3 2017-03-02 10:36:57.070 (5) [P1T1]: loaded column: databaseInstances.name->global-staging 2017-03-02 10:36:57.070 (5) [P1T1]: loaded column: databaseInstances.description->Global Staging Tables 2017-03-02 10:36:57.070 (5) [P1T1]: loaded column: databaseInstances.type->mysql 2017-03-02 10:36:57.070 (5) [P1T1]: loaded column: databaseInstances.database->staging 2017-03-02 10:36:57.070 (5) [P1T1]: loaded column: databaseInstances.host->staging-01-write 2017-03-02 10:36:57.070 (5) [P1T1]: loaded column: databaseInstances.port->3306 2017-03-02 10:36:57.071 (5) [P1T1]: loaded column: databaseInstances.access->rw 2017-03-02 10:36:57.071 (4) [P1T1]: Record Loaded 2017-03-02 10:36:57.071 (4) [P1T1]: DataCache: put key global-staging 2017-03-02 10:36:57.072 (4) [P1T1]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true] 2017-03-02 10:36:57.075 (4) [P1T1]: registered MBean [com.carldunham.jst.pooling:type=ObjectPool428cd40a-3e4c-4c11-ba7e-7acbd457f89c] for class com.carldunham.jst.pooling.ObjectPool 2017-03-02 10:36:57.075 (3) [P1T1]: DatabasePool with a limit of 3 created 2017-03-02 10:36:57.075 (4) [P1T1]: registered MBean [com.carldunham.jst.db:type=DatabasePoold672418b-0e33-4cff-a439-a4f2a9a4f4c6] for class com.carldunham.jst.db.DatabasePool 2017-03-02 10:36:57.077 (4) [ConnectionCloser]: Starting DatabasePool ConnectionCloserThread 2017-03-02 10:36:57.096 (3) [P1T1]: JDBC Driver Version: 5.1 (com.mysql.jdbc.Driver) 2017-03-02 10:36:57.096 (4) [P1T1]: opened [jdbc:mysql://staging-01-write:3306/staging?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true] 2017-03-02 10:36:57.096 (4) [P1T1]: Created new Object 2017-03-02 10:36:57.096 (5) [P1T1]: ProfilerRec.start("db",true) in Thread [P1T1] 2017-03-02 10:36:57.096 (4) [P1T1]: spike: SQL->[select @@version] 2017-03-02 10:36:57.098 (5) [P1T1]: recordAsSubs("db", 2, "P1T1") 2017-03-02 10:36:57.098 (5) [P1T1]: ProfilerRec.end("db", true): ret=2 2017-03-02 10:36:57.098 (4) [P1T1]: time=0.0020 2017-03-02 10:36:57.098 (4) [P1T1]: Query executed in 0.002s 2017-03-02 10:36:57.098 (4) [P1T1]: test query succeeded, returned "5.5.34" 2017-03-02 10:36:57.104 (5) [P1T1]: ProfilerRec.start("db",true) in Thread [P1T1] 2017-03-02 10:36:57.104 (4) [P1T1]: spike: SQL->[select * from `tsacommon`.`searchEngineAccounts` where ((`searchEngineUserID`="1848"))] 2017-03-02 10:36:57.106 (5) [P1T1]: recordAsSubs("db", 2, "P1T1") 2017-03-02 10:36:57.106 (5) [P1T1]: ProfilerRec.end("db", true): ret=2 2017-03-02 10:36:57.106 (4) [P1T1]: time=0.0020 2017-03-02 10:36:57.106 (4) [P1T1]: Query executed in 0.002s 2017-03-02 10:36:57.109 (3) [P1T1]: Deleting existing records where ((`startTime`="2016-12-25") and (`campaignid` in ("223252672","223252673"))) 2017-03-02 10:36:57.109 (5) [P1T1]: ProfilerRec.start("db",true) in Thread [P1T1] 2017-03-02 10:36:57.109 (4) [P1T1]: spike: SQL->[delete from `staging`.`bingPerformanceReports` where ((`startTime`="2016-12-25") and (`campaignid` in ("223252672","223252673")))], genflags=no 2017-03-02 10:36:57.111 (5) [P1T1]: recordAsSubs("db", 2, "P1T1") 2017-03-02 10:36:57.111 (5) [P1T1]: ProfilerRec.end("db", true): ret=2 2017-03-02 10:36:57.111 (4) [P1T1]: time=0.0020 2017-03-02 10:36:57.112 (4) [P1T1]: Query executed in 0.002s, 0 row(s) affected 2017-03-02 10:36:57.112 (3) [P1T1]: Inserting new data into `staging`.`bingPerformanceReports` 2017-03-02 10:36:57.131 (4) [P1T1]: preparing SQL statement [INSERT INTO `staging`.`bingPerformanceReports`(startTime,campaignid,adgroupid,creativeid,keywordid,keyword,kwType,avgCpc,imps,clicks,cost,pos,qualityScore) VALUES (?,?,?,?,?,?,?,?,?,?,?,?,?) ON DUPLICATE KEY UPDATE startTime=(?), campaignid=(?), adgroupid=(?), creativeid=(?), keywordid=(?), keyword=(?), kwType=(?), avgCpc=(?), imps=(?), clicks=(?), cost=(?), pos=(?), qualityScore=(?)] 2017-03-02 10:36:57.152 (4) [P1T1]: DB AutoCommit -> false 2017-03-02 10:36:57.153 (5) [P1T1]: ProfilerRec.start("db",true) in Thread [P1T1] 2017-03-02 10:36:57.153 (4) [P1T1]: spike: SQL->[start transaction] 2017-03-02 10:36:57.154 (5) [P1T1]: recordAsSubs("db", 1, "P1T1") 2017-03-02 10:36:57.154 (5) [P1T1]: ProfilerRec.end("db", true): ret=1 2017-03-02 10:36:57.154 (4) [P1T1]: time=0.0010 2017-03-02 10:36:57.154 (4) [P1T1]: Query executed in 0.001s 2017-03-02 10:36:57.154 (5) [P1T1]: SQL execute() returned false 2017-03-02 10:36:57.167 (4) [P1T1]: DB AutoCommit -> true 2017-03-02 10:36:57.168 (4) [P1T1]: DB AutoCommit -> true 2017-03-02 10:36:57.169 (4) [P1T1]: Removing temp file... 2017-03-02 10:36:57.169 (3) [P1T1]: Parsing /var/local/tsa/sedata/bing/tsa-bing-report-clickperformance-2016-12-25-U1848.xml.zip into staging database 2017-03-02 10:36:57.171 (4) [P1T1]: Found column 'CampaignId' 2017-03-02 10:36:57.171 (4) [P1T1]: Found column 'AdGroupId' 2017-03-02 10:36:57.171 (4) [P1T1]: Found column 'KeywordId' 2017-03-02 10:36:57.171 (4) [P1T1]: Found column 'Keyword' 2017-03-02 10:36:57.171 (4) [P1T1]: Found column 'Network' 2017-03-02 10:36:57.171 (4) [P1T1]: Found column 'AdExtensionType' 2017-03-02 10:36:57.172 (4) [P1T1]: Found column 'ClickType' 2017-03-02 10:36:57.172 (4) [P1T1]: Found column 'Devicetype' 2017-03-02 10:36:57.172 (4) [P1T1]: Found column 'Clicks' 2017-03-02 10:36:57.173 (5) [P1T1]: ProfilerRec.start("db",true) in Thread [P1T1] 2017-03-02 10:36:57.173 (4) [P1T1]: spike: SQL->[select * from `tsacommon`.`searchEngineAccounts` where ((`searchEngineUserID`="1848"))] 2017-03-02 10:36:57.174 (5) [P1T1]: recordAsSubs("db", 1, "P1T1") 2017-03-02 10:36:57.174 (5) [P1T1]: ProfilerRec.end("db", true): ret=1 2017-03-02 10:36:57.174 (4) [P1T1]: time=0.0010 2017-03-02 10:36:57.175 (4) [P1T1]: Query executed in 0.001s 2017-03-02 10:36:57.176 (3) [P1T1]: Deleting existing records where ((`startTime`="2016-12-25") and (`campaignid` in ("223252672","223252673"))) 2017-03-02 10:36:57.176 (5) [P1T1]: ProfilerRec.start("db",true) in Thread [P1T1] 2017-03-02 10:36:57.176 (4) [P1T1]: spike: SQL->[delete from `staging`.`bingClicks` where ((`startTime`="2016-12-25") and (`campaignid` in ("223252672","223252673")))], genflags=no 2017-03-02 10:36:57.179 (5) [P1T1]: recordAsSubs("db", 3, "P1T1") 2017-03-02 10:36:57.179 (5) [P1T1]: ProfilerRec.end("db", true): ret=3 2017-03-02 10:36:57.179 (4) [P1T1]: time=0.0030 2017-03-02 10:36:57.179 (4) [P1T1]: Query executed in 0.003s, 0 row(s) affected 2017-03-02 10:36:57.179 (2) [P1T1]: report does not contain any performance data. Nothing to parse. 2017-03-02 10:36:57.179 (4) [P1T1]: Removing temp file... 2017-03-02 10:36:57.179 (3) [P1T1]: === Completed search engine user #1848 b7d676e7-ded9-4e23-9b44-562da48ca842_2_qa4amltest_Performance_Account_2, search engine identifier 54064815 === 2017-03-02 10:36:57.179 (4) [P1T1]: Returning Object to Pool 2017-03-02 10:36:57.180 (4) [main]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true] 2017-03-02 10:36:57.180 (3) [main]: ------------BingReport done 2017-03-02 10:36:57.180 (3) [main]: =============== Completed BingReport ================