[TSAApp@aml-qa4-core1 bidmgr]$ ./bingreport.sh -d5 -rt performance -T2016-12-25 -U1848
2017-03-02 10:36:07.257 (3) [main]: Debug Level set to 3
------- Loaded DatabaseAccounts properties from file:/usr/local/tsa/bidmgr-distribution-2.9.9-dev-t20170228-1046/libs/deployment-bidmgr-shaded-jar-2.9.9.jar!/core-jdb-datasource.properties -------
{datasource-user=spike, datasource-password=tar63t}
2017-03-02 10:36:07.345 (3) [main]: Debug Level set to 5
2017-03-02 10:36:07.419 (3) [main]: LicensingFileRefresher: modification detected on 1450252197000 for licensing.properties
2017-03-02 10:36:07.419 (3) [main]: Licensing environment detected, loading configuration.
2017-03-02 10:36:07.420 (3) [main]: Loaded property: distribution-service-url=http://aml-qa4-front1:8080/distribution
2017-03-02 10:36:07.420 (3) [main]: Loaded property: distribution-service-username=readwrite
2017-03-02 10:36:07.420 (3) [main]: Loaded property: distribution-service-password=readwrite
2017-03-02 10:36:07.420 (3) [main]: Loaded property: sapi-auth-url=http://aml-qa4-front1:8080/sapi/rest/security/tokens
2017-03-02 10:36:07.420 (3) [main]: Loaded property: sapi-merchant-service-url=http://aml-qa4-front1:8080/sapi/rest/merchants
2017-03-02 10:36:07.420 (3) [main]: Loaded property: sapi-reseller-service-url=http://aml-qa4-front1:8080/sapi/rest/resellers
2017-03-02 10:36:07.420 (3) [main]: Loaded property: sapi-username=admin+tsa@thesearchagency.com
2017-03-02 10:36:07.420 (3) [main]: Loaded property: sapi-password=admin
2017-03-02 10:36:07.421 (3) [main]: Loaded property: sapi-realm=thesearchagency
2017-03-02 10:36:07.421 (3) [main]: Loaded property: tsa.google.mcc.developerToken=ojCnjZaM6RD1h0yt_DOJZg
2017-03-02 10:36:07.421 (3) [main]: Loaded property: tsa.google.mcc.isReseller=true
2017-03-02 10:36:07.421 (3) [main]: Loaded property: tsa.google.mcc.userAgent=AdMaxLocal AdWords Software TSA QA
2017-03-02 10:36:07.421 (3) [main]: Loaded property: tsa.timezone=UTC
2017-03-02 10:36:07.426 (3) [main]: =============== Starting BingReport ================
2017-03-02 10:36:07.426 (3) [main]: ----------------BingReport starting
2017-03-02 10:36:07.429 (4) [main]: no account, or instance for databaseInstance, skipping lookup...
2017-03-02 10:36:07.669 (3) [main]: JDBC Driver Version: 5.1 (com.mysql.jdbc.Driver)
2017-03-02 10:36:07.670 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true]
2017-03-02 10:36:07.686 (5) [main]: quoteValue(), nothing special about it=>[0], type=class java.lang.Integer
2017-03-02 10:36:07.688 (5) [main]: ProfilerRec.start("db",true) in Thread [main]
2017-03-02 10:36:07.688 (4) [main]: spike: SQL->[select * from `searchEngineUsers` join `accounts` on ((`tsacommon`.`accounts`.`id`=`tsacommon`.`searchEngineUsers`.`accountID`)) where ((`enabled`="true") and (`tsacommon`.`accounts`.`isActive`="true") and (`tsacommon`.`searchEngineUsers`.`id` in ("1848")) and (`tsacommon`.`searchEngineUsers`.`distributionID`="147") and (`tsacommon`.`searchEngineUsers`.`accountID`!=0)) order by `tsacommon`.`accounts`.`tier` asc,`tsacommon`.`accounts`.`priority` asc,`tsacommon`.`accounts`.`id` desc]
2017-03-02 10:36:07.693 (5) [main]: recordAsSubs("db", 5, "main")
2017-03-02 10:36:07.693 (5) [main]: ProfilerRec.end("db", true): ret=5
2017-03-02 10:36:07.694 (4) [main]: time=0.0050
2017-03-02 10:36:07.695 (4) [main]: Query executed in 0.005s
2017-03-02 10:36:07.698 (5) [main]: loading 35 columns from result set:
2017-03-02 10:36:07.699 (5) [main]: loaded column: searchEngineUsers.id->1848
2017-03-02 10:36:07.700 (5) [main]: loaded column: searchEngineUsers.accountID->1438
2017-03-02 10:36:07.700 (5) [main]: loaded column: searchEngineUsers.distributionID->147
2017-03-02 10:36:07.701 (5) [main]: loaded column: searchEngineUsers.searchEngineIdentifier->54064815
2017-03-02 10:36:07.701 (5) [main]: loaded column: searchEngineUsers.description->b7d676e7-ded9-4e23-9b44-562da48ca842_2_qa4amltest_Performance_Account_2
2017-03-02 10:36:07.701 (5) [main]: loaded column: searchEngineUsers.username->
2017-03-02 10:36:07.702 (5) [main]: loaded column: searchEngineUsers.password->
2017-03-02 10:36:07.702 (5) [main]: loaded column: searchEngineUsers.enabled->true
2017-03-02 10:36:07.702 (5) [main]: loaded column: searchEngineUsers.inTsaMcc->true
2017-03-02 10:36:07.702 (5) [main]: loaded column: searchEngineUsers.apiKey->25162148
2017-03-02 10:36:07.702 (5) [main]: loaded column: searchEngineUsers.managerUsernames->null
2017-03-02 10:36:07.702 (5) [main]: loaded column: searchEngineUsers.managerIDs->5121009
2017-03-02 10:36:07.710 (5) [main]: loaded column: searchEngineUsers.lastChecked->2016-12-16 07:07:44.0
2017-03-02 10:36:07.710 (5) [main]: loaded column: searchEngineUsers.lastInMcc->null
2017-03-02 10:36:07.711 (5) [main]: skipping invalid column: accounts.id
2017-03-02 10:36:07.711 (5) [main]: skipping invalid column: accounts.description
2017-03-02 10:36:07.711 (5) [main]: skipping invalid column: accounts.tier
2017-03-02 10:36:07.711 (5) [main]: skipping invalid column: accounts.priority
2017-03-02 10:36:07.711 (5) [main]: skipping invalid column: accounts.reportClicksOut
2017-03-02 10:36:07.711 (5) [main]: skipping invalid column: accounts.reportConversions
2017-03-02 10:36:07.711 (5) [main]: skipping invalid column: accounts.conversionTypes
2017-03-02 10:36:07.712 (5) [main]: skipping invalid column: accounts.isBidManaged
2017-03-02 10:36:07.712 (5) [main]: skipping invalid column: accounts.isActive
2017-03-02 10:36:07.712 (5) [main]: skipping invalid column: accounts.perfMetric
2017-03-02 10:36:07.712 (5) [main]: skipping invalid column: accounts.providesConversionData
2017-03-02 10:36:07.712 (5) [main]: skipping invalid column: accounts.addConversionData
2017-03-02 10:36:07.712 (5) [main]: skipping invalid column: accounts.fractionalConversionCounts
2017-03-02 10:36:07.712 (5) [main]: skipping invalid column: accounts.hideNullSources
2017-03-02 10:36:07.713 (5) [main]: skipping invalid column: accounts.nowTime
2017-03-02 10:36:07.713 (5) [main]: skipping invalid column: accounts.warehouseDatabase
2017-03-02 10:36:07.713 (5) [main]: skipping invalid column: accounts.databaseInstance
2017-03-02 10:36:07.713 (5) [main]: skipping invalid column: accounts.warehouseInstance
2017-03-02 10:36:07.713 (5) [main]: skipping invalid column: accounts.isOnline
2017-03-02 10:36:07.713 (5) [main]: skipping invalid column: accounts.currencyCode
2017-03-02 10:36:07.713 (5) [main]: skipping invalid column: accounts.timeZoneID
2017-03-02 10:36:07.717 (3) [P1T1]: === Starting BingReportSearchEngineUserWorker for search engine user #1848 b7d676e7-ded9-4e23-9b44-562da48ca842_2_qa4amltest_Performance_Account_2, search engine identifier 54064815 ===
2017-03-02 10:36:07.718 (3) [P1T1]: Using file name /var/local/tsa/sedata/bing/tsa-bing-report-kwperformance-2016-12-25-U1848.xml.zip
2017-03-02 10:36:07.718 (3) [P1T1]: Local copy of /var/local/tsa/sedata/bing/tsa-bing-report-kwperformance-2016-12-25-U1848.xml.zip found. Deleting existing file.
2017-03-02 10:36:07.718 (3) [P1T1]: Using file name /var/local/tsa/sedata/bing/tsa-bing-report-clickperformance-2016-12-25-U1848.xml.zip
2017-03-02 10:36:07.718 (3) [P1T1]: Local copy of /var/local/tsa/sedata/bing/tsa-bing-report-clickperformance-2016-12-25-U1848.xml.zip found. Deleting existing file.
2017-03-02 10:36:08.051 (5) [P1T1]: quoteValue(), nothing special about it=>[1438], type=class java.lang.Integer
2017-03-02 10:36:08.051 (5) [P1T1]: ProfilerRec.start("db",true) in Thread [P1T1]
2017-03-02 10:36:08.052 (4) [P1T1]: spike: SQL->[select * from `tsacommon`.`accounts` where (`id`=1438) limit 1]
2017-03-02 10:36:08.053 (5) [P1T1]: recordAsSubs("db", 1, "P1T1")
2017-03-02 10:36:08.053 (5) [P1T1]: ProfilerRec.end("db", true): ret=1
2017-03-02 10:36:08.053 (4) [P1T1]: time=0.0010
2017-03-02 10:36:08.054 (4) [P1T1]: Query executed in 0.001s
2017-03-02 10:36:08.054 (5) [P1T1]: loading 21 columns from result set:
2017-03-02 10:36:08.054 (5) [P1T1]: loaded column: accounts.id->1438
2017-03-02 10:36:08.054 (5) [P1T1]: loaded column: accounts.description->b7d676e7-ded9-4e23-9b44-562da48ca842
2017-03-02 10:36:08.054 (5) [P1T1]: loaded column: accounts.tier->1
2017-03-02 10:36:08.054 (5) [P1T1]: loaded column: accounts.priority->50
2017-03-02 10:36:08.054 (5) [P1T1]: loaded column: accounts.reportClicksOut->false
2017-03-02 10:36:08.055 (5) [P1T1]: loaded column: accounts.reportConversions->false
2017-03-02 10:36:08.055 (5) [P1T1]: loaded column: accounts.conversionTypes->paid
2017-03-02 10:36:08.055 (5) [P1T1]: loaded column: accounts.isBidManaged->true
2017-03-02 10:36:08.055 (5) [P1T1]: loaded column: accounts.isActive->true
2017-03-02 10:36:08.055 (5) [P1T1]: loaded column: accounts.perfMetric->cpa
2017-03-02 10:36:08.055 (5) [P1T1]: loaded column: accounts.providesConversionData->true
2017-03-02 10:36:08.055 (5) [P1T1]: loaded column: accounts.addConversionData->true
2017-03-02 10:36:08.056 (5) [P1T1]: loaded column: accounts.fractionalConversionCounts->false
2017-03-02 10:36:08.056 (5) [P1T1]: loaded column: accounts.hideNullSources->false
2017-03-02 10:36:08.059 (5) [P1T1]: loaded column: accounts.nowTime->null
2017-03-02 10:36:08.059 (5) [P1T1]: skipping invalid column: accounts.warehouseDatabase
2017-03-02 10:36:08.059 (5) [P1T1]: loaded column: accounts.databaseInstance->1
2017-03-02 10:36:08.059 (5) [P1T1]: loaded column: accounts.warehouseInstance->1
2017-03-02 10:36:08.059 (5) [P1T1]: loaded column: accounts.isOnline->true
2017-03-02 10:36:08.060 (5) [P1T1]: loaded column: accounts.currencyCode->USD
2017-03-02 10:36:08.060 (5) [P1T1]: loaded column: accounts.timeZoneID->America/New_York
2017-03-02 10:36:08.060 (4) [P1T1]: Record Loaded
2017-03-02 10:36:08,939 [P1T1] DEBUG c.t.searchengines.bing.BingApiUtils - Getting Bing properties using distribution service
2017-03-02 10:36:09,059 [P1T1] INFO c.t.s.c.b.impl.BingAdsServiceFactory - USING PRODUCTION ENVIRONMENT
2017-03-02 10:36:09,061 [P1T1] DEBUG c.t.s.client.bing.impl.BingAdsClient - Created BingAdsClient for 54064815
2017-03-02 10:36:09.062 (5) [P1T1]: parseInteger->[1438]
2017-03-02 10:36:09.063 (5) [P1T1]: parseInteger<-[1438]
2017-03-02 10:36:09.063 (4) [P1T1]: preparing SQL statement [select currencyCode from `tsacommon`.`accounts` where id = ?]
2017-03-02 10:36:09,084 [P1T1] DEBUG c.t.s.c.b.i.s.ReportServiceClient - ReportServiceClient - Submitting generate report request for reportType: KEYWORD_PERFORMANCE, Accounts:[54064815]
2017-03-02 10:36:09,167 [P1T1] INFO o.a.c.w.s.f.ReflectionServiceFactoryBean - Creating Service {https://bingads.microsoft.com/Reporting/v9}ReportingService from class com.microsoft.bingads.reporting.IReportingService
2017-03-02 10:36:11,272 [P1T1] INFO o.a.c.w.s.f.ReflectionServiceFactoryBean - Creating Service {https://bingads.microsoft.com/Reporting/v9}ReportingService from class com.microsoft.bingads.reporting.IReportingService
2017-03-02 10:36:12,111 [P1T1] INFO o.a.c.s.R.I.IReportingService - Outbound Message
---------------------------
ID: 1
Address: https://api.bingads.microsoft.com/Api/Advertiser/Reporting/v9/ReportingService.svc
Encoding: UTF-8
Http-Method: POST
Content-Type: text/xml
Headers: {Accept=[*/*], SOAPAction=[SubmitGenerateReport]}
Payload: 5406481525162148Pa55w0rdDN8ELHL3API_TheSearchAgencyXmlEnglishBing Keyword PerformanceDailyCampaignIdAdGroupIdAdIdKeywordIdKeywordBidMatchTypeAverageCpcImpressionsClicksSpendAveragePositionQualityScore54064815
--------------------------------------
2017-03-02 10:36:12,903 [P1T1] INFO o.a.c.s.R.I.IReportingService - Inbound Message
----------------------------
ID: 1
Response-Code: 200
Encoding: UTF-8
Content-Type: text/xml; charset=utf-8
Headers: {Content-Length=[397], content-type=[text/xml; charset=utf-8], Date=[Thu, 02 Mar 2017 10:36:12 GMT], Server=[Microsoft-IIS/8.0], X-Powered-By=[ASP.NET]}
Payload: 83f6834c-1e0e-4740-9b17-00dc3a0d896a30000000568409541
--------------------------------------
2017-03-02 10:36:13,000 [P1T1] INFO c.t.s.c.b.i.s.ReportServiceClient - Successfully submitted generate report request for reportType: KEYWORD_PERFORMANCE, accounts:[54064815]
2017-03-02 10:36:13,002 [P1T1] DEBUG c.t.s.c.b.i.s.ReportServiceClient - ReportServiceClient - Polling requested Report for report ID 30000000568409541
2017-03-02 10:36:13,005 [P1T1] INFO o.a.c.s.R.I.IReportingService - Outbound Message
---------------------------
ID: 2
Address: https://api.bingads.microsoft.com/Api/Advertiser/Reporting/v9/ReportingService.svc
Encoding: UTF-8
Http-Method: POST
Content-Type: text/xml
Headers: {Accept=[*/*], SOAPAction=[PollGenerateReport]}
Payload: 5406481525162148Pa55w0rdDN8ELHL3API_TheSearchAgency30000000568409541
--------------------------------------
2017-03-02 10:36:13,219 [P1T1] INFO o.a.c.s.R.I.IReportingService - Inbound Message
----------------------------
ID: 2
Response-Code: 200
Encoding: UTF-8
Content-Type: text/xml; charset=utf-8
Headers: {Content-Length=[493], content-type=[text/xml; charset=utf-8], Date=[Thu, 02 Mar 2017 10:36:12 GMT], Server=[Microsoft-IIS/8.0], X-Powered-By=[ASP.NET]}
Payload: 0403054a-28fc-4c5d-bd61-0d95fdfdaca7Pending
--------------------------------------
2017-03-02 10:36:13,223 [P1T1] INFO c.t.s.c.b.i.s.ReportServiceClient - Successfully polled report request for report ID: 30000000568409541
2017-03-02 10:36:13,224 [P1T1] DEBUG c.t.s.client.bing.impl.BingAdsClient - Bing Report '/var/local/tsa/sedata/bing/tsa-bing-report-kwperformance-2016-12-25-U1848.xml.zip' is not ready for download. Waiting 20 seconds.
2017-03-02 10:36:33,224 [P1T1] DEBUG c.t.s.c.b.i.s.ReportServiceClient - ReportServiceClient - Polling requested Report for report ID 30000000568409541
2017-03-02 10:36:33,227 [P1T1] INFO o.a.c.s.R.I.IReportingService - Outbound Message
---------------------------
ID: 3
Address: https://api.bingads.microsoft.com/Api/Advertiser/Reporting/v9/ReportingService.svc
Encoding: UTF-8
Http-Method: POST
Content-Type: text/xml
Headers: {Accept=[*/*], SOAPAction=[PollGenerateReport]}
Payload: 5406481525162148Pa55w0rdDN8ELHL3API_TheSearchAgency30000000568409541
--------------------------------------
2017-03-02 10:36:33,865 [P1T1] INFO o.a.c.s.R.I.IReportingService - Inbound Message
----------------------------
ID: 3
Response-Code: 200
Encoding: UTF-8
Content-Type: text/xml; charset=utf-8
Headers: {Content-Length=[1621], content-type=[text/xml; charset=utf-8], Date=[Thu, 02 Mar 2017 10:36:33 GMT], Server=[Microsoft-IIS/8.0], X-Powered-By=[ASP.NET]}
Payload: 04bade9a-f140-4e29-80a8-71078af47be7https://dvsrdl.api.bingads.microsoft.com/ReportDownload/Download.aspx?q=uyQQEx07K%2fP4Cl55JJMODydJfX7hEzUYu2eKR3gdYdevyxYhz7usLI0jQfOv%2bg4nflbZQr2sMczvdbVQ4Jivx6aa5TXOPaMroHSXjdljZ1oP4CnuboD1dge6ir44LnhsxwYwCODWJi5MUaO%2ffFmMUSNub1%2b0dvE4BoERFErPpq4oTYn3ajs%2bljG7ZDQ9v8k%2b27D3IQdCmorfh3GXPxzQPpmv9N1Hly1YuLNPZ5dOLb%2fkwq8N8P32zlkTl%2fUaBeuzJ0FY3VTdF1bj9Js5NE6wL%2b9GK7cHZ1x%2fWHc86pxO7F9am0SfpMdYWeK%2fr34Jbno2o0LRMsnT5V37oV7P5oMXnjgmGewVvdOOLAJ3ixlY1%2faV6l93rUie%2ba5MiEaUmTPNGNgk646XTQkbZtZ1MFIb9Cqkklt2ewiwLp4otcbUhhQVH5n4bkNGtJmIeQGEr836X9b3n7zTXCPrdqsvpp9q%2bJ%2b34rKmk%2bsC%2f958aHWs4hgfqzCHowKApH%2bpDmuI8QySZ16iWjtAhQ%2bAkm0RoV7753167FBNRxyGI4M0Idb5bBWZmYi2GIpO7ar9%2foemFaXDVyS%2fkZVRfzB8EXb5FvTjkBfDzpgkXVnQ9u0tW6RTPJHFEid%2fpw509JVz8%2f0CkwoitdybvEgriLjRo%2fZ%2bk6KyemJXcNgqU%2bFCk2gslruEJjd3iMVtY2dRHCpgpouE6Od2iYSMmkrYfnZLZ5eXVQM9RdGrEdX20N2D5B5UnawTu68%2bTPhqDRVIvrR3s5n7zX%2fmgyQD4QobO7eXPUNJ7MdQSRsJgEAGihTbTO6NY2bpkJFbQJWZczKib%2bVW1P3nuEg7js55Ik0kgqyS7VcveVaCjXEnRUlskobC0r98YXl6T%2bdPAVCsUcW48jIZpeBanX1fMVY2ppQGdm0Lc9FJ6ZbgOio%2bmf9QxSvBjgN%2fWRxMbLOtN07mYqs2cFBBYvfvzoKkk3dqh3RAuI4OIfv0IoWPgh0%3dSuccess
--------------------------------------
2017-03-02 10:36:33,868 [P1T1] INFO c.t.s.c.b.i.s.ReportServiceClient - Successfully polled report request for report ID: 30000000568409541
2017-03-02 10:36:33,868 [P1T1] DEBUG c.t.s.client.bing.impl.BingAdsClient - Downloading report '/var/local/tsa/sedata/bing/tsa-bing-report-kwperformance-2016-12-25-U1848.xml.zip' with download URL https://dvsrdl.api.bingads.microsoft.com/ReportDownload/Download.aspx?q=uyQQEx07K%2fP4Cl55JJMODydJfX7hEzUYu2eKR3gdYdevyxYhz7usLI0jQfOv%2bg4nflbZQr2sMczvdbVQ4Jivx6aa5TXOPaMroHSXjdljZ1oP4CnuboD1dge6ir44LnhsxwYwCODWJi5MUaO%2ffFmMUSNub1%2b0dvE4BoERFErPpq4oTYn3ajs%2bljG7ZDQ9v8k%2b27D3IQdCmorfh3GXPxzQPpmv9N1Hly1YuLNPZ5dOLb%2fkwq8N8P32zlkTl%2fUaBeuzJ0FY3VTdF1bj9Js5NE6wL%2b9GK7cHZ1x%2fWHc86pxO7F9am0SfpMdYWeK%2fr34Jbno2o0LRMsnT5V37oV7P5oMXnjgmGewVvdOOLAJ3ixlY1%2faV6l93rUie%2ba5MiEaUmTPNGNgk646XTQkbZtZ1MFIb9Cqkklt2ewiwLp4otcbUhhQVH5n4bkNGtJmIeQGEr836X9b3n7zTXCPrdqsvpp9q%2bJ%2b34rKmk%2bsC%2f958aHWs4hgfqzCHowKApH%2bpDmuI8QySZ16iWjtAhQ%2bAkm0RoV7753167FBNRxyGI4M0Idb5bBWZmYi2GIpO7ar9%2foemFaXDVyS%2fkZVRfzB8EXb5FvTjkBfDzpgkXVnQ9u0tW6RTPJHFEid%2fpw509JVz8%2f0CkwoitdybvEgriLjRo%2fZ%2bk6KyemJXcNgqU%2bFCk2gslruEJjd3iMVtY2dRHCpgpouE6Od2iYSMmkrYfnZLZ5eXVQM9RdGrEdX20N2D5B5UnawTu68%2bTPhqDRVIvrR3s5n7zX%2fmgyQD4QobO7eXPUNJ7MdQSRsJgEAGihTbTO6NY2bpkJFbQJWZczKib%2bVW1P3nuEg7js55Ik0kgqyS7VcveVaCjXEnRUlskobC0r98YXl6T%2bdPAVCsUcW48jIZpeBanX1fMVY2ppQGdm0Lc9FJ6ZbgOio%2bmf9QxSvBjgN%2fWRxMbLOtN07mYqs2cFBBYvfvzoKkk3dqh3RAuI4OIfv0IoWPgh0%3d
2017-03-02 10:36:34,793 [P1T1] DEBUG c.t.s.client.bing.impl.BingAdsClient - Report downloaded
2017-03-02 10:36:34,794 [P1T1] DEBUG c.t.s.c.b.i.s.ReportServiceClient - ReportServiceClient - Submitting generate report request for reportType: CLICK_PERFORMANCE_KEYWORD, Accounts:[54064815]
2017-03-02 10:36:34,799 [P1T1] INFO o.a.c.s.R.I.IReportingService - Outbound Message
---------------------------
ID: 4
Address: https://api.bingads.microsoft.com/Api/Advertiser/Reporting/v9/ReportingService.svc
Encoding: UTF-8
Http-Method: POST
Content-Type: text/xml
Headers: {Accept=[*/*], SOAPAction=[SubmitGenerateReport]}
Payload: 5406481525162148Pa55w0rdDN8ELHL3API_TheSearchAgencyXmlEnglishBing AdExtension Performance Keyword ReportDailyCampaignIdAdGroupIdKeywordIdKeywordNetworkAdExtensionTypeClickTypeDeviceTypeClicks54064815
--------------------------------------
2017-03-02 10:36:35,391 [P1T1] INFO o.a.c.s.R.I.IReportingService - Inbound Message
----------------------------
ID: 4
Response-Code: 200
Encoding: UTF-8
Content-Type: text/xml; charset=utf-8
Headers: {Content-Length=[397], content-type=[text/xml; charset=utf-8], Date=[Thu, 02 Mar 2017 10:36:35 GMT], Server=[Microsoft-IIS/8.0], X-Powered-By=[ASP.NET]}
Payload: e4cf6231-cf42-4e9b-87c0-fb83ade0023f30000000568410238
--------------------------------------
2017-03-02 10:36:35,393 [P1T1] INFO c.t.s.c.b.i.s.ReportServiceClient - Successfully submitted generate report request for reportType: CLICK_PERFORMANCE_KEYWORD, accounts:[54064815]
2017-03-02 10:36:35,394 [P1T1] DEBUG c.t.s.c.b.i.s.ReportServiceClient - ReportServiceClient - Polling requested Report for report ID 30000000568410238
2017-03-02 10:36:35,395 [P1T1] INFO o.a.c.s.R.I.IReportingService - Outbound Message
---------------------------
ID: 5
Address: https://api.bingads.microsoft.com/Api/Advertiser/Reporting/v9/ReportingService.svc
Encoding: UTF-8
Http-Method: POST
Content-Type: text/xml
Headers: {Accept=[*/*], SOAPAction=[PollGenerateReport]}
Payload: 5406481525162148Pa55w0rdDN8ELHL3API_TheSearchAgency30000000568410238
--------------------------------------
2017-03-02 10:36:35,615 [P1T1] INFO o.a.c.s.R.I.IReportingService - Inbound Message
----------------------------
ID: 5
Response-Code: 200
Encoding: UTF-8
Content-Type: text/xml; charset=utf-8
Headers: {Content-Length=[493], content-type=[text/xml; charset=utf-8], Date=[Thu, 02 Mar 2017 10:36:35 GMT], Server=[Microsoft-IIS/8.0], X-Powered-By=[ASP.NET]}
Payload: f9b3de96-9458-4a89-ab8f-7d3a7d51d70dPending
--------------------------------------
2017-03-02 10:36:35,617 [P1T1] INFO c.t.s.c.b.i.s.ReportServiceClient - Successfully polled report request for report ID: 30000000568410238
2017-03-02 10:36:35,617 [P1T1] DEBUG c.t.s.client.bing.impl.BingAdsClient - Bing Report '/var/local/tsa/sedata/bing/tsa-bing-report-clickperformance-2016-12-25-U1848.xml.zip' is not ready for download. Waiting 20 seconds.
2017-03-02 10:36:55,618 [P1T1] DEBUG c.t.s.c.b.i.s.ReportServiceClient - ReportServiceClient - Polling requested Report for report ID 30000000568410238
2017-03-02 10:36:55,620 [P1T1] INFO o.a.c.s.R.I.IReportingService - Outbound Message
---------------------------
ID: 6
Address: https://api.bingads.microsoft.com/Api/Advertiser/Reporting/v9/ReportingService.svc
Encoding: UTF-8
Http-Method: POST
Content-Type: text/xml
Headers: {Accept=[*/*], SOAPAction=[PollGenerateReport]}
Payload: 5406481525162148Pa55w0rdDN8ELHL3API_TheSearchAgency30000000568410238
--------------------------------------
2017-03-02 10:36:56,381 [P1T1] INFO o.a.c.s.R.I.IReportingService - Inbound Message
----------------------------
ID: 6
Response-Code: 200
Encoding: UTF-8
Content-Type: text/xml; charset=utf-8
Headers: {Content-Length=[1637], content-type=[text/xml; charset=utf-8], Date=[Thu, 02 Mar 2017 10:36:56 GMT], Server=[Microsoft-IIS/8.0], X-Powered-By=[ASP.NET]}
Payload: ffdf4be3-9f3a-40bd-80a3-45f49e9d5efchttps://dvsrdl.api.bingads.microsoft.com/ReportDownload/Download.aspx?q=DorqVrbv%2bhTNob7zXYP1hAXKS6WaFEIRqENGYlnYtuZrWk3Px%2bdWHopE5ZJJvaooUi4i2PI0VI0fROLLpcroy55w4PMpyyppMMCH1SDGbVSW9V4jkdmTAp33%2f5b6CEu9jq9y1TcpU1TVxUrkpbk%2fnCk%2fMuWGsJZIyCO%2fvJailDJHBzYuc5k%2fhp4xLKBJbOmn%2bxFOifsDytoAPJFklmrvx6lH%2fVQ5jSyw9cBlR8aLmHtCvOSPzu2rIEvOGZcjLopWLcjENVCxYVlK7LyBASWZ0DdURoJzzOSy5wPlM1Zf4Tv7KrwzDxzS%2f6%2bVDk21nck4TC9hmDHO%2bGVPBM5LlIGxSf9vSeFr0gJnP8W%2b3u3WR7FM09z2HEXmnFAY7IvEJhpOWnf0w1hwgGaIKqLTGDBr9DxbjnZK5V7jBGD6z6m9F1r27EiU1RVoZBU0Ms4oyoyR%2fetBjltZ80qcTEYR5XpYDnJSHSSBPOgtIAsnN79tV7GMLDueFf5%2frbj64oRC7nVPjQD58nEbYkJVRQqtVnArdieaTCJT%2bE1ZejaT9syZ0AFvl3TzI572X2W4UQnglW3asVEH9%2bTP4f%2bcFS3OEKDn29BQW8tdURG5%2fgbHQYJfsoad%2ffIw7TtyogXHSR0VP5P6P7a%2buCK74WHHbB%2b2Nw2iFfcdPFdkhBVpKVKoni74G9BGwZ4Uc%2b7hR1mOAQBZzVIdfrkqfoVUPL6T9BWOZ6RUCTq0o93St2uFuvkBWUhgLQyPsb3liQKeCYWpQFAXslMaKs0nviI58FDsHHLKt76Y9m55OF5hhBoxRy9FoPA49j%2bIDKlFeDHa6RlBUrKIsEMT3FFDi%2bSTXNILhMS%2fVN%2f1rJ6nE%2b5qq%2b0xATNTWHv3Et26xEjtU0LmitNmNQf8kszzAFEmBHQQ91SkMoQJG%2fALvy9Es93QIf8zyhKKNxz6eKpZ2ZJOUaXzAo%2b9NzEogteN9brQ0m2hEnqdeXMmlcGfisbgEQ2YtNG7EvstiDhNuKDVSuccess
--------------------------------------
2017-03-02 10:36:56,383 [P1T1] INFO c.t.s.c.b.i.s.ReportServiceClient - Successfully polled report request for report ID: 30000000568410238
2017-03-02 10:36:56,383 [P1T1] DEBUG c.t.s.client.bing.impl.BingAdsClient - Downloading report '/var/local/tsa/sedata/bing/tsa-bing-report-clickperformance-2016-12-25-U1848.xml.zip' with download URL https://dvsrdl.api.bingads.microsoft.com/ReportDownload/Download.aspx?q=DorqVrbv%2bhTNob7zXYP1hAXKS6WaFEIRqENGYlnYtuZrWk3Px%2bdWHopE5ZJJvaooUi4i2PI0VI0fROLLpcroy55w4PMpyyppMMCH1SDGbVSW9V4jkdmTAp33%2f5b6CEu9jq9y1TcpU1TVxUrkpbk%2fnCk%2fMuWGsJZIyCO%2fvJailDJHBzYuc5k%2fhp4xLKBJbOmn%2bxFOifsDytoAPJFklmrvx6lH%2fVQ5jSyw9cBlR8aLmHtCvOSPzu2rIEvOGZcjLopWLcjENVCxYVlK7LyBASWZ0DdURoJzzOSy5wPlM1Zf4Tv7KrwzDxzS%2f6%2bVDk21nck4TC9hmDHO%2bGVPBM5LlIGxSf9vSeFr0gJnP8W%2b3u3WR7FM09z2HEXmnFAY7IvEJhpOWnf0w1hwgGaIKqLTGDBr9DxbjnZK5V7jBGD6z6m9F1r27EiU1RVoZBU0Ms4oyoyR%2fetBjltZ80qcTEYR5XpYDnJSHSSBPOgtIAsnN79tV7GMLDueFf5%2frbj64oRC7nVPjQD58nEbYkJVRQqtVnArdieaTCJT%2bE1ZejaT9syZ0AFvl3TzI572X2W4UQnglW3asVEH9%2bTP4f%2bcFS3OEKDn29BQW8tdURG5%2fgbHQYJfsoad%2ffIw7TtyogXHSR0VP5P6P7a%2buCK74WHHbB%2b2Nw2iFfcdPFdkhBVpKVKoni74G9BGwZ4Uc%2b7hR1mOAQBZzVIdfrkqfoVUPL6T9BWOZ6RUCTq0o93St2uFuvkBWUhgLQyPsb3liQKeCYWpQFAXslMaKs0nviI58FDsHHLKt76Y9m55OF5hhBoxRy9FoPA49j%2bIDKlFeDHa6RlBUrKIsEMT3FFDi%2bSTXNILhMS%2fVN%2f1rJ6nE%2b5qq%2b0xATNTWHv3Et26xEjtU0LmitNmNQf8kszzAFEmBHQQ91SkMoQJG%2fALvy9Es93QIf8zyhKKNxz6eKpZ2ZJOUaXzAo%2b9NzEogteN9brQ0m2hEnqdeXMmlcGfisbgEQ2YtNG7EvstiDhNuKDV
2017-03-02 10:36:57,027 [P1T1] DEBUG c.t.s.client.bing.impl.BingAdsClient - Report downloaded
2017-03-02 10:36:57.028 (3) [P1T1]: Parsing /var/local/tsa/sedata/bing/tsa-bing-report-kwperformance-2016-12-25-U1848.xml.zip into staging database
2017-03-02 10:36:57.031 (4) [P1T1]: Found column 'CampaignId'
2017-03-02 10:36:57.031 (4) [P1T1]: Found column 'AdGroupId'
2017-03-02 10:36:57.031 (4) [P1T1]: Found column 'AdId'
2017-03-02 10:36:57.031 (4) [P1T1]: Found column 'KeywordId'
2017-03-02 10:36:57.031 (4) [P1T1]: Found column 'Keyword'
2017-03-02 10:36:57.031 (4) [P1T1]: Found column 'BiddedMatchType'
2017-03-02 10:36:57.032 (4) [P1T1]: Found column 'AverageCpc'
2017-03-02 10:36:57.032 (4) [P1T1]: Found column 'Impressions'
2017-03-02 10:36:57.032 (4) [P1T1]: Found column 'Clicks'
2017-03-02 10:36:57.032 (4) [P1T1]: Found column 'Spend'
2017-03-02 10:36:57.032 (4) [P1T1]: Found column 'AveragePosition'
2017-03-02 10:36:57.032 (4) [P1T1]: Found column 'QualityScore'
2017-03-02 10:36:57.046 (4) [P1T1]: no account, or instance for databaseInstance, skipping lookup...
2017-03-02 10:36:57.066 (3) [P1T1]: JDBC Driver Version: 5.1 (com.mysql.jdbc.Driver)
2017-03-02 10:36:57.066 (4) [P1T1]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true]
2017-03-02 10:36:57.068 (5) [P1T1]: ProfilerRec.start("db",true) in Thread [P1T1]
2017-03-02 10:36:57.068 (4) [P1T1]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`name`="global-staging") and (`type`="mysql")) limit 1]
2017-03-02 10:36:57.069 (5) [P1T1]: recordAsSubs("db", 1, "P1T1")
2017-03-02 10:36:57.069 (5) [P1T1]: ProfilerRec.end("db", true): ret=1
2017-03-02 10:36:57.069 (4) [P1T1]: time=0.0010
2017-03-02 10:36:57.070 (4) [P1T1]: Query executed in 0.001s
2017-03-02 10:36:57.070 (5) [P1T1]: loading 8 columns from result set:
2017-03-02 10:36:57.070 (5) [P1T1]: loaded column: databaseInstances.id->3
2017-03-02 10:36:57.070 (5) [P1T1]: loaded column: databaseInstances.name->global-staging
2017-03-02 10:36:57.070 (5) [P1T1]: loaded column: databaseInstances.description->Global Staging Tables
2017-03-02 10:36:57.070 (5) [P1T1]: loaded column: databaseInstances.type->mysql
2017-03-02 10:36:57.070 (5) [P1T1]: loaded column: databaseInstances.database->staging
2017-03-02 10:36:57.070 (5) [P1T1]: loaded column: databaseInstances.host->staging-01-write
2017-03-02 10:36:57.070 (5) [P1T1]: loaded column: databaseInstances.port->3306
2017-03-02 10:36:57.071 (5) [P1T1]: loaded column: databaseInstances.access->rw
2017-03-02 10:36:57.071 (4) [P1T1]: Record Loaded
2017-03-02 10:36:57.071 (4) [P1T1]: DataCache: put key global-staging
2017-03-02 10:36:57.072 (4) [P1T1]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true]
2017-03-02 10:36:57.075 (4) [P1T1]: registered MBean [com.carldunham.jst.pooling:type=ObjectPool428cd40a-3e4c-4c11-ba7e-7acbd457f89c] for class com.carldunham.jst.pooling.ObjectPool
2017-03-02 10:36:57.075 (3) [P1T1]: DatabasePool with a limit of 3 created
2017-03-02 10:36:57.075 (4) [P1T1]: registered MBean [com.carldunham.jst.db:type=DatabasePoold672418b-0e33-4cff-a439-a4f2a9a4f4c6] for class com.carldunham.jst.db.DatabasePool
2017-03-02 10:36:57.077 (4) [ConnectionCloser]: Starting DatabasePool ConnectionCloserThread
2017-03-02 10:36:57.096 (3) [P1T1]: JDBC Driver Version: 5.1 (com.mysql.jdbc.Driver)
2017-03-02 10:36:57.096 (4) [P1T1]: opened [jdbc:mysql://staging-01-write:3306/staging?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true]
2017-03-02 10:36:57.096 (4) [P1T1]: Created new Object
2017-03-02 10:36:57.096 (5) [P1T1]: ProfilerRec.start("db",true) in Thread [P1T1]
2017-03-02 10:36:57.096 (4) [P1T1]: spike: SQL->[select @@version]
2017-03-02 10:36:57.098 (5) [P1T1]: recordAsSubs("db", 2, "P1T1")
2017-03-02 10:36:57.098 (5) [P1T1]: ProfilerRec.end("db", true): ret=2
2017-03-02 10:36:57.098 (4) [P1T1]: time=0.0020
2017-03-02 10:36:57.098 (4) [P1T1]: Query executed in 0.002s
2017-03-02 10:36:57.098 (4) [P1T1]: test query succeeded, returned "5.5.34"
2017-03-02 10:36:57.104 (5) [P1T1]: ProfilerRec.start("db",true) in Thread [P1T1]
2017-03-02 10:36:57.104 (4) [P1T1]: spike: SQL->[select * from `tsacommon`.`searchEngineAccounts` where ((`searchEngineUserID`="1848"))]
2017-03-02 10:36:57.106 (5) [P1T1]: recordAsSubs("db", 2, "P1T1")
2017-03-02 10:36:57.106 (5) [P1T1]: ProfilerRec.end("db", true): ret=2
2017-03-02 10:36:57.106 (4) [P1T1]: time=0.0020
2017-03-02 10:36:57.106 (4) [P1T1]: Query executed in 0.002s
2017-03-02 10:36:57.109 (3) [P1T1]: Deleting existing records where ((`startTime`="2016-12-25") and (`campaignid` in ("223252672","223252673")))
2017-03-02 10:36:57.109 (5) [P1T1]: ProfilerRec.start("db",true) in Thread [P1T1]
2017-03-02 10:36:57.109 (4) [P1T1]: spike: SQL->[delete from `staging`.`bingPerformanceReports` where ((`startTime`="2016-12-25") and (`campaignid` in ("223252672","223252673")))], genflags=no
2017-03-02 10:36:57.111 (5) [P1T1]: recordAsSubs("db", 2, "P1T1")
2017-03-02 10:36:57.111 (5) [P1T1]: ProfilerRec.end("db", true): ret=2
2017-03-02 10:36:57.111 (4) [P1T1]: time=0.0020
2017-03-02 10:36:57.112 (4) [P1T1]: Query executed in 0.002s, 0 row(s) affected
2017-03-02 10:36:57.112 (3) [P1T1]: Inserting new data into `staging`.`bingPerformanceReports`
2017-03-02 10:36:57.131 (4) [P1T1]: preparing SQL statement [INSERT INTO `staging`.`bingPerformanceReports`(startTime,campaignid,adgroupid,creativeid,keywordid,keyword,kwType,avgCpc,imps,clicks,cost,pos,qualityScore) VALUES (?,?,?,?,?,?,?,?,?,?,?,?,?) ON DUPLICATE KEY UPDATE startTime=(?), campaignid=(?), adgroupid=(?), creativeid=(?), keywordid=(?), keyword=(?), kwType=(?), avgCpc=(?), imps=(?), clicks=(?), cost=(?), pos=(?), qualityScore=(?)]
2017-03-02 10:36:57.152 (4) [P1T1]: DB AutoCommit -> false
2017-03-02 10:36:57.153 (5) [P1T1]: ProfilerRec.start("db",true) in Thread [P1T1]
2017-03-02 10:36:57.153 (4) [P1T1]: spike: SQL->[start transaction]
2017-03-02 10:36:57.154 (5) [P1T1]: recordAsSubs("db", 1, "P1T1")
2017-03-02 10:36:57.154 (5) [P1T1]: ProfilerRec.end("db", true): ret=1
2017-03-02 10:36:57.154 (4) [P1T1]: time=0.0010
2017-03-02 10:36:57.154 (4) [P1T1]: Query executed in 0.001s
2017-03-02 10:36:57.154 (5) [P1T1]: SQL execute() returned false
2017-03-02 10:36:57.167 (4) [P1T1]: DB AutoCommit -> true
2017-03-02 10:36:57.168 (4) [P1T1]: DB AutoCommit -> true
2017-03-02 10:36:57.169 (4) [P1T1]: Removing temp file...
2017-03-02 10:36:57.169 (3) [P1T1]: Parsing /var/local/tsa/sedata/bing/tsa-bing-report-clickperformance-2016-12-25-U1848.xml.zip into staging database
2017-03-02 10:36:57.171 (4) [P1T1]: Found column 'CampaignId'
2017-03-02 10:36:57.171 (4) [P1T1]: Found column 'AdGroupId'
2017-03-02 10:36:57.171 (4) [P1T1]: Found column 'KeywordId'
2017-03-02 10:36:57.171 (4) [P1T1]: Found column 'Keyword'
2017-03-02 10:36:57.171 (4) [P1T1]: Found column 'Network'
2017-03-02 10:36:57.171 (4) [P1T1]: Found column 'AdExtensionType'
2017-03-02 10:36:57.172 (4) [P1T1]: Found column 'ClickType'
2017-03-02 10:36:57.172 (4) [P1T1]: Found column 'Devicetype'
2017-03-02 10:36:57.172 (4) [P1T1]: Found column 'Clicks'
2017-03-02 10:36:57.173 (5) [P1T1]: ProfilerRec.start("db",true) in Thread [P1T1]
2017-03-02 10:36:57.173 (4) [P1T1]: spike: SQL->[select * from `tsacommon`.`searchEngineAccounts` where ((`searchEngineUserID`="1848"))]
2017-03-02 10:36:57.174 (5) [P1T1]: recordAsSubs("db", 1, "P1T1")
2017-03-02 10:36:57.174 (5) [P1T1]: ProfilerRec.end("db", true): ret=1
2017-03-02 10:36:57.174 (4) [P1T1]: time=0.0010
2017-03-02 10:36:57.175 (4) [P1T1]: Query executed in 0.001s
2017-03-02 10:36:57.176 (3) [P1T1]: Deleting existing records where ((`startTime`="2016-12-25") and (`campaignid` in ("223252672","223252673")))
2017-03-02 10:36:57.176 (5) [P1T1]: ProfilerRec.start("db",true) in Thread [P1T1]
2017-03-02 10:36:57.176 (4) [P1T1]: spike: SQL->[delete from `staging`.`bingClicks` where ((`startTime`="2016-12-25") and (`campaignid` in ("223252672","223252673")))], genflags=no
2017-03-02 10:36:57.179 (5) [P1T1]: recordAsSubs("db", 3, "P1T1")
2017-03-02 10:36:57.179 (5) [P1T1]: ProfilerRec.end("db", true): ret=3
2017-03-02 10:36:57.179 (4) [P1T1]: time=0.0030
2017-03-02 10:36:57.179 (4) [P1T1]: Query executed in 0.003s, 0 row(s) affected
2017-03-02 10:36:57.179 (2) [P1T1]: report does not contain any performance data. Nothing to parse.
2017-03-02 10:36:57.179 (4) [P1T1]: Removing temp file...
2017-03-02 10:36:57.179 (3) [P1T1]: === Completed search engine user #1848 b7d676e7-ded9-4e23-9b44-562da48ca842_2_qa4amltest_Performance_Account_2, search engine identifier 54064815 ===
2017-03-02 10:36:57.179 (4) [P1T1]: Returning Object to Pool
2017-03-02 10:36:57.180 (4) [main]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true]
2017-03-02 10:36:57.180 (3) [main]: ------------BingReport done
2017-03-02 10:36:57.180 (3) [main]: =============== Completed BingReport ================