Uploaded image for project: 'AdMaxLocal'
  1. AdMaxLocal
  2. AML-3738

Googlemcc fails to download Performance data to DB

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: Mercury
    • Fix Version/s: Mercury
    • Component/s: Budget Management
    • Labels:
      None
    • Environment:

      bidmgr #929
      Core #385
      Sapi #1098

    • Sprint:
      Sprint 10

      Description

      Googlemcc fails to download Performance data to DB.
      Log shows "AuthorizationError.USER_PERMISSION_DENIED"

      [TSAApp@aml-qa4-core1 bidmgr]$ ./googlemcc.sh -d3 -U 453 -T 2015-09-03
      2015-10-01 14:42:35.978 (3) [main]: Debug Level set to 3
      2015-10-01 14:42:36.006 (3) [main]: Licensing environment detected, loading configuration.
      2015-10-01 14:42:36.030 (3) [main]: Loaded property: distribution-service-url=http://aml-qa4-front1:8080/distribution
      2015-10-01 14:42:36.030 (3) [main]: Loaded property: distribution-service-username=readwrite
      2015-10-01 14:42:36.030 (3) [main]: Loaded property: distribution-service-password=readwrite
      2015-10-01 14:42:36.030 (3) [main]: Loaded property: tsa.google.mcc.developerToken=ojCnjZaM6RD1h0yt_DOJZg
      2015-10-01 14:42:36.030 (3) [main]: Loaded property: tsa.google.mcc.isReseller=true
      2015-10-01 14:42:36.031 (3) [main]: Loaded property: tsa.google.mcc.userAgent=AdMaxLocal AdWords Software TSA QA
      2015-10-01 14:42:36.031 (3) [main]: Loaded property: tsa.timezone=UTC
      2015-10-01 14:42:36.100 (3) [main]: Debug Level set to 3
      2015-10-01 14:42:36.411 (3) [main]: =============== Starting Google MCC Report ================
      2015-10-01 14:42:36.411 (3) [main]: ----------------Google MCC Report starting
      2015-10-01 14:42:36.824 (3) [main]: JDBC Driver Version: 5.1 (com.mysql.jdbc.Driver)
      2015-10-01 14:42:36.901 (3) [P1T1]: === Starting user #453, 730090ff-5a33-49f6-8143-9f3d8a83ae49_1 ===
      2015-10-01 14:42:36.901 (3) [P1T1]: Using filename: /var/local/tsa/sedata/google/tsa-mcc-report-2015-09-03-U453_4629576581.xml.gz
      2015-10-01 14:42:37.166 (3) [P1T1]: DistributionServiceRemoteClient created for 730090ff-5a33-49f6-8143-9f3d8a83ae49_1
      2015-10-01 14:42:40.824 (3) [P1T1]: Creating API for reseller DistributionSettings b8a7d340-30e0-4369-97d0-8f901d238f86
      2015-10-01 14:42:40.972 (3) [P1T1]: JDBC Driver Version: 5.1 (com.mysql.jdbc.Driver)
      2015-10-01 14:42:41.001 (3) [P1T1]: JDBC Driver Version: 5.1 (com.mysql.jdbc.Driver)
      2015-10-01 14:42:41.057 (3) [P1T1]: JDBC Driver Version: 5.1 (com.mysql.jdbc.Driver)
      2015-10-01 14:42:41.057 (3) [P1T1]: Created shared sesystem connection rw
      2015-10-01 14:42:41.133 (3) [P1T1]: [oauth] Creating new OAuthService component
      2015-10-01 14:42:41,202 [P1T1] INFO c.t.s.o.core.OAuthServiceComponent - [oauth] Creating new OAuthServiceComponent
      2015-10-01 14:42:41.425 (3) [P1T1]: Retrieving credentials for search engine user id : 453 || client id : 143943699348-p752ag8fq5kf31mctbgev2dauvcaoupf.apps.googleusercontent.com , client secret :PJIJBVuFuicGaQQ6pCg9qaFU , refresh token : 1/4Ic0TM_o3L1GnHo87uIsD1Ui4gOk6cvIY9gBlf1FmOZIgOrJDtdun6zK6XiATCKT
      2015-10-01 14:42:41,437 [P1T1] INFO c.t.s.o.core.OAuthServiceComponent - [oauth] Getting new access token
      2015-10-01 14:42:43,188 [P1T1] INFO c.t.s.o.core.OAuthServiceComponent - [oauth] Return OAuth credential. Access token = ya29._wE2JH80J0aXg4kTL9rtfQEgPXKeZznCrRUOgWpPBruBBnqDRMoQSIp3E5ESSML1IP1acg
      2015-10-01 14:42:43.189 (3) [P1T1]: [oauth] Returning access token from OAuth service: ya29._wE2JH80J0aXg4kTL9rtfQEgPXKeZznCrRUOgWpPBruBBnqDRMoQSIp3E5ESSML1IP1acg
      2015-10-01 14:42:43.190 (3) [P1T1]: Retrieving credentials for search engine user id : 453 || client id : 143943699348-p752ag8fq5kf31mctbgev2dauvcaoupf.apps.googleusercontent.com , client secret :PJIJBVuFuicGaQQ6pCg9qaFU , refresh token : 1/4Ic0TM_o3L1GnHo87uIsD1Ui4gOk6cvIY9gBlf1FmOZIgOrJDtdun6zK6XiATCKT
      2015-10-01 14:42:43,190 [P1T1] INFO c.t.s.o.core.OAuthServiceComponent - [oauth] Return OAuth credential. Access token = ya29._wE2JH80J0aXg4kTL9rtfQEgPXKeZznCrRUOgWpPBruBBnqDRMoQSIp3E5ESSML1IP1acg
      2015-10-01 14:42:43.190 (3) [P1T1]: [oauth] Returning access token from OAuth service: ya29._wE2JH80J0aXg4kTL9rtfQEgPXKeZznCrRUOgWpPBruBBnqDRMoQSIp3E5ESSML1IP1acg
      2015-10-01 14:42:43.213 (3) [P1T1]: Downloading MCC report...
      2015-10-01 14:42:43,582 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Request made: POST https://adwords.google.com//api/adwords/reportdownload/v201506

      2015-10-01 14:42:43,586 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - accept-encoding: [gzip]
      authorization: REDACTED
      user-agent: [AdMaxLocal AdWords Software TSA QA (AwApi-Java, Common-Java/2.4.0, Java/1.6.0_27, maven)]
      developertoken: REDACTED
      clientcustomerid: 4629576581

      Parameters:
      __fmt: GZIPPED_XML
      __rdquery: SELECT CampaignId,AdGroupId,KeywordId,Id,AdNetworkType1,Impressions,Clicks,Cost,AveragePosition,ConversionsManyPerClick FROM AD_PERFORMANCE_REPORT WHERE Impressions > 0 DURING 20150903,20150903

      2015-10-01 14:42:43,587 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Response received with status code 400 and message: Bad Request

      2015-10-01 14:42:43.948 (1) [P1T1]: Exception: HTTP Response Code: 400, Trigger: <null>, Type: AuthorizationError.USER_PERMISSION_DENIED
      2015-10-01 14:42:44,024 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Request made: POST https://adwords.google.com//api/adwords/reportdownload/v201506

      2015-10-01 14:42:44,025 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - accept-encoding: [gzip]
      authorization: REDACTED
      user-agent: [AdMaxLocal AdWords Software TSA QA (AwApi-Java, Common-Java/2.4.0, Java/1.6.0_27, maven)]
      developertoken: REDACTED
      clientcustomerid: 4629576581

      Parameters:
      __fmt: GZIPPED_XML
      __rdquery: SELECT CampaignId,AdGroupId,KeywordId,Id,AdNetworkType1,Impressions,Clicks,Cost,AveragePosition,ConversionsManyPerClick FROM AD_PERFORMANCE_REPORT WHERE Impressions > 0 DURING 20150903,20150903

      2015-10-01 14:42:44,025 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Response received with status code 400 and message: Bad Request

      2015-10-01 14:42:44.035 (1) [P1T1]: Exception: HTTP Response Code: 400, Trigger: <null>, Type: AuthorizationError.USER_PERMISSION_DENIED
      2015-10-01 14:42:44,138 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Request made: POST https://adwords.google.com//api/adwords/reportdownload/v201506

      2015-10-01 14:42:44,139 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - accept-encoding: [gzip]
      authorization: REDACTED
      user-agent: [AdMaxLocal AdWords Software TSA QA (AwApi-Java, Common-Java/2.4.0, Java/1.6.0_27, maven)]
      developertoken: REDACTED
      clientcustomerid: 4629576581

      Parameters:
      __fmt: GZIPPED_XML
      __rdquery: SELECT CampaignId,AdGroupId,KeywordId,Id,AdNetworkType1,Impressions,Clicks,Cost,AveragePosition,ConversionsManyPerClick FROM AD_PERFORMANCE_REPORT WHERE Impressions > 0 DURING 20150903,20150903

      2015-10-01 14:42:44,139 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Response received with status code 400 and message: Bad Request

      2015-10-01 14:42:44.148 (1) [P1T1]: Exception: HTTP Response Code: 400, Trigger: <null>, Type: AuthorizationError.USER_PERMISSION_DENIED
      2015-10-01 14:42:44,199 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Request made: POST https://adwords.google.com//api/adwords/reportdownload/v201506

      2015-10-01 14:42:44,201 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - accept-encoding: [gzip]
      authorization: REDACTED
      user-agent: [AdMaxLocal AdWords Software TSA QA (AwApi-Java, Common-Java/2.4.0, Java/1.6.0_27, maven)]
      developertoken: REDACTED
      clientcustomerid: 4629576581

      Parameters:
      __fmt: GZIPPED_XML
      __rdquery: SELECT CampaignId,AdGroupId,KeywordId,Id,AdNetworkType1,Impressions,Clicks,Cost,AveragePosition,ConversionsManyPerClick FROM AD_PERFORMANCE_REPORT WHERE Impressions > 0 DURING 20150903,20150903

      2015-10-01 14:42:44,201 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Response received with status code 400 and message: Bad Request

      2015-10-01 14:42:44.213 (1) [P1T1]: Exception: HTTP Response Code: 400, Trigger: <null>, Type: AuthorizationError.USER_PERMISSION_DENIED
      2015-10-01 14:42:44.213 (1) [P1T1]: Downloading /var/local/tsa/sedata/google/tsa-mcc-report-adperformance-2015-09-03-U453_4629576581.xml.gz failed after running out of retries. This account/SEU will need to be rerun. Error message:
      2015-10-01 14:42:44,294 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Request made: POST https://adwords.google.com//api/adwords/reportdownload/v201506

      2015-10-01 14:42:44,298 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - accept-encoding: [gzip]
      authorization: REDACTED
      user-agent: [AdMaxLocal AdWords Software TSA QA (AwApi-Java, Common-Java/2.4.0, Java/1.6.0_27, maven)]
      developertoken: REDACTED
      clientcustomerid: 4629576581

      Parameters:
      __fmt: GZIPPED_XML
      __rdquery: SELECT CampaignId,AdGroupId,Id,KeywordMatchType,QualityScore,FirstPageCpc,CpcBid,CpcBidSource,Impressions FROM KEYWORDS_PERFORMANCE_REPORT WHERE Impressions > 0 DURING 20150903,20150903

      2015-10-01 14:42:44,298 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Response received with status code 400 and message: Bad Request

      2015-10-01 14:42:44.311 (1) [P1T1]: Exception: HTTP Response Code: 400, Trigger: <null>, Type: AuthorizationError.USER_PERMISSION_DENIED
      2015-10-01 14:42:44,577 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Request made: POST https://adwords.google.com//api/adwords/reportdownload/v201506

      2015-10-01 14:42:44,578 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - accept-encoding: [gzip]
      authorization: REDACTED
      user-agent: [AdMaxLocal AdWords Software TSA QA (AwApi-Java, Common-Java/2.4.0, Java/1.6.0_27, maven)]
      developertoken: REDACTED
      clientcustomerid: 4629576581

      Parameters:
      __fmt: GZIPPED_XML
      __rdquery: SELECT CampaignId,AdGroupId,Id,KeywordMatchType,QualityScore,FirstPageCpc,CpcBid,CpcBidSource,Impressions FROM KEYWORDS_PERFORMANCE_REPORT WHERE Impressions > 0 DURING 20150903,20150903

      2015-10-01 14:42:44,578 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Response received with status code 400 and message: Bad Request

      2015-10-01 14:42:44.588 (1) [P1T1]: Exception: HTTP Response Code: 400, Trigger: <null>, Type: AuthorizationError.USER_PERMISSION_DENIED
      2015-10-01 14:42:44,699 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Request made: POST https://adwords.google.com//api/adwords/reportdownload/v201506

      2015-10-01 14:42:44,700 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - accept-encoding: [gzip]
      authorization: REDACTED
      user-agent: [AdMaxLocal AdWords Software TSA QA (AwApi-Java, Common-Java/2.4.0, Java/1.6.0_27, maven)]
      developertoken: REDACTED
      clientcustomerid: 4629576581

      Parameters:
      __fmt: GZIPPED_XML
      __rdquery: SELECT CampaignId,AdGroupId,Id,KeywordMatchType,QualityScore,FirstPageCpc,CpcBid,CpcBidSource,Impressions FROM KEYWORDS_PERFORMANCE_REPORT WHERE Impressions > 0 DURING 20150903,20150903

      2015-10-01 14:42:44,700 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Response received with status code 400 and message: Bad Request

      2015-10-01 14:42:44.709 (1) [P1T1]: Exception: HTTP Response Code: 400, Trigger: <null>, Type: AuthorizationError.USER_PERMISSION_DENIED
      2015-10-01 14:42:44,968 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Request made: POST https://adwords.google.com//api/adwords/reportdownload/v201506

      2015-10-01 14:42:44,969 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - accept-encoding: [gzip]
      authorization: REDACTED
      user-agent: [AdMaxLocal AdWords Software TSA QA (AwApi-Java, Common-Java/2.4.0, Java/1.6.0_27, maven)]
      developertoken: REDACTED
      clientcustomerid: 4629576581

      Parameters:
      __fmt: GZIPPED_XML
      __rdquery: SELECT CampaignId,AdGroupId,Id,KeywordMatchType,QualityScore,FirstPageCpc,CpcBid,CpcBidSource,Impressions FROM KEYWORDS_PERFORMANCE_REPORT WHERE Impressions > 0 DURING 20150903,20150903

      2015-10-01 14:42:44,970 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Response received with status code 400 and message: Bad Request

      2015-10-01 14:42:44.985 (1) [P1T1]: Exception: HTTP Response Code: 400, Trigger: <null>, Type: AuthorizationError.USER_PERMISSION_DENIED
      2015-10-01 14:42:44.985 (1) [P1T1]: Downloading /var/local/tsa/sedata/google/tsa-mcc-report-kwperformance-2015-09-03-U453_4629576581.xml.gz failed after running out of retries. This account/SEU will need to be rerun. Error message:
      2015-10-01 14:42:45,033 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Request made: POST https://adwords.google.com//api/adwords/reportdownload/v201506

      2015-10-01 14:42:45,034 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - accept-encoding: [gzip]
      authorization: REDACTED
      user-agent: [AdMaxLocal AdWords Software TSA QA (AwApi-Java, Common-Java/2.4.0, Java/1.6.0_27, maven)]
      developertoken: REDACTED
      clientcustomerid: 4629576581

      Parameters:
      __fmt: GZIPPED_XML
      __rdquery: SELECT CampaignId,AdGroupId,CriteriaId,CreativeId,AdNetworkType1,GclId,ClickType,Device FROM CLICK_PERFORMANCE_REPORT DURING 20150903,20150903

      2015-10-01 14:42:45,034 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Response received with status code 400 and message: Bad Request

      2015-10-01 14:42:45.043 (1) [P1T1]: Exception: HTTP Response Code: 400, Trigger: <null>, Type: AuthorizationError.USER_PERMISSION_DENIED
      2015-10-01 14:42:45,090 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Request made: POST https://adwords.google.com//api/adwords/reportdownload/v201506

      2015-10-01 14:42:45,091 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - accept-encoding: [gzip]
      authorization: REDACTED
      user-agent: [AdMaxLocal AdWords Software TSA QA (AwApi-Java, Common-Java/2.4.0, Java/1.6.0_27, maven)]
      developertoken: REDACTED
      clientcustomerid: 4629576581

      Parameters:
      __fmt: GZIPPED_XML
      __rdquery: SELECT CampaignId,AdGroupId,CriteriaId,CreativeId,AdNetworkType1,GclId,ClickType,Device FROM CLICK_PERFORMANCE_REPORT DURING 20150903,20150903

      2015-10-01 14:42:45,092 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Response received with status code 400 and message: Bad Request

      2015-10-01 14:42:45.100 (1) [P1T1]: Exception: HTTP Response Code: 400, Trigger: <null>, Type: AuthorizationError.USER_PERMISSION_DENIED
      2015-10-01 14:42:45,189 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Request made: POST https://adwords.google.com//api/adwords/reportdownload/v201506

      2015-10-01 14:42:45,190 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - accept-encoding: [gzip]
      authorization: REDACTED
      user-agent: [AdMaxLocal AdWords Software TSA QA (AwApi-Java, Common-Java/2.4.0, Java/1.6.0_27, maven)]
      developertoken: REDACTED
      clientcustomerid: 4629576581

      Parameters:
      __fmt: GZIPPED_XML
      __rdquery: SELECT CampaignId,AdGroupId,CriteriaId,CreativeId,AdNetworkType1,GclId,ClickType,Device FROM CLICK_PERFORMANCE_REPORT DURING 20150903,20150903

      2015-10-01 14:42:45,191 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Response received with status code 400 and message: Bad Request

      2015-10-01 14:42:45.200 (1) [P1T1]: Exception: HTTP Response Code: 400, Trigger: <null>, Type: AuthorizationError.USER_PERMISSION_DENIED
      2015-10-01 14:42:45,261 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Request made: POST https://adwords.google.com//api/adwords/reportdownload/v201506

      2015-10-01 14:42:45,262 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - accept-encoding: [gzip]
      authorization: REDACTED
      user-agent: [AdMaxLocal AdWords Software TSA QA (AwApi-Java, Common-Java/2.4.0, Java/1.6.0_27, maven)]
      developertoken: REDACTED
      clientcustomerid: 4629576581

      Parameters:
      __fmt: GZIPPED_XML
      __rdquery: SELECT CampaignId,AdGroupId,CriteriaId,CreativeId,AdNetworkType1,GclId,ClickType,Device FROM CLICK_PERFORMANCE_REPORT DURING 20150903,20150903

      2015-10-01 14:42:45,263 [P1T1] WARN c.g.a.a.a.lib.utils.report_download - Response received with status code 400 and message: Bad Request

      2015-10-01 14:42:45.271 (1) [P1T1]: Exception: HTTP Response Code: 400, Trigger: <null>, Type: AuthorizationError.USER_PERMISSION_DENIED
      2015-10-01 14:42:45.271 (1) [P1T1]: Downloading /var/local/tsa/sedata/google/tsa-mcc-report-clickperformance-2015-09-03-U453_4629576581.xml.gz failed after running out of retries. This account/SEU will need to be rerun. Error message:
      2015-10-01 14:42:45.271 (3) [P1T1]: MCC report download (Thu Sep 03 00:00:00 UTC 2015, "/var/local/tsa/sedata/google/tsa-mcc-report-2015-09-03-U453_4629576581.xml.gz") -> success:false
      2015-10-01 14:42:45.272 (3) [P1T1]: === Completed user #453, 730090ff-5a33-49f6-8143-9f3d8a83ae49_1 ===
      2015-10-01 14:42:45.273 (3) [main]: ------------Google MCC Report done
      2015-10-01 14:42:45.322 (3) [main]: DefaultPropertyFileMonitor: modification detected on 1382459505000 for com.thesearchagency.AlertUtils.properties
      2015-10-01 14:42:45.350 (2) [main]: sendAlert: executing command: [/usr/local/tsa/send_alarm.sh, WARNING, TSAOPS, AdMax Application [GoogleMCC]: Service - Failed to download report /var/local/tsa/sedata/google/tsa-mcc-report-2015-09-03-U453_4629576581.xml.gz]
      Service - Failed to download report /var/local/tsa/sedata/google/tsa-mcc-report-2015-09-03-U453_4629576581.xml.gz
      2015-10-01 14:42:45.793 (3) [main]: =============== Completed Google MCC Report ================
      2015-10-01 14:42:45.795 (3) [main]: Google MCC Report: 9.383s
      2015-10-01 14:42:45.795 (3) [main]: by key:
      2015-10-01 14:42:45.795 (3) [main]: db: 0.005s
      2015-10-01 14:42:45.795 (3) [main]: by thread:
      2015-10-01 14:42:45.795 (3) [main]: P1T1: 0.004s
      2015-10-01 14:42:45.795 (3) [main]: main: 0.001s
      2015-10-01 14:42:45.795 (3) [main]: other: 9.378s

      There is no data downloaded into googleMcc or googleMccAdMax when used with admax parameter.

      AccountID=406 (QA4)

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              varshini.padmanabhan Varshini Padmanabhan (Inactive)
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: