Uploaded image for project: 'AdMaxLocal'
  1. AdMaxLocal
  2. AML-4164

Google Analytics report is not completely downloaded into the DB

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Not a Bug
    • Affects Version/s: Mercury
    • Fix Version/s: None
    • Component/s: Other / Misc.
    • Labels:
      None
    • Environment:

      Mercury RC builds

      Description

      Google Analytics report is not completely downloaded into the DB.
      There are some campaigns that is getting missed in the performance.analytics_conversions table while downloading the data
      Hence the smb.merchant_performance also has wrong values.
      Attaching the file that is used to generate GA data.

      DB values:

      SELECT * FROM performance.analytics_conversions WHERE merchant_id="013f9360-ee42-4087-a7c7-595751077cc6"
      merchant_id distribution_id account_id ba_id loc_id location_targeting conversion_date event_category event_action keyword conversions utm_campaign unique_key
      013f9360-ee42-4087-a7c7-595751077cc6 147 8816 12553 3319 GT 2016-05-15 Navigation Click to Call #NAME? 8 013f9360-ee42-4087-a7c7-595751077cc6_12553_3319_8816_GT 2a31cfaea5ec7f4ef95bb7704fe3a323
      013f9360-ee42-4087-a7c7-595751077cc6 147 8816 12553 3319 GT 2016-05-15 Form Form Submit #NAME? 10 013f9360-ee42-4087-a7c7-595751077cc6_12553_3319_8816_GT 2f5b1e2b30c0f2aef4f2940ad9c45f3e
      013f9360-ee42-4087-a7c7-595751077cc6 3 8819 12552 4058 GT 2016-05-16 Form Form Submit #NAME? 1 013f9360-ee42-4087-a7c7-595751077cc6_12552_4058_8819_GT 465022f7e3e242a662e4a48ce43b0311
      013f9360-ee42-4087-a7c7-595751077cc6 147 8822 12704 3199 GT 2016-05-16 Navigation Click to Call #NAME? 2 013f9360-ee42-4087-a7c7-595751077cc6_12704_3199_8822_GT 5e239bf6e692db44a1eda812ab1cb944
      013f9360-ee42-4087-a7c7-595751077cc6 3 8819 12552 4058 GT 2016-05-15 Navigation Click to URL #NAME? 2 013f9360-ee42-4087-a7c7-595751077cc6_12552_4058_8819_GT 7716e7fb7ac21556581f818255973647
      013f9360-ee42-4087-a7c7-595751077cc6 3 8819 12552 4058 GT 2016-05-16 Navigation Click to Call #NAME? 2 013f9360-ee42-4087-a7c7-595751077cc6_12552_4058_8819_GT 7d0efcddcc44f421b14248900a7c21b0
      013f9360-ee42-4087-a7c7-595751077cc6 147 8822 12704 3199 GT 2016-05-16 Form Lightbox Click #NAME? 4 013f9360-ee42-4087-a7c7-595751077cc6_12704_3199_8822_GT aa8065ec6775522768eb5efdaa9e5206
      013f9360-ee42-4087-a7c7-595751077cc6 147 8816 12553 3319 GT 2016-05-15 Form Lightbox Click #NAME? 7 013f9360-ee42-4087-a7c7-595751077cc6_12553_3319_8816_GT bc2aabe7158b14d748fa760e3a661782

      SELECT * FROM smb.merchant_performance WHERE merchant_uuid LIKE "%013f9360-ee42-4087-a7c7-595751077cc6%";
      merchant_uuid start_date distributionID imps clicks cost call_leads adwords_leads analytics_leads
      013f9360-ee42-4087-a7c7-595751077cc6 2016-05-15 3 0 0 0 0 0 2
      013f9360-ee42-4087-a7c7-595751077cc6 2016-05-15 147 0 0 0 0 0 25
      013f9360-ee42-4087-a7c7-595751077cc6 2016-05-16 3 0 0 0 0 0 3
      013f9360-ee42-4087-a7c7-595751077cc6 2016-05-16 147 0 0 0 0 0 6

      aml.log

      2016-05-20 12:55:02,816-169940723 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside and timestamp : 1460117513000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
      2016-05-20 12:55:03,044-169940951 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside and timestamp : 1460201382000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
      2016-05-20 12:55:03,300-169941207 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside and timestamp : 1460287464000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
      2016-05-20 12:55:03,535-169941442 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside and timestamp : 1460374405000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
      2016-05-20 12:55:03,816-169941723 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside and timestamp : 1460460059000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
      2016-05-20 12:55:04,238-169942145 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside and timestamp : 1460546724000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
      2016-05-20 12:55:04,539-169942446 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : subject and timestamp : 1460560796000 from sender : Varshini Padmanabhan <Varshini.Padmanabhan@thesearchagency.com> as it does not contain the stackname : qatest
      2016-05-20 12:55:04,819-169942726 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside and timestamp : 1460633277000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
      2016-05-20 12:55:05,050-169942957 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside and timestamp : 1460719469000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
      2016-05-20 12:55:05,273-169943180 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside and timestamp : 1460805485000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
      2016-05-20 12:55:05,491-169943398 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside and timestamp : 1460891768000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
      2016-05-20 12:55:05,738-169943645 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: New Custom Report and timestamp : 1460978534000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
      2016-05-20 12:55:05,960-169943867 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside,Top Events and timestamp : 1460978534000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
      2016-05-20 12:55:06,222-169944129 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Good Spa,Audience Overview and timestamp : 1460992393000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
      2016-05-20 12:55:06,456-169944363 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Good Spa,Audience Overview and timestamp : 1461030480000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
      2016-05-20 12:55:06,738-169944645 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside,Top Events and timestamp : 1461065079000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
      2016-05-20 12:55:06,960-169944867 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: New Custom Report and timestamp : 1461065078000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
      2016-05-20 12:55:07,179-169945086 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Good Spa,Audience Overview,Template and timestamp : 1461117110000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
      2016-05-20 12:55:07,425-169945332 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Found message with subject : qatest new and timestamp : 1463748632000 from sender : Varshini Padmanabhan <Varshini.Padmanabhan@thesearchagency.com>
      2016-05-20 12:55:07,660-169945567 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Saving attachment named qatest new_Analytics All Web Site Data qatest2 20160415-20160416.csv with encoded size 1828
      2016-05-20 12:55:07,867-169945774 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsLoaderService [] - Updating analytics data using /var/local/tsa/analytics-reports/qatest new_Analytics All Web Site Data qatest2 20160415-20160416.csv
      2016-05-20 12:55:07,929-169945836 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.data.AnalyticsDataRowDAO [] - Aggregated Merchant Performance Data 4 rows for date range Sun May 15 00:00:00 UTC 2016 to Mon May 16 00:00:00 UTC 2016
      2016-05-20 12:55:08,390-169946297 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Downloaded report from message with subject : qatest new and timestamp : 1463748632000 from sender : Varshini Padmanabhan <Varshini.Padmanabhan@thesearchagency.com>
      2016-05-20 12:55:08,741-169946648 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Finished Downloading Reports
      2016-05-20 12:55:59,705-169997612 [OrderScheduler_Worker-1] DEBUG com.thesearchagency.sapi.services.order.OrderStatusUpdateJob [] - Determining number of orders requiring update.
      2016-05-20 12:55:59,720-169997627 [OrderScheduler_Worker-1] INFO com.thesearchagency.sapi.services.order.OrderStatusUpdateJob [] - Beginning update for 0 orders.
      2016-05-20 12:56:59,698-170057605 [OrderScheduler_Worker-2] DEBUG com.thesearchagency.sapi.services.order.OrderStatusUpdateJob [] - Determining number of orders requiring update.
      2016-05-20 12:56:59,713-170057620 [OrderScheduler_Worker-2] INFO com.thesearchagency.sapi.services.order.OrderStatusUpdateJob [] - Beginning update for 0 orders.
      2016-05-20 12:57:59,697-170117604 [OrderScheduler_Worker-4] DEBUG com.thesearchagency.sapi.services.order.OrderStatusUpdateJob [] - Determining number of orders requiring update.
      2016-05-20 12:57:59,712-170117619 [OrderScheduler_Worker-4] INFO com.thesearchagency.sapi.services.order.OrderStatusUpdateJob [] - Beginning update for 0 orders.
      2016-05-20 12:58:59,698-170177605 [OrderScheduler_Worker-3] DEBUG com.thesearchagency.sapi.services.order.OrderStatusUpdateJob [] - Determining number of orders requiring update.
      2016-05-20 12:58:59,713-170177620 [OrderScheduler_Worker-3] INFO com.thesearchagency.sapi.services.order.OrderStatusUpdateJob [] - Beginning update for 0 orders.
      2016-05-20 12:59:59,698-170237605 [OrderScheduler_Worker-5] DEBUG com.thesearchagency.sapi.services.order.OrderStatusUpdateJob [] - Determining number of orders requiring update.
      2016-05-20 12:59:59,712-170237619 [OrderScheduler_Worker-5] INFO com.thesearchagency.sapi.services.order.OrderStatusUpdateJob [] - Beginning update for 0 orders.
      2016-05-20 13:00:00,001-170237908 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Downloading Reports

      QA4 was used for testing (realm: qa4amltest)

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              varshini.padmanabhan Varshini Padmanabhan (Inactive)
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: