Details
-
Type:
Bug
-
Status: Closed
-
Priority:
Major
-
Resolution: Not a Bug
-
Affects Version/s: Mercury
-
Fix Version/s: None
-
Component/s: Other / Misc.
-
Labels:None
-
Environment:
Mercury RC builds
Description
Google Analytics report is not completely downloaded into the DB.
There are some campaigns that is getting missed in the performance.analytics_conversions table while downloading the data
Hence the smb.merchant_performance also has wrong values.
Attaching the file that is used to generate GA data.
DB values:
SELECT * FROM performance.analytics_conversions WHERE merchant_id="013f9360-ee42-4087-a7c7-595751077cc6"
merchant_id distribution_id account_id ba_id loc_id location_targeting conversion_date event_category event_action keyword conversions utm_campaign unique_key
013f9360-ee42-4087-a7c7-595751077cc6 147 8816 12553 3319 GT 2016-05-15 Navigation Click to Call #NAME? 8 013f9360-ee42-4087-a7c7-595751077cc6_12553_3319_8816_GT 2a31cfaea5ec7f4ef95bb7704fe3a323
013f9360-ee42-4087-a7c7-595751077cc6 147 8816 12553 3319 GT 2016-05-15 Form Form Submit #NAME? 10 013f9360-ee42-4087-a7c7-595751077cc6_12553_3319_8816_GT 2f5b1e2b30c0f2aef4f2940ad9c45f3e
013f9360-ee42-4087-a7c7-595751077cc6 3 8819 12552 4058 GT 2016-05-16 Form Form Submit #NAME? 1 013f9360-ee42-4087-a7c7-595751077cc6_12552_4058_8819_GT 465022f7e3e242a662e4a48ce43b0311
013f9360-ee42-4087-a7c7-595751077cc6 147 8822 12704 3199 GT 2016-05-16 Navigation Click to Call #NAME? 2 013f9360-ee42-4087-a7c7-595751077cc6_12704_3199_8822_GT 5e239bf6e692db44a1eda812ab1cb944
013f9360-ee42-4087-a7c7-595751077cc6 3 8819 12552 4058 GT 2016-05-15 Navigation Click to URL #NAME? 2 013f9360-ee42-4087-a7c7-595751077cc6_12552_4058_8819_GT 7716e7fb7ac21556581f818255973647
013f9360-ee42-4087-a7c7-595751077cc6 3 8819 12552 4058 GT 2016-05-16 Navigation Click to Call #NAME? 2 013f9360-ee42-4087-a7c7-595751077cc6_12552_4058_8819_GT 7d0efcddcc44f421b14248900a7c21b0
013f9360-ee42-4087-a7c7-595751077cc6 147 8822 12704 3199 GT 2016-05-16 Form Lightbox Click #NAME? 4 013f9360-ee42-4087-a7c7-595751077cc6_12704_3199_8822_GT aa8065ec6775522768eb5efdaa9e5206
013f9360-ee42-4087-a7c7-595751077cc6 147 8816 12553 3319 GT 2016-05-15 Form Lightbox Click #NAME? 7 013f9360-ee42-4087-a7c7-595751077cc6_12553_3319_8816_GT bc2aabe7158b14d748fa760e3a661782
SELECT * FROM smb.merchant_performance WHERE merchant_uuid LIKE "%013f9360-ee42-4087-a7c7-595751077cc6%";
merchant_uuid start_date distributionID imps clicks cost call_leads adwords_leads analytics_leads
013f9360-ee42-4087-a7c7-595751077cc6 2016-05-15 3 0 0 0 0 0 2
013f9360-ee42-4087-a7c7-595751077cc6 2016-05-15 147 0 0 0 0 0 25
013f9360-ee42-4087-a7c7-595751077cc6 2016-05-16 3 0 0 0 0 0 3
013f9360-ee42-4087-a7c7-595751077cc6 2016-05-16 147 0 0 0 0 0 6
aml.log
2016-05-20 12:55:02,816-169940723 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside and timestamp : 1460117513000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
2016-05-20 12:55:03,044-169940951 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside and timestamp : 1460201382000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
2016-05-20 12:55:03,300-169941207 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside and timestamp : 1460287464000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
2016-05-20 12:55:03,535-169941442 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside and timestamp : 1460374405000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
2016-05-20 12:55:03,816-169941723 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside and timestamp : 1460460059000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
2016-05-20 12:55:04,238-169942145 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside and timestamp : 1460546724000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
2016-05-20 12:55:04,539-169942446 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : subject and timestamp : 1460560796000 from sender : Varshini Padmanabhan <Varshini.Padmanabhan@thesearchagency.com> as it does not contain the stackname : qatest
2016-05-20 12:55:04,819-169942726 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside and timestamp : 1460633277000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
2016-05-20 12:55:05,050-169942957 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside and timestamp : 1460719469000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
2016-05-20 12:55:05,273-169943180 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside and timestamp : 1460805485000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
2016-05-20 12:55:05,491-169943398 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside and timestamp : 1460891768000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
2016-05-20 12:55:05,738-169943645 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: New Custom Report and timestamp : 1460978534000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
2016-05-20 12:55:05,960-169943867 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside,Top Events and timestamp : 1460978534000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
2016-05-20 12:55:06,222-169944129 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Good Spa,Audience Overview and timestamp : 1460992393000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
2016-05-20 12:55:06,456-169944363 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Good Spa,Audience Overview and timestamp : 1461030480000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
2016-05-20 12:55:06,738-169944645 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Seaside,Top Events and timestamp : 1461065079000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
2016-05-20 12:55:06,960-169944867 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: New Custom Report and timestamp : 1461065078000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
2016-05-20 12:55:07,179-169945086 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Skipping message with subject : Google Analytics: Good Spa,Audience Overview,Template and timestamp : 1461117110000 from sender : varshgooganal@gmail.com as it does not contain the stackname : qatest
2016-05-20 12:55:07,425-169945332 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Found message with subject : qatest new and timestamp : 1463748632000 from sender : Varshini Padmanabhan <Varshini.Padmanabhan@thesearchagency.com>
2016-05-20 12:55:07,660-169945567 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Saving attachment named qatest new_Analytics All Web Site Data qatest2 20160415-20160416.csv with encoded size 1828
2016-05-20 12:55:07,867-169945774 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsLoaderService [] - Updating analytics data using /var/local/tsa/analytics-reports/qatest new_Analytics All Web Site Data qatest2 20160415-20160416.csv
2016-05-20 12:55:07,929-169945836 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.data.AnalyticsDataRowDAO [] - Aggregated Merchant Performance Data 4 rows for date range Sun May 15 00:00:00 UTC 2016 to Mon May 16 00:00:00 UTC 2016
2016-05-20 12:55:08,390-169946297 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Downloaded report from message with subject : qatest new and timestamp : 1463748632000 from sender : Varshini Padmanabhan <Varshini.Padmanabhan@thesearchagency.com>
2016-05-20 12:55:08,741-169946648 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Finished Downloading Reports
2016-05-20 12:55:59,705-169997612 [OrderScheduler_Worker-1] DEBUG com.thesearchagency.sapi.services.order.OrderStatusUpdateJob [] - Determining number of orders requiring update.
2016-05-20 12:55:59,720-169997627 [OrderScheduler_Worker-1] INFO com.thesearchagency.sapi.services.order.OrderStatusUpdateJob [] - Beginning update for 0 orders.
2016-05-20 12:56:59,698-170057605 [OrderScheduler_Worker-2] DEBUG com.thesearchagency.sapi.services.order.OrderStatusUpdateJob [] - Determining number of orders requiring update.
2016-05-20 12:56:59,713-170057620 [OrderScheduler_Worker-2] INFO com.thesearchagency.sapi.services.order.OrderStatusUpdateJob [] - Beginning update for 0 orders.
2016-05-20 12:57:59,697-170117604 [OrderScheduler_Worker-4] DEBUG com.thesearchagency.sapi.services.order.OrderStatusUpdateJob [] - Determining number of orders requiring update.
2016-05-20 12:57:59,712-170117619 [OrderScheduler_Worker-4] INFO com.thesearchagency.sapi.services.order.OrderStatusUpdateJob [] - Beginning update for 0 orders.
2016-05-20 12:58:59,698-170177605 [OrderScheduler_Worker-3] DEBUG com.thesearchagency.sapi.services.order.OrderStatusUpdateJob [] - Determining number of orders requiring update.
2016-05-20 12:58:59,713-170177620 [OrderScheduler_Worker-3] INFO com.thesearchagency.sapi.services.order.OrderStatusUpdateJob [] - Beginning update for 0 orders.
2016-05-20 12:59:59,698-170237605 [OrderScheduler_Worker-5] DEBUG com.thesearchagency.sapi.services.order.OrderStatusUpdateJob [] - Determining number of orders requiring update.
2016-05-20 12:59:59,712-170237619 [OrderScheduler_Worker-5] INFO com.thesearchagency.sapi.services.order.OrderStatusUpdateJob [] - Beginning update for 0 orders.
2016-05-20 13:00:00,001-170237908 [analytics-email-scheduler-1] INFO com.admaxlocal.analytics.AnalyticsReportIMAPDownloader [] - Downloading Reports
QA4 was used for testing (realm: qa4amltest)