Details
-
Type: Bug
-
Status: Closed
-
Priority: Major
-
Resolution: Fixed
-
Affects Version/s: unspecified
-
Fix Version/s: None
-
Component/s: Data Checker
-
Labels:None
-
Environment:
Operating System: Linux
Platform: PC
-
Bugzilla Id:3812
Description
--------------------------------------------------
Project: DataChecker_Discrepancy_Resolver
Component Used: ./generate-discrepancies.sh and resolver
Build: /var/local/builds/datachecker/tsa-build-bidmgr-2010-05-10-p7-r1304
Environment: Yell-Ec
--------------------------------------------------
Discrepancy resolver is not able to resolve discrepancy which is created
manually by updating the "googleDailyCheck" table.
Steps to reproduce:
1)./sedatacheck.sh -d3 -U4071 -T2010-05-07 -E 2010-01-01 --daily
2)
mysql> select * from staging.googleDailyCheck where campaignid=55321857 and
date between '2010-04-18' and '2010-04-20' ;
---------------------------------------------------------------------------------------+
date | acctname | campaignid | campaign |
imps | clicks | cost | conv |
---------------------------------------------------------------------------------------+
2010-04-18 | 55321857 | 0016034650_1000000410_1040_101862_GM |
15 | 0 | 0 | 0 |
2010-04-19 | 55321857 | 0016034650_1000000410_1040_101862_GM |
54 | 0 | 0 | 0 |
2010-04-20 | 55321857 | 0016034650_1000000410_1040_101862_GM |
8 | 2 | 3860000 | 0 |
---------------------------------------------------------------------------------------+
3 rows in set (0.00 sec)
3)Now update one of the date manually and run the ./geneate-discrepany resolver
script.
update googleDailyCheck set imps=50 where date = '2010-04-19' and
campaignid=55321857;
update googleDailyCheck set clicks= 5 where date = '2010-04-19' and
campaignid=55321857;
update googleDailyCheck set cost= 500000 where date = '2010-04-19' and
campaignid=55321857;
4)./generate-discrepancies.sh -d3 --accountid 3611 --distribution 3 -E
2010-04-20 -T 2010-04-18
5)Check if manually updated data is present in "reportdiscrepany" file.
tsaapp@yell-ec-xml:/var/local/builds/datachecker/tsa-build-bidmgr-2010-05-10-p7-r1304$
cat /var/local/tsa/datachecker/2010-05-10-tsa-DiscrepancyReport-D3.csv
"Date","Account/Campaign","SE Imps","SE Clicks","SE Cost","SE
Conv","Status","SEAcctID","SEUserID","inMCC","AcctID","TSA Account","TSA SE
Imps","TSA SE Clicks","TSA SE Cost","TSA SE Conv","Imps Difference","Clicks
Difference","Cost Difference","Conv Difference","Campaign Last Synchronized"
"2010-04-18","0016034650_1000000044_1040_101863_GT","1928","2","6.61","0","enabled","11831","4071","MCC","3611","qdtest9","","","","","1928.0","2.0","6.61","0.0","2010-04-22
13:42:01"
"2010-04-20","0016034650_1000000044_1040_101863_GT","398","2","6.35","0","enabled","11831","4071","MCC","3611","qdtest9","","","","","398.0","2.0","6.35","0.0","2010-04-22
13:42:01"
"2010-04-18","0016034650_1000000049_1040_101861_GM","1","1","0.99","0","enabled","11861","4071","MCC","3611","qdtest9","","","","","1.0","1.0","0.99","0.0","2010-04-22
13:42:02"
"2010-04-20","0016034650_1000000049_1040_101861_GM","1","1","0.96","0","enabled","11861","4071","MCC","3611","qdtest9","","","","","1.0","1.0","0.96","0.0","2010-04-22
13:42:02"
"2010-04-18","0016034650_1000000049_1040_101861_GT","761","6","9.31","0","enabled","11801","4071","MCC","3611","qdtest9","","","","","761.0","6.0","9.31","0.0","2010-04-22
13:41:45"
"2010-04-20","0016034650_1000000049_1040_101861_GT","1070","6","8.21","0","enabled","11801","4071","MCC","3611","qdtest9","","","","","1070.0","6.0","8.21","0.0","2010-04-22
13:41:45"
"2010-04-18","0016034650_1000000410_1040_101862_GM","15","0","0.0","0","enabled","11871","4071","MCC","3611","qdtest9","","","","","15.0","0.0","0.0","0.0","2010-04-22
13:41:41"
"2010-04-20","0016034650_1000000410_1040_101862_GM","8","2","3.86","0","enabled","11871","4071","MCC","3611","qdtest9","","","","","8.0","2.0","3.86","0.0","2010-04-22
13:41:41"
"2010-04-19","0016034650_1000000410_1040_101862_GM","50","5","0.5","0","enabled","11871","4071","MCC","3611","qdtest9","54.0","0.0","0.0","0","-4.0","5.0","0.5","0.0","2010-04-22
13:41:41"
"2010-04-18","0016034650_1000000410_1040_101862_GT","2894","10","17.47","0","enabled","11781","4071","MCC","3611","qdtest9","","","","","2894.0","10.0","17.47","0.0","2010-04-22
13:42:01"
"2010-04-20","0016034650_1000000410_1040_101862_GT","8191","10","16.86","0","enabled","11781","4071","MCC","3611","qdtest9","","","","","8191.0","10.0","16.86","0.0","2010-04-22
13:42:01"
"2010-04-18","0016034650_1000000496_1040_101864_GT","1532","1","0.7","0","enabled","11811","4071","MCC","3611","qdtest9","","","","","1532.0","1.0","0.7","0.0","2010-04-22
13:41:41"
"2010-04-20","0016034650_1000000496_1040_101864_GT","609","1","1.08","0","enabled","11811","4071","MCC","3611","qdtest9","","","","","609.0","1.0","1.08","0.0","2010-04-22
13:41:41"
"2010-04-18","0016034650_1000001006_1040_101860_GM","2","0","0.0","0","enabled","11841","4071","MCC","3611","qdtest9","","","","","2.0","0.0","0.0","0.0","2010-04-22
13:41:58"
"2010-04-20","0016034650_1000001006_1040_101860_GM","2","0","0.0","0","enabled","11841","4071","MCC","3611","qdtest9","","","","","2.0","0.0","0.0","0.0","2010-04-22
13:41:58"
"2010-04-18","0016034650_1000001006_1040_101860_GT","38","7","2.53","0","enabled","11791","4071","MCC","3611","qdtest9","","","","","38.0","7.0","2.53","0.0","2010-04-22
13:41:56"
"2010-04-20","0016034650_1000001006_1040_101860_GT","217","7","1.47","0","enabled","11791","4071","MCC","3611","qdtest9","","","","","217.0","7.0","1.47","0.0","2010-04-22
13:41:56"
Discrepancy for date '2010-04-19 ' is generated in the discrepancy report.
7)./generate-discrepancies.sh -d3 --accountid 3611 --distribution 3 -E
2010-04-20 -T 2010-04-18 -resolve
.
.
.
2010-05-10 14:59:09.762 (3) [main]: getAbsolutePath() returned /tmp/abtl24710.csv
2010-05-10 14:59:09.770 (3) [main]: Writing file to
/var/local/tsa/datachecker/2010-05-10-tsa-DiscrepancyReport-D3.csv
2010-05-10 14:59:09.777 (3) [main]: ... done
2010-05-10 14:59:09.777 (3) [main]: Report generated successfully at following
location /var/local/tsa/datachecker/2010-05-10-tsa-DiscrepancyReport-D3.csv
2010-05-10 14:59:09.780 (3) [main]: Getting unresolved discrepancy records
2010-05-10 14:59:09.781 (3) [main]: Discrepancies not solved for
SearchEngineAccountIDs (11871) after second Rerun
tsaapp@yell-ec-xml:/var/local/builds/datachecker/tsa-build-bidmgr-2010-05-10-p7-r1304$
cat /var/local/tsa/datachecker/2010-05-10-tsa-DiscrepancyReport-D3.csv
"Date","Account/Campaign","SE Imps","SE Clicks","SE Cost","SE
Conv","Status","SEAcctID","SEUserID","inMCC","AcctID","TSA Account","TSA SE
Imps","TSA SE Clicks","TSA SE Cost","TSA SE Conv","Imps Difference","Clicks
Difference","Cost Difference","Conv Difference","Campaign Last Synchronized"
"2010-04-19","0016034650_1000000410_1040_101862_GM","50","5","0.5","0","enabled","11871","4071","MCC","3611","qdtest9","54.0","0.0","0.0","0","-4.0","5.0","0.5","0.0","2010-04-22
13:41:41"
Its observed that after second rerun, discrepancy is not resolved...
Even after running it again, its not resolved.