Uploaded image for project: 'AdMax'
  1. AdMax
  2. ADMAX-2350

DataChecker_Discrepancy_Resolver: Performance issue>It is taking around 6 hrs to resolve the discrepanies of a single day.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Won't Fix
    • Affects Version/s: Configurable Multi-Source Data Support
    • Component/s: None
    • Labels:
      None
    • Environment:

      Staging-xml1

      Description

      ------------------------------------------------------------------------------------------------------------------------------------------------------------

      Project: Datachecker Discrepancy Resolver

      Build:tsa-build-bidmgr-2010-08-13-p174-r27057

      -----------------------------------------------------------------------------------------------------------------------------------------------------------

      Datachecker resolver takes around 6 hours to resolve the discrepancies for a single day. [Google]

      Steps to reproduce:

      1. cd cd /var/local/builds/tsa-build-bidmgr-2010-08-13-p174-r27057

      2.Run ./generate-discrepancies-resolver.sh -d3 -a 289 -S 3 -E 2010-08-05 -T 2010-08-04 2>&1|tee -a /tmp/resolver_google.log

      3.Check the 'resolver_google.log' file and see how much time it takes to resolve the discrepancies...

      tsaapp@tvvm-staging-xml1:/var/local/builds/tsa-build-bidmgr-2010-08-13-p174-r27057$ head -2 /tmp/resolver_google.log

      ================= 2: Starting Discrepancy Resolver with [-d3 --resolve -a 289 -S 3 -E 2010-08-05 -T 2010-08-04]

      2010-08-13 05:36:12.058 (3) [main]: Debug Level set to 3

      .

      .

      .

      tsaapp@tvvm-staging-xml1:/var/local/builds/tsa-build-bidmgr-2010-08-13-p174-r27057$ tail -2 /tmp/resolver_google.log

      2010-08-13 13:31:46.075 (3) [main]: Report generated successfully at following location /var/local/tsa/datachecker/2010-08-13-tsa-DiscrepancyReport-D3.csv

      2010-08-13 13:31:46.075 (3) [main]: No Discrepancy Record exists After Second Rerun

      2010-08-13 13:31:38.955 (3) [main]: getAbsolutePath() returned /tmp/abtl45785.csv

      2010-08-13 13:31:46.074 (3) [main]: Writing file to /var/local/tsa/datachecker/2010-08-13-tsa-DiscrepancyReport-D3.csv

      2010-08-13 13:31:46.075 (3) [main]: ... done

      2010-08-13 13:31:46.075 (3) [main]: Report generated successfully at following location /var/local/tsa/datachecker/2010-08-13-tsa-DiscrepancyReport-D3.csv

      2010-08-13 13:31:46.075 (3) [main]: No Discrepancy Record exists After Second Rerun

      Note: Log is attached.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              atul.sanagar Atul Sanagar (Inactive)
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: