Extended UDF: lowgran whsumm only waits for at least 1 feed to come in. it should wait for all active feeds to come in.

This is the backend code change associated with it.

http://trac.ri.thesearchagency.com/cgi-bin/trac.cgi/changeset/28241

Currently the lowgran will run once searchengine, pixel, datafeed and one of the publisher feed finishes successfully. lowgran needs to wait till all the publisher feeds are finished. To test this, the account must have multiple publisher distributions associated with a specific day.

A fix is checked in to trunk build 287.

the problem is displayed in this screenshot (where we see a green dot for WH Low and mixed gray/green dots for "PF LD".

Also, these log files show lowgran whsumm starting for account 541 immediately after one distribution is loaded, and not all 3. It needs to wait for all 3 (or until the maximum wait time is reached) before running.

Note: The fix means that when clicking on the "PF WH" dot, there will be multiple entries (1 for each distribution). The UI should be updated to look at the typeID saved in the database too display the distribution, but that can be fixed later.

/var/local/tsa/log/2010-12-15/load-all-publishers.sh_08.log

2010-12-15 08:30:11.240 (3) [pool-1-thread-1]: loading "/var/local/tsa/publishers/541/177/541_177_20101214.csv"...

2010-12-15 08:30:11.240 (3) [pool-1-thread-1]: Account [541]: deleting old publisher data (2010-12-14 00:00:00)

2010-12-15 08:30:11.245 (3) [pool-1-thread-1]: Initializing Headers...

2010-12-15 08:30:11.245 (3) [pool-1-thread-1]: Skipped line # 1

2010-12-15 08:30:11.973 (3) [pool-1-thread-1]: – do warehouse summarizaztion for Date[20101214] ? true

2010-12-15 08:30:11.974 (3) [pool-1-thread-1]: ...calling warehouse summarization with args: --debug 3 --accountid 541 --distribution 177 --date 2010-12-14 --publisher --highgran

2010-12-15 08:30:11.984 (3) [pool-1-thread-1]: Debug Level set to 3

2010-12-15 08:30:11.985 (3) [pool-1-thread-1]: =============== Starting Warehouse Summarizer ================

/tmp/2010-12-15/lowgran-whsumm.sh_04.log

2010-12-15 08:30:14.684 (3) [P6T1]: Starting Account #541 TSA - Martian Tourism aggregates for Tue Dec 14 00:00:00 PST 2010 to <Wed Dec 15 00:00:00 PST 2010

2010-12-15 08:30:15.323 (3) [P6T1]: ... 20 Weekly Source Perf Records Inserted

2010-12-15 08:30:15.422 (3) [P6T1]: ... 54 Weekly Source Conversion Records Inserted

2010-12-15 08:30:15.492 (3) [P6T1]: ... 19 Weekly Source Attribute Records Inserted

2010-12-15 08:30:16.825 (3) [P6T1]: ... 90 Monthly Source Perf Records Inserted

2010-12-15 08:30:16.987 (3) [P6T1]: ... 107 Monthly Source Conversion Records Inserted

2010-12-15 08:30:17.133 (3) [P6T1]: ... 19 Monthly Source Attribute Records Inserted

2010-12-15 08:30:17.145 (3) [P6T1]: ... 2 Daily Group Perf Records Inserted

2010-12-15 08:30:17.148 (3) [P6T1]: ... 3 Daily Group Conversion Records Inserted

2010-12-15 08:30:17.150 (3) [P6T1]: ... 1 Daily Group Attribute Records Inserted

2010-12-15 08:30:17.662 (3) [P6T1]: ... 3 Weekly Group Perf Records Inserted

2010-12-15 08:30:17.673 (3) [P6T1]: ... 3 Weekly Group Conversion Records Inserted

2010-12-15 08:30:17.692 (3) [P6T1]: ... 2 Weekly Group Attribute Records Inserted

2010-12-15 08:30:18.114 (3) [P6T1]: ... 10 Monthly Group Perf Records Inserted

2010-12-15 08:30:18.136 (3) [P6T1]: ... 5 Monthly Group Conversion Records Inserted

2010-12-15 08:30:18.139 (3) [P6T1]: ... 2 Monthly Group Attribute Records Inserted

2010-12-15 08:30:18.142 (3) [P6T1]: Finished Account #541 TSA - Martian Tourism aggregates for Tue Dec 14 00:00:00 PST 2010 to <Wed Dec 15 00:00:00 PST 2010

2010-12-15 08:30:18.145 (3) [P6T1]: Sending 'account done' JMS message for 541