1) ./dataavailability.sh -d3 --date $refdate --set-not-started 2) ./googlemcc.sh -d3 -T$refdate -U719 ./sesummarize.sh -d3 -S3 -a299 -T$refdate now will see green in google column 3) ./stageyahoo.sh -d3 -T$refdate -U720 ./sesummarize.sh -d3 -S164 -a299 -T$refdate now will see green in yahoo column too 4) get the current feed file from /var/local/tsa/clientdirs/viking on xml-03 and run it with the command below. the -L option is where i got it to. you can put it at your convenient location. File name will be soimething like below Tracking Code Data Extract for Viking River Cruises - Sun. 12 Dec. 2010.zip ./load-vikingriver.sh -d3 -L /var/local/tsa/clientdirs/viking --date $refdate && ./client-whsumm.sh -d3 --date $refdate --highgran-daily --script ./load-vikingriver.sh now will see green in df columns 5) get 10121201-318.txt from /usr/local/share/tsa/logs/working filename format is yymmddhh-318.txt. I just got the first hours file only. ./spikeplayer.sh -d3 -a299 /usr/local/tsa/bidmgr/pixelsumm.sh -d3 -a "299" now will see green in pixel columns 6) cp /var/local/tsa/publishers/299/177/299_177_20101212.csv.done /var/local/tsa/publishers/299/177/299_177_20101212.csv ./load-all-publishers.sh -d3 now will see green in pf columns 7) The following query will show all success as below mysql (spike@staging-db6.ri.thesearchagency.com)> select * from dataSources join dataAvailability on (dataSources.id = dataAvailability.dataSourceID ) where dataAvailability.date = "2010-12-13" and accountID=299 and type in ('searchengine','wh_searchengine','client','wh_client','pixel','wh_pixel'); +-------+-----------------+--------+-----------+----------+------------+------------+---------------------+--------------+---------+------------+------------+----------+ | id | type | typeID | accountID | id | date | oldUpdated | updated | dataSourceID | status | statusText | needsRerun | override | +-------+-----------------+--------+-----------+----------+------------+------------+---------------------+--------------+---------+------------+------------+----------+ | 16138 | wh_searchengine | 3 | 299 | 13508311 | 2010-12-12 | 00:00:00 | 2010-12-13 14:14:36 | 16138 | success | NULL | false | false | | 16908 | wh_client | NULL | 299 | 13508321 | 2010-12-12 | 00:00:00 | 2010-12-13 14:17:58 | 16908 | success | NULL | false | false | | 16907 | client | NULL | 299 | 13512141 | 2010-12-12 | 00:00:00 | 2010-12-13 14:17:46 | 16907 | success | NULL | false | false | | 86121 | wh_pixel | NULL | 299 | 13512281 | 2010-12-12 | 00:00:00 | 2010-12-13 14:31:29 | 86121 | success | NULL | false | false | | 16201 | wh_searchengine | 164 | 299 | 13547671 | 2010-12-12 | 00:00:00 | 2010-12-13 14:15:42 | 16201 | success | NULL | false | false | +-------+-----------------+--------+-----------+----------+------------+------------+---------------------+--------------+---------+------------+------------+----------+ Following query will show sucess for the publisher feed you have run as shown below mysql (spike@staging-db6.ri.thesearchagency.com)> select * from dataSources join dataAvailability on (dataSources.id = dataAvailability.dataSourceID ) where dataAvailability.date = "2010-12-12" and accountID=299 and type in ('publisher', 'wh_publisher'); +--------+--------------+--------+-----------+----------+------------+------------+---------------------+--------------+-------------+------------+------------+----------+ | id | type | typeID | accountID | id | date | oldUpdated | updated | dataSourceID | status | statusText | needsRerun | override | +--------+--------------+--------+-----------+----------+------------+------------+---------------------+--------------+-------------+------------+------------+----------+ | 223041 | publisher | 177 | 299 | 13508281 | 2010-12-12 | 00:00:00 | 2010-12-13 14:20:06 | 223041 | success | NULL | false | false | | 223051 | publisher | 180 | 299 | 13543261 | 2010-12-12 | 00:00:00 | 2010-06-03 08:58:59 | 223051 | not started | NULL | false | false | | 223061 | publisher | 188 | 299 | 13543271 | 2010-12-12 | 00:00:00 | 2010-06-03 08:58:59 | 223061 | not started | NULL | false | false | | 230831 | publisher | 197 | 299 | 13546651 | 2010-12-12 | 00:00:00 | 2010-06-03 08:59:06 | 230831 | not started | NULL | false | false | | 223111 | wh_publisher | NULL | 299 | 13540671 | 2010-12-12 | 00:00:00 | 2010-12-13 14:20:09 | 223111 | success | NULL | false | false | +--------+--------------+--------+-----------+----------+------------+------------+---------------------+--------------+-------------+------------+------------+----------+ Then I have set the publisher feed to "failure" and wh_publisher entry to "not started" using the update commands below... mysql (spike@staging-db6.ri.thesearchagency.com)> update dataAvailability set status='not started' where id=13540671; Query OK, 1 row affected (0.01 sec) Rows matched: 1 Changed: 1 Warnings: 0 mysql (spike@staging-db6.ri.thesearchagency.com)> update dataAvailability set status='failure ' where id=13508281; Query OK, 1 row affected (0.00 sec) Rows matched: 1 Changed: 1 Warnings: 0 mysql (spike@staging-db6.ri.thesearchagency.com)> select * from dataSources join dataAvailability on (dataSources.id = dataAvailability.dataSourceID ) where dataAvailability.date = "2010-12-13" and accountID=299 and type in ('publisher', 'wh_publisher'); +--------+--------------+--------+-----------+----------+------------+------------+---------------------+--------------+-------------+------------+------------+----------+ | id | type | typeID | accountID | id | date | oldUpdated | updated | dataSourceID | status | statusText | needsRerun | override | +--------+--------------+--------+-----------+----------+------------+------------+---------------------+--------------+-------------+------------+------------+----------+ | 223041 | publisher | 177 | 299 | 13508281 | 2010-12-12 | 00:00:00 | 2010-12-13 14:20:06 | 223041 | failure | NULL | false | false | | 223051 | publisher | 180 | 299 | 13543261 | 2010-12-12 | 00:00:00 | 2010-06-03 08:58:59 | 223051 | not started | NULL | false | false | | 223061 | publisher | 188 | 299 | 13543271 | 2010-12-12 | 00:00:00 | 2010-06-03 08:58:59 | 223061 | not started | NULL | false | false | | 230831 | publisher | 197 | 299 | 13546651 | 2010-12-12 | 00:00:00 | 2010-06-03 08:59:06 | 230831 | not started | NULL | false | false | | 223111 | wh_publisher | NULL | 299 | 13540671 | 2010-12-12 | 00:00:00 | 2010-12-13 14:20:09 | 223111 | not started | NULL | false | false | +--------+--------------+--------+-----------+----------+------------+------------+---------------------+--------------+-------------+------------+------------+----------+ 5 rows in set (0.00 sec) Now i see a red in pf load column and grey in pd wh column 9) then ran the low gran ./lowgran-whsumm.sh -a 299 -d4 It keeps waiting on the follwing query... mysql (spike@staging-db6.ri.thesearchagency.com)> select `dataSources`.`accountID`,`dataSources`.`type`,`dataAvailability`.`status` from `dataAvailability` join `dataSources` on ((`dataSources`.`id`=`dataAvailability`.`dataSourceID`)) join `tsacommon`.`accounts` on ((`dataSources`.`accountID`=`tsacommon`.`accounts`.`id`)) where ((`tsacommon`.`accounts`.`id` in (299)) and (`dataAvailability`.`date`="2010-12-12") and (`dataSources`.`type` in ('wh_pixel','wh_client','wh_searchengine','wh_position','wh_publisher'))) order by `dataSources`.`accountID`; +-----------+-----------------+-------------+ | accountID | type | status | +-----------+-----------------+-------------+ | 299 | wh_searchengine | success | | 299 | wh_searchengine | success | | 299 | wh_client | success | | 299 | wh_pixel | success | | 299 | wh_publisher | not started | +-----------+-----------------+-------------+ 5 rows in set (0.00 sec) waited a few minutes and while this is running I repeated step 6... Once that is finished you should see that the "./lowgran-whsumm.sh -a 299 -d4" would finish...