Details
-
Type: Bug
-
Status: Closed
-
Priority: Major
-
Resolution: Won't Fix
-
Affects Version/s: None
-
Fix Version/s: None
-
Component/s: Algorithms
-
Labels:None
-
Environment:
production
Description
the pixsync.sh script was set to download for the hour '13'. It set the --exclude to 10123014*. It starting downloading at
Thu Dec 30 14:31:09 PST 2010 – pixel-05-c-wpa.thesearchagency.net starting.
and finished at
1: copying files on pixspike@pixel-05-c-wpa.thesearchagency.net to /usr/local/share/tsa/logs/done/: " 10123013-768-37.txt"
Thu Dec 30 15:44:32 PST 2010 – pixel-05-c-wpa.thesearchagency.net done.
Now the current hour is '15', when it started downloading from the next pixel server, since the exclude file was still 10123014*, it downloaded both
10123013-768-253.txt
10123015-768-253.txt
10123015-768-253.txt should not have been downloaded, but the exclusion is only for one file, and since the hour changed to '15', that file began to be written, and pixsync simply grabbed all files that matched the pattern and excluded 10123014*.
This happened for all remaining pixel servers.