Details
-
Type:
Improvement
-
Status: Open
-
Priority:
Minor
-
Resolution: Unresolved
-
Affects Version/s: Cloud Spider 3.03
-
Fix Version/s: Sustaining
-
Component/s: Cloud Spider
-
Labels:None
-
Environment:
AWS instances
Description
Delete crawl data after successful S3 Upload, will free up disk space.
Also, no need to upload lucene crawl indexes, just the chunk data file should be sufficient.
