convert code from using LOAD DATA LOCAL INFILE

Rackspace database as a service product does not allow LOAD DATA INFILE or LOAD DATA LOCAL INFILE for security reasons. It is preferable to use their DB hosting service instead of our own to increase performance, reduce hosting costs, and easier maintenance of our database servers.

There are many places we use LOAD DATA LOCAL INFILE. This may not be all of them, but is a good start.

1. business taxonomy load
2. location taxonomy load
3. keyword file load
4. point radius file load
5. google content editor
6. GoogleMCC
7. SearchEngineSummarizer
8. Warehouse Summarizer
9. pixel playback

We can convert the java code to use batch multi-insert statements instead of LOAD DATA INFILE (we definitely do not want to use individual insert statements, for performance).

For the data loaders that are SQL scripts, we have a few options

• convert them to a simple, easy to maintain scripting language that can parse a CSV file (such as Python or Groovy)
• write standalone java apps to replace the existing SQL load scripts
• integrate loading the data in to the system (like we did with keyword file loading)