2010-06-21 03:37:27.403 (3) [main]: Debug Level set to 4 2010-06-21 03:37:27.420 (3) [main]: =============== Starting Warehouse Summarizer ================ 2010-06-21 03:37:27.420 (4) [main]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:27.421 (3) [main]: ----------------Warehouse Summarizer starting 2010-06-21 03:37:28.059 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:28.093 (4) [main]: spike: SQL->[select * from `tsacommon`.`accounts` where ((`tsacommon`.`accounts`.`isActive`="true")) order by `tsacommon`.`accounts`.`tier` asc,`tsacommon`.`accounts`.`priority` asc,`tsacommon`.`accounts`.`id` desc] 2010-06-21 03:37:28.307 (4) [main]: time=0.216 2010-06-21 03:37:28.308 (4) [main]: Query executed in 0.216s 2010-06-21 03:37:28.318 (4) [main]: DataCache: put key dwh 698 2010-06-21 03:37:28.318 (4) [main]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:28.704 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:28.711 (4) [main]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="dwh-1")) limit 1] 2010-06-21 03:37:28.716 (4) [main]: time=0.0040 2010-06-21 03:37:28.716 (4) [main]: Query executed in 0.004s 2010-06-21 03:37:28.717 (4) [main]: Record Loaded 2010-06-21 03:37:28.719 (4) [main]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:28.719 (4) [main]: DatabaseAccounts.getDatabaseName() returning "warehouse_1" 2010-06-21 03:37:28.776 (4) [main]: DataCache: put key dwh 690 2010-06-21 03:37:28.776 (4) [main]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:28.779 (4) [P1T1]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:28.783 (3) [P1T1]: DatabasePool with a limit of 80 created 2010-06-21 03:37:28.796 (4) [ConnectionCloser]: Starting DatabasePool ConnectionCloserThread 2010-06-21 03:37:28.820 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:28.821 (4) [main]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="dwh-1")) limit 1] 2010-06-21 03:37:28.828 (4) [main]: time=0.0070 2010-06-21 03:37:28.828 (4) [main]: Query executed in 0.007s 2010-06-21 03:37:28.830 (4) [main]: Record Loaded 2010-06-21 03:37:28.831 (4) [main]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:28.831 (4) [main]: DatabaseAccounts.getDatabaseName() returning "warehouse_1" 2010-06-21 03:37:28.834 (4) [main]: DataCache: put key dwh 687 2010-06-21 03:37:28.834 (4) [main]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:28.835 (4) [P1T2]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:28.858 (4) [P1T1]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:28.858 (4) [P1T1]: Created new Object 2010-06-21 03:37:28.859 (4) [P1T1]: perfsum: SQL->[select @@version] 2010-06-21 03:37:28.863 (4) [P1T1]: time=0.0040 2010-06-21 03:37:28.864 (4) [P1T1]: Query executed in 0.004s 2010-06-21 03:37:28.864 (4) [P1T1]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:28.865 (4) [P1T1]: perfsum: SQL->[select * from `tsacommon`.`accounts` where (`tsacommon`.`accounts`.`id`=698) limit 1] 2010-06-21 03:37:28.870 (4) [P1T1]: time=0.0050 2010-06-21 03:37:28.870 (4) [P1T1]: Query executed in 0.005s 2010-06-21 03:37:28.872 (4) [P1T1]: Record Loaded 2010-06-21 03:37:28.912 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:28.913 (4) [main]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="dwh-1")) limit 1] 2010-06-21 03:37:28.918 (4) [main]: time=0.0050 2010-06-21 03:37:28.919 (4) [main]: Query executed in 0.005s 2010-06-21 03:37:28.922 (4) [main]: Record Loaded 2010-06-21 03:37:28.923 (4) [main]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:28.924 (4) [main]: DatabaseAccounts.getDatabaseName() returning "warehouse_1" 2010-06-21 03:37:28.926 (4) [main]: DataCache: put key dwh 570 2010-06-21 03:37:28.927 (4) [main]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:28.927 (4) [P1T3]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:28.979 (4) [P1T2]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:28.979 (4) [P1T2]: Created new Object 2010-06-21 03:37:28.980 (4) [P1T2]: perfsum: SQL->[select @@version] 2010-06-21 03:37:28.985 (4) [P1T2]: time=0.0050 2010-06-21 03:37:28.986 (4) [P1T2]: Query executed in 0.005s 2010-06-21 03:37:28.986 (4) [P1T2]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:28.987 (4) [P1T2]: perfsum: SQL->[select * from `tsacommon`.`accounts` where (`tsacommon`.`accounts`.`id`=690) limit 1] 2010-06-21 03:37:29.002 (4) [P1T2]: time=0.015 2010-06-21 03:37:29.002 (4) [P1T2]: Query executed in 0.015s 2010-06-21 03:37:29.004 (4) [P1T2]: Record Loaded 2010-06-21 03:37:29.156 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:29.157 (4) [main]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="dwh-4")) limit 1] 2010-06-21 03:37:29.176 (4) [main]: time=0.019 2010-06-21 03:37:29.177 (4) [main]: Query executed in 0.019s 2010-06-21 03:37:29.178 (4) [main]: Record Loaded 2010-06-21 03:37:29.179 (4) [main]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:29.199 (4) [main]: DatabaseAccounts.getDatabaseName() returning "warehouse_4" 2010-06-21 03:37:29.206 (4) [main]: DataCache: put key dwh 542 2010-06-21 03:37:29.206 (4) [main]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:29.206 (4) [P1T4]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:29.209 (4) [P1T3]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:29.209 (4) [P1T3]: Created new Object 2010-06-21 03:37:29.209 (4) [P1T3]: perfsum: SQL->[select @@version] 2010-06-21 03:37:29.211 (4) [P1T3]: time=0.0020 2010-06-21 03:37:29.212 (4) [P1T3]: Query executed in 0.002s 2010-06-21 03:37:29.212 (4) [P1T3]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:29.213 (4) [P1T3]: perfsum: SQL->[select * from `tsacommon`.`accounts` where (`tsacommon`.`accounts`.`id`=687) limit 1] 2010-06-21 03:37:29.215 (4) [P1T3]: time=0.0020 2010-06-21 03:37:29.216 (4) [P1T3]: Query executed in 0.002s 2010-06-21 03:37:29.218 (4) [P1T3]: Record Loaded 2010-06-21 03:37:29.238 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:29.239 (4) [main]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="dwh-4")) limit 1] 2010-06-21 03:37:29.243 (4) [main]: time=0.0040 2010-06-21 03:37:29.244 (4) [main]: Query executed in 0.004s 2010-06-21 03:37:29.245 (4) [main]: Record Loaded 2010-06-21 03:37:29.245 (4) [main]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:29.246 (4) [main]: DatabaseAccounts.getDatabaseName() returning "warehouse_4" 2010-06-21 03:37:29.248 (4) [main]: DataCache: put key dwh 246 2010-06-21 03:37:29.249 (4) [main]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:29.249 (4) [P1T5]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:29.330 (4) [P1T4]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:29.331 (4) [P1T4]: Created new Object 2010-06-21 03:37:29.331 (4) [P1T4]: perfsum: SQL->[select @@version] 2010-06-21 03:37:29.336 (4) [P1T4]: time=0.0040 2010-06-21 03:37:29.336 (4) [P1T4]: Query executed in 0.004s 2010-06-21 03:37:29.336 (4) [P1T4]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:29.337 (4) [P1T4]: perfsum: SQL->[select * from `tsacommon`.`accounts` where (`tsacommon`.`accounts`.`id`=570) limit 1] 2010-06-21 03:37:29.340 (4) [P1T4]: time=0.0030 2010-06-21 03:37:29.340 (4) [P1T4]: Query executed in 0.003s 2010-06-21 03:37:29.343 (4) [P1T4]: Record Loaded 2010-06-21 03:37:29.355 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:29.356 (4) [main]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="dwh-3")) limit 1] 2010-06-21 03:37:29.362 (4) [main]: time=0.0060 2010-06-21 03:37:29.362 (4) [main]: Query executed in 0.006s 2010-06-21 03:37:29.373 (4) [main]: Record Loaded 2010-06-21 03:37:29.380 (4) [main]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:29.380 (4) [main]: DatabaseAccounts.getDatabaseName() returning "warehouse_3" 2010-06-21 03:37:29.387 (4) [main]: DataCache: put key dwh 245 2010-06-21 03:37:29.388 (4) [main]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:29.388 (4) [P1T6]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:29.442 (4) [P1T5]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:29.443 (4) [P1T5]: Created new Object 2010-06-21 03:37:29.446 (4) [P1T5]: perfsum: SQL->[select @@version] 2010-06-21 03:37:29.534 (4) [P1T5]: time=0.085 2010-06-21 03:37:29.543 (4) [P1T5]: Query executed in 0.085s 2010-06-21 03:37:29.546 (4) [P1T5]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:29.563 (4) [P1T5]: perfsum: SQL->[select * from `tsacommon`.`accounts` where (`tsacommon`.`accounts`.`id`=542) limit 1] 2010-06-21 03:37:29.569 (4) [P1T5]: time=0.0060 2010-06-21 03:37:29.569 (4) [P1T5]: Query executed in 0.006s 2010-06-21 03:37:29.571 (4) [P1T5]: Record Loaded 2010-06-21 03:37:29.604 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:29.605 (4) [main]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="dwh-3")) limit 1] 2010-06-21 03:37:29.610 (4) [main]: time=0.0050 2010-06-21 03:37:29.611 (4) [main]: Query executed in 0.005s 2010-06-21 03:37:29.611 (4) [main]: Record Loaded 2010-06-21 03:37:29.612 (4) [main]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:29.613 (4) [main]: DatabaseAccounts.getDatabaseName() returning "warehouse_3" 2010-06-21 03:37:29.616 (4) [main]: DataCache: put key dwh 244 2010-06-21 03:37:29.624 (4) [main]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:29.624 (4) [P1T7]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:29.629 (4) [P1T6]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:29.629 (4) [P1T6]: Created new Object 2010-06-21 03:37:29.629 (4) [P1T6]: perfsum: SQL->[select @@version] 2010-06-21 03:37:29.634 (4) [P1T6]: time=0.0050 2010-06-21 03:37:29.635 (4) [P1T6]: Query executed in 0.005s 2010-06-21 03:37:29.635 (4) [P1T6]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:29.635 (4) [P1T6]: perfsum: SQL->[select * from `tsacommon`.`accounts` where (`tsacommon`.`accounts`.`id`=246) limit 1] 2010-06-21 03:37:29.638 (4) [P1T6]: time=0.0030 2010-06-21 03:37:29.639 (4) [P1T6]: Query executed in 0.003s 2010-06-21 03:37:29.640 (4) [P1T6]: Record Loaded 2010-06-21 03:37:29.663 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:29.664 (4) [main]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="dwh-3")) limit 1] 2010-06-21 03:37:29.670 (4) [main]: time=0.0050 2010-06-21 03:37:29.670 (4) [main]: Query executed in 0.005s 2010-06-21 03:37:29.671 (4) [main]: Record Loaded 2010-06-21 03:37:29.671 (4) [main]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:29.672 (4) [main]: DatabaseAccounts.getDatabaseName() returning "warehouse_3" 2010-06-21 03:37:29.683 (4) [main]: DataCache: put key dwh 243 2010-06-21 03:37:29.683 (4) [main]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:29.683 (4) [P1T8]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:29.713 (4) [P1T7]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:29.713 (4) [P1T7]: Created new Object 2010-06-21 03:37:29.714 (4) [P1T7]: perfsum: SQL->[select @@version] 2010-06-21 03:37:29.718 (4) [P1T7]: time=0.0040 2010-06-21 03:37:29.719 (4) [P1T7]: Query executed in 0.004s 2010-06-21 03:37:29.719 (4) [P1T7]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:29.720 (4) [P1T7]: perfsum: SQL->[select * from `tsacommon`.`accounts` where (`tsacommon`.`accounts`.`id`=245) limit 1] 2010-06-21 03:37:29.723 (4) [P1T7]: time=0.0020 2010-06-21 03:37:29.723 (4) [P1T7]: Query executed in 0.002s 2010-06-21 03:37:29.724 (4) [P1T7]: Record Loaded 2010-06-21 03:37:29.739 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:29.744 (4) [main]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="dwh-3")) limit 1] 2010-06-21 03:37:29.747 (4) [main]: time=0.0020 2010-06-21 03:37:29.747 (4) [main]: Query executed in 0.002s 2010-06-21 03:37:29.747 (4) [main]: Record Loaded 2010-06-21 03:37:29.748 (4) [main]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:29.749 (4) [main]: DatabaseAccounts.getDatabaseName() returning "warehouse_3" 2010-06-21 03:37:29.750 (4) [main]: DataCache: put key dwh 240 2010-06-21 03:37:29.751 (4) [main]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:29.751 (4) [P1T9]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:29.835 (4) [P1T8]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:29.835 (4) [P1T8]: Created new Object 2010-06-21 03:37:29.836 (4) [P1T8]: perfsum: SQL->[select @@version] 2010-06-21 03:37:29.843 (4) [P1T8]: time=0.0070 2010-06-21 03:37:29.843 (4) [P1T8]: Query executed in 0.007s 2010-06-21 03:37:29.843 (4) [P1T8]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:29.844 (4) [P1T8]: perfsum: SQL->[select * from `tsacommon`.`accounts` where (`tsacommon`.`accounts`.`id`=244) limit 1] 2010-06-21 03:37:29.847 (4) [P1T8]: time=0.0030 2010-06-21 03:37:29.847 (4) [P1T8]: Query executed in 0.003s 2010-06-21 03:37:29.849 (4) [P1T8]: Record Loaded 2010-06-21 03:37:29.944 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:29.945 (4) [main]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="dwh-3")) limit 1] 2010-06-21 03:37:29.950 (4) [main]: time=0.0040 2010-06-21 03:37:29.950 (4) [main]: Query executed in 0.004s 2010-06-21 03:37:29.951 (4) [main]: Record Loaded 2010-06-21 03:37:30.181 (4) [main]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:30.182 (4) [main]: DatabaseAccounts.getDatabaseName() returning "warehouse_3" 2010-06-21 03:37:30.281 (4) [main]: DataCache: put key dwh 192 2010-06-21 03:37:30.281 (4) [main]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:30.282 (4) [P1T10]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:30.288 (4) [P1T9]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:30.288 (4) [P1T9]: Created new Object 2010-06-21 03:37:30.289 (4) [P1T9]: perfsum: SQL->[select @@version] 2010-06-21 03:37:30.291 (4) [P1T9]: time=0.0020 2010-06-21 03:37:30.291 (4) [P1T9]: Query executed in 0.002s 2010-06-21 03:37:30.291 (4) [P1T9]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:30.292 (4) [P1T9]: perfsum: SQL->[select * from `tsacommon`.`accounts` where (`tsacommon`.`accounts`.`id`=243) limit 1] 2010-06-21 03:37:30.295 (4) [P1T9]: time=0.0020 2010-06-21 03:37:30.295 (4) [P1T9]: Query executed in 0.002s 2010-06-21 03:37:30.296 (4) [P1T9]: Record Loaded 2010-06-21 03:37:30.309 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:30.310 (4) [main]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="dwh-3")) limit 1] 2010-06-21 03:37:30.316 (4) [main]: time=0.0050 2010-06-21 03:37:30.316 (4) [main]: Query executed in 0.005s 2010-06-21 03:37:30.316 (4) [main]: Record Loaded 2010-06-21 03:37:30.317 (4) [main]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:30.318 (4) [main]: DatabaseAccounts.getDatabaseName() returning "warehouse_3" 2010-06-21 03:37:30.319 (4) [main]: DataCache: put key dwh 158 2010-06-21 03:37:30.319 (4) [main]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:30.350 (4) [P1T10]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:30.350 (4) [P1T10]: Created new Object 2010-06-21 03:37:30.351 (4) [P1T9]: Returning Object to Pool 2010-06-21 03:37:30.351 (4) [P1T8]: Returning Object to Pool 2010-06-21 03:37:30.351 (4) [P1T7]: Returning Object to Pool 2010-06-21 03:37:30.351 (4) [P1T6]: Returning Object to Pool 2010-06-21 03:37:30.352 (4) [P1T5]: Returning Object to Pool 2010-06-21 03:37:30.352 (4) [P1T5]: isYesterday = true 2010-06-21 03:37:30.353 (4) [P1T5]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:30.354 (4) [P1T6]: isYesterday = true 2010-06-21 03:37:30.355 (4) [P1T6]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:30.358 (4) [P1T4]: Returning Object to Pool 2010-06-21 03:37:30.358 (4) [P1T4]: isYesterday = true 2010-06-21 03:37:30.358 (4) [P1T4]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:30.359 (4) [P1T3]: Returning Object to Pool 2010-06-21 03:37:30.359 (4) [P1T3]: isYesterday = true 2010-06-21 03:37:30.359 (4) [P1T3]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:30.360 (4) [P1T2]: Returning Object to Pool 2010-06-21 03:37:30.360 (4) [P1T2]: isYesterday = true 2010-06-21 03:37:30.361 (4) [P1T2]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:30.362 (4) [P1T1]: Returning Object to Pool 2010-06-21 03:37:30.362 (4) [P1T1]: isYesterday = true 2010-06-21 03:37:30.362 (4) [P1T1]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:30.362 (4) [P1T7]: isYesterday = true 2010-06-21 03:37:30.363 (4) [P1T7]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:30.667 (4) [P1T5]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:30.668 (4) [P1T5]: spike: SQL->[select * from `tsacommon`.`accounts` where (`id`=542) limit 1] 2010-06-21 03:37:30.668 (4) [P1T8]: isYesterday = true 2010-06-21 03:37:30.669 (4) [P1T8]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:30.670 (4) [P1T9]: isYesterday = true 2010-06-21 03:37:30.671 (4) [P1T5]: time=0.0030 2010-06-21 03:37:30.671 (4) [P1T5]: Query executed in 0.003s 2010-06-21 03:37:30.673 (4) [P1T5]: Record Loaded 2010-06-21 03:37:30.673 (4) [P1T5]: DataCache: put key acct-st-tracker 542 2010-06-21 03:37:30.673 (4) [P1T5]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="acct-st-tracker-1")) limit 1] 2010-06-21 03:37:30.686 (4) [P1T5]: time=0.013 2010-06-21 03:37:30.686 (4) [P1T5]: Query executed in 0.013s 2010-06-21 03:37:30.687 (4) [P1T5]: Record Loaded 2010-06-21 03:37:30.687 (4) [P1T5]: DataCache: put key acct-st-tracker-1 2010-06-21 03:37:30.688 (4) [P1T5]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:30.688 (3) [P1T5]: DatabasePool with a limit of 80 created 2010-06-21 03:37:31.255 (4) [P1T9]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:31.266 (4) [P1T10]: perfsum: SQL->[select @@version] 2010-06-21 03:37:31.270 (4) [P1T10]: time=0.0040 2010-06-21 03:37:31.271 (4) [P1T10]: Query executed in 0.004s 2010-06-21 03:37:31.271 (4) [P1T10]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:31.286 (4) [P1T10]: perfsum: SQL->[select * from `tsacommon`.`accounts` where (`tsacommon`.`accounts`.`id`=240) limit 1] 2010-06-21 03:37:31.385 (4) [P1T10]: time=0.097 2010-06-21 03:37:31.386 (4) [P1T10]: Query executed in 0.097s 2010-06-21 03:37:31.393 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:31.396 (4) [main]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="dwh-3")) limit 1] 2010-06-21 03:37:31.399 (4) [main]: time=0.0030 2010-06-21 03:37:31.401 (4) [main]: Query executed in 0.003s 2010-06-21 03:37:31.402 (4) [main]: Record Loaded 2010-06-21 03:37:31.404 (4) [main]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:31.409 (4) [P1T9]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:31.412 (4) [P1T9]: spike: SQL->[select * from `tsacommon`.`accounts` where (`id`=243) limit 1] 2010-06-21 03:37:31.414 (4) [main]: DatabaseAccounts.getDatabaseName() returning "warehouse_3" 2010-06-21 03:37:31.416 (4) [P1T9]: time=0.0030 2010-06-21 03:37:31.416 (4) [P1T9]: Query executed in 0.003s 2010-06-21 03:37:31.419 (4) [P1T9]: Record Loaded 2010-06-21 03:37:31.419 (4) [P1T9]: DataCache: put key acct-st-tracker 243 2010-06-21 03:37:31.487 (4) [P1T5]: opened [jdbc:mysql://acctdb-01-write:3306/st-tracker?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:31.491 (4) [P1T5]: Created new Object 2010-06-21 03:37:31.515 (4) [P1T5]: perfsum: SQL->[select @@version] 2010-06-21 03:37:31.563 (4) [P1T5]: time=0.044 2010-06-21 03:37:31.563 (4) [P1T5]: Query executed in 0.044s 2010-06-21 03:37:31.563 (4) [P1T5]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:31.563 (4) [P1T5]: DataCache: Found key dwh 542 2010-06-21 03:37:31.573 (4) [P1T9]: DataCache: Found key acct-st-tracker-1 2010-06-21 03:37:31.573 (4) [P1T5]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:31.574 (4) [P1T9]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:31.579 (4) [main]: DataCache: put key dwh 85 2010-06-21 03:37:31.580 (4) [main]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:31.580 (4) [P1T10]: Record Loaded 2010-06-21 03:37:31.581 (4) [P1T10]: Returning Object to Pool 2010-06-21 03:37:31.582 (4) [P1T10]: isYesterday = true 2010-06-21 03:37:31.582 (4) [P1T10]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:31.588 (4) [P1T8]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:31.589 (4) [P1T8]: spike: SQL->[select * from `tsacommon`.`accounts` where (`id`=244) limit 1] 2010-06-21 03:37:31.591 (4) [P1T8]: time=0.0020 2010-06-21 03:37:31.592 (4) [P1T8]: Query executed in 0.002s 2010-06-21 03:37:31.593 (4) [P1T8]: Record Loaded 2010-06-21 03:37:31.593 (4) [P1T8]: DataCache: put key acct-st-tracker 244 2010-06-21 03:37:31.593 (4) [P1T8]: DataCache: Found key acct-st-tracker-1 2010-06-21 03:37:31.594 (4) [P1T8]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:31.607 (4) [P1T10]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:31.686 (4) [P1T10]: spike: SQL->[select * from `tsacommon`.`accounts` where (`id`=240) limit 1] 2010-06-21 03:37:31.731 (4) [P1T10]: time=0.044 2010-06-21 03:37:31.731 (4) [P1T10]: Query executed in 0.044s 2010-06-21 03:37:31.733 (4) [P1T10]: Record Loaded 2010-06-21 03:37:31.736 (4) [P1T10]: DataCache: put key acct-st-tracker 240 2010-06-21 03:37:31.737 (4) [P1T10]: DataCache: Found key acct-st-tracker-1 2010-06-21 03:37:31.743 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:31.756 (4) [main]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="dwh-1")) limit 1] 2010-06-21 03:37:31.757 (4) [P1T10]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:31.760 (4) [main]: time=0.0040 2010-06-21 03:37:31.760 (4) [main]: Query executed in 0.004s 2010-06-21 03:37:31.774 (4) [P1T9]: opened [jdbc:mysql://acctdb-01-write:3306/st-tracker?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:31.775 (4) [P1T9]: Created new Object 2010-06-21 03:37:31.776 (4) [P1T9]: perfsum: SQL->[select @@version] 2010-06-21 03:37:31.778 (4) [main]: Record Loaded 2010-06-21 03:37:31.781 (4) [P1T9]: time=0.0030 2010-06-21 03:37:31.781 (4) [P1T9]: Query executed in 0.003s 2010-06-21 03:37:31.781 (4) [P1T9]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:31.781 (4) [P1T9]: DataCache: Found key dwh 243 2010-06-21 03:37:31.781 (4) [P1T9]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:31.784 (4) [P1T5]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:31.785 (4) [P1T5]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="dwh-4")) limit 1] 2010-06-21 03:37:31.802 (4) [P1T5]: time=0.017 2010-06-21 03:37:31.802 (4) [P1T5]: Query executed in 0.017s 2010-06-21 03:37:31.802 (4) [P1T5]: Record Loaded 2010-06-21 03:37:31.802 (4) [P1T5]: DataCache: put key dwh-4 2010-06-21 03:37:31.803 (4) [P1T5]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:31.803 (3) [P1T5]: DatabasePool with a limit of 80 created 2010-06-21 03:37:31.848 (4) [main]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:31.849 (4) [main]: DatabaseAccounts.getDatabaseName() returning "warehouse_1" 2010-06-21 03:37:31.850 (4) [main]: DataCache: put key dwh 67 2010-06-21 03:37:31.851 (4) [main]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:31.857 (4) [P1T9]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:31.858 (4) [P1T9]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="dwh-3")) limit 1] 2010-06-21 03:37:31.860 (4) [P1T9]: time=0.0020 2010-06-21 03:37:31.860 (4) [P1T9]: Query executed in 0.002s 2010-06-21 03:37:31.861 (4) [P1T9]: Record Loaded 2010-06-21 03:37:31.861 (4) [P1T9]: DataCache: put key dwh-3 2010-06-21 03:37:31.862 (4) [P1T9]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:31.862 (3) [P1T9]: DatabasePool with a limit of 80 created 2010-06-21 03:37:31.880 (4) [P1T10]: opened [jdbc:mysql://acctdb-01-write:3306/st-tracker?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:31.880 (4) [P1T10]: Created new Object 2010-06-21 03:37:31.881 (4) [P1T10]: perfsum: SQL->[select @@version] 2010-06-21 03:37:31.883 (4) [P1T10]: time=0.0020 2010-06-21 03:37:31.883 (4) [P1T10]: Query executed in 0.002s 2010-06-21 03:37:31.883 (4) [P1T10]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:31.884 (4) [P1T10]: DataCache: Found key dwh 240 2010-06-21 03:37:31.884 (4) [P1T10]: DataCache: Found key dwh-3 2010-06-21 03:37:34.894 (2) [P1T9]: Exception [creating pooled Database]:com.mysql.jdbc.CommunicationsException: Communications link failure due to underlying exception: ** BEGIN NESTED EXCEPTION ** java.net.SocketException MESSAGE: java.net.NoRouteToHostException: No route to host STACKTRACE: java.net.SocketException: java.net.NoRouteToHostException: No route to host at com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:156) at com.mysql.jdbc.MysqlIO.(MysqlIO.java:277) at com.mysql.jdbc.Connection.createNewIO(Connection.java:2668) at com.mysql.jdbc.Connection.(Connection.java:1531) at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266) at java.sql.DriverManager.getConnection(DriverManager.java:525) at java.sql.DriverManager.getConnection(DriverManager.java:171) at com.carldunham.jst.db.Database.init(Database.java:203) at com.carldunham.jst.db.Database.(Database.java:188) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:166) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:35) at com.carldunham.jst.pooling.ObjectPool.get(ObjectPool.java:88) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:96) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) ** END NESTED EXCEPTION ** Last packet sent to the server was 3 ms ago. at com.mysql.jdbc.Connection.createNewIO(Connection.java:2741) at com.mysql.jdbc.Connection.(Connection.java:1531) at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266) at java.sql.DriverManager.getConnection(DriverManager.java:525) at java.sql.DriverManager.getConnection(DriverManager.java:171) at com.carldunham.jst.db.Database.init(Database.java:203) at com.carldunham.jst.db.Database.(Database.java:188) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:166) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:35) at com.carldunham.jst.pooling.ObjectPool.get(ObjectPool.java:88) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:96) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) 2010-06-21 03:37:34.895 (4) [P1T9]: Created new Object 2010-06-21 03:37:34.897 (1) [P1T9]: Exception [Account #243 Catch All ]:java.lang.NullPointerException at java.util.concurrent.ConcurrentHashMap.hash(ConcurrentHashMap.java:157) at java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:903) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.update(DatabasePool.java:402) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.get(DatabasePool.java:417) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.access$000(DatabasePool.java:389) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:98) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) 2010-06-21 03:37:34.905 (4) [P1T8]: opened [jdbc:mysql://acctdb-01-write:3306/st-tracker?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:34.905 (4) [P1T8]: Created new Object 2010-06-21 03:37:34.905 (4) [P1T8]: perfsum: SQL->[select @@version] 2010-06-21 03:37:34.907 (4) [P1T8]: time=0.0020 2010-06-21 03:37:34.907 (4) [P1T8]: Query executed in 0.002s 2010-06-21 03:37:34.907 (4) [P1T8]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:34.908 (4) [P1T8]: DataCache: Found key dwh 244 2010-06-21 03:37:34.908 (4) [P1T8]: DataCache: Found key dwh-3 2010-06-21 03:37:34.908 (4) [P1T9]: Returning Object to Pool 2010-06-21 03:37:34.909 (4) [P1T9]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:34.909 (4) [P1T9]: Took Existing Object from Pool 2010-06-21 03:37:34.909 (4) [P1T9]: perfsum: SQL->[select @@version] 2010-06-21 03:37:34.914 (4) [P1T9]: time=0.0050 2010-06-21 03:37:34.914 (4) [P1T9]: Query executed in 0.005s 2010-06-21 03:37:34.914 (4) [P1T9]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:34.915 (4) [P1T9]: perfsum: SQL->[select * from `tsacommon`.`accounts` where (`tsacommon`.`accounts`.`id`=192) limit 1] 2010-06-21 03:37:34.918 (4) [P1T9]: time=0.0030 2010-06-21 03:37:34.919 (4) [P1T9]: Query executed in 0.003s 2010-06-21 03:37:34.984 (4) [P1T9]: Record Loaded 2010-06-21 03:37:34.985 (4) [P1T9]: Returning Object to Pool 2010-06-21 03:37:34.985 (4) [P1T9]: isYesterday = true 2010-06-21 03:37:34.986 (4) [P1T9]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:37.918 (2) [P1T10]: Exception [creating pooled Database]:com.mysql.jdbc.CommunicationsException: Communications link failure due to underlying exception: ** BEGIN NESTED EXCEPTION ** java.net.SocketException MESSAGE: java.net.NoRouteToHostException: No route to host STACKTRACE: java.net.SocketException: java.net.NoRouteToHostException: No route to host at com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:156) at com.mysql.jdbc.MysqlIO.(MysqlIO.java:277) at com.mysql.jdbc.Connection.createNewIO(Connection.java:2668) at com.mysql.jdbc.Connection.(Connection.java:1531) at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266) at java.sql.DriverManager.getConnection(DriverManager.java:525) at java.sql.DriverManager.getConnection(DriverManager.java:171) at com.carldunham.jst.db.Database.init(Database.java:203) at com.carldunham.jst.db.Database.(Database.java:188) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:166) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:35) at com.carldunham.jst.pooling.ObjectPool.get(ObjectPool.java:88) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:96) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) ** END NESTED EXCEPTION ** Last packet sent to the server was 1 ms ago. at com.mysql.jdbc.Connection.createNewIO(Connection.java:2741) at com.mysql.jdbc.Connection.(Connection.java:1531) at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266) at java.sql.DriverManager.getConnection(DriverManager.java:525) at java.sql.DriverManager.getConnection(DriverManager.java:171) at com.carldunham.jst.db.Database.init(Database.java:203) at com.carldunham.jst.db.Database.(Database.java:188) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:166) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:35) at com.carldunham.jst.pooling.ObjectPool.get(ObjectPool.java:88) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:96) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) 2010-06-21 03:37:37.918 (4) [P1T10]: Created new Object 2010-06-21 03:37:37.919 (1) [P1T10]: Exception [Account #240 Catch All ]:java.lang.NullPointerException at java.util.concurrent.ConcurrentHashMap.hash(ConcurrentHashMap.java:157) at java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:903) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.update(DatabasePool.java:402) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.get(DatabasePool.java:417) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.access$000(DatabasePool.java:389) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:98) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) 2010-06-21 03:37:37.935 (4) [P1T10]: Returning Object to Pool 2010-06-21 03:37:37.936 (4) [P1T10]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:37.936 (4) [P1T10]: Took Existing Object from Pool 2010-06-21 03:37:37.936 (4) [P1T10]: perfsum: SQL->[select @@version] 2010-06-21 03:37:37.945 (4) [P1T10]: time=0.0090 2010-06-21 03:37:37.945 (4) [P1T10]: Query executed in 0.009s 2010-06-21 03:37:37.946 (4) [P1T10]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:37.946 (4) [P1T10]: perfsum: SQL->[select * from `tsacommon`.`accounts` where (`tsacommon`.`accounts`.`id`=158) limit 1] 2010-06-21 03:37:37.955 (4) [P1T10]: time=0.0090 2010-06-21 03:37:37.955 (4) [P1T10]: Query executed in 0.009s 2010-06-21 03:37:37.956 (4) [P1T10]: Record Loaded 2010-06-21 03:37:37.957 (4) [P1T10]: Returning Object to Pool 2010-06-21 03:37:37.957 (4) [P1T10]: isYesterday = true 2010-06-21 03:37:37.957 (4) [P1T10]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:38.010 (4) [P1T9]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:38.010 (4) [P1T9]: spike: SQL->[select * from `tsacommon`.`accounts` where (`id`=192) limit 1] 2010-06-21 03:37:38.013 (4) [P1T9]: time=0.0030 2010-06-21 03:37:38.013 (4) [P1T9]: Query executed in 0.003s 2010-06-21 03:37:38.014 (4) [P1T9]: Record Loaded 2010-06-21 03:37:38.014 (4) [P1T9]: DataCache: put key acct-st-tracker 192 2010-06-21 03:37:38.014 (4) [P1T9]: DataCache: Found key acct-st-tracker-1 2010-06-21 03:37:38.014 (4) [P1T9]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:38.015 (4) [P1T9]: Took Existing Object from Pool 2010-06-21 03:37:38.015 (4) [P1T9]: perfsum: SQL->[select @@version] 2010-06-21 03:37:38.034 (4) [P1T9]: time=0.019 2010-06-21 03:37:38.035 (4) [P1T9]: Query executed in 0.019s 2010-06-21 03:37:38.035 (4) [P1T9]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:38.035 (4) [P1T9]: DataCache: Found key dwh 192 2010-06-21 03:37:38.035 (4) [P1T9]: DataCache: Found key dwh-3 2010-06-21 03:37:38.071 (4) [P1T10]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:38.071 (4) [P1T10]: spike: SQL->[select * from `tsacommon`.`accounts` where (`id`=158) limit 1] 2010-06-21 03:37:38.073 (4) [P1T10]: time=0.0020 2010-06-21 03:37:38.074 (4) [P1T10]: Query executed in 0.002s 2010-06-21 03:37:38.074 (4) [P1T10]: Record Loaded 2010-06-21 03:37:38.074 (4) [P1T10]: DataCache: put key acct-st-tracker 158 2010-06-21 03:37:38.075 (4) [P1T10]: DataCache: Found key acct-st-tracker-1 2010-06-21 03:37:38.075 (4) [P1T10]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:38.075 (4) [P1T10]: Took Existing Object from Pool 2010-06-21 03:37:38.076 (4) [P1T10]: perfsum: SQL->[select @@version] 2010-06-21 03:37:38.077 (4) [P1T10]: time=0.0010 2010-06-21 03:37:38.078 (4) [P1T10]: Query executed in 0.001s 2010-06-21 03:37:38.078 (4) [P1T10]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:38.078 (4) [P1T10]: DataCache: Found key dwh 158 2010-06-21 03:37:38.078 (4) [P1T10]: DataCache: Found key dwh-3 2010-06-21 03:37:41.096 (2) [P1T8]: Exception [creating pooled Database]:com.mysql.jdbc.CommunicationsException: Communications link failure due to underlying exception: ** BEGIN NESTED EXCEPTION ** java.net.SocketException MESSAGE: java.net.NoRouteToHostException: No route to host STACKTRACE: java.net.SocketException: java.net.NoRouteToHostException: No route to host at com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:156) at com.mysql.jdbc.MysqlIO.(MysqlIO.java:277) at com.mysql.jdbc.Connection.createNewIO(Connection.java:2668) at com.mysql.jdbc.Connection.(Connection.java:1531) at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266) at java.sql.DriverManager.getConnection(DriverManager.java:525) at java.sql.DriverManager.getConnection(DriverManager.java:171) at com.carldunham.jst.db.Database.init(Database.java:203) at com.carldunham.jst.db.Database.(Database.java:188) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:166) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:35) at com.carldunham.jst.pooling.ObjectPool.get(ObjectPool.java:88) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:96) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) ** END NESTED EXCEPTION ** Last packet sent to the server was 1 ms ago. at com.mysql.jdbc.Connection.createNewIO(Connection.java:2741) at com.mysql.jdbc.Connection.(Connection.java:1531) at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266) at java.sql.DriverManager.getConnection(DriverManager.java:525) at java.sql.DriverManager.getConnection(DriverManager.java:171) at com.carldunham.jst.db.Database.init(Database.java:203) at com.carldunham.jst.db.Database.(Database.java:188) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:166) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:35) at com.carldunham.jst.pooling.ObjectPool.get(ObjectPool.java:88) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:96) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) 2010-06-21 03:37:41.098 (4) [P1T8]: Created new Object 2010-06-21 03:37:41.099 (1) [P1T8]: Exception [Account #244 Catch All ]:java.lang.NullPointerException at java.util.concurrent.ConcurrentHashMap.hash(ConcurrentHashMap.java:157) at java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:903) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.update(DatabasePool.java:402) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.get(DatabasePool.java:417) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.access$000(DatabasePool.java:389) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:98) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) 2010-06-21 03:37:41.099 (4) [P1T8]: Returning Object to Pool 2010-06-21 03:37:41.099 (4) [P1T8]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:41.100 (4) [P1T8]: Took Existing Object from Pool 2010-06-21 03:37:41.100 (4) [P1T8]: perfsum: SQL->[select @@version] 2010-06-21 03:37:41.103 (4) [P1T8]: time=0.0020 2010-06-21 03:37:41.103 (4) [P1T8]: Query executed in 0.002s 2010-06-21 03:37:41.104 (4) [P1T8]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:41.104 (4) [P1T8]: perfsum: SQL->[select * from `tsacommon`.`accounts` where (`tsacommon`.`accounts`.`id`=85) limit 1] 2010-06-21 03:37:41.112 (4) [P1T8]: time=0.0080 2010-06-21 03:37:41.112 (4) [P1T8]: Query executed in 0.008s 2010-06-21 03:37:41.113 (4) [P1T8]: Record Loaded 2010-06-21 03:37:41.113 (4) [P1T8]: Returning Object to Pool 2010-06-21 03:37:41.114 (4) [P1T8]: isYesterday = true 2010-06-21 03:37:41.114 (4) [P1T8]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:44.133 (2) [P1T10]: Exception [creating pooled Database]:com.mysql.jdbc.CommunicationsException: Communications link failure due to underlying exception: ** BEGIN NESTED EXCEPTION ** java.net.SocketException MESSAGE: java.net.NoRouteToHostException: No route to host STACKTRACE: java.net.SocketException: java.net.NoRouteToHostException: No route to host at com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:156) at com.mysql.jdbc.MysqlIO.(MysqlIO.java:277) at com.mysql.jdbc.Connection.createNewIO(Connection.java:2668) at com.mysql.jdbc.Connection.(Connection.java:1531) at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266) at java.sql.DriverManager.getConnection(DriverManager.java:525) at java.sql.DriverManager.getConnection(DriverManager.java:171) at com.carldunham.jst.db.Database.init(Database.java:203) at com.carldunham.jst.db.Database.(Database.java:188) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:166) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:35) at com.carldunham.jst.pooling.ObjectPool.get(ObjectPool.java:88) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:96) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) ** END NESTED EXCEPTION ** Last packet sent to the server was 0 ms ago. at com.mysql.jdbc.Connection.createNewIO(Connection.java:2741) at com.mysql.jdbc.Connection.(Connection.java:1531) at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266) at java.sql.DriverManager.getConnection(DriverManager.java:525) at java.sql.DriverManager.getConnection(DriverManager.java:171) at com.carldunham.jst.db.Database.init(Database.java:203) at com.carldunham.jst.db.Database.(Database.java:188) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:166) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:35) at com.carldunham.jst.pooling.ObjectPool.get(ObjectPool.java:88) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:96) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) 2010-06-21 03:37:44.133 (4) [P1T10]: Created new Object 2010-06-21 03:37:44.134 (1) [P1T10]: Exception [Account #158 Catch All ]:java.lang.NullPointerException at java.util.concurrent.ConcurrentHashMap.hash(ConcurrentHashMap.java:157) at java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:903) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.update(DatabasePool.java:402) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.get(DatabasePool.java:417) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.access$000(DatabasePool.java:389) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:98) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) 2010-06-21 03:37:44.134 (4) [P1T10]: Returning Object to Pool 2010-06-21 03:37:47.142 (2) [P1T9]: Exception [creating pooled Database]:com.mysql.jdbc.CommunicationsException: Communications link failure due to underlying exception: ** BEGIN NESTED EXCEPTION ** java.net.SocketException MESSAGE: java.net.NoRouteToHostException: No route to host STACKTRACE: java.net.SocketException: java.net.NoRouteToHostException: No route to host at com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:156) at com.mysql.jdbc.MysqlIO.(MysqlIO.java:277) at com.mysql.jdbc.Connection.createNewIO(Connection.java:2668) at com.mysql.jdbc.Connection.(Connection.java:1531) at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266) at java.sql.DriverManager.getConnection(DriverManager.java:525) at java.sql.DriverManager.getConnection(DriverManager.java:171) at com.carldunham.jst.db.Database.init(Database.java:203) at com.carldunham.jst.db.Database.(Database.java:188) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:166) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:35) at com.carldunham.jst.pooling.ObjectPool.get(ObjectPool.java:88) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:96) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) ** END NESTED EXCEPTION ** Last packet sent to the server was 1 ms ago. at com.mysql.jdbc.Connection.createNewIO(Connection.java:2741) at com.mysql.jdbc.Connection.(Connection.java:1531) at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266) at java.sql.DriverManager.getConnection(DriverManager.java:525) at java.sql.DriverManager.getConnection(DriverManager.java:171) at com.carldunham.jst.db.Database.init(Database.java:203) at com.carldunham.jst.db.Database.(Database.java:188) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:166) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:35) at com.carldunham.jst.pooling.ObjectPool.get(ObjectPool.java:88) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:96) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) 2010-06-21 03:37:47.142 (4) [P1T9]: Created new Object 2010-06-21 03:37:47.143 (1) [P1T9]: Exception [Account #192 Catch All ]:java.lang.NullPointerException at java.util.concurrent.ConcurrentHashMap.hash(ConcurrentHashMap.java:157) at java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:903) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.update(DatabasePool.java:402) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.get(DatabasePool.java:417) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.access$000(DatabasePool.java:389) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:98) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) 2010-06-21 03:37:47.143 (4) [P1T9]: Returning Object to Pool 2010-06-21 03:37:47.259 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:47.261 (4) [main]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="dwh-1")) limit 1] 2010-06-21 03:37:47.265 (4) [main]: time=0.0040 2010-06-21 03:37:47.267 (4) [main]: Query executed in 0.004s 2010-06-21 03:37:47.267 (4) [main]: Record Loaded 2010-06-21 03:37:47.267 (4) [main]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:47.268 (4) [main]: DatabaseAccounts.getDatabaseName() returning "warehouse_1" 2010-06-21 03:37:47.268 (4) [P1T10]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:47.268 (4) [P1T10]: Took Existing Object from Pool 2010-06-21 03:37:47.269 (4) [P1T10]: perfsum: SQL->[select @@version] 2010-06-21 03:37:47.272 (4) [P1T8]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:47.272 (4) [P1T8]: spike: SQL->[select * from `tsacommon`.`accounts` where (`id`=85) limit 1] 2010-06-21 03:37:47.273 (4) [P1T10]: time=0.0040 2010-06-21 03:37:47.274 (4) [P1T10]: Query executed in 0.004s 2010-06-21 03:37:47.274 (4) [P1T10]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:47.274 (4) [P1T10]: perfsum: SQL->[select * from `tsacommon`.`accounts` where (`tsacommon`.`accounts`.`id`=67) limit 1] 2010-06-21 03:37:47.276 (4) [P1T8]: time=0.0040 2010-06-21 03:37:47.277 (4) [P1T8]: Query executed in 0.004s 2010-06-21 03:37:47.277 (4) [P1T10]: time=0.0030 2010-06-21 03:37:47.277 (4) [P1T10]: Query executed in 0.003s 2010-06-21 03:37:47.278 (4) [P1T8]: Record Loaded 2010-06-21 03:37:47.278 (4) [P1T8]: DataCache: put key acct-st-tracker 85 2010-06-21 03:37:47.278 (4) [P1T8]: DataCache: Found key acct-st-tracker-1 2010-06-21 03:37:47.279 (4) [P1T8]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:47.279 (4) [P1T8]: Took Existing Object from Pool 2010-06-21 03:37:47.279 (4) [P1T8]: perfsum: SQL->[select @@version] 2010-06-21 03:37:47.281 (4) [P1T8]: time=0.0020 2010-06-21 03:37:47.281 (4) [P1T8]: Query executed in 0.002s 2010-06-21 03:37:47.281 (4) [P1T8]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:47.282 (4) [P1T8]: DataCache: Found key dwh 85 2010-06-21 03:37:47.282 (4) [P1T8]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:47.313 (4) [P1T10]: Record Loaded 2010-06-21 03:37:47.314 (4) [P1T10]: Returning Object to Pool 2010-06-21 03:37:47.314 (4) [P1T10]: isYesterday = true 2010-06-21 03:37:47.314 (4) [P1T10]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:47.315 (4) [main]: DataCache: put key dwh 553 2010-06-21 03:37:47.315 (4) [main]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:50.324 (2) [P1T5]: Exception [creating pooled Database]:com.mysql.jdbc.CommunicationsException: Communications link failure due to underlying exception: ** BEGIN NESTED EXCEPTION ** java.net.SocketException MESSAGE: java.net.NoRouteToHostException: No route to host STACKTRACE: java.net.SocketException: java.net.NoRouteToHostException: No route to host at com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:156) at com.mysql.jdbc.MysqlIO.(MysqlIO.java:277) at com.mysql.jdbc.Connection.createNewIO(Connection.java:2668) at com.mysql.jdbc.Connection.(Connection.java:1531) at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266) at java.sql.DriverManager.getConnection(DriverManager.java:525) at java.sql.DriverManager.getConnection(DriverManager.java:171) at com.carldunham.jst.db.Database.init(Database.java:203) at com.carldunham.jst.db.Database.(Database.java:188) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:166) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:35) at com.carldunham.jst.pooling.ObjectPool.get(ObjectPool.java:88) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:96) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) ** END NESTED EXCEPTION ** Last packet sent to the server was 1 ms ago. at com.mysql.jdbc.Connection.createNewIO(Connection.java:2741) at com.mysql.jdbc.Connection.(Connection.java:1531) at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266) at java.sql.DriverManager.getConnection(DriverManager.java:525) at java.sql.DriverManager.getConnection(DriverManager.java:171) at com.carldunham.jst.db.Database.init(Database.java:203) at com.carldunham.jst.db.Database.(Database.java:188) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:166) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:35) at com.carldunham.jst.pooling.ObjectPool.get(ObjectPool.java:88) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:96) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) 2010-06-21 03:37:50.324 (4) [P1T5]: Created new Object 2010-06-21 03:37:50.325 (1) [P1T5]: Exception [Account #542 Catch All ]:java.lang.NullPointerException at java.util.concurrent.ConcurrentHashMap.hash(ConcurrentHashMap.java:157) at java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:903) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.update(DatabasePool.java:402) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.get(DatabasePool.java:417) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.access$000(DatabasePool.java:389) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:98) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) 2010-06-21 03:37:50.325 (4) [P1T5]: Returning Object to Pool 2010-06-21 03:37:50.342 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:50.345 (4) [main]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="dwh-4")) limit 1] 2010-06-21 03:37:50.348 (4) [main]: time=0.0030 2010-06-21 03:37:50.350 (4) [main]: Query executed in 0.003s 2010-06-21 03:37:50.350 (4) [main]: Record Loaded 2010-06-21 03:37:50.350 (4) [main]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:50.350 (4) [main]: DatabaseAccounts.getDatabaseName() returning "warehouse_4" 2010-06-21 03:37:50.351 (4) [P1T9]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:50.351 (4) [P1T9]: Took Existing Object from Pool 2010-06-21 03:37:50.351 (4) [P1T9]: perfsum: SQL->[select @@version] 2010-06-21 03:37:50.372 (4) [P1T9]: time=0.021 2010-06-21 03:37:50.372 (4) [P1T9]: Query executed in 0.021s 2010-06-21 03:37:50.373 (4) [P1T9]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:50.373 (4) [P1T9]: perfsum: SQL->[select * from `tsacommon`.`accounts` where (`tsacommon`.`accounts`.`id`=553) limit 1] 2010-06-21 03:37:50.381 (4) [P1T9]: time=0.0070 2010-06-21 03:37:50.381 (4) [P1T9]: Query executed in 0.007s 2010-06-21 03:37:50.381 (4) [P1T9]: Record Loaded 2010-06-21 03:37:50.382 (4) [P1T9]: Returning Object to Pool 2010-06-21 03:37:50.382 (4) [P1T9]: isYesterday = true 2010-06-21 03:37:50.382 (4) [P1T9]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:50.384 (4) [P1T10]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:50.385 (4) [P1T10]: spike: SQL->[select * from `tsacommon`.`accounts` where (`id`=67) limit 1] 2010-06-21 03:37:50.389 (4) [main]: DataCache: put key dwh 314 2010-06-21 03:37:50.389 (4) [P1T10]: time=0.0040 2010-06-21 03:37:50.389 (4) [P1T10]: Query executed in 0.004s 2010-06-21 03:37:50.391 (4) [P1T10]: Record Loaded 2010-06-21 03:37:50.391 (4) [P1T10]: DataCache: put key acct-st-tracker 67 2010-06-21 03:37:50.391 (4) [P1T10]: DataCache: Found key acct-st-tracker-1 2010-06-21 03:37:50.392 (4) [P1T10]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:50.392 (4) [P1T10]: Took Existing Object from Pool 2010-06-21 03:37:50.392 (4) [P1T10]: perfsum: SQL->[select @@version] 2010-06-21 03:37:50.392 (4) [main]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:50.396 (4) [P1T10]: time=0.0040 2010-06-21 03:37:50.396 (4) [P1T10]: Query executed in 0.004s 2010-06-21 03:37:50.396 (4) [P1T10]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:50.402 (4) [P1T10]: DataCache: Found key dwh 67 2010-06-21 03:37:50.403 (4) [P1T10]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:50.403 (4) [P1T9]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:50.404 (4) [P1T9]: spike: SQL->[select * from `tsacommon`.`accounts` where (`id`=553) limit 1] 2010-06-21 03:37:50.408 (4) [P1T9]: time=0.0030 2010-06-21 03:37:50.408 (4) [P1T9]: Query executed in 0.003s 2010-06-21 03:37:50.409 (4) [P1T9]: Record Loaded 2010-06-21 03:37:50.409 (4) [P1T9]: DataCache: put key acct-st-tracker 553 2010-06-21 03:37:50.409 (4) [P1T9]: DataCache: Found key acct-st-tracker-1 2010-06-21 03:37:50.409 (4) [P1T9]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:50.410 (4) [P1T9]: Took Existing Object from Pool 2010-06-21 03:37:50.410 (4) [P1T9]: perfsum: SQL->[select @@version] 2010-06-21 03:37:50.412 (4) [P1T9]: time=0.0020 2010-06-21 03:37:50.412 (4) [P1T9]: Query executed in 0.002s 2010-06-21 03:37:50.412 (4) [P1T9]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:50.412 (4) [P1T9]: DataCache: Found key dwh 553 2010-06-21 03:37:50.413 (4) [P1T9]: DataCache: Found key dwh-4 2010-06-21 03:37:50.536 (4) [P1T10]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:50.569 (4) [P1T10]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="dwh-1")) limit 1] 2010-06-21 03:37:50.580 (4) [P1T10]: time=0.01 2010-06-21 03:37:50.580 (4) [P1T10]: Query executed in 0.010s 2010-06-21 03:37:50.580 (4) [P1T10]: Record Loaded 2010-06-21 03:37:50.580 (4) [P1T10]: DataCache: put key dwh-1 2010-06-21 03:37:50.581 (4) [P1T10]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:50.581 (3) [P1T10]: DatabasePool with a limit of 80 created 2010-06-21 03:37:53.583 (2) [P1T9]: Exception [creating pooled Database]:com.mysql.jdbc.CommunicationsException: Communications link failure due to underlying exception: ** BEGIN NESTED EXCEPTION ** java.net.SocketException MESSAGE: java.net.NoRouteToHostException: No route to host STACKTRACE: java.net.SocketException: java.net.NoRouteToHostException: No route to host at com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:156) at com.mysql.jdbc.MysqlIO.(MysqlIO.java:277) at com.mysql.jdbc.Connection.createNewIO(Connection.java:2668) at com.mysql.jdbc.Connection.(Connection.java:1531) at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266) at java.sql.DriverManager.getConnection(DriverManager.java:525) at java.sql.DriverManager.getConnection(DriverManager.java:171) at com.carldunham.jst.db.Database.init(Database.java:203) at com.carldunham.jst.db.Database.(Database.java:188) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:166) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:35) at com.carldunham.jst.pooling.ObjectPool.get(ObjectPool.java:88) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:96) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) ** END NESTED EXCEPTION ** Last packet sent to the server was 15 ms ago. at com.mysql.jdbc.Connection.createNewIO(Connection.java:2741) at com.mysql.jdbc.Connection.(Connection.java:1531) at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266) at java.sql.DriverManager.getConnection(DriverManager.java:525) at java.sql.DriverManager.getConnection(DriverManager.java:171) at com.carldunham.jst.db.Database.init(Database.java:203) at com.carldunham.jst.db.Database.(Database.java:188) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:166) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:35) at com.carldunham.jst.pooling.ObjectPool.get(ObjectPool.java:88) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:96) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) 2010-06-21 03:37:53.583 (4) [P1T9]: Created new Object 2010-06-21 03:37:53.584 (1) [P1T9]: Exception [Account #553 Catch All ]:java.lang.NullPointerException at java.util.concurrent.ConcurrentHashMap.hash(ConcurrentHashMap.java:157) at java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:903) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.update(DatabasePool.java:402) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.get(DatabasePool.java:417) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.access$000(DatabasePool.java:389) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:98) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) 2010-06-21 03:37:53.584 (4) [P1T9]: Returning Object to Pool 2010-06-21 03:37:56.591 (2) [P1T10]: Exception [creating pooled Database]:com.mysql.jdbc.CommunicationsException: Communications link failure due to underlying exception: ** BEGIN NESTED EXCEPTION ** java.net.SocketException MESSAGE: java.net.NoRouteToHostException: No route to host STACKTRACE: java.net.SocketException: java.net.NoRouteToHostException: No route to host at com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:156) at com.mysql.jdbc.MysqlIO.(MysqlIO.java:277) at com.mysql.jdbc.Connection.createNewIO(Connection.java:2668) at com.mysql.jdbc.Connection.(Connection.java:1531) at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266) at java.sql.DriverManager.getConnection(DriverManager.java:525) at java.sql.DriverManager.getConnection(DriverManager.java:171) at com.carldunham.jst.db.Database.init(Database.java:203) at com.carldunham.jst.db.Database.(Database.java:188) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:166) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:35) at com.carldunham.jst.pooling.ObjectPool.get(ObjectPool.java:88) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:96) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) ** END NESTED EXCEPTION ** Last packet sent to the server was 1 ms ago. at com.mysql.jdbc.Connection.createNewIO(Connection.java:2741) at com.mysql.jdbc.Connection.(Connection.java:1531) at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266) at java.sql.DriverManager.getConnection(DriverManager.java:525) at java.sql.DriverManager.getConnection(DriverManager.java:171) at com.carldunham.jst.db.Database.init(Database.java:203) at com.carldunham.jst.db.Database.(Database.java:188) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:166) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:35) at com.carldunham.jst.pooling.ObjectPool.get(ObjectPool.java:88) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:96) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) 2010-06-21 03:37:56.591 (4) [P1T10]: Created new Object 2010-06-21 03:37:56.592 (1) [P1T10]: Exception [Account #67 Catch All ]:java.lang.NullPointerException at java.util.concurrent.ConcurrentHashMap.hash(ConcurrentHashMap.java:157) at java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:903) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.update(DatabasePool.java:402) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.get(DatabasePool.java:417) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.access$000(DatabasePool.java:389) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:98) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) 2010-06-21 03:37:56.592 (4) [P1T10]: Returning Object to Pool 2010-06-21 03:37:56.817 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:56.820 (4) [main]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="dwh-1")) limit 1] 2010-06-21 03:37:56.825 (4) [main]: time=0.0050 2010-06-21 03:37:56.825 (4) [main]: Query executed in 0.005s 2010-06-21 03:37:56.825 (4) [main]: Record Loaded 2010-06-21 03:37:56.826 (4) [main]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:56.826 (4) [main]: DatabaseAccounts.getDatabaseName() returning "warehouse_1" 2010-06-21 03:37:56.826 (4) [P1T5]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:56.827 (4) [P1T5]: Took Existing Object from Pool 2010-06-21 03:37:56.827 (4) [P1T5]: perfsum: SQL->[select @@version] 2010-06-21 03:37:56.829 (4) [P1T8]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:56.830 (4) [P1T8]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="dwh-1")) limit 1] 2010-06-21 03:37:56.831 (4) [P1T5]: time=0.0040 2010-06-21 03:37:56.831 (4) [P1T5]: Query executed in 0.004s 2010-06-21 03:37:56.831 (4) [P1T5]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:56.831 (4) [P1T5]: perfsum: SQL->[select * from `tsacommon`.`accounts` where (`tsacommon`.`accounts`.`id`=314) limit 1] 2010-06-21 03:37:56.839 (4) [P1T8]: time=0.0090 2010-06-21 03:37:56.839 (4) [P1T8]: Query executed in 0.009s 2010-06-21 03:37:56.839 (4) [P1T8]: Record Loaded 2010-06-21 03:37:56.839 (4) [P1T8]: DataCache: put key dwh-1 2010-06-21 03:37:56.840 (4) [P1T8]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:56.847 (4) [P1T5]: time=0.016 2010-06-21 03:37:56.847 (4) [P1T5]: Query executed in 0.016s 2010-06-21 03:37:56.850 (4) [P1T5]: Record Loaded 2010-06-21 03:37:56.864 (4) [P1T5]: Returning Object to Pool 2010-06-21 03:37:56.866 (4) [P1T5]: isYesterday = true 2010-06-21 03:37:56.866 (4) [P1T5]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:56.874 (4) [main]: DataCache: put key dwh 307 2010-06-21 03:37:56.876 (4) [main]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:58.802 (4) [ConnectionCloser]: 5 DatabasePools remaining : 3 pending closure 2010-06-21 03:37:59.878 (2) [P1T8]: Exception [creating pooled Database]:com.mysql.jdbc.CommunicationsException: Communications link failure due to underlying exception: ** BEGIN NESTED EXCEPTION ** java.net.SocketException MESSAGE: java.net.NoRouteToHostException: No route to host STACKTRACE: java.net.SocketException: java.net.NoRouteToHostException: No route to host at com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:156) at com.mysql.jdbc.MysqlIO.(MysqlIO.java:277) at com.mysql.jdbc.Connection.createNewIO(Connection.java:2668) at com.mysql.jdbc.Connection.(Connection.java:1531) at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266) at java.sql.DriverManager.getConnection(DriverManager.java:525) at java.sql.DriverManager.getConnection(DriverManager.java:171) at com.carldunham.jst.db.Database.init(Database.java:203) at com.carldunham.jst.db.Database.(Database.java:188) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:166) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:35) at com.carldunham.jst.pooling.ObjectPool.get(ObjectPool.java:88) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:96) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) ** END NESTED EXCEPTION ** Last packet sent to the server was 0 ms ago. at com.mysql.jdbc.Connection.createNewIO(Connection.java:2741) at com.mysql.jdbc.Connection.(Connection.java:1531) at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266) at java.sql.DriverManager.getConnection(DriverManager.java:525) at java.sql.DriverManager.getConnection(DriverManager.java:171) at com.carldunham.jst.db.Database.init(Database.java:203) at com.carldunham.jst.db.Database.(Database.java:188) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:166) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:35) at com.carldunham.jst.pooling.ObjectPool.get(ObjectPool.java:88) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:96) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) 2010-06-21 03:37:59.878 (4) [P1T8]: Created new Object 2010-06-21 03:37:59.878 (1) [P1T8]: Exception [Account #85 Catch All ]:java.lang.NullPointerException at java.util.concurrent.ConcurrentHashMap.hash(ConcurrentHashMap.java:157) at java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:903) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.update(DatabasePool.java:402) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.get(DatabasePool.java:417) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.access$000(DatabasePool.java:389) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:98) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) 2010-06-21 03:37:59.878 (4) [P1T8]: Returning Object to Pool 2010-06-21 03:37:59.895 (4) [P1T7]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:59.895 (4) [P1T7]: spike: SQL->[select * from `tsacommon`.`accounts` where (`id`=245) limit 1] 2010-06-21 03:37:59.900 (4) [P1T7]: time=0.0050 2010-06-21 03:37:59.900 (4) [P1T7]: Query executed in 0.005s 2010-06-21 03:37:59.901 (4) [P1T7]: Record Loaded 2010-06-21 03:37:59.901 (4) [P1T7]: DataCache: put key acct-st-tracker 245 2010-06-21 03:37:59.901 (4) [P1T7]: DataCache: Found key acct-st-tracker-1 2010-06-21 03:37:59.901 (4) [P1T7]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:59.902 (4) [P1T7]: Took Existing Object from Pool 2010-06-21 03:37:59.902 (4) [P1T7]: perfsum: SQL->[select @@version] 2010-06-21 03:37:59.904 (4) [P1T7]: time=0.0020 2010-06-21 03:37:59.904 (4) [P1T7]: Query executed in 0.002s 2010-06-21 03:37:59.904 (4) [P1T7]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:59.904 (4) [P1T7]: DataCache: Found key dwh 245 2010-06-21 03:37:59.904 (4) [P1T7]: DataCache: Found key dwh-3 2010-06-21 03:37:59.911 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:59.924 (4) [main]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="dwh-1")) limit 1] 2010-06-21 03:37:59.929 (4) [main]: time=0.0040 2010-06-21 03:37:59.929 (4) [main]: Query executed in 0.004s 2010-06-21 03:37:59.929 (4) [main]: Record Loaded 2010-06-21 03:37:59.929 (4) [main]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:37:59.930 (4) [main]: DatabaseAccounts.getDatabaseName() returning "warehouse_1" 2010-06-21 03:37:59.930 (4) [P1T9]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:59.930 (4) [P1T9]: Took Existing Object from Pool 2010-06-21 03:37:59.930 (4) [P1T9]: perfsum: SQL->[select @@version] 2010-06-21 03:37:59.932 (4) [P1T9]: time=0.0020 2010-06-21 03:37:59.932 (4) [P1T9]: Query executed in 0.002s 2010-06-21 03:37:59.932 (4) [P1T9]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:37:59.933 (4) [P1T9]: perfsum: SQL->[select * from `tsacommon`.`accounts` where (`tsacommon`.`accounts`.`id`=307) limit 1] 2010-06-21 03:37:59.933 (4) [main]: DataCache: put key dwh 562 2010-06-21 03:37:59.933 (4) [main]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:37:59.935 (4) [P1T9]: time=0.0020 2010-06-21 03:37:59.935 (4) [P1T9]: Query executed in 0.002s 2010-06-21 03:37:59.936 (4) [P1T9]: Record Loaded 2010-06-21 03:37:59.936 (4) [P1T9]: Returning Object to Pool 2010-06-21 03:37:59.936 (4) [P1T9]: isYesterday = true 2010-06-21 03:37:59.936 (4) [P1T9]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:38:02.937 (2) [P1T7]: Exception [creating pooled Database]:com.mysql.jdbc.CommunicationsException: Communications link failure due to underlying exception: ** BEGIN NESTED EXCEPTION ** java.net.SocketException MESSAGE: java.net.NoRouteToHostException: No route to host STACKTRACE: java.net.SocketException: java.net.NoRouteToHostException: No route to host at com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:156) at com.mysql.jdbc.MysqlIO.(MysqlIO.java:277) at com.mysql.jdbc.Connection.createNewIO(Connection.java:2668) at com.mysql.jdbc.Connection.(Connection.java:1531) at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266) at java.sql.DriverManager.getConnection(DriverManager.java:525) at java.sql.DriverManager.getConnection(DriverManager.java:171) at com.carldunham.jst.db.Database.init(Database.java:203) at com.carldunham.jst.db.Database.(Database.java:188) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:166) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:35) at com.carldunham.jst.pooling.ObjectPool.get(ObjectPool.java:88) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:96) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) ** END NESTED EXCEPTION ** Last packet sent to the server was 0 ms ago. at com.mysql.jdbc.Connection.createNewIO(Connection.java:2741) at com.mysql.jdbc.Connection.(Connection.java:1531) at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266) at java.sql.DriverManager.getConnection(DriverManager.java:525) at java.sql.DriverManager.getConnection(DriverManager.java:171) at com.carldunham.jst.db.Database.init(Database.java:203) at com.carldunham.jst.db.Database.(Database.java:188) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:166) at com.carldunham.jst.db.DatabasePool.create(DatabasePool.java:35) at com.carldunham.jst.pooling.ObjectPool.get(ObjectPool.java:88) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:96) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) 2010-06-21 03:38:02.938 (4) [P1T7]: Created new Object 2010-06-21 03:38:02.939 (1) [P1T7]: Exception [Account #245 Catch All ]:java.lang.NullPointerException at java.util.concurrent.ConcurrentHashMap.hash(ConcurrentHashMap.java:157) at java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:903) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.update(DatabasePool.java:402) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.get(DatabasePool.java:417) at com.carldunham.jst.db.DatabasePool$ConnectionCloserThread.access$000(DatabasePool.java:389) at com.carldunham.jst.db.DatabasePool.get(DatabasePool.java:98) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:326) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:314) at com.thesearchagency.db.util.MultiplexDatabasePool.get(MultiplexDatabasePool.java:115) at com.thesearchagency.db.util.AccountDatabases.get(AccountDatabases.java:102) at com.thesearchagency.perf.WarehouseSummarizer$AccountWorker.run(WarehouseSummarizer.java:458) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595) 2010-06-21 03:38:02.939 (4) [P1T7]: Returning Object to Pool 2010-06-21 03:38:02.944 (4) [P1T9]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:38:02.945 (4) [P1T9]: spike: SQL->[select * from `tsacommon`.`accounts` where (`id`=307) limit 1] 2010-06-21 03:38:02.965 (4) [P1T9]: time=0.02 2010-06-21 03:38:02.965 (4) [P1T9]: Query executed in 0.020s 2010-06-21 03:38:02.966 (4) [P1T9]: Record Loaded 2010-06-21 03:38:02.966 (4) [P1T9]: DataCache: put key acct-st-tracker 307 2010-06-21 03:38:02.966 (4) [P1T9]: DataCache: Found key acct-st-tracker-1 2010-06-21 03:38:02.967 (4) [P1T9]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:38:02.967 (4) [P1T9]: Took Existing Object from Pool 2010-06-21 03:38:02.968 (4) [P1T9]: perfsum: SQL->[select @@version] 2010-06-21 03:38:02.970 (4) [P1T9]: time=0.0020 2010-06-21 03:38:02.970 (4) [P1T9]: Query executed in 0.002s 2010-06-21 03:38:02.970 (4) [P1T9]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:38:02.971 (4) [P1T9]: DataCache: Found key dwh 307 2010-06-21 03:38:02.971 (4) [P1T9]: DataCache: Found key dwh-1 2010-06-21 03:38:02.998 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:38:02.998 (4) [main]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`type`="mysql") and (`name`="dwh-4")) limit 1] 2010-06-21 03:38:03.000 (4) [main]: time=0.0020 2010-06-21 03:38:03.001 (4) [main]: Query executed in 0.002s 2010-06-21 03:38:03.001 (4) [main]: Record Loaded 2010-06-21 03:38:03.001 (4) [main]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false] 2010-06-21 03:38:03.002 (4) [main]: DatabaseAccounts.getDatabaseName() returning "warehouse_4" 2010-06-21 03:38:03.002 (4) [P1T10]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:38:03.002 (4) [P1T10]: Took Existing Object from Pool 2010-06-21 03:38:03.002 (4) [P1T10]: perfsum: SQL->[select @@version] 2010-06-21 03:38:03.004 (4) [P1T10]: time=0.0010 2010-06-21 03:38:03.004 (4) [P1T10]: Query executed in 0.001s 2010-06-21 03:38:03.004 (4) [P1T10]: test query succeeded, returned "5.0.30-enterprise-gpl" 2010-06-21 03:38:03.004 (4) [P1T10]: perfsum: SQL->[select * from `tsacommon`.`accounts` where (`tsacommon`.`accounts`.`id`=562) limit 1] 2010-06-21 03:38:03.005 (4) [main]: DataCache: put key dwh 560 2010-06-21 03:38:03.005 (4) [main]: no account, or instance for databaseInstance, skipping lookup... 2010-06-21 03:38:03.006 (4) [P1T10]: time=0.0020 2010-06-21 03:38:03.007 (4) [P1T10]: Query executed in 0.002s 2010-06-21 03:38:03.007 (4) [P1T10]: Record Loaded 2010-06-21 03:38:03.008 (4) [P1T10]: Returning Object to Pool 2010-06-21 03:38:03.008 (4) [P1T10]: isYesterday = true 2010-06-21 03:38:03.008 (4) [P1T10]: no account, or instance for databaseInstance, skipping lookup...