./usr/local/tsa/bidmgr/sebidupdater.sh -d4 -S 178 -U 96
Troubleshooting tips:
- Is the budget correct in both the Y!J SS UI and st-tracker.admaxSearchEngineAccountActualDailyBudgets?
- Is the date in admaxBids.currentBidSetDate equal to yesterday or before?
2014-11-07 10:30:47.634 (3) [main]: Debug Level set to 4
2014-11-07 10:30:47.680 (4) [main]: registered MBean [thesearchagency.db.util:type=MultiplexDatabasePoolfd0a8c45-9ab8-4f5c-8918-3ebc2422f6b7] for class com.thesearchagency.db.util.MultiplexDatabasePool
2014-11-07 10:30:47.681 (4) [main]: no account, or instance for databaseInstance, skipping lookup...
2014-11-07 10:30:47.684 (4) [main]: registered MBean [com.carldunham.jst.pooling:type=ObjectPool8e684e00-b64b-46f4-9c6e-3cec5d2a6a71] for class com.carldunham.jst.pooling.ObjectPool
2014-11-07 10:30:47.684 (3) [main]: DatabasePool with a limit of 80 created
2014-11-07 10:30:47.689 (4) [main]: registered MBean [com.carldunham.jst.db:type=DatabasePoolc65fa562-7fd1-45d5-842c-f6efeebe26cd] for class com.carldunham.jst.db.DatabasePool
2014-11-07 10:30:47.693 (4) [ConnectionCloser]: Starting DatabasePool ConnectionCloserThread
2014-11-07 10:30:49.749 (3) [main]: JDBC Driver Version: 5.1 (com.mysql.jdbc.Driver)
2014-11-07 10:30:49.750 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true]
2014-11-07 10:30:49.750 (4) [main]: Created new Object
2014-11-07 10:30:49.751 (4) [main]: spike: SQL->[select @@version]
2014-11-07 10:30:50.156 (4) [main]: time=0.404
2014-11-07 10:30:50.156 (4) [main]: Query executed in 0.404s
2014-11-07 10:30:50.156 (4) [main]: test query succeeded, returned "5.5.34"
2014-11-07 10:30:50.194 (4) [main]: spike: SQL->[select `tsacommon`.`accounts`.`id`,`tsacommon`.`accounts`.`databaseInstance` from `tsacommon`.`accounts` where ((`tsacommon`.`accounts`.`isOnline`="true") and (`tsacommon`.`accounts`.`isActive`="true")) group by `tsacommon`.`accounts`.`databaseInstance`]
2014-11-07 10:30:50.723 (4) [main]: time=0.528
2014-11-07 10:30:50.723 (4) [main]: Query executed in 0.528s
2014-11-07 10:30:50.723 (4) [main]: no account, or instance for databaseInstance, skipping lookup...
2014-11-07 10:30:52.534 (3) [main]: JDBC Driver Version: 5.1 (com.mysql.jdbc.Driver)
2014-11-07 10:30:52.534 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true]
2014-11-07 10:30:52.535 (4) [main]: Created new Object
2014-11-07 10:30:52.535 (4) [main]: spike: SQL->[select @@version]
2014-11-07 10:30:53.026 (4) [main]: time=0.491
2014-11-07 10:30:53.026 (4) [main]: Query executed in 0.491s
2014-11-07 10:30:53.026 (4) [main]: test query succeeded, returned "5.5.34"
2014-11-07 10:30:53.029 (4) [main]: spike: SQL->[select * from `tsacommon`.`distribution` where (`id`=178) limit 1]
2014-11-07 10:30:53.496 (4) [main]: time=0.467
2014-11-07 10:30:53.496 (4) [main]: Query executed in 0.467s
2014-11-07 10:30:53.501 (4) [main]: Record Loaded
2014-11-07 10:30:53.527 (3) [main]: Skipping initialization of Yahoo Client. This means no API calls can be made.
2014-11-07 10:30:53.541 (4) [main]: no account, or instance for databaseInstance, skipping lookup...
2014-11-07 10:30:55.641 (3) [main]: JDBC Driver Version: 5.1 (com.mysql.jdbc.Driver)
2014-11-07 10:30:55.641 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true]
2014-11-07 10:30:55.642 (4) [main]: spike: SQL->[select * from `tsacommon`.`accounts` where (`id`=1) limit 1]
2014-11-07 10:30:56.203 (4) [main]: time=0.561
2014-11-07 10:30:56.203 (4) [main]: Query executed in 0.561s
2014-11-07 10:30:56.204 (4) [main]: Record Loaded
2014-11-07 10:30:56.205 (4) [main]: DataCache: put key acct-st-tracker 1
2014-11-07 10:30:56.207 (4) [main]: spike: SQL->[select * from `tsacommon`.`databaseInstances` where ((`name`="acct-st-tracker-1") and (`type`="mysql")) limit 1]
2014-11-07 10:30:56.701 (4) [main]: time=0.494
2014-11-07 10:30:56.701 (4) [main]: Query executed in 0.494s
2014-11-07 10:30:56.702 (4) [main]: Record Loaded
2014-11-07 10:30:56.702 (4) [main]: DataCache: put key acct-st-tracker-1
2014-11-07 10:30:56.709 (4) [main]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true]
2014-11-07 10:30:56.709 (4) [main]: registered MBean [com.carldunham.jst.pooling:type=ObjectPool103426e1-363e-47af-9df8-e7e00551ee50] for class com.carldunham.jst.pooling.ObjectPool
2014-11-07 10:30:56.709 (3) [main]: DatabasePool with a limit of 80 created
2014-11-07 10:30:56.710 (4) [main]: registered MBean [com.carldunham.jst.db:type=DatabasePool0b28d099-5d64-4611-a441-e7cb3dfa18a1] for class com.carldunham.jst.db.DatabasePool
2014-11-07 10:30:58.667 (3) [main]: JDBC Driver Version: 5.1 (com.mysql.jdbc.Driver)
2014-11-07 10:30:58.667 (4) [main]: opened [jdbc:mysql://acctdb-01-write:3306/st-tracker?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true]
2014-11-07 10:30:58.667 (4) [main]: Created new Object
2014-11-07 10:30:58.667 (4) [main]: spike: SQL->[select @@version]
2014-11-07 10:30:59.159 (4) [main]: time=0.492
2014-11-07 10:30:59.159 (4) [main]: Query executed in 0.492s
2014-11-07 10:30:59.159 (4) [main]: test query succeeded, returned "5.5.34"
2014-11-07 10:30:59.162 (4) [main]: Instantiating an AdmaxBidDAO object for Database: jdbc:mysql://acctdb-01-write:3306/st-tracker?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true
2014-11-07 10:30:59.162 (4) [main]: preparing SQL statement [select ab.accountID,ab.elementType,ab.elementID,ab.currentBid,ab.currentBidSetDate,ab.newBid,ab.newBidSetDate,ab.retryCount,sea.distributionID,sea.searchEngineIdentifier,seg.id,seg.searchEngineIdentifier,seadb.budget,seadb.actualSEBudget from `tsacommon`.searchEngineAccounts sea join `st-tracker`.admaxSearchEngineAccountActualDailyBudgets seadb on seadb.searchEngineAccountID = sea.id and seadb.date = (select max(seadb2.date) from `st-tracker`.admaxSearchEngineAccountActualDailyBudgets seadb2 where seadb2.searchEngineAccountID = sea.id) join `st-tracker`.searchEngineGroups seg on seg.searchEngineAccountID = sea.id join `st-tracker`.admaxBids ab on ab.accountID = sea.accountID and ab.elementType = 'searchEngineAccount' and ab.elementID = sea.id where ab.newBid IS NOT NULL and sea.distributionID=? and seg.searchEngineStatus = 'ok' and sea.searchEngineUserID in (96) group by seg.id order by ab.accountID,ab.newBidSetDate asc]
2014-11-07 10:30:59.348 (4) [main]: Returning Object to Pool
2014-11-07 10:30:59.349 (4) [main]: Returning Object to Pool
2014-11-07 10:30:59.349 (4) [main]: All Pending Bids (before validation)...
2014-11-07 10:30:59.349 (4) [main]: AdmaxBidDTO [ AccountID: 98, ElementType: searchEngineAccount, ElementID: 2216, CurrentBid: 15.321, CurrentBidSetDate: 2014-11-01, NewBid: 100000.0, NewBidSetDate: 2014-11-07, RetryCount: 0 ]
2014-11-07 10:30:59.350 (3) [main]: ----------------Search Engine Bid Updater starting
2014-11-07 10:30:59.350 (4) [main]: no account, or instance for databaseInstance, skipping lookup...
2014-11-07 10:31:01.358 (3) [main]: JDBC Driver Version: 5.1 (com.mysql.jdbc.Driver)
2014-11-07 10:31:01.358 (4) [main]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true]
2014-11-07 10:31:01.364 (4) [main]: spike: SQL->[select * from `searchEngineUsers` join `accounts` on ((`tsacommon`.`accounts`.`id`=`tsacommon`.`searchEngineUsers`.`accountID`)) where ((`enabled`="true") and (`tsacommon`.`accounts`.`isActive`="true") and (`tsacommon`.`searchEngineUsers`.`id` in ("96")) and (`tsacommon`.`searchEngineUsers`.`distributionID`="178")) order by `tsacommon`.`accounts`.`tier` asc,`tsacommon`.`accounts`.`priority` asc,`tsacommon`.`accounts`.`id` desc]
2014-11-07 10:31:01.871 (4) [main]: time=0.507
2014-11-07 10:31:01.872 (4) [main]: Query executed in 0.507s
2014-11-07 10:31:01.874 (4) [main]: no account, or instance for databaseInstance, skipping lookup...
2014-11-07 10:31:01.874 (4) [main]: Took Existing Object from Pool
2014-11-07 10:31:01.874 (4) [main]: spike: SQL->[select @@version]
2014-11-07 10:31:02.355 (4) [main]: time=0.481
2014-11-07 10:31:02.355 (4) [main]: Query executed in 0.481s
2014-11-07 10:31:02.355 (4) [main]: test query succeeded, returned "5.5.34"
2014-11-07 10:31:02.355 (4) [main]: spike: SQL->[select * from `tsacommon`.`distribution` where (`id`=178) limit 1]
2014-11-07 10:31:02.901 (4) [main]: time=0.546
2014-11-07 10:31:02.901 (4) [main]: Query executed in 0.546s
2014-11-07 10:31:02.902 (4) [main]: Record Loaded
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/stacie.waleyko/.m2/repository/com/thesearchagency/smb/client/yj-soap-client/1.0.0/yj-soap-client-1.0.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/stacie.waleyko/.m2/repository/ch/qos/logback/logback-classic/1.1.2/logback-classic-1.1.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/stacie.waleyko/.m2/repository/org/slf4j/slf4j-log4j12/1.7.7/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/stacie.waleyko/.m2/repository/org/jboss/slf4j/slf4j-jboss-logging/1.0.2.GA/slf4j-jboss-logging-1.0.2.GA.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
2014-11-07 10:31:03.215 (2) [Finalizer]: AccountDatabases: finalize: unloading connections - app may need updates?
2014-11-07 10:31:03.215 (4) [Finalizer]: Returning Object to Pool
2014-11-07 10:31:03,217 [main] DEBUG c.t.s.c.y.impl.YahooJapanSSClient - Created YahooJapanSSClient for Authentication [ACCOUNT_ID=586501, ON_BEHALF_OF_ACCOUNT_ID= ylWCn-cgHc-Kyf4z-6PGU ]
2014-11-07 10:31:03.221 (4) [main]: preparing SQL statement [select currencyCode from `tsacommon`.`accounts` where id = ?]
2014-11-07 10:31:03.425 (4) [main]: Returning Object to Pool
2014-11-07 10:31:03.425 (3) [P1T1]: Starting User (96) "797667fd-206f-4324-bfbb-5e5dc4b14704_1"
2014-11-07 10:31:03.426 (4) [P1T1]: no account, or instance for databaseInstance, skipping lookup...
2014-11-07 10:31:05.786 (3) [P1T1]: JDBC Driver Version: 5.1 (com.mysql.jdbc.Driver)
2014-11-07 10:31:05.786 (4) [P1T1]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true]
2014-11-07 10:31:05.786 (4) [P1T1]: spike: SQL->[select * from `tsacommon`.`accounts` where (`id`=98) limit 1]
2014-11-07 10:31:06.313 (4) [P1T1]: time=0.527
2014-11-07 10:31:06.314 (4) [P1T1]: Query executed in 0.527s
2014-11-07 10:31:06.314 (4) [P1T1]: Record Loaded
2014-11-07 10:31:06.314 (4) [P1T1]: DataCache: put key acct-st-tracker 98
2014-11-07 10:31:06.314 (4) [P1T1]: DataCache: Found key acct-st-tracker-1
2014-11-07 10:31:06.315 (4) [P1T1]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true]
2014-11-07 10:31:06.315 (4) [P1T1]: Took Existing Object from Pool
2014-11-07 10:31:06.315 (4) [P1T1]: spike: SQL->[select @@version]
2014-11-07 10:31:06.790 (4) [P1T1]: time=0.475
2014-11-07 10:31:06.790 (4) [P1T1]: Query executed in 0.475s
2014-11-07 10:31:06.790 (4) [P1T1]: test query succeeded, returned "5.5.34"
2014-11-07 10:31:06.792 (4) [P1T1]: Instantiating an AdmaxBidErrorDAO object for Database: jdbc:mysql://acctdb-01-write:3306/st-tracker?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true
2014-11-07 10:31:06.793 (4) [P1T1]: tried to set bid > budget but budget > maxCPC, so setting bid = maxCPC for SEA 2216
2014-11-07 10:31:06.793 (4) [P1T1]: preparing SQL statement [update `st-tracker`.admaxBids ab set ab.newBid=? where ab.accountID=? and ab.elementID=? and ab.elementType=?]
2014-11-07 10:31:07.036 (4) [P1T1]: All Pending Bids (after validation) for SEU 96...
2014-11-07 10:31:07.036 (4) [P1T1]: AdmaxBidDTO [ AccountID: 98, ElementType: searchEngineAccount, ElementID: 2216, CurrentBid: 15.321, CurrentBidSetDate: 2014-11-01, NewBid: 50000.0, NewBidSetDate: 2014-11-07, DistributionID: 178, Campaign Identifier: 908302, AdGroup Identifier: 323516578, RetryCount: 0, Budget: 115.0, Actual SE Budget: 60000.0 ]
2014-11-07 10:31:07.037 (4) [P1T1]: Pending bids mapped to campaigns...
2014-11-07 10:31:07.037 (4) [P1T1]: BidElement [ AccountID: 98, BidElementType: searchEngineAccount, BidElementID: 2216, BidElementIdentifier: 908302 ]
2014-11-07 10:31:07.037 (4) [P1T1]: Bids mapped to above BidElement...
2014-11-07 10:31:07.037 (4) [P1T1]: BidUpdate [ BidToBeUpdated: 50000.0, BiddingLevelIdentifier: 323516578 ]
2014-11-07 10:31:07.039 (4) [P1T1]: no account, or instance for databaseInstance, skipping lookup...
2014-11-07 10:31:09.012 (3) [P1T1]: JDBC Driver Version: 5.1 (com.mysql.jdbc.Driver)
2014-11-07 10:31:09.012 (4) [P1T1]: opened [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true]
2014-11-07 10:31:09.012 (4) [P1T1]: spike: SQL->[select `id`,`shortCode` from distribution where ((`searchEngineClass` is not null) and (`searchEngineClass`!=""))]
2014-11-07 10:31:09.521 (4) [P1T1]: time=0.509
2014-11-07 10:31:09.521 (4) [P1T1]: Query executed in 0.509s
2014-11-07 10:31:09.522 (4) [P1T1]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true]
2014-11-07 10:31:09.523 (3) [P1T1]: originalCurrencyValue(50000.0) : aCurrencyCode(JPY) : roundedCurrencyValue(50000)
2014-11-07 10:31:09,853 [P1T1] DEBUG c.t.s.c.yahoojapan.util.SoapUtils - ========================================================================================
2014-11-07 10:31:09,853 [P1T1] DEBUG c.t.s.c.yahoojapan.util.SoapUtils - AdGroupService EndPoint URL = https://colo02.ss.yahooapis.jp/services/V5.0/AdGroupService
2014-11-07 10:31:09,853 [P1T1] DEBUG c.t.s.c.yahoojapan.util.SoapUtils - ========================================================================================
2014-11-07 10:31:10,158 [P1T1] INFO o.a.c.s.f.ReflectionServiceFactoryBean - Creating Service {http://ss.yahooapis.jp/V5}AdGroupService from class jp.yahooapis.ss.V5.AdGroupService.AdGroupServiceInterface
2014-11-07 10:31:10,473 [P1T1] INFO o.a.c.s.f.ReflectionServiceFactoryBean - Creating Service {http://ss.yahooapis.jp/V5}AdGroupService from class jp.yahooapis.ss.V5.AdGroupService.AdGroupServiceInterface
2014-11-07 10:31:11,009 [P1T1] DEBUG c.t.s.c.y.util.SoapClientHandler - REQUEST XML:
1327-7818-1693-5552
5567-7860-7473-8517
MtFuj1
586501
ylWCn-cgHc-Kyf4z-6PGU
TSATrialYahoo55
SET
586501
908302
586501
908302
323516578
50000
2014-11-07 10:31:11,012 [P1T1] INFO o.a.c.s.A.A.AdGroupServiceInterface - Outbound Message
---------------------------
ID: 1
Address: https://colo02.ss.yahooapis.jp/services/V5.0/AdGroupService
Encoding: UTF-8
Http-Method: POST
Content-Type: text/xml
Headers: {Accept=[*/*], SOAPAction=[""]}
Payload: 1327-7818-1693-55525567-7860-7473-8517MtFuj1586501 ylWCn-cgHc-Kyf4z-6PGU TSATrialYahoo55 SET58650190830258650190830232351657850000
--------------------------------------
2014-11-07 10:31:13,432 [P1T1] INFO o.a.c.s.A.A.AdGroupServiceInterface - Inbound Message
----------------------------
ID: 1
Response-Code: 200
Encoding: UTF-8
Content-Type: text/xml; charset=utf-8
Headers: {Cache-Control=[private], connection=[close], Content-Length=[1216], content-type=[text/xml; charset=utf-8], Date=[Fri, 07 Nov 2014 18:31:16 GMT], P3P=[policyref="http://privacy.yahoo.co.jp/w3c/p3p_jp.xml", CP="CAO DSP COR CUR ADM DEV TAI PSA PSD IVAi IVDi CONi TELo OTPi OUR DELi SAMi OTRi UNRi PUBi IND PHY ONL UNI PUR FIN COM NAV INT DEM CNT STA POL HEA PRE GOV"], Vary=[Accept-Encoding]}
Payload:
AdGroupService3418910.1544AdGroupReturnValueSETtrue586501908302a98_150501_400001_330_GT323516578a98_150501_400001_330ACTIVEMANUAL_CPC50000
--------------------------------------
2014-11-07 10:31:13,474 [P1T1] DEBUG c.t.s.c.y.util.SoapClientHandler - RESPONSE XML:
AdGroupService
34189
1
0.1544
AdGroupReturnValue
SET
true
586501
908302
a98_150501_400001_330_GT
323516578
a98_150501_400001_330
ACTIVE
MANUAL_CPC
50000
2014-11-07 10:31:13.490 (4) [P1T1]: preparing SQL statement [update `st-tracker`.admaxBids ab join `tsacommon`.searchEngineAccounts sea on sea.id = ab.elementID set ab.currentBid=ab.newBid,ab.newBid=NULL,ab.newBidSetDate=NULL,ab.currentBidSetDate=?,ab.retryCount=0 where ab.newBid IS NOT NULL and sea.distributionID=? and ab.elementID in (2216)]
2014-11-07 10:31:13.653 (3) [P1T1]: Updated rows (1) matched the number of pending updates (1)
2014-11-07 10:31:13.653 (3) [P1T1]: Completed User (96) "797667fd-206f-4324-bfbb-5e5dc4b14704_1"
2014-11-07 10:31:13.653 (4) [P1T1]: Returning Object to Pool
2014-11-07 10:31:13.654 (4) [main]: closed [jdbc:mysql://tsacommon-01-write/tsacommon?useUnicode=true&zeroDateTimeBehavior=convertToNull&dontTrackOpenResources=true&jdbcCompliantTruncation=false&useServerPrepStmts=false&rewriteBatchedStatements=true]
2014-11-07 10:31:13.654 (3) [main]: ------------Search Engine Bid Updater done