Re: LTCP cache and load

[Matthew Cooke]

I also experienced a deadlock situtation on JCS.get(key) under 
production load, I ditched the LTCP and used a derivative of the remote 
cache instead.

Talking of which, I never managed to get push mode working under high 
traffic loads either (after running a while JCS started returning the 
wrong values for keys on our production systems)

Has anyone else got JCS working reliably in a push configuration under 
high load?
Also, has anyone got a fully distributed version JCS working (without a 
remote cache) under a high load?

Matt.

Siefker, Adam wrote:

> When using LTCP cache I've seen 2 java threads start to concume all 
> CPU resources on my servers. The servers in question have 2 CPUs and 
> each CPU is at 100% capacity. It appears that a JCS.get(key) call is 
> not returning and is the source of this.
>
> Cache.ccf:
>
>
> # sets the default aux value for any non configured caches
> jcs.default=
> jcs.default.cacheattributes=org.apache.jcs.engine.CompositeCacheAttributes 
>
> jcs.default.cacheattributes.MaxObjects=1000
> jcs.default.cacheattributes.MemoryCacheName=org.apache.jcs.engine.memory.lru.LRUMemoryCache 
>
> jcs.default.cacheattributes.UseMemoryShrinker=false
> jcs.default.cacheattributes.ShrinkerIntervalSeconds=60
> jcs.default.cacheattributes.MaxMemoryIdleTimeSeconds=3600
> jcs.default.elementattributes=org.apache.jcs.engine.ElementAttributes
> jcs.default.elementattributes.IsEternal=false
> jcs.default.elementattributes.MaxLifeSeconds=3600
> jcs.default.elementattributes.IsSpool=true
> jcs.default.elementattributes.IsRemote=true
> jcs.default.elementattributes.IsLateral=true
>
> ##############################################################
> #Blended search results caching
> jcs.region.fijiSearchBlendedResults=LTCP
> jcs.region.fijiSearchBlendedResults.cacheattributes=org.apache.jcs.engine.CompositeCacheAttributes 
>
> jcs.region.fijiSearchBlendedResults.cacheattributes.MaxObjects=10000
> jcs.region.fijiSearchBlendedResults.cacheattributes.MemoryCacheName=org.apache.jcs.engine.memory.lru.LRUMemoryCache 
>
> jcs.region.fijiSearchBlendedResults.cacheattributes.UseMemoryShrinker=false 
>
> jcs.region.fijiSearchBlendedResults.cacheattributes.MaxSpoolPerRun=100
> jcs.region.fijiSearchBlendedResults.cacheattributes.MaxMemoryIdleTimeSeconds=100 
>
> jcs.region.fijiSearchBlendedResults.cacheattributes.ShrinkerIntervalSeconds=30 
>
> jcs.region.fijiSearchBlendedResults.elementattributes=org.apache.jcs.engine.ElementAttributes 
>
> jcs.region.fijiSearchBlendedResults.elementattributes.IsEternal=true
> #Search results will be retained for 30 minutes.
> jcs.region.fijiSearchBlendedResults.elementattributes.MaxLifeSeconds=1800
> jcs.region.fijiSearchBlendedResults.elementattributes.IsSpool=false
> jcs.region.fijiSearchBlendedResults.elementattributes.IsLateral=true
> jcs.region.fijiSearchBlendedResults.elementattributes.IsRemote=false
>
> #Later TCP cache
> jcs.auxiliary.LTCP=org.apache.jcs.auxiliary.lateral.LateralCacheFactory
> jcs.auxiliary.LTCP.attributes=org.apache.jcs.auxiliary.lateral.LateralCacheAttributes 
>
> jcs.auxiliary.LTCP.attributes.TransmissionTypeName=TCP
> jcs.auxiliary.LTCP.attributes.TcpServers=serverA:1812,serverB:1812
> jcs.auxiliary.LTCP.attributes.TcpListenerPort=1812
> jcs.auxiliary.LTCP.attributes.PutOnlyMode=false
>
>
> Attached is a segment of my log file. This is the first JCS call that 
> apparently does not return.
>
>
> <<logs.txt>>
> If I can provide you with any more information please let me know.
>
> Adam
>
>
>
>
> ------------------------------------------------------------------------
>
> 2005-08-09 11:59:25,108 INFO [http8080-Processor23] 
> com.amazon.fiji.search.dao.aws.AWSSearchDAOImpl - Checking cache for key: Key: 
> AWSSearchIndex [Blended] Value: star trek  P
> age: 48
> 2005-08-09 11:59:29,037 INFO [Thread-2] 
> org.apache.jcs.auxiliary.lateral.LateralCacheMonitor - 
> LateralCacheManager.instances.size() = 3
> 2005-08-09 11:59:29,037 INFO [Thread-2] 
> org.apache.jcs.auxiliary.lateral.LateralCacheMonitor -
> 1- mgr.lca.getTcpServer() = 172.21.1.52:1812 mgr = 
> org.apache.jcs.auxiliary.lateral.LateralCacheManager@185918e
> 2005-08-09 11:59:29,037 INFO [Thread-2] 
> org.apache.jcs.auxiliary.lateral.LateralCacheMonitor -
> 1- mgr.caches.size() = 1
> 2005-08-09 11:59:29,037 INFO [Thread-2] 
> org.apache.jcs.auxiliary.lateral.LateralCacheMonitor - Lateral Cache No Wait 
> not in error
> 2005-08-09 11:59:29,037 INFO [Thread-2] 
> org.apache.jcs.auxiliary.lateral.LateralCacheMonitor -
> 2- mgr.lca.getTcpServer() = integ-node-03526.sea3.amazon.com:1812 mgr = 
> org.apache.jcs.auxiliary.lateral.LateralCacheManager@1734ad
> 2005-08-09 11:59:29,037 INFO [Thread-2] 
> org.apache.jcs.auxiliary.lateral.LateralCacheMonitor -
> 2- mgr.caches.size() = 1
> 2005-08-09 11:59:29,037 INFO [Thread-2] 
> org.apache.jcs.auxiliary.lateral.LateralCacheMonitor - Lateral Cache No Wait 
> not in error
> 2005-08-09 11:59:29,037 INFO [Thread-2] 
> org.apache.jcs.auxiliary.lateral.LateralCacheMonitor -
> 3- mgr.lca.getTcpServer() = 172.21.1.53:1812 mgr = 
> org.apache.jcs.auxiliary.lateral.LateralCacheManager@1837603
> 2005-08-09 11:59:29,037 INFO [Thread-2] 
> org.apache.jcs.auxiliary.lateral.LateralCacheMonitor -
> 3- mgr.caches.size() = 1
> 2005-08-09 11:59:29,037 INFO [Thread-2] 
> org.apache.jcs.auxiliary.lateral.LateralCacheMonitor - found LateralCacheNoWait 
> in error,  LateralCacheNoWait  Status = 3 cache = [
> LateralCache
> Cache Name [fijiSearchBlendedResults]
> cattr =  [TCP228.5.6.76789172.21.1.53:1812]]
> 2005-08-09 11:59:29,038 INFO [Thread-2] org.apache.jcs.engine.CacheEventQueue - 
> Destroying queue, stats =  Cache Event Queue
> Working = true
> Alive = false
> Empty = true
> Size = 0
> 2005-08-09 11:59:29,038 INFO [Thread-2] org.apache.jcs.engine.CacheEventQueue - 
> Cache event queue destroyed: CacheEventQueue [listenerId=-1668551018, 
> cacheName=fijiSearchBlend
> edResults]
> 2005-08-09 11:59:29,038 INFO [Thread-2] 
> org.apache.jcs.auxiliary.lateral.LateralCacheRestore - Lateral connection 
> resumed.
> 2005-08-09 11:59:29,038 WARN 
> [CacheEventQueue.QProcessor-fijiSearchBlendedResults] 
> org.apache.jcs.engine.CacheEventQueue - Interrupted while waiting for another 
> event to come
> in before we die.
> 2005-08-09 11:59:35,156 INFO 
> [CacheEventQueue.QProcessor-fijiSearchBlendedResults] 
> org.apache.jcs.engine.CacheEventQueue - QProcessor exiting for CacheEventQueue 
> [listenerId=-
> 1668551018, cacheName=fijiSearchBlendedResults]
>  
>
> ------------------------------------------------------------------------
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: jcs-users-unsubscribe@xxxxxxxxxxxxxxxxxx
> For additional commands, e-mail: jcs-users-help@xxxxxxxxxxxxxxxxxx