4.0.1 dying daily

[linuxman]

Sindre something is going on with 4.01 where the servlet is dying within tomcat and I have to restart tomcat to get the server back up and running. Tomcat process is still running strong but the subsonic servlet is dead and non responsive. Here's an error within the tomcat log I'm seeing:
May 23, 2010 2:48:27 PM org.apache.tomcat.util.threads.ThreadPool logFull
SEVERE: All threads (150) are currently busy, waiting. Increase maxThreads (150) or check the servlet status

This has happened twice and it's staying up an avg of 2 to 3 days only whereas before it would be up for months. The subsonic log isn't showing anything what other log would be effective for what is happening? This is still happening where it'll be up for a day or two and then the server just quit responding yet tomcat processes are still alive and active so therefore something in the java has to be dying. Can't really find anything in the logs other than the max threads above.

Now it's happening every 24 hrs and occasoinally I have to delete the subsonic folder and restart tomcat and let the war redeploy the code as it's getting corrupted somehow.

I've never had any issues with this until I went to 4.0.1 and I'm not seeing anything really within the subsonic log or the tomcat logs as to why its happening.

[sliver4321]

Since you are a linuxman I assume you are running Tomcat on Linux

The problem seems to be a resource leak in the threadpool, most likely the webcontainer threads that are used to process incoming HTTP requests. They are probably stuck doing some operation, and eventually, all threads (150) are used.

When you experience this, execute a "kill -3 <tomcat-pid>"
This will not kill your tomcat-process, but generate a "javacore", which should list what the thread are currently doing. If you cannot see where the "javacore" file is saved, check at the end of the <tomcat-home>/logs/catalina.out file.

Then upload/post the javacore file here

Another way of getting the thread stack traces (if you are running on Sun JDK 1.6), is to run <JDK-HOME>/bin/jconsole . This program must be run from the SAME SERVER that is running tomcat. The "jconsole" program will list relevant information about the Java Virtual Machine that tomcat is running on (memory usage, threads etc)

[linuxman]

Yes it is tomcat on linux and I will do those very things. I did a hack where you can do a touch of the web.xml file which causes and auto restart of the webapp and had the log tailing out when I did it but it got hung trying to kill the java threads so I had to restart tomcat anyways. I have a suspicion its happening after a file upload comes into the server. I just ran the jconsole and it wouldn't ever connect to the tomcat process no matter what I tried and the server is up and running right now. Any thoughts on why that would be so?

[sliver4321]

I just ran the jconsole and it wouldn't ever connect to the tomcat process no matter what I tried and the server is up and running right now. Any thoughts on why that would be so?

It could be that the files under /tmp/hsperfXXXX have been deleted or corrupted (these are generated when a new JVM(tomcat) is started, and is used by Jconsole to find the PID of running JVMs), or that the tomcat process is in such a bad state that it cannot even respond to Jconsole requests

Use "kill -3" instead

Also, what Java version are you using to run tomcat?
Do a "ps -ef|grep java" and find the path to the java-executable that tomcat is using. Then run "<path-to-java>/bin/java -version"

[derlachendehans]

i posted a similar problem here:
http://forum.subsonic.org/forum/viewtop ... ght=#11129
threaddump can be found here:
http://forum.subsonic.org/forum/viewtop ... ght=#11149

java version is:

Code: Select all

java version "1.6.0_20"
Java(TM) SE Runtime Environment (build 1.6.0_20-b02)
Java HotSpot(TM) 64-Bit Server VM (build 16.3-b01, mixed mode)


the problem can be reproduced using openjdk and also on windows 7 with tomcat.
i also tried standalone installations of jett6 and jetty7 on the linux machine and then the problem seems not appear.

[sliver4321]

@derlachendehans

I'm not sure if Sindre answered you question or "jeankalud"s question in that thread, but I will attempt to give an answer anyway.

From your stack trace I can see that there is a problem with synchronizing on a mutex in "org.directwebremoting.dwrp.XXX".

You can see that the "main" thread (which seems to be attempting a shutdown of tomcat), is waiting to lock id "0x00007fae33a77de8":

Code: Select all

main" prio=10 tid=0x0000000001e32800 nid=0x776c waiting for monitor entry [0x00007fff64159000]
   java.lang.Thread.State: BLOCKED (on object monitor)
   at org.directwebremoting.dwrp.JettyContinuationSleeper.wakeUp(JettyContinuationSleeper.java:111)
   - waiting to lock <0x00007fae33a77de8>


however, this monitor is locked by:

Code: Select all

"TP-Processor7" daemon prio=10 tid=0x00000000022b8000 nid=0x7791 in Object.wait() [0x00007fae232d6000]
...
- locked <0x00007fae33a77de8> (a java.lang.Object)


"TP-Processor7" must release this lock first, in order for the shutdown to succeed.
The "TP-Processor"-threads are used to handle normal browser requests, and it should not be nessesary to wait for certain client requests before a shutdown.

It seems to me like there is a bug in the "directwebremoting" library used by Subsonic. Subsonic uses dwr v2.0.5. There are a couple of bugs that are fixed in v2.0.6 that might be related to the problem you are experiencing:
http://bugs.directwebremoting.org/jira/browse/DWR-287
http://bugs.directwebremoting.org/jira/browse/DWR-291
Although there is no deadlock in your log, it might still be related somehow.

Also i can see that you are using tomcat, but "dwr" is using a class called "JettyContinuationSleeper", and looking at the things added to dwr 3.0RC1, maybe the continuation support in dwr 2.0.5 (JettyContinuation) will not work with tomcat6, and you need specific continuation support for tomcat6?
http://bugs.directwebremoting.org/jira/browse/DWR-34

Also, I noticed from your log that you are low on "PermGenSpace" (99% used):

Code: Select all

PSPermGen       total 50880K, used 50848K [0x00007fae2aa50000, 0x00007fae2dc00000, 0x00007fae32a50000)
  object space 50880K, 99% used [0x00007fae2aa50000,0x00007fae2dbf82d8,0x00007fae2dc00000)


I recommend you increase PermGen by setting:
-XX:MaxPermSize=128m
somewhere in your tomcat configuration file (startup.sh/catalina.sh), or setting the environment variable CATALINA_OPTS:

Code: Select all

export CATALINA_OPTS="$CATALINA_OPTS -XX:MaxPermSize=128m"


For those of you using jetty, edit the subsonic(.sh/.bat) files and add the setting there after the "-Xmx"-argument

[linuxman]

eap
PSYoungGen total 49472K, used 3887K [0x00007f6bad360000, 0x00007f6bb0bd0000, 0x00007f6bc1000000)
eden space 48448K, 5% used [0x00007f6bad360000,0x00007f6bad62be88,0x00007f6bb02b0000)
from space 1024K, 100% used [0x00007f6bb0ad0000,0x00007f6bb0bd0000,0x00007f6bb0bd0000)
to space 1664K, 0% used [0x00007f6bb0890000,0x00007f6bb0890000,0x00007f6bb0a30000)
PSOldGen total 72640K, used 52758K [0x00007f6b85a00000, 0x00007f6b8a0f0000, 0x00007f6bad360000)
object space 72640K, 72% used [0x00007f6b85a00000,0x00007f6b88d85850,0x00007f6b8a0f0000)
PSPermGen total 64704K, used 40001K [0x00007f6b7b200000, 0x00007f6b7f130000, 0x00007f6b85a00000)
object space 64704K, 61% used [0x00007f6b7b200000,0x00007f6b7d910770,0x00007f6b7f130000)

The core dump didn't work quite right and this was at the end of the catalina.out file until I refreshed the webpage and then the server came back and was working again. I'm using jdk 1.6.0_11 and have been for quite a while and still at tomcat5 not tomcat6 as that's what is still being released in fedora core 11 which I'll probably be moving to 13 soon as I usually update every other version.

I've been running subsonic under tomcat since 1.x versions and this is the first time I've ever had anything happen where it crapped during running. I had some versions that I had to update the java because the servlet wouldn't deploy after an upgrade but never failed after up and running. I'm sure it'll be probably an update within the libraries subsonic is using as you mentioned above to fix the issue. Sindre psssst you're back from vacation buddy

[linuxman]

Here's my thread dump and its huge and I also added the little bit of log where the server recovered after the dump was initiated.

[code]2010-06-02 14:44:45
Full thread dump OpenJDK 64-Bit Server VM (14.0-b16 mixed mode):

"pool-10-thread-1" daemon prio=10 tid=0x00007f6b4c004800 nid=0x67b runnable [0x00007f6b5e2bd000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:146)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:130)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:127)
at org.apache.http.impl.io.AbstractSessionInputBuffer.read(AbstractSessionInputBuffer.java:161)
at org.apache.http.impl.io.ContentLengthInputStream.read(ContentLengthInputStream.java:159)
at org.apache.http.impl.io.ContentLengthInputStream.read(ContentLengthInputStream.java:173)
at org.apache.http.conn.EofSensorInputStream.read(EofSensorInputStream.java:155)
at net.sourceforge.subsonic.service.PodcastService.doDownloadEpisode(PodcastService.java:418)
at net.sourceforge.subsonic.service.PodcastService.access$200(PodcastService.java:67)
at net.sourceforge.subsonic.service.PodcastService$4.run(PodcastService.java:282)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-9-thread-1" daemon prio=10 tid=0x00007f6b509eb000 nid=0x7495 waiting on condition [0x00007f6b5e3be000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00007f6b863ea298> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"Java2D Disposer" daemon prio=10 tid=0x00007f6b3c010800 nid=0x4419 in Object.wait() [0x00007f6b781aa000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b872bd5d8> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:133)
- locked <0x00007f6b872bd5d8> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:149)
at sun.java2d.Disposer.run(Disposer.java:143)
at java.lang.Thread.run(Thread.java:636)

"Timer-1" daemon prio=10 tid=0x00007f6b7006c800 nid=0x4405 waiting for monitor entry [0x00007f6b782ab000]
java.lang.Thread.State: BLOCKED (on object monitor)
at org.directwebremoting.dwrp.JettyContinuationSleeper.wakeUp(JettyContinuationSleeper.java:111)
- waiting to lock <0x00007f6b87148088> (a java.lang.Object)
at org.directwebremoting.dwrp.BasicAlarm.raiseAlarm(BasicAlarm.java:33)
- locked <0x00007f6b87148240> (a java.lang.Object)
at org.directwebremoting.dwrp.OutputAlarm$AlarmScriptConduit$1.run(OutputAlarm.java:105)
at java.util.TimerThread.mainLoop(Timer.java:534)
at java.util.TimerThread.run(Timer.java:484)

"pool-8-thread-1" daemon prio=10 tid=0x00007f6b4400d800 nid=0x4402 waiting on condition [0x00007f6b783ac000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00007f6b863e9438> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-7-thread-1" daemon prio=10 tid=0x00007f6b4400c000 nid=0x4401 waiting on condition [0x00007f6b784ad000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00007f6b863e9438> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-6-thread-1" daemon prio=10 tid=0x00007f6b44017000 nid=0x4073 waiting on condition [0x00007f6b785ae000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00007f6b863e9438> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-5-thread-1" daemon prio=10 tid=0x00007f6b44016000 nid=0x4072 waiting on condition [0x00007f6b786af000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00007f6b863e9438> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-4-thread-1" daemon prio=10 tid=0x00007f6b44014800 nid=0x4071 waiting on condition [0x00007f6b7a6cf000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00007f6b863e9438> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"TP-Monitor" daemon prio=10 tid=0x00007f6bc434b800 nid=0x4056 in Object.wait() [0x00007f6b787b0000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b86bbf4f8> (a org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable)
at org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable.run(ThreadPool.java:564)
- locked <0x00007f6b86bbf4f8> (a org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable)
at java.lang.Thread.run(Thread.java:636)

"TP-Processor4" daemon prio=10 tid=0x00007f6bc4587800 nid=0x4055 runnable [0x00007f6b788b1000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:358)
at java.net.ServerSocket.implAccept(ServerSocket.java:470)
at java.net.ServerSocket.accept(ServerSocket.java:438)
at org.apache.jk.common.ChannelSocket.accept(ChannelSocket.java:312)
at org.apache.jk.common.ChannelSocket.acceptConnections(ChannelSocket.java:666)
at org.apache.jk.common.ChannelSocket$SocketAcceptor.runIt(ChannelSocket.java:876)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:689)
at java.lang.Thread.run(Thread.java:636)

"TP-Processor3" daemon prio=10 tid=0x00007f6bc4586800 nid=0x4054 in Object.wait() [0x00007f6b789b2000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b86bbe910> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b86bbe910> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"TP-Processor2" daemon prio=10 tid=0x00007f6bc43b7800 nid=0x4053 in Object.wait() [0x00007f6b78ab3000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b86bbed08> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b86bbed08> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"TP-Processor1" daemon prio=10 tid=0x00007f6bc4412800 nid=0x4052 in Object.wait() [0x00007f6b78bb4000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b86bbf100> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b86bbf100> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Monitor" prio=10 tid=0x00007f6bc445e800 nid=0x4051 in Object.wait() [0x00007f6b78cb5000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b86aae4f0> (a org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable)
at org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable.run(ThreadPool.java:564)
- locked <0x00007f6b86aae4f0> (a org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor25" daemon prio=10 tid=0x00007f6bc431e800 nid=0x4050 in Object.wait() [0x00007f6b78db5000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6bb0ae3400> (a java.lang.Object)
at java.lang.Object.wait(Object.java:502)
at org.directwebremoting.dwrp.ThreadWaitSleeper.goToSleep(ThreadWaitSleeper.java:36)
- locked <0x00007f6bb0ae3400> (a java.lang.Object)
at org.directwebremoting.dwrp.JettyContinuationSleeper.goToSleep(JettyContinuationSleeper.java:98)
- locked <0x00007f6bb0ae33b8> (a java.lang.Object)
at org.directwebremoting.dwrp.PollHandler.handle(PollHandler.java:211)
at org.directwebremoting.servlet.UrlProcessor.handle(UrlProcessor.java:101)
at org.directwebremoting.servlet.DwrServlet.doPost(DwrServlet.java:146)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:647)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:729)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:269)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:265)
at org.acegisecurity.intercept.web.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:107)
at org.acegisecurity.intercept.web.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:72)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.ui.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:166)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.providers.anonymous.AnonymousProcessingFilter.doFilter(AnonymousProcessingFilter.java:125)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.ui.rememberme.RememberMeProcessingFilter.doFilter(RememberMeProcessingFilter.java:142)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.wrapper.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:81)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.ui.basicauth.BasicProcessingFilter.doFilter(BasicProcessingFilter.java:173)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.ui.AbstractProcessingFilter.doFilter(AbstractProcessingFilter.java:271)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.ui.logout.LogoutFilter.doFilter(LogoutFilter.java:110)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.context.HttpSessionContextIntegrationFilter.doFilter(HttpSessionContextIntegrationFilter.java:249)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.util.FilterChainProxy.doFilter(FilterChainProxy.java:149)
at org.acegisecurity.util.FilterToBeanProxy.doFilter(FilterToBeanProxy.java:98)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at net.sourceforge.subsonic.filter.RequestEncodingFilter.doFilter(RequestEncodingFilter.java:43)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at net.sourceforge.subsonic.filter.ParameterDecodingFilter.doFilter(ParameterDecodingFilter.java:54)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at net.sourceforge.subsonic.filter.BootstrapVerificationFilter.doFilter(BootstrapVerificationFilter.java:54)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:172)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:174)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:875)
at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:665)
at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:528)
at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:81)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:689)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor24" daemon prio=10 tid=0x00007f6bc431d000 nid=0x404f in Object.wait() [0x00007f6b78eb7000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b869ccc08> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b869ccc08> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor23" daemon prio=10 tid=0x00007f6bc430f000 nid=0x404e in Object.wait() [0x00007f6b78fb8000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b86977fa8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b86977fa8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor22" daemon prio=10 tid=0x00007f6bc439b800 nid=0x404d in Object.wait() [0x00007f6b790b9000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b86a6c798> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b86a6c798> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor21" daemon prio=10 tid=0x00007f6bc4581000 nid=0x404c in Object.wait() [0x00007f6b791ba000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b86b41498> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b86b41498> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor20" daemon prio=10 tid=0x00007f6bc4594000 nid=0x404b in Object.wait() [0x00007f6b792bb000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b86b0ccc0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b86b0ccc0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor19" daemon prio=10 tid=0x00007f6bc452a000 nid=0x404a in Object.wait() [0x00007f6b793bc000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b86adc910> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b86adc910> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor18" daemon prio=10 tid=0x00007f6bc4528800 nid=0x4049 in Object.wait() [0x00007f6b794bd000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b86aa5310> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b86aa5310> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor17" daemon prio=10 tid=0x00007f6bc44a1800 nid=0x4048 in Object.wait() [0x00007f6b795be000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b86a12c08> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b86a12c08> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor16" daemon prio=10 tid=0x00007f6bc44ee800 nid=0x4047 in Object.wait() [0x00007f6b796bf000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b869779e0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b869779e0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor15" daemon prio=10 tid=0x00007f6bc4501000 nid=0x4046 in Object.wait() [0x00007f6b797c0000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b869cc7d0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b869cc7d0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor14" daemon prio=10 tid=0x00007f6bc42e1000 nid=0x4045 in Object.wait() [0x00007f6b798c1000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b86aa4aa0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b86aa4aa0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor13" daemon prio=10 tid=0x00007f6bc433e000 nid=0x4044 in Object.wait() [0x00007f6b799c2000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b86aa4ed8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b86aa4ed8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor12" daemon prio=10 tid=0x00007f6bc4521000 nid=0x4043 in Object.wait() [0x00007f6b79ac1000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b88a665a8> (a java.lang.Object)
at java.lang.Object.wait(Object.java:502)
at org.directwebremoting.dwrp.ThreadWaitSleeper.goToSleep(ThreadWaitSleeper.java:36)
- locked <0x00007f6b88a665a8> (a java.lang.Object)
at org.directwebremoting.dwrp.JettyContinuationSleeper.goToSleep(JettyContinuationSleeper.java:98)
- locked <0x00007f6b88a66560> (a java.lang.Object)
at org.directwebremoting.dwrp.PollHandler.handle(PollHandler.java:211)
at org.directwebremoting.servlet.UrlProcessor.handle(UrlProcessor.java:101)
at org.directwebremoting.servlet.DwrServlet.doPost(DwrServlet.java:146)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:647)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:729)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:269)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:265)
at org.acegisecurity.intercept.web.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:107)
at org.acegisecurity.intercept.web.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:72)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.ui.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:166)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.providers.anonymous.AnonymousProcessingFilter.doFilter(AnonymousProcessingFilter.java:125)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.ui.rememberme.RememberMeProcessingFilter.doFilter(RememberMeProcessingFilter.java:142)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.wrapper.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:81)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.ui.basicauth.BasicProcessingFilter.doFilter(BasicProcessingFilter.java:173)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.ui.AbstractProcessingFilter.doFilter(AbstractProcessingFilter.java:271)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.ui.logout.LogoutFilter.doFilter(LogoutFilter.java:110)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.context.HttpSessionContextIntegrationFilter.doFilter(HttpSessionContextIntegrationFilter.java:249)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.util.FilterChainProxy.doFilter(FilterChainProxy.java:149)
at org.acegisecurity.util.FilterToBeanProxy.doFilter(FilterToBeanProxy.java:98)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at net.sourceforge.subsonic.filter.RequestEncodingFilter.doFilter(RequestEncodingFilter.java:43)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at net.sourceforge.subsonic.filter.ParameterDecodingFilter.doFilter(ParameterDecodingFilter.java:54)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at net.sourceforge.subsonic.filter.BootstrapVerificationFilter.doFilter(BootstrapVerificationFilter.java:54)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:172)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:174)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:875)
at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:665)
at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:528)
at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:81)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:689)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor11" daemon prio=10 tid=0x00007f6bc4342000 nid=0x4042 runnable [0x00007f6b79bc4000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:358)
at java.net.ServerSocket.implAccept(ServerSocket.java:470)
at java.net.ServerSocket.accept(ServerSocket.java:438)
at org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:61)
at org.apache.tomcat.util.net.PoolTcpEndpoint.acceptSocket(PoolTcpEndpoint.java:408)
at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:71)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:689)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor10" daemon prio=10 tid=0x00007f6bc41c0800 nid=0x4041 in Object.wait() [0x00007f6b79cc5000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b86b41060> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b86b41060> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor9" daemon prio=10 tid=0x00007f6bc41c0000 nid=0x4040 in Object.wait() [0x00007f6b79dc6000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b86b8abc0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b86b8abc0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor8" daemon prio=10 tid=0x00007f6bc41fa000 nid=0x403f in Object.wait() [0x00007f6b79ec7000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b869300b0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b869300b0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor7" daemon prio=10 tid=0x00007f6bc4462000 nid=0x403e in Object.wait() [0x00007f6b79fc6000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b871480d0> (a java.lang.Object)
at java.lang.Object.wait(Object.java:502)
at org.directwebremoting.dwrp.ThreadWaitSleeper.goToSleep(ThreadWaitSleeper.java:36)
- locked <0x00007f6b871480d0> (a java.lang.Object)
at org.directwebremoting.dwrp.JettyContinuationSleeper.goToSleep(JettyContinuationSleeper.java:98)
- locked <0x00007f6b87148088> (a java.lang.Object)
at org.directwebremoting.dwrp.PollHandler.handle(PollHandler.java:211)
at org.directwebremoting.servlet.UrlProcessor.handle(UrlProcessor.java:101)
at org.directwebremoting.servlet.DwrServlet.doPost(DwrServlet.java:146)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:647)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:729)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:269)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:265)
at org.acegisecurity.intercept.web.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:107)
at org.acegisecurity.intercept.web.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:72)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.ui.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:166)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.providers.anonymous.AnonymousProcessingFilter.doFilter(AnonymousProcessingFilter.java:125)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.ui.rememberme.RememberMeProcessingFilter.doFilter(RememberMeProcessingFilter.java:142)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.wrapper.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:81)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.ui.basicauth.BasicProcessingFilter.doFilter(BasicProcessingFilter.java:173)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.ui.AbstractProcessingFilter.doFilter(AbstractProcessingFilter.java:271)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.ui.logout.LogoutFilter.doFilter(LogoutFilter.java:110)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.context.HttpSessionContextIntegrationFilter.doFilter(HttpSessionContextIntegrationFilter.java:249)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.util.FilterChainProxy.doFilter(FilterChainProxy.java:149)
at org.acegisecurity.util.FilterToBeanProxy.doFilter(FilterToBeanProxy.java:98)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at net.sourceforge.subsonic.filter.RequestEncodingFilter.doFilter(RequestEncodingFilter.java:43)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at net.sourceforge.subsonic.filter.ParameterDecodingFilter.doFilter(ParameterDecodingFilter.java:54)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at net.sourceforge.subsonic.filter.BootstrapVerificationFilter.doFilter(BootstrapVerificationFilter.java:54)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:172)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:174)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:875)
at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:665)
at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:528)
at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:81)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:689)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor6" daemon prio=10 tid=0x00007f6bc427a800 nid=0x403d in Object.wait() [0x00007f6b7a0c9000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b86945c58> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b86945c58> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor5" daemon prio=10 tid=0x00007f6bc4597000 nid=0x403c in Object.wait() [0x00007f6b7a1ca000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b86946d18> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b86946d18> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor4" daemon prio=10 tid=0x00007f6bc42bc800 nid=0x403b in Object.wait() [0x00007f6b7a2cb000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b8692fc80> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b8692fc80> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor3" daemon prio=10 tid=0x00007f6bc42ed000 nid=0x403a in Object.wait() [0x00007f6b7a3cc000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b869468e8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b869468e8> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor2" daemon prio=10 tid=0x00007f6bc4328000 nid=0x4039 in Object.wait() [0x00007f6b7a4cd000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b86946088> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b86946088> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"http-8180-Processor1" daemon prio=10 tid=0x00007f6bc4383000 nid=0x4038 in Object.wait() [0x00007f6b7a5ce000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b86aae0f0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:502)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:661)
- locked <0x00007f6b86aae0f0> (a org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:636)

"ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon prio=10 tid=0x00007f6bc421c800 nid=0x4037 waiting on condition [0x00007f6b7a9d2000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1548)
at java.lang.Thread.run(Thread.java:636)

"pool-3-thread-1" prio=10 tid=0x00007f6bc448b000 nid=0x4035 waiting on condition [0x00007f6b7a7d0000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00007f6b863ede58> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:193)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:688)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:681)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-2-thread-1" daemon prio=10 tid=0x00007f6bc4371800 nid=0x4034 waiting on condition [0x00007f6b7a8d1000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00007f6b863ea5d0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2081)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:193)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:688)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:681)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-2" prio=10 tid=0x00007f6bc4371000 nid=0x4032 waiting on condition [0x00007f6b7aad3000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00007f6b863ee6a8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:189)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:688)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:681)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-1" prio=10 tid=0x00007f6bc43a6800 nid=0x4031 waiting on condition [0x00007f6b7abd4000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00007f6b863ee6a8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:189)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:688)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:681)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"Timer-0" daemon prio=10 tid=0x00007f6bc4417800 nid=0x4030 in Object.wait() [0x00007f6b7acd5000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b863ef4e8> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:531)
- locked <0x00007f6b863ef4e8> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:484)

"Store chatCache Spool Thread" daemon prio=10 tid=0x00007f6bc4365800 nid=0x402f waiting on condition [0x00007f6b7add6000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at net.sf.ehcache.store.DiskStore.spoolAndExpiryThreadMain(DiskStore.java:589)
at net.sf.ehcache.store.DiskStore.access$800(DiskStore.java:65)
at net.sf.ehcache.store.DiskStore$SpoolAndExpiryThread.run(DiskStore.java:1036)

"Store musicFolderCache Spool Thread" daemon prio=10 tid=0x00007f6bc406e000 nid=0x402e waiting on condition [0x00007f6b7aed7000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at net.sf.ehcache.store.DiskStore.spoolAndExpiryThreadMain(DiskStore.java:589)
at net.sf.ehcache.store.DiskStore.access$800(DiskStore.java:65)
at net.sf.ehcache.store.DiskStore$SpoolAndExpiryThread.run(DiskStore.java:1036)

"HSQLDB Timer @1f3a34af" daemon prio=10 tid=0x00007f6bc43ff800 nid=0x402c in Object.wait() [0x00007f6bc8121000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b860a1a28> (a org.hsqldb.lib.HsqlTimer)
at org.hsqldb.lib.HsqlTimer.nextTask(Unknown Source)
- locked <0x00007f6b860a1a28> (a org.hsqldb.lib.HsqlTimer)
at org.hsqldb.lib.HsqlTimer$TaskRunner.run(Unknown Source)
at java.lang.Thread.run(Thread.java:636)

"Low Memory Detector" daemon prio=10 tid=0x00007f6bc40a3000 nid=0x402a runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE

"CompilerThread1" daemon prio=10 tid=0x00007f6bc40a0000 nid=0x4029 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE

"CompilerThread0" daemon prio=10 tid=0x00007f6bc409e000 nid=0x4028 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE

"Signal Dispatcher" daemon prio=10 tid=0x00007f6bc409c000 nid=0x4027 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE

"Finalizer" daemon prio=10 tid=0x00007f6bc407a800 nid=0x4026 in Object.wait() [0x00007f6bc8d57000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b85d5b728> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:133)
- locked <0x00007f6b85d5b728> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:149)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:177)

"Reference Handler" daemon prio=10 tid=0x00007f6bc4078800 nid=0x4025 in Object.wait() [0x00007f6bc8e58000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007f6b85d5b6e0> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:502)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
- locked <0x00007f6b85d5b6e0> (a java.lang.ref.Reference$Lock)

"main" prio=10 tid=0x00007f6bc4008000 nid=0x4020 runnable [0x00007f6bca3a8000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:358)
at java.net.ServerSocket.implAccept(ServerSocket.java:470)
at java.net.ServerSocket.accept(ServerSocket.java:438)
at org.apache.catalina.core.StandardServer.await(StandardServer.java:379)
at org.apache.catalina.startup.Catalina.await(Catalina.java:616)
at org.apache.catalina.startup.Catalina.start(Catalina.java:576)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:295)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:433)

"VM Thread" prio=10 tid=0x00007f6bc4074000 nid=0x4024 runnable

"GC task thread#0 (ParallelGC)" prio=10 tid=0x00007f6bc4012800 nid=0x4021 runnable

"GC task thread#1 (ParallelGC)" prio=10 tid=0x00007f6bc4014000 nid=0x4022 runnable

"VM Periodic Task Thread" prio=10 tid=0x00007f6bc40a5800 nid=0x402b waiting on condition

JNI global references: 839

Heap
PSYoungGen total 49472K, used 3887K [0x00007f6bad360000, 0x00007f6bb0bd0000, 0x00007f6bc1000000)
eden space 48448K, 5% used [0x00007f6bad360000,0x00007f6bad62be88,0x00007f6bb02b0000)
from space 1024K, 100% used [0x00007f6bb0ad0000,0x00007f6bb0bd0000,0x00007f6bb0bd0000)
to space 1664K, 0% used [0x00007f6bb0890000,0x00007f6bb0890000,0x00007f6bb0a30000)
PSOldGen total 72640K, used 52758K [0x00007f6b85a00000, 0x00007f6b8a0f0000, 0x00007f6bad360000)
object space 72640K, 72% used [0x00007f6b85a00000,0x00007f6b88d85850,0x00007f6b8a0f0000)
PSPermGen total 64704K, used 40001K [0x00007f6b7b200000, 0x00007f6b7f130000, 0x00007f6b85a00000)
object space 64704K, 61% used [0x00007f6b7b200000,0x00007f6b7d910770,0x00007f6b7f130000)

[2010-06-02 14:48:23,261] WARN org.directwebremoting.dwrp.JettyContinuationSleeper - Exception
java.lang.NullPointerException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.directwebremoting.util.Continuation.suspend(Continuation.java:57)
at org.directwebremoting.dwrp.JettyContinuationSleeper.goToSleep(JettyContinuationSleeper.java:90)
at org.directwebremoting.dwrp.PollHandler.handle(PollHandler.java:211)
at org.directwebremoting.servlet.UrlProcessor.handle(UrlProcessor.java:101)
at org.directwebremoting.servlet.DwrServlet.doPost(DwrServlet.java:146)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:647)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:729)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:269)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:265)
at org.acegisecurity.intercept.web.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:107)
at org.acegisecurity.intercept.web.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:72)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.ui.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:166)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.providers.anonymous.AnonymousProcessingFilter.doFilter(AnonymousProcessingFilter.java:125)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.ui.rememberme.RememberMeProcessingFilter.doFilter(RememberMeProcessingFilter.java:142)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.wrapper.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:81)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.ui.basicauth.BasicProcessingFilter.doFilter(BasicProcessingFilter.java:173)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.ui.AbstractProcessingFilter.doFilter(AbstractProcessingFilter.java:271)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.ui.logout.LogoutFilter.doFilter(LogoutFilter.java:110)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.context.HttpSessionContextIntegrationFilter.doFilter(HttpSessionContextIntegrationFilter.java:249)
at org.acegisecurity.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:275)
at org.acegisecurity.util.FilterChainProxy.doFilter(FilterChainProxy.java:149)
at org.acegisecurity.util.FilterToBeanProxy.doFilter(FilterToBeanProxy.java:98)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at net.sourceforge.subsonic.filter.RequestEncodingFilter.doFilter(RequestEncodingFilter.java:43)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at net.sourceforge.subsonic.filter.ParameterDecodingFilter.doFilter(ParameterDecodingFilter.java:54)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at net.sourceforge.subsonic.filter.BootstrapVerificationFilter.doFilter(BootstrapVerificationFilter.java:54)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:172)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108)

[sliver4321]

@linuxman

You might be experiencing the same problem as "derlachendehans".

Just as a quick test: can you update 'dwr' to version 2.0.6?
Download from here:
https://dwr.dev.java.net/files/document ... 94/dwr.jar

And put into <tomcat-home>/webapps/<subsonic>/WEB-INF/lib

Remember to move dwr 2.0.5 to another folder (we only want 1 version in the lib folder), and finally restart tomcat.

Also I recommend you update to the latest java version 1.6.0_20.

[linuxman]

I've switched over to the jetty version for right now and when I have time I'll give this a try. It was dying faster and faster and couldn't afford the effort to keep it up. Downside is I can't forward the port thru apache's proxy setting with the jetty version for some reason and just switched it to running on port 80. Is there a proxy type setting that would take a connection coming in as a regular port 80 url and then return the port 4040 back to the user's browser as a redirect?

[derlachendehans]

sorry for the late answer,
i did a update of dwr but that did not solve my problem.

btw max permsize was already set to 128mb when i did the dump.

[linuxman]

Hey are you running 64 bit or 32 bit linux? I'm running 64 and found when I went to the standalone jetty version it wouldn't even start till I changed my sdk to point to 64 bit and not 32 bit. Haven't switched and updated the dwr but I'm just wondering if you have a 32 bit java or 64 bit loaded with the tomcat?

[derlachendehans]

hi,

i`am also using a 64bit jdk, i've tried openjdk and sun jdk.
i connect tomcat to apache using mod_proxy_ajp, because some things like gathering album art does not work when i connect it with mod_proxy using http.
actually my servlet is not really dying like yours, i just noticed that there are threads floating around with open connections, that are doing nothing, and the number grows constantly as my users listen to music, but it never maxed out my threadpool with 200 threads.
problem starts when a cron job tries the weekly tomcat restart, then subsonic really dies.
when i try stopping the daemon, it takes quite a while and then stats "fail" but the processes are still running and can only be killed with the -9 switch.

[linuxman]

Wow interesting mine can actually be restarted via the service command but takes a while for it to kill all the hung threads. Funny that this is only happening using the tomcat server and not standalone with the jetty. I'm trying to figure how to do a proxy redirect with the jetty but it just comes back with a jetty server page and never loads the subsonic app when I proxy it. It was starting to die twice a day at the end and I just couldn't keep dealing with it everytimte I got an alert from a user it was down again.

[derlachendehans]

try the following, for me it works perfectly:

- download the current http://dist.codehaus.org/jetty/jetty-6.1.24/jetty-6.1.24.zip extract it to /opt/jetty.

- open subsonic.war and remove standard-1.1.2.jar from the WEB-INF/lib folder and copy the archive to /opt/jetty/webapps.

- then you have to change the owner of the working folder of subsonic (should be /var/subsonic ) to the user that will be running jetty.

- delete /tmp/subsonic.

- run jetty using the /opt/jetty/bin/jetty.sh start and boom you can use your apache proxy setting.

as i wrote in my posting above, for me it works better using mod_proxy_ajp. to use ajp you have to do some minor changes to the jetty configuration.