CPU usage and no HTTP requests being fulfilled

[FalseTetrabyte]

Over the past few days, my Subsonic server has been a real bastard to get working. It's been running flawlessly for a long time, but lately, I log into the PC hosting it and the subsonic service is chewing up 17% of the CPU and it won't serve HTTP requests - the page just sits there and tries to load for as long as I have the patience to let it keep going.

I thought I had resolved it by reinstalling Subsonic yesterday, but it's back to doing it again.

Server is an AMD Phenom II X6 1100T, 16GB RAM running Server 2008 R2. Disks are healthy, no issues there, and no one else is using the box. (pretty much a given anyway since the webpage won't load)

Anyone run into something like this? Any fixes?

[BKKKPewsey]

Have a look at the SS log file and see if there are any errors being shown and what it is doing.
I wonder if may be doing a media scan and something is causing a hiccup

[FalseTetrabyte]

For some reason the Help forum wasn't showing up when I made this post - if a mod could move it over, I'd appreciate it.

The agent log looks like this:

Code: Select all

Executing: subsonic-service.exe -stop
81448736 [pool-1-thread-2] WARN org.springframework.remoting.rmi.RmiProxyFactoryBean - Could not connect to RMI service [rmi://localhost:9412/SubsonicDeployerService] - retrying
Executing: subsonic-service.exe -start
Executing: subsonic-service.exe -stop


and the Service log looks like this (only the latest lines posted, not sure how far back this goes, the file was dated a few days ago):

Code: Select all

15756 [main] INFO org.springframework.web.servlet.DispatcherServlet - FrameworkServlet 'subsonic': initialization started
15756 [main] INFO org.springframework.web.context.support.XmlWebApplicationContext - Refreshing org.springframework.web.context.support.XmlWebApplicationContext@c8c7d6: display name [WebApplicationContext for namespace 'subsonic-servlet']; startup date [Tue Feb 05 09:06:53 MST 2013]; parent: org.springframework.web.context.support.XmlWebApplicationContext@16921fd
15756 [main] INFO org.springframework.beans.factory.xml.XmlBeanDefinitionReader - Loading XML bean definitions from ServletContext resource [/WEB-INF/subsonic-servlet.xml]
15865 [main] INFO org.springframework.web.context.support.XmlWebApplicationContext - Bean factory for application context [org.springframework.web.context.support.XmlWebApplicationContext@c8c7d6]: org.springframework.beans.factory.support.DefaultListableBeanFactory@18eb7b8
16411 [main] INFO org.springframework.beans.factory.support.DefaultListableBeanFactory - Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@18eb7b8: defining beans [leftController,rightController,statusController,mainController,playlistController,importPlaylistController,topController,helpController,moreController,uploadController,lyricsController,allmusicController,podcastController,podcastReceiverController,podcastReceiverAdminController,setMusicFileInfoController,shareManagementController,setRatingController,randomPlayQueueController,changeCoverArtController,nowPlayingController,starredController,searchController,settingsController,playerSettingsController,shareSettingsController,musicFolderSettingsController,networkSettingsController,transcodingSettingsController,internetRadioSettingsController,podcastSettingsController,generalSettingsController,advancedSettingsController,personalSettingsController,avatarUploadController,userSettingsController,passwordSettingsController,homeController,editTagsController,playQueueController,coverArtController,avatarController,proxyController,statusChartController,userChartController,m3uController,streamController,hlsController,videoPlayerController,externalPlayerController,downloadController,donateController,multiController,wapController,restController,dbController,donateValidator,userSettingsValidator,passwordSettingsValidator,urlMapping,messageSource,themeSource,localeResolver,themeResolver,viewResolver]; parent: org.springframework.beans.factory.support.DefaultListableBeanFactory@88e2dd
17394 [main] INFO org.springframework.web.servlet.DispatcherServlet - FrameworkServlet 'subsonic': initialization completed in 1638 ms
17410 [main] INFO org.mortbay.log - Started SelectChannelConnector@0.0.0.0:6464
Subsonic running on: http://localhost:6464/
17488 [main] INFO org.springframework.remoting.rmi.RmiServiceExporter - Looking for RMI registry at port '9412'
18517 [main] INFO org.springframework.remoting.rmi.RmiServiceExporter - Could not detect RMI registry - creating new one
18580 [main] INFO org.springframework.remoting.rmi.RmiServiceExporter - Binding service 'SubsonicDeployerService' to RMI registry: RegistryImpl[UnicastServerRef [liveRef: [endpoint:[10.6.4.3:9412](local),objID:[0:0:0, 0]]]]
34180 [btpool0-7] INFO org.directwebremoting.log.startup - Starting: DwrServlet v3.0.0.116.rc1 on jetty-6.1.x / JDK 1.6.0_33 from Sun Microsystems Inc. at


No idea if there's a problem or not...

[BKKKPewsey]

Wrong log! Have a look at your main SS log which in Windows will be in c:\subsonic

[FalseTetrabyte]

Thanks, I've never had to post a subsonic log before.

Also, I saw your forum sticky - this is indeed an upgrade to 4.7 from 4.6 (and from the version prior to 4.6, 4.5?) but it's only been upgraded twice overall.

This latest install is actually a fresh install, and I started the software, let it create the db files from scratch, then I stopped the services, imported the old DB folders and started the service again.

The software is still locking up on me - refusing to display the page when I go to use it the next day, but if I bounce the service it'll start accepting loads again. I'm to the point that I'm ready to trash the database (cry) and just start over.

Here's the full log file: http://pastebin.com/E23ENKPt

Also, when this occurs, subsonic-service.exe*32 is running at 17% CPU utilization (6 core Phenom II X6 CPU) and I have to stop the service via the control applet, then end the task on that exe via task manager, then I can restart the service via the control applet and it starts resolving again. The software applet says it's using anywhere from 41-50 MB of memory when the hangup occurs.

[larry.hanks]

I didn't notice anything wrong in your log but not sure if I missed anything either.

Do you know if you have any other services running on that box that could be using the same ports as subsonic?

In a command prompt you can run a "netstat -an" to show port numbers the server is listening on.

I think if it were me in your position, I would probably shut down the subsonic service, copy the entire subsonic folder to another location as a backup. Then I would uninstall subsonic. Reboot the machine. Then reinstall subsonic. Shut down the service again. Then copy your backup folder over top of the newly/freshly installed subsonic folder but I wouldn't copy over any of the files that are just in the root of the subsonic folder. So in short, I would only copy over the folders of, db, db.backup, jetty, log, lucene, lucene2, thumbs, transcode. By doing this you would have freshly installed exe's and you'll still have your original database.

Then just start the service back up and hopefully you're back in business. I have no idea if this will help you but it's where I think I'd start.

[FalseTetrabyte]

The system was my home central file server running Server 2008 R2. It had a ton of things going on, and only after upgrading to 4.7 from 4.6 and prior did it have that issue.

I did exactly what you said - twice - and it persisted as long as I kept using the old database.

In the end however, my other project took precidence and the issue is resolved. How?

I virtualized my physical servers on one box and installed Subsonic from scratch to 4.7. I like the new features enough that it made sense to just start over - I already know what my favorite tracks are, and my playlists were stagnant, but like most geeks, a problem needs fixing! lol

Thanks for the help at least, I hope this post helps others in some way if they're struggling and find that your idea works, larry.

Still a huge Subsonic fan! Pandora/Spotify/etc, eat your heart out.

- Edit- the new Subsonic install is running on a copy of Server 2012 if anyone out there is considering doing this. It works great. Fantastic results, and with 3 vCPUs in ESXi 5.1 it transcodes anything I throw at it and has processing power to spare (two cores doing video transcoding was maxing out at 99-100%, but three cores averages about 85% at peak usage which is more comfortable for me, given how VMWare assigns vCPUs and such)

[BKKKPewsey]

did exactly what you said - twice - and it persisted as long as I kept using the old database.

Yep that was the problem which is why I mentioned about the clean install - if you copy back the db you are effectively going back to an upgrade as 4.7 has to modify/upgrade your DB.
SS 4.7 appears to have difficulties with upgrading from a 4.6 DB at times, I know my test server kept having issues , usually after a day or two, but since doing a clean install and just letting SS rescan media (6 hrs ) there have been no problems.

[larry.hanks]

Glad to hear you got everything working!

Gotta love the VMware stuff. I've been running my stuff in VMware Workstation for a long time now. Love it. Snapshots really help in case an upgrade doesn't go well....been known to happen.