Subsonic 4.7.beta2 released

[BKKKPewsey]

Reading some of the posts here with regarding scan times with 4.7 there appears to a wide variation.
(From a long time to I am still waiting for it to finish )
As Sindre is mostly probably interested in discovering if there is a fundamental problem with the scanning in of tag info
and any possible database optimisation required could we post some facts to help him.
eg number of files, time of initial scan and rescan times, and the main type of media being scanned eg mp3, flacs etc
Also if the media is on local or networked drives as far as SS is concerned.
(And anything else you may think is relevant and I may have omitted)

I will start the ball rolling.

110,000 tracks 95% mp3 on local drives - just under 12 hrs to scan (initial)
SS running on windows server 2003 (WHS R1)
(Uninstalled after that so no rescan info)

[GBSub]

Not sure what you are talking about, I am running the beta2 and can add new music to my folder, refresh the browser and it shows up just fine, I don't need to rescan my media from the server at all. Maybe I am misunderstanding what you mean

I went back to 4.6 but I wasn't seeing the behavior you describe, it took a scan to make any files added show up. Hopefully just a bug, then. FWIW I run my server on Ubuntu 10.1

[sindre_mehus]

Reading some of the posts here with regarding scan times with 4.7 there appears to a wide variation.
(From a long time to I am still waiting for it to finish )
As Sindre is mostly probably interested in discovering if there is a fundamental problem with the scanning in of tag info
and any possible database optimisation required could we post some facts to help him.
eg number of files, time of initial scan and rescan times, and the main type of media being scanned eg mp3, flacs etc
Also if the media is on local or networked drives as far as SS is concerned.
(And anything else you may think is relevant and I may have omitted)

I will start the ball rolling.

110,000 tracks 95% mp3 on local drives - just under 12 hrs to scan (initial)
SS running on windows server 2003 (WHS R1)
(Uninstalled after that so no rescan info)

Also, it would be most useful to see the content of subsonic.log.

Thanks in advance,
Sindre

[sorrodje]

I wish we could find out what has changed in 4.7b2 that requires you to manually start a media folder scan before new music will show up in SS.

Previous versions going as far back as I can remember just required a refresh of the browser window on the Client side before new music will show up.

Pretty massive shift don't you think?

I really hope there's an option to preserve the old behavior in this regard. One of the huge attractions to me and why I gladly paid for Subsonic was the live file system. I hate relying on timed or manual rescans. I want to throw a new piece of media in my folder and go.

Not sure what you are talking about, I am running the beta2 and can add new music to my folder, refresh the browser and it shows up just fine, I don't need to rescan my media from the server at all. Maybe I am misunderstanding what you mean

Hi All


I'm a really happy user of Subsonic 4.6 ( installed with .deb behind an apache2 front web server configured as reverse proxy on a Ubuntu 12.04 Virual private server) and I give a try to 4.7b2 whitch seems to work fine .. except the necessity to do manual scan ( or to wait nightly automatic scan ) to make appear new music in Subsonic. If waiting a few hours to get new music in database is not too boring , waiting few hours to be able to hear it is a bad point comparing 4.6 version.

So I suscribed here in order to find or report this fact as a bug and I found these posts ! . I really hope "real time" scanning will come back in Subsonic 4.7 .

Thanks for all this amazing work on Subsonic.

Sorrodje from Burgundy/France

[StrawDragon]

I agree with the above. I use Subsonic for both as a media center and music. I hate having to manually click the scan folders so new content would appear. The older version did handle it better.

Can't wait until the final release and actually be able to create a playlist for movies.

[phazzard]

Here is where this scan started:

[2012-07-12 03:00:00,756] INFO MediaScannerService - Starting to scan media library.
[2012-07-12 03:06:42,273] INFO MediaScannerService - Scanned media library with 250 entries.
[2012-07-12 03:12:23,851] INFO MediaScannerService - Scanned media library with 500 entries.
[2012-07-12 03:18:00,890] INFO MediaScannerService - Scanned media library with 750 entries.
[2012-07-12 03:22:53,094] INFO MediaScannerService - Scanned media library with 1000 entries.
[2012-07-12 03:28:39,461] INFO MediaScannerService - Scanned media library with 1250 entries.
[2012-07-12 03:34:21,851] INFO MediaScannerService - Scanned media library with 1500 entries.
[2012-07-12 03:37:59,191] INFO NetworkService - Successfully forwarding port 4040.
[2012-07-12 03:40:11,183] INFO MediaScannerService - Scanned media library with 1750 entries.
[2012-07-12 03:45:47,052] INFO MediaScannerService - Scanned media library with 2000 entries.
[2012-07-12 03:51:33,794] INFO MediaScannerService - Scanned media library with 2250 entries.
[2012-07-12 03:57:28,429] INFO MediaScannerService - Scanned media library with 2500 entries.
[2012-07-12 04:03:12,924] INFO MediaScannerService - Scanned media library with 2750 entries.
[2012-07-12 04:08:59,573] INFO MediaScannerService - Scanned media library with 3000 entries.
[2012-07-12 04:14:55,456] INFO MediaScannerService - Scanned media library with 3250 entries.
[2012-07-12 04:20:27,518] INFO MediaScannerService - Scanned media library with 3500 entries.
[2012-07-12 04:26:13,730] INFO MediaScannerService - Scanned media library with 3750 entries.
[2012-07-12 04:31:58,537] INFO MediaScannerService - Scanned media library with 4000 entries.
[2012-07-12 04:37:55,622] INFO MediaScannerService - Scanned media library with 4250 entries.
[2012-07-12 04:38:02,611] INFO NetworkService - Successfully forwarding port 4040.
[2012-07-12 04:43:57,325] INFO MediaScannerService - Scanned media library with 4500 entries.
[2012-07-12 04:49:56,516] INFO MediaScannerService - Scanned media library with 4750 entries.
[2012-07-12 04:55:35,333] INFO MediaScannerService - Scanned media library with 5000 entries.
[2012-07-12 05:01:13,978] INFO MediaScannerService - Scanned media library with 5250 entries.
[2012-07-12 05:06:58,941] INFO MediaScannerService - Scanned media library with 5500 entries.
[2012-07-12 05:12:40,800] INFO MediaScannerService - Scanned media library with 5750 entries.
[2012-07-12 05:18:33,049] INFO MediaScannerService - Scanned media library with 6000 entries.
[2012-07-12 05:24:22,146] INFO MediaScannerService - Scanned media library with 6250 entries.
[2012-07-12 05:30:02,040] INFO MediaScannerService - Scanned media library with 6500 entries.
[2012-07-12 05:35:56,535] INFO MediaScannerService - Scanned media library with 6750 entries.
[2012-07-12 05:38:06,250] INFO NetworkService - Successfully forwarding port 4040.
[2012-07-12 05:41:30,252] INFO MediaScannerService - Scanned media library with 7000 entries.
[2012-07-12 05:47:18,288] INFO MediaScannerService - Scanned media library with 7250 entries.
[2012-07-12 05:52:50,522] INFO MediaScannerService - Scanned media library with 7500 entries.
[2012-07-12 05:58:39,120] INFO MediaScannerService - Scanned media library with 7750 entries.
[2012-07-12 06:04:17,079] INFO MediaScannerService - Scanned media library with 8000 entries.
[2012-07-12 06:10:09,234] INFO MediaScannerService - Scanned media library with 8250 entries.
[2012-07-12 06:15:56,522] INFO MediaScannerService - Scanned media library with 8500 entries.
[2012-07-12 06:21:44,652] INFO MediaScannerService - Scanned media library with 8750 entries.
[2012-07-12 06:27:28,368] INFO MediaScannerService - Scanned media library with 9000 entries.
[2012-07-12 06:33:14,829] INFO MediaScannerService - Scanned media library with 9250 entries.
[2012-07-12 06:38:09,686] INFO NetworkService - Successfully forwarding port 4040.
[2012-07-12 06:38:57,391] INFO MediaScannerService - Scanned media library with 9500 entries.
[2012-07-12 06:44:09,812] INFO MediaScannerService - Scanned media library with 9750 entries.
[2012-07-12 06:49:48,973] INFO MediaScannerService - Scanned media library with 10000 entries.

Still going, here is where we are today:

[2012-07-16 06:45:48,747] INFO MediaScannerService - Scanned media library with 285250 entries.
[2012-07-16 06:50:41,544] INFO MediaScannerService - Scanned media library with 285500 entries.
[2012-07-16 06:55:31,127] INFO MediaScannerService - Scanned media library with 285750 entries.
[2012-07-16 07:00:24,236] INFO MediaScannerService - Scanned media library with 286000 entries.
[2012-07-16 07:05:11,854] INFO MediaScannerService - Scanned media library with 286250 entries.
[2012-07-16 07:10:10,361] INFO MediaScannerService - Scanned media library with 286500 entries.
[2012-07-16 07:14:52,004] INFO MediaScannerService - Scanned media library with 286750 entries.
[2012-07-16 07:19:41,509] INFO MediaScannerService - Scanned media library with 287000 entries.
[2012-07-16 07:24:36,677] INFO MediaScannerService - Scanned media library with 287250 entries.
[2012-07-16 07:29:17,524] INFO MediaScannerService - Scanned media library with 287500 entries.
[2012-07-16 07:34:06,952] INFO MediaScannerService - Scanned media library with 287750 entries.
[2012-07-16 07:38:57,034] INFO MediaScannerService - Scanned media library with 288000 entries.
[2012-07-16 07:43:49,129] INFO MediaScannerService - Scanned media library with 288250 entries.
[2012-07-16 07:44:13,528] INFO NetworkService - Successfully forwarding port 4040.
[2012-07-16 07:48:39,287] INFO MediaScannerService - Scanned media library with 288500 entries.
[2012-07-16 07:56:47,743] INFO MediaScannerService - Scanned media library with 288750 entries.
[2012-07-16 08:05:59,384] INFO MediaScannerService - Scanned media library with 289000 entries.
[2012-07-16 08:12:00,350] INFO MediaScannerService - Scanned media library with 289250 entries.
[2012-07-16 08:17:04,177] INFO MediaScannerService - Scanned media library with 289500 entries.
[2012-07-16 08:22:11,695] INFO MediaScannerService - Scanned media library with 289750 entries.
[2012-07-16 08:27:45,757] INFO MediaScannerService - Scanned media library with 290000 entries.
[2012-07-16 08:33:10,248] INFO MediaScannerService - Scanned media library with 290250 entries.
[2012-07-16 08:37:59,390] INFO MediaScannerService - Scanned media library with 290500 entries.
[2012-07-16 08:42:50,487] INFO MediaScannerService - Scanned media library with 290750 entries.
[2012-07-16 08:44:17,146] INFO NetworkService - Successfully forwarding port 4040.
[2012-07-16 08:47:40,648] INFO MediaScannerService - Scanned media library with 291000 entries.
[2012-07-16 08:52:33,273] INFO MediaScannerService - Scanned media library with 291250 entries.
[2012-07-16 08:57:22,030] INFO MediaScannerService - Scanned media library with 291500 entries.
[2012-07-16 09:02:17,120] INFO MediaScannerService - Scanned media library with 291750 entries.
[2012-07-16 09:07:02,850] INFO MediaScannerService - Scanned media library with 292000 entries.
[2012-07-16 09:11:52,574] INFO MediaScannerService - Scanned media library with 292250 entries.
[2012-07-16 09:16:48,007] INFO MediaScannerService - Scanned media library with 292500 entries.
[2012-07-16 09:21:42,707] INFO MediaScannerService - Scanned media library with 292750 entries.


Still a ways to go - I know I have a lot of files (around 800,000) but in previous versions it would take about 5 hours to scan - Now it is taking 2 weeks. Any ideas?

Sindre, again I ABSOLUTELY love Subsonic!

Thanks

[BKKKPewsey]

Still a ways to go - I know I have a lot of files (around 800,000) but in previous versions it would take about 5 hours to scan - Now it is taking 2 weeks. Any ideas?

Don't add any more music - it may never finish

I think that shows somewhat the wide variations - using my lowly powered server as a benchmark 110k files in just under 12 hours
so I would have expected 800k files in about 3-4 days But 2 weeks

[mp3sponge]

Wow... it takes you guys that long to add the music?.... ive got about 270,000 files (1.8tb) and it might take......2 hours to add it all. maybe less.... I always switch out to another task while its running.

also , its running on a dedicated quad core system with 4gb ram only (win7).

I'll reinstall and run the scan again just to make sure im not wrong about this , but I still have piles of problems with java errors after , so I switched back to 4.6 . Man I wish this mashup would work for me , it just looks amazing, and has all the little things I wish were there before (like the (20xx) years next to the albums). So if after the scan Im wrong , I'll edit my post and see what the dealio is.



Sponge.

[GJ51]

I have several 4.7b2 sites up on different platforms and they all work fine. You might get java problems with an upgade, but I haven't run into any issues doing a "clean" install even with Java 7. I only have about 50k tracks but a scan usually only takes about 10 - 20 mins. depending on which platform I'm on.

I've even got it running on an atom powered netbook. I'll time a scan.

[BKKKPewsey]

Before Gary responds back with his figures from his netbook (Modified by Cray Research methinks )
I thought I would do a bit more testing with my test server.
Unfortunately I am still getting the problem I had previous eg. the scan will not finish.
Checking the log I get

Code: Select all

[7/16/12 11:25:15 PM BST]   WARN   FileUtil   Failed to list children for \\XXXX\Music\B\The Bravery
[7/16/12 11:25:15 PM BST]   WARN   FileUtil   Failed to list children for \\XXXX\Music\B\The Bronx
[7/16/12 11:25:15 PM BST]   WARN   FileUtil   Failed to list children for \\XXXX\Music\B\The Burnpool
[7/16/12 11:25:15 PM BST]   WARN   FileUtil   Failed to list children for \\XXXX\Music\B\The Byrds
.........and so on

It lists all the artists correctly in the left frame but most of them now appear to have released no albums
I used the quick fix suggested by Sindre

Code: Select all

update media_file set present=true

From db.view but the scan still will not go past the point it failed on the initial scan with no errors shown subsequently in the log.
So all those users who think that their scans finished np check that you can actually see your tracks

[lovebags]

A handy feature if it could be incorporated would be the ability to arrange playlists up and down in the left hand side panel. Currently if I want to insert a new playlist I have to delete everything up to that point.

[DaveWut]

Hi all,

I don't know if someone have already proposed the feature, but well, here's the idea: One of my friend told me it would be cool to implement a kind of shared playlist, which can be launched and listened by multiple users at the same time on different computers / mobiles. These kind of playlist can only be managed by admins or to some dedicated people on SS in a specific page / control panel on the web site. On this page, you can start / stop / pause the playlist and instantaneously affect all users who are listening it. It would be a kind of virtual radio or some sort that will allow users to listen to a user defined playlist.

I hope you guys understand what I mean... and that helps to give a new idea to improve SS!
Dave

[asayler]

I don't know if there is a formal method for reporting 4.7 beta 2 bugs (if so, please direct me to it), but there seems to be an issue with Subsonic ignoring media directories when there is a dash ('-') in the path (at least on Linux systems):

viewtopic.php?f=5&t=9904&p=43570&hilit=dash#p43570
viewtopic.php?f=2&t=9863&p=43650&hilit=dash#p43650

[BKKKPewsey]

but there seems to be an issue with Subsonic ignoring media directories when there is a dash ('-') in the path (at least on Linux systems):

I can report that isn't (or appears not) an issue on Windows.
However I have just noticed that the database does not clear old entries
I updated one of my artist directories to my standard format artist/year - album/tracks which was missing the year part
SS is now showing both the new and the old folders names so that artist now has twice as many albums then before
(One way of increasing your media collection I suppose )
However I still cannot get it to scan all my media in though

With regarding 4.7beta issues etc I think we should keep it all in this thread at the moment.
At least Sindre won't need to scan all over the board then.

[lovebags]

However I have just noticed that the database does not clear old entries
I updated one of my artist directories to my standard format artist/year - album/tracks which was missing the year part
SS is now showing both the new and the old folders names so that artist now has twice as many albums then before

Yes I just had a similar issue where I added a new folder, did the scan (24,000 entries took 73 seconds) and it didn't show up in the LHS. I then added a shortcut and it did show up, then removed the shortcut and rescanned a few more times and the folder now shows up. Not sure which bit made it work though.