Is there a limit to the number of songs?

[sindre_mehus]

I have some more questions:

Did you use Subsonic 2.8 previously, and did it work then?
Is all of your 106 GB music collection mp3's, or do you have some other formats?
Can you please look in the logs in TOMCAT_HOME\logs for anything suspicious?

Yes, you will be able to see, browse and play all your music even if this error occurs. What will not work is searching, library statistics and the "Random" and "Newest" page.

Sindre

[PeeGee]

Hi Sindre,

1) Nope, this is the first version I use!

2) Yes, they're all mp3's!

3) I took a look att the tomcatlogs and found this in log called stdout_20061018.log:

log4j:WARN No appenders could be found for logger (org.apache.commons.digester.Digester.sax).
log4j:WARN Please initialize the log4j system properly.
Exception in thread "Search Index Generator" java.lang.OutOfMemoryError: Java heap space
log4j:WARN No appenders could be found for logger (org.apache.commons.digester.Digester.sax).
log4j:WARN Please initialize the log4j system properly.
Exception in thread "Search Index Generator" java.lang.OutOfMemoryError: Java heap space
Exception in thread "HSQLDB Timer @bac9b9" java.lang.NullPointerException
at org.hsqldb.lib.HsqlTimer.nextTask(Unknown Source)
at org.hsqldb.lib.HsqlTimer$TaskRunner.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
log4j:WARN No appenders could be found for logger (org.apache.commons.digester.Digester.sax).
log4j:WARN Please initialize the log4j system properly.
Exception in thread "HSQLDB Timer @1cb52ae" java.lang.NullPointerException
at org.hsqldb.lib.HsqlTimer.nextTask(Unknown Source)
at org.hsqldb.lib.HsqlTimer$TaskRunner.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
log4j:WARN No appenders could be found for logger (org.apache.commons.digester.Digester.sax).
log4j:WARN Please initialize the log4j system properly.
Exception in thread "Search Index Generator" java.lang.OutOfMemoryError: Java heap space
Exception in thread "Search Index Generator" java.lang.OutOfMemoryError: Java heap space
Exception in thread "Search Index Generator" java.lang.OutOfMemoryError: Java heap space

Maybe this could give a hint of the problem!

Regards / Patrik

[sindre_mehus]

Thanks. The log clearly indicates that there is a memory problem. However, I think we can rule out the possibility that not enough memory is allocated, since you got the same error with 256MB (which is much more than should be necessary. I'm running with 64MB without problems, and I have 80GB worth of music).

There could be a bug (most likely in some third-party libraries I use to parse ID3 tags) which allocates a lot of memory, causing OutOfMemoryError.

It would be extremely helpful if you could do the following:

1) Rename c:\subsonic\subsonic8.index to subsonic8.index.old
2) Visit the Subsonic home page. The search index creation should start automatically.
3) When the search index is done (or fails after 9000 entries), check if the new subsonic8.index is identical to the old.
4) If they are identical, please post the few last lines of the index file.

Thanks!
Sindre

[PeeGee]

Hi S,

It failed at the exact same spot as usual and the indexfiles were identical. Here are som logs for you!

subsonic.log:
[2006-10-18 11:04:48,653] INFO DaoHelper - Checking database schema.
[2006-10-18 11:04:56,198] INFO DaoHelper - Done checking database schema.
[2006-10-18 11:04:57,417] INFO SearchService - Automatic index creation scheduled to run every 1 day(s), starting at Thu Oct 19 03:00:00 CEST 2006
[2006-10-18 11:05:31,911] INFO VersionService - Resolved latest Subsonic final version to: 2.8
[2006-10-18 11:05:31,911] INFO VersionService - Resolved latest Subsonic beta version to: 2.9.beta1
[2006-10-18 11:05:31,943] INFO VersionService - Resolved local Subsonic version to: 2.9.beta1
[2006-10-18 11:05:38,942] INFO SearchService - Starting to create search index.
[2006-10-18 11:07:06,288] INFO SearchService - Created search index with 1000 entries.
[2006-10-18 11:07:31,565] INFO SearchService - Created search index with 2000 entries.
[2006-10-18 11:07:54,530] INFO SearchService - Created search index with 3000 entries.
[2006-10-18 11:08:24,916] INFO SearchService - Created search index with 4000 entries.
[2006-10-18 11:08:54,412] INFO SearchService - Created search index with 5000 entries.
[2006-10-18 11:09:21,220] INFO SearchService - Created search index with 6000 entries.
[2006-10-18 11:09:44,357] INFO SearchService - Created search index with 7000 entries.
[2006-10-18 11:10:13,759] INFO SearchService - Created search index with 8000 entries.
[2006-10-18 11:10:14,962] WARN Mp3Parser - Failed to parse MP3 header for E:\FTP\-=Music=-\-=Albums=-\-=Unsorted Albums=-\Kate Bush discography - 11 albums - 192+ kbit\1990 - This Woman's Work, Vol. 1\Kate Bush - This Woman's Work, Vol. 1 - 12 - The Handsome Cabin Boy.mp3
java.lang.IndexOutOfBoundsException: 0
at java.nio.DirectByteBuffer.get(Unknown Source)
at org.jaudiotagger.audio.mp3.MPEGFrameHeader.isMPEGFrame(MPEGFrameHeader.java:865)
at org.jaudiotagger.audio.mp3.MP3AudioHeader.seek(MP3AudioHeader.java:129)
at org.jaudiotagger.audio.mp3.MP3AudioHeader.<init>(MP3AudioHeader.java:82)
at net.sourceforge.subsonic.domain.Mp3Parser.parseMp3Header(Mp3Parser.java:200)
at net.sourceforge.subsonic.domain.Mp3Parser.getRawMetaData(Mp3Parser.java:126)
at net.sourceforge.subsonic.domain.Mp3Parser.getMetaData(Mp3Parser.java:26)
at net.sourceforge.subsonic.domain.MusicFile.getMetaData(MusicFile.java:186)
at net.sourceforge.subsonic.service.SearchService$Line.forFile(SearchService.java:511)
at net.sourceforge.subsonic.service.SearchService$Scanner.visit(SearchService.java:571)
at net.sourceforge.subsonic.domain.MusicFile.accept(MusicFile.java:281)
at net.sourceforge.subsonic.domain.MusicFile.accept(MusicFile.java:288)
at net.sourceforge.subsonic.domain.MusicFile.accept(MusicFile.java:288)
at net.sourceforge.subsonic.domain.MusicFile.accept(MusicFile.java:288)
at net.sourceforge.subsonic.service.SearchService$1.run(SearchService.java:80)

[2006-10-18 11:10:35,537] INFO SearchService - Created search index with 9000 entries.


Last lines in stdout_20061018:
log4j:WARN No appenders could be found for logger (org.apache.commons.digester.Digester.sax).
log4j:WARN Please initialize the log4j system properly.
Exception in thread "Search Index Generator" java.lang.OutOfMemoryError: Java heap space



Last lines in subsonic8.index:
A ixYxi 1129205243734 ixYxi E:\FTP\-=Music=-\-=Albums=-\-=Unsorted Albums=-\Mercury Rev - All Is Dream ixYxi 0 ixYxi ixYxi ixYxi ixYxi
F ixYxi 1104446233000 ixYxi E:\FTP\-=Music=-\-=Albums=-\-=Unsorted Albums=-\Mercury Rev - All Is Dream\01 The Dark Is Rising.mp3 ixYxi 7015222 ixYxi MERCURY REV ixYxi ALL IS DREAM ixYxi THE DARK IS RISING ixYxi
F ixYxi 1104446233000 ixYxi E:\FTP\-=Music=-\-=Albums=-\-=Unsorted Albums=-\Mercury Rev - All Is Dream\02 Tides Of The Moon.mp3 ixYxi 7518654 ixYxi MERCURY REV ixYxi ALL IS DREAM ixYxi TIDES OF THE MOON ixYxi
F ixYxi 1104446233000 ixYxi E:\FTP\-=Music=-\-=Albums=-\-=Unsorted Albums=-\Mercury Rev - All Is Dream\03 Chains.mp3 ixYxi 6299247 ixYxi MERCURY REV ixYxi ALL IS DREAM ixYxi CHAINS ixYxi
F ixYxi 1104446233000 ixYxi E:\FTP\-=Music=-\-=Albums=-\-=Unsorted Albums=-\Mercury Rev - All Is Dream\04 Lincoln's Eyes.mp3 ixYxi 10310410 ixYxi MERCURY REV ixYxi ALL IS DREAM ixYxi LINCOLN'S EYES ixYxi

/ Patrik

[sindre_mehus]

Excellent!

The problem is then most likely with the next file. Can you please email me track 5, i.e., the file after this one:

E:\FTP\-=Music=-\-=Albums=-\-=Unsorted Albums=-\Mercury Rev - All Is Dream\04 Lincoln's Eyes.mp3

Can you also try to rename the track 5 file to something not ending with ".mp3" and then recreate the search index?

Sindre

[PeeGee]

Hi S,

I've mailed you the requested file.

I also renamed that mp3 to something else and tried a rescan, but it stops at the exact same place.

/ Patrik

[PeeGee]

Hi Sindre,

The mail seems to have bounced. Anyhow, I did as you told me in the mail and scrapped this album from the collection and guess what.......

IT WORKES.............so sweet!

Do you still want this album in "errorseeking" purposes maybe?

Thanks for your help, now I will add all the other directories with music.

/ Patrik

[sindre_mehus]

Great!

Yes, I would very much like one of the "bad" files for further error seeking. If email doesn't work, maybe you can upload it to http://mihd.net/

Sindre

[PeeGee]

Hi Sindre,

I'm having trouble to upload the file to that site as well, it claims there is a problem with the file half way through.

Do we have any other option?

/ PG

[sindre_mehus]

Yes, here are some other similar services:

http://www.rapidshare.com/
http://www.megaupload.com/
http://www.yousendit.com/

Sindre

[PeeGee]

Hi Sindre,

A new strange problem with the feature showing the amount of tracks and more. My subsoniclog tells me the index is going well and it looks like this:

[2007-03-01 03:01:31,993] INFO SearchService - Created search index with 26348 entries.

The sumfeature to the upperleft in subsonic is telling me the following:

2,656 artists
2,275 albums
24,508 songs
134.29 GB (~ 2,086 hours)

As far as I understand it I'm missing 1840 songs, right?

Any ideas?

Regards / Patrik

[sindre_mehus]

Hi Patrik,

The search index contains both files and directories, hence it has more entries than the number of songs displayed.

Sindre

[PeeGee]

Ah that explains it, thanx for input Sindre!

/ Patrik

[Mannetje]

First of all, thank you for this great program!!!!

I have the same problem... I have two locations on my Server 2003 that i'm using in Subsonic.

I made some extra (only mp3) albums and they didn't show up in my list.
But when i only selected the top dir where they are in i suddenly had them in my list.

The numbers that are showing below are far less than in reality. And it has bin for at leest 1 week. (tried to refresh by hand also)

6.596 artiest
2.573 albums
35.430 nummers
208,01 GB (~ 3.231 hours)

So it seems my combined VA dir is at some sort of non excisting maximum...

Btw: i'm running version 3.7

Greats Mannetje

[Mannetje]

I made two dirs from my VA dir, and now all my albums are showing...