[solved] Size limitation file subsonic14.index

[qray]

Hello,
dose anyboddy know if there is a size limit on file subsonic14.index?
It seems that it cannot get greater than 127MB.

Regards,
qray

[BKKKPewsey]

Good question - I certainly have no idea but I must ask - How big is your Media library?
I have 80k tracks and my subsonic14.index is only 21Mb

[qray]

My Testfiles are about 570k.
I had a look at the subsonic14.index file with a texteditor and noticed that files are missing at the end.
It has 552k lines but not all lines are files (directories etc.) .
So I think you can calculate like this:
If 80k=21MB than 480k=127MB .
So there is a rough limit of around 500k files dependent on how they are organized (amount of directories etc.).

Perhaps someboddy of the programmers can validate this statement?


Regards,
qray

[GJ51]

My recollection is that it is only the folders that are indexed. I have one site that has 60k track and has an 18Mb ss14.index

You may need to bump up the java memory allocation if the indexing isn't functioning properly. I ran fine at 256, but recently started using 512 only because I had the resources and have never had indexing or performance problems. If the indexing is done in memory it would make sense that the file would be limited when the process runs out of usable memory.

[qray]

Thanks for the sugestion. I already set the memory size to 1024.
I did it in /etc/default/subsonic . Btw, i am using Ubuntu 64 Bit.
Is there another place to set memory?

I reindexed the database and had a look at the log file.
The only entries I can see look like this:
INFO SearchService - Created search index with 554000 entries.

Regards,
qray

[GJ51]

From the feedback I've seen on this issue, there may also be a problem associated with allocating too much memory; but it's hard to determine the exact cause when someone reports an issue due to the variation in hardware and OS differences. I use Windows, so I'm not sure, but I think your OK on where your changing the memory setting. I would suggest backing off to 512 and see if it solves any issues. You can always go back up, but 1024 may just be a boundry number that wasn't programmed for and may be creating an out of bound error. I do recall posts that used big memory number and ran into problems.

I'm assuming that you have reasonable total memory overhead and good disk space available with everything up and running.

[qray]

Problem solved. Actually its no problem. Problem was the user .

When I had a look at subsonic14.index with a Texteditor I was thinking that files are missing.
But that is not true. In fact the ordering in the file dose not match alphabetical order. So by
looking at the end of the file I was thinking that files are missing.
Accidentally the file size is about 127MB which made me think there may be a size problem

Thank you very much everyone for trying to help.

Regards,
qray

[GJ51]

NP - It's good to know that SS can handle such a large library and that everything is working.

By the way, just how big is your library. what are the stats?

[qray]

Hello Gary,

my index is about 503k files. ATM the index is working correct but i had to do s a workaround.
There was an issue that if you are searching a string it would only find some occurrencies.
But i will start another thread on this once i have done more tests.

Background: This is a private/hobby project. It started to create a NAS which can handle
a huge partition with millions of files and some other requirements. ATM the system is running Ububtu Server 64Bit with ZFS file system.
At the moment I test some solotions to catalog and access different file types. This is why
I am trying subsonic.

Regards,
qray