Page 1 of 1

Subsonic won't index entire collection

PostPosted: Sat May 13, 2017 7:51 pm
by cds1
My mp3 collection is ~55k files. I can't get Subsonic to index more than ~17k of them though. I've tried increasing the max Java memory, but that doesn't have any effect. There isn't a permissions problem.

Here's the latest entry from subsonic.log
Code: Select all
[2017-05-13 19:45:54,732] INFO MediaScannerService - Scanned media library with 11750 entries.
[2017-05-13 19:45:55,020] INFO MediaScannerService - Scanned media library with 12000 entries.
[2017-05-13 19:45:55,303] INFO MediaScannerService - Scanned media library with 12250 entries.
[2017-05-13 19:45:55,606] INFO MediaScannerService - Scanned media library with 12500 entries.
[2017-05-13 19:45:55,893] INFO MediaScannerService - Scanned media library with 12750 entries.
[2017-05-13 19:45:56,201] INFO MediaScannerService - Scanned media library with 13000 entries.
[2017-05-13 19:45:56,496] INFO MediaScannerService - Scanned media library with 13250 entries.
[2017-05-13 19:45:56,791] INFO MediaScannerService - Scanned media library with 13500 entries.
[2017-05-13 19:45:57,090] INFO MediaScannerService - Scanned media library with 13750 entries.
[2017-05-13 19:45:57,409] INFO MediaScannerService - Scanned media library with 14000 entries.
[2017-05-13 19:45:57,706] INFO MediaScannerService - Scanned media library with 14250 entries.
[2017-05-13 19:45:58,038] INFO MediaScannerService - Scanned media library with 14500 entries.
[2017-05-13 19:45:58,316] INFO MediaScannerService - Scanned media library with 14750 entries.
[2017-05-13 19:45:58,610] INFO MediaScannerService - Scanned media library with 15000 entries.
[2017-05-13 19:45:58,902] INFO MediaScannerService - Scanned media library with 15250 entries.
[2017-05-13 19:45:59,188] INFO MediaScannerService - Scanned media library with 15500 entries.
[2017-05-13 19:45:59,476] INFO MediaScannerService - Scanned media library with 15750 entries.
[2017-05-13 19:45:59,768] INFO MediaScannerService - Scanned media library with 16000 entries.
[2017-05-13 19:46:00,054] INFO MediaScannerService - Scanned media library with 16250 entries.
[2017-05-13 19:46:00,374] INFO MediaScannerService - Scanned media library with 16500 entries.
[2017-05-13 19:46:00,683] INFO MediaScannerService - Scanned media library with 16750 entries.
[2017-05-13 19:46:00,979] INFO MediaScannerService - Scanned media library with 17000 entries.
[2017-05-13 19:46:01,148] INFO MediaScannerService - Scanned media library with 17145 entries.
[2017-05-13 19:46:01,148] INFO MediaScannerService - Marking non-present files.
[2017-05-13 19:46:01,160] INFO MediaScannerService - Marking non-present artists.
[2017-05-13 19:46:01,161] INFO MediaScannerService - Marking non-present albums.
[2017-05-13 19:46:01,165] INFO MediaScannerService - Completed media library scan.
[2017-05-13 19:46:01,230] INFO PlaylistService - Starting playlist import.
[2017-05-13 19:46:01,230] INFO PlaylistService - Completed playlist import.


Anyone have any idea of what might be causing this? In the past, Subsonic didn't have this issue with the same collection/configuration.

Re: Subsonic won't index entire collection

PostPosted: Wed May 17, 2017 5:41 am
by Exrace
Windows, Linux, OSX?

Re: Subsonic won't index entire collection

PostPosted: Wed May 17, 2017 12:56 pm
by cds1
Linux - Centos 6.9

Re: Subsonic won't index entire collection

PostPosted: Wed May 17, 2017 2:33 pm
by Tak-MK
Did you add all the folders to Settings -> Media Folders ?

Re: Subsonic won't index entire collection

PostPosted: Thu May 18, 2017 12:42 pm
by cds1
Yes, all folders were added. It may be worth noting that the data lives on an NFS mount. So, /nfs/mp3 is what has been added to Subsonic.

Re: Subsonic won't index entire collection

PostPosted: Thu May 18, 2017 2:52 pm
by acroyear
UPDATE from first post - ok, you did say "it isn't a permissions problem", but I'd like to see details on that. Permissions did cause the last bout of scanning problems I ran into earlier this week.

--
Double-check who actually owns the files on the drive and that the permissions on them allow the subsonic account to view them?

I found on windows that for some reason, it decided that a VFAT external drive wasn't owned by 'me', so even though the drive's security said EVERYBODY was supposed to have access, the subsonic daemon didn't. I had to stop the service, do some permission tweaks, then start it up again and everything worked.

Subsonic doesn't like not having write access to a drive, even if it isn't actually intending to write to that drive.

Re: Subsonic won't index entire collection

PostPosted: Fri May 19, 2017 10:36 am
by cds1
The permissions are world readable/executable across the entire set. That also means the permissions are the same on directories/files that do get indexed vs. those that don't.