SearchService can't find folders

[IWarez]

Since 4.5 I have some strange issues with the SearchService. I can't find some albums that are actually in my music folder. The albums that are unavailable are becoming more and more.

When I check the log I get debug information like;

Code: Select all

[8/16/11 2:58:28 PM GMT+01:00]   INFO   PlaylistInputStream   admin listening to "Falco - The Ultimate Collection (2008)/11 - America.mp3"
[8/16/11 3:00:00 PM GMT+01:00]   INFO   SearchService   Starting to create search index.
[8/16/11 3:00:01 PM GMT+01:00]   INFO   SearchService   Created search index with 1000 entries.
[8/16/11 3:00:02 PM GMT+01:00]   INFO   SearchService   Created search index with 2000 entries.
[8/16/11 3:00:04 PM GMT+01:00]   INFO   SearchService   Created search index with 3000 entries.
[8/16/11 3:00:06 PM GMT+01:00]   INFO   SearchService   Created search index with 4000 entries.
[8/16/11 3:00:07 PM GMT+01:00]   INFO   SearchService   Created search index with 5000 entries.
[8/16/11 3:00:09 PM GMT+01:00]   INFO   SearchService   Created search index with 6000 entries.
[8/16/11 3:00:10 PM GMT+01:00]   INFO   SearchService   Created search index with 7000 entries.
[8/16/11 3:00:12 PM GMT+01:00]   INFO   SearchService   Created search index with 8000 entries.
[8/16/11 3:00:13 PM GMT+01:00]   INFO   SearchService   Created search index with 9000 entries.
[8/16/11 3:00:14 PM GMT+01:00]   INFO   SearchService   Created search index with 10000 entries.
[8/16/11 3:00:16 PM GMT+01:00]   INFO   SearchService   Created search index with 11000 entries.
[8/16/11 3:00:17 PM GMT+01:00]   INFO   SearchService   Created search index with 12000 entries.
[8/16/11 3:00:18 PM GMT+01:00]   INFO   SearchService   Created search index with 13000 entries.
[8/16/11 3:00:19 PM GMT+01:00]   INFO   SearchService   Created search index with 14000 entries.
[8/16/11 3:00:21 PM GMT+01:00]   INFO   SearchService   Created search index with 15000 entries.
[8/16/11 3:00:22 PM GMT+01:00]   INFO   SearchService   Created search index with 16000 entries.
[8/16/11 3:00:24 PM GMT+01:00]   INFO   SearchService   Created search index with 17000 entries.
[8/16/11 3:00:25 PM GMT+01:00]   INFO   SearchService   Created search index with 18000 entries.
[8/16/11 3:00:26 PM GMT+01:00]   INFO   SearchService   Created search index with 19000 entries.
[8/16/11 3:00:27 PM GMT+01:00]   DEBUG   SearchService   Logically deleting info for album /volume1/Music/G/Gorillaz/Gorillaz - Plastic Beach (2010). Not found on disk.
[8/16/11 3:00:27 PM GMT+01:00]   DEBUG   SearchService   Logically deleting info for album /volume1/Music/F/Falco/Falco - The Ultimate Collection (2008). Not found on disk.
[8/16/11 3:00:27 PM GMT+01:00]   INFO   SearchService   Updating Lucene search index.
[8/16/11 3:00:29 PM GMT+01:00]   INFO   SearchService   Created search index with 19183 entries.
[8/16/11 3:02:23 PM GMT+01:00]   INFO   PlaylistInputStream   admin listening to "Falco - The Ultimate Collection (2008)/12 - Brilliantin' Brutal.mp3"

Notice this:

Code: Select all

[8/16/11 3:00:27 PM GMT+01:00]   DEBUG   SearchService   Logically deleting info for album /volume1/Music/G/Gorillaz/Gorillaz - Plastic Beach (2010). Not found on disk.
[8/16/11 3:00:27 PM GMT+01:00]   DEBUG   SearchService   Logically deleting info for album /volume1/Music/F/Falco/Falco - The Ultimate Collection (2008). Not found on disk.

These folders are actually available. The result is that the named items cannot be found by the search service whereas they could be found before. The albums are playable from SubSonic when I navigate to the right album without using the search service so I think it's not a permissions issue. SubSonic is running under the guest user but I tried running it as root also.

I tried:
- Updating the search index
- Stop and restart SubSonic
- Stop SubSonic. Removing the Lucene folder, start SubSonic and updating the search index.
- Stop SubSonic, removing all files and folders in /var/subsonic except the transcode folder, restart SubSonic
- I reapplied permissions on the folders (permissions are the same in the whole tree)
- Running as root

Additional information:
In this case I'm playing the album that is deleted while the search index is being built. I have other albums that are not in the search index anymore that were not played since some time but are also unavailable in the search index.

Specs:
Synology NAS DS710
java running with -Xmx200m but it says it's using only 90 mb
4.5 (build 2384) – August 10, 2011
jetty-6.1.x, java 1.6.0_24, Linux (50.7 MB / 85.4 MB)

Anyone any idea?

[IWarez]

bump?

[BKKKPewsey]

I cant help too much as I am running on WHS but can you confirm that the albums that get deleted dont get found again on the next search update?
I have seen similar in my log file but after the next scan update I can find them again in search.
I presumed it was a temporary access problem or tags/file name/something / changes made to the files in question.

[IWarez]

Yes, I tried rebuilding the search index a few times manually and also automatically from subsonic (with the scheduler). Doesn't work.

If I search for tracks within the albums that are not listed I do get a result.

So searching for 'Ultimate' doesn't find 'Falco - The Ultimate Collection (2008)' but when I search for the track 'Rock Me Amadeus' which is from the same album I do find the track.

[BKKKPewsey]

Ok bit of guess here but what is your directory structure like?
SS REALLY likes music/artist/album/album tracks structure. You break that rule at your peril
I know that I had a few single albums which broke those rules eg: music/abba greatest hits/tracks and SS really got confused about the artist / album name

[IWarez]

I Have:

F/Falco/Falco - The Ultimate Collection (2008)/[Tracks]

And aside from that the searchindex is based (I hope!) on the id3 tags so it shouldn't be an issue.

I will try to rename the folder, rebuild index and see what happens...

[BKKKPewsey]

Yep give that a try. I also remember I had a problem album once and got round it by synchronising the ID3 tags.
The V1 & V2 tags were different in a couple of places - best of luck

SS one of life's little mysteries

[IWarez]

Hmm, renaming the folder will bring the album back in the search results. When I rename it back to what it was the album is still found. I call it a BUG! Oh, well. This seems to work so I will have to live with it. Now to find all the albums that don't show up...

[ultrasonic]

Hmm, renaming the folder will bring the album back in the search results. When I rename it back to what it was the album is still found. I call it a BUG! Oh, well. This seems to work so I will have to live with it. Now to find all the albums that don't show up...

Based on what I am seeing it is for sure a bug, we just need to make sure the right people know.

[IWarez]

After I renamed the folders all is working fine now. Maybe I forgot to delete an index file or something like that when I cleaned the /var/subsonic folder.