Non-Latin Characters [Solved]

[robotmachine]

Hello.

I have a somewhat large music library running with Subsonic (~200GB) and except for my one problem it is fantastic.
My problem is thus: If there is any non-Latin character involved (ie áöø etc), the file does not get indexed in Subsonic. By this I mean that those files just simply do not appear in the list to be played.
I can play the files in other music programs with no trouble. Other applications (Exaile is the only program that comes to mind) have no issues indexing the same directories.
I can't quite figure out what is going wrong and so I turn to you.

I have Subsonic running on Arch Linux. I'm using XFS for my filesystem and my locale is set to en_US.UTF-8 .
I have LC_CTYPE=en_US.utf-8 as well as LANG=en_US.utf-8 set in the script to start Subsonic which I saw as tips in various searches on the web including this forum.

Any ideas?

[BKKKPewsey]

Letting us know what version of subsonic you are using would be a help.
With regard to play lists read http://forum.subsonic.org/forum/viewtopic.php?f=2&t=8199

[robotmachine]

Terribly sorry. I am using the latest release. The problem has persisted as long as I have used Subsonic which is about eight or so months. I update about as soon as they come out.

This issue is before playlists enter the picture, the songs with non Latin chars do not show up at all. I am sure it is y system, but I can't figure out what needs to be set where to use those files.

[wowo]

First disable Subsonic.
Then you must add the following code to the subsonic.sh file almost at the beginning right after the line "SUBSONIC_DEFAULT_PLAYLIST_FOLDER=/var/playlists"
Mind the " !!!! they are essential otherwise it won't work.

Code: Select all

export LANG="en_US.UTF-8"
export LC_CTYPE="en_US.UTF-8"

Finally you can see Björk and other artists, albums and tracks with international characters.

I had also to change the default music folder and then changed it back to the normal default music folder then it works for me.
Sorry for my bad English.

[BKKKPewsey]

Let us know if that works as I will mark this thread solved and and "ear mark" for inclusion in the wiki.
Thank you wowo

[robotmachine]

Thank you so much wowo, that worked just fine. I also had to delete my music folder and re-add.

You can mark it as solved, BKKKPewsey. I should have posted here months ago.

Thanks again!

[hanker]

First disable Subsonic.
Then you must add the following code to the subsonic.sh file almost at the beginning right after the line "SUBSONIC_DEFAULT_PLAYLIST_FOLDER=/var/playlists"
Mind the " !!!! they are essential otherwise it won't work.

Code: Select all

export LANG="en_US.UTF-8"
export LC_CTYPE="en_US.UTF-8"

Greetings

I tried this as follows on my Subsonic machine (Subsonic 4.5 on Debian Lenny):

Code: Select all

# service subsonic stop
# nano /usr/share/subsonic/subsonic.sh


I added the lines:

Code: Select all

export LANG="en_US.UTF-8"
export LC_CTYPE="en_US.UTF-8"


right after

Code: Select all

SUBSONIC_DEFAULT_PLAYLIST_FOLDER=/var/playlists


Then I did this:

Code: Select all

# service subsonic start


This gave this error message:

Code: Select all

# service subsonic start
/usr/bin/subsonic: line 20: warning: setlocale: LC_CTYPE: cannot change locale (en_US.UTF-8): No such file or directory
Started Subsonic [PID 22898, /var/subsonic/subsonic_sh.log]


Is this supposed to give that error message?

Thank you!

[robotmachine]

I'm using Arch so I can't really comment. I would maybe check with a Debian forum or Debian IRC about that. It is definitely not supposed to happen and it is not a Subsonic issue.

A cursory search makes me think that you might need to use

Code: Select all

export LANG="en_US.utf8"
export LC_CTYPE="en_US.utf8"

[hanker]

I'm using Arch so I can't really comment. I would maybe check with a Debian forum or Debian IRC about that. It is definitely not supposed to happen and it is not a Subsonic issue.

Thank you for your reply!

I have Subsonic running on a Sheevaplug. This is little plug computer with an ARM processor and 512 MB RAM, and it boots from an SD card. It has a minimal Debian squeeze (not lenny) install. So minimal that it didn't have the "locales" package installed. So I did:

Code: Select all

# apt-get install dialog
# apt-get install locales
# dpkg-reconfigure locales


and selected

Code: Select all

[*] en_US.UTF-8 UTF-8


and then

Code: Select all

en_US.UTF-8 UTF-8


in the next two dialogs.

Then do

Code: Select all

# service subsonic stop
# nano /usr/share/subsonic/subsonic.sh


insert these lines:

Code: Select all

export LANG="en_US.UTF-8"
export LC_CTYPE="en_US.UTF-8"


and then:

Code: Select all

# service subsonic start


No error messages this time.

Then I did Settings -> Search -> Update search index now.

Wait a few minutes while it crunches...

And now I can see, e.g.,

Code: Select all

Soumbou Ya Ya    In the Heart of the Moon    Ali Farka Touré       mp3    5.6 MB
Danse Norvégienne    Jazz in Paris: Swing 48    Django Reinhardt    mp3    4.2 MB
Camichi Cornu    Drôles D'oiseaux    Jean C. Roché, Nelly Desesquelle    mp3


in my search results. Good! Thank you! I've been wanting to get this to work for over a year!

In fact, I think I'll finally donate. Three cheers for Sindre and the support community

[Kingsy]

Hello,

I seem to be having this exact problem on my subsonic installation. However adding the LANG and LC_CTYPE variables to the subsonic.sh file doesnt help for me.. here is a section of the top of my file.

.....
SUBSONIC_DEFAULT_PODCAST_FOLDER=/var/music/Podcast
SUBSONIC_DEFAULT_PLAYLIST_FOLDER=/var/playlists

JAVA_HOME=/opt/java/jre:/usr/lib/jvm/java-7-openjdk
export LANG="en_US.UTF-8"
export LC_CTYPE="en_US.UTF-8"
quiet=0
.....

I can also confirm that it is not the client pc causing the problem, I have tried it on 4 different machines (as a client) however only 1 server.
The problem is seen in the regular catalog and I cannot play any songs with special characters. These songs are playable through another mediaplayer however so the files are working correctly and are not corrupt.

What else can I try?

Thanks


Chris

[wowo]

Since a new install and a new firmware of my NAS the non-latin characters problem occurred again.
Of course the lines I have added to subsonic.sh were disappeared.
So I added them again:

Code: Select all

export LANG="en_US.UTF-8"
export LC_CTYPE="en_US.UTF-8"

Strange enough it did not work for me anymore.

Then I deleted the " 's and tada! it works again for me.

Code: Select all

export LANG=en_US.UTF-8
export LC_CTYPE=en_US.UTF-8

I am happy again.