Can not index files or folders with Unicode Characters

[drucifer]

Problem Description: Subsonic will not index any files with special characters/unicode in the file or folder names. I had this same issue with a previous Madsonic installation which I was able to fix because I am currently using Madsonic on a separate LXC, with the same media files, and I am able to index the unicode character files. I went through as many config files as I could find to try and replicate any changes I made to the Madsonic LXC to try to get Subsonic working but so far I have been unsuccessful.

Troubleshooting Steps: I have tried putting the local settings (export LANG="en_US.UTF-8", export LC_ALL="en_US.UTF-8", export LANGUAGE="en_US.UTF-8") in .bashrc file of running user, in the subsonic.sh, /etc/default/subsonic, /etc/init.d/subsonic. I tried changing the user to a new user, changing the Subsonic user to different users including root.

Playback Application and version: Subsonic web interface/DSub for Android

Subsonic Version: 6.1.3 (build e408c9) – October 31, 2017

Server Version: jetty-6.1.x, java 1.8.0_171, HSQLDB, Linux (95.4 MB / 145.0 MB)

Hardware Platform: Subsonic running in a Ubuntu 18.04 LXC (Linux Container) on Proxmox 5.1-52. Media is on a mounted NFS share.

Java Memory Limit: (If this is in /etc/default/subsonic, the default is set at --max-memory=150)

Problem Filename: (examples): /music/Tool/Tool - 1996 - Ænima/01 - Stinkfist.mp3 ; /music/Fantômas/Fantômas - 2001 - The Director's Cut/01 - The Godfather.flac

Output from ffmpeg -i:

Code: Select all

ffmpeg version 3.4.2-2 Copyright (c) 2000-2018 the FFmpeg developers
  built with gcc 7 (Ubuntu 7.3.0-16ubuntu2)
  configuration: --prefix=/usr --extra-version=2 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --enable-gpl --disable-stripping --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librubberband --enable-librsvg --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-omx --enable-openal --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libopencv --enable-libx264 --enable-shared
  libavutil      55. 78.100 / 55. 78.100
  libavcodec     57.107.100 / 57.107.100
  libavformat    57. 83.100 / 57. 83.100
  libavdevice    57. 10.100 / 57. 10.100
  libavfilter     6.107.100 /  6.107.100
  libavresample   3.  7.  0 /  3.  7.  0
  libswscale      4.  8.100 /  4.  8.100
  libswresample   2.  9.100 /  2.  9.100
  libpostproc    54.  7.100 / 54.  7.100
Input #0, mp3, from '/music/Tool/Tool - 1996 - Ænima/01 - Stinkfist.mp3':
  Metadata:
    title           : Stinkfist
    artist          : Tool
    track           : 1/15
    album           : Ænima
    disc            : 1/1
    TBPM            : 0
    compilation     : 0
    lyrics-         :
    TMED            : CD
    TORY            : 1996
    album_artist    : Tool
    publisher       : Volcano Records
    ALBUMARTISTSORT : Tool
    ASIN            : B00000099Y
    Album Artist Credit: Tool
    Artist Credit   : Tool
    CATALOGNUMBER   : 61422-31087-2
    MusicBrainz Album Artist Id: 66fc5bf8-daa4-4241-b378-9bc9077939d2
    MusicBrainz Album Id: b1b9bf98-86fa-4092-950f-1fb6744a25b4
    MusicBrainz Album Release Country: US
    MusicBrainz Album Status: Official
    MusicBrainz Album Type: album
    MusicBrainz Artist Id: 66fc5bf8-daa4-4241-b378-9bc9077939d2
    MusicBrainz Release Group Id: ef1e8130-dd5f-336a-85fa-4936a47342bd
    Script          : Latn
    date            : 1996-10-01
  Duration: 00:05:11.14, start: 0.025056, bitrate: 206 kb/s
    Stream #0:0: Audio: mp3, 44100 Hz, stereo, s16p, 205 kb/s
    Metadata:
      encoder         : LAME3.96
    Side data:
      replaygain: track gain - -8.500000, track peak - unknown, album gain - unknown, album peak - unknown,
    Stream #0:1: Video: mjpeg, yuvj420p(pc, bt470bg/unknown/unknown), 301x300 [SAR 1:1 DAR 301:300], 90k tbr, 90k tbn, 90k tbc
    Metadata:
      comment         : Cover (front)
At least one output file must be specified


Last ten log file lines:

Code: Select all

[5/17/18 12:42:43 AM UTC]   INFO   MediaScannerService   Scanned media library with 8250 entries.
[5/17/18 12:42:43 AM UTC]   INFO   MediaScannerService   Scanned media library with 8500 entries.
[5/17/18 12:42:43 AM UTC]   INFO   MediaScannerService   Scanned media library with 8750 entries.
[5/17/18 12:42:43 AM UTC]   INFO   MediaScannerService   Scanned media library with 9000 entries.
[5/17/18 12:42:43 AM UTC]   INFO   MediaScannerService   Scanned media library with 9250 entries.
[5/17/18 12:42:43 AM UTC]   INFO   MediaScannerService   Scanned media library with 9500 entries.
[5/17/18 12:42:44 AM UTC]   INFO   MediaScannerService   Scanned media library with 9750 entries.
[5/17/18 12:42:44 AM UTC]   INFO   MediaScannerService   Scanned media library with 10000 entries.
[5/17/18 12:42:44 AM UTC]   INFO   MediaScannerService   Scanned media library with 10250 entries.
[5/17/18 12:42:44 AM UTC]   INFO   MediaScannerService   Scanned media library with 10500 entries.

[drucifer]

I would like to add that the Madsonic server is on Ubuntu 15.10 with OpenJDK 1.7, and the Subsonic server is using OpenJDK 1.8

[drucifer]

It turns out that one of the things that I did to fix the issue worked, I only needed to delete the database manually and rescan. I had previously tried to delete the media folder from the webui but I guess that it was not enough. As soon as I recreated the database from scratch (remove everything from /var/subsonic/db/ except subsonic.script) and rescanned, the missing artists/albums/tracks showed right up. Still not sure exactly what fixed it, next time I reinstall I guess I will need to manually delete the database each time I make a change so I can figure out what the exact solution is.