Subsonic 4.7.beta2 released

Announcements and discussion of new releases.

Moderator: moderators

Re: Subsonic 4.7.beta2 released

Postby sindre_mehus » Thu Jul 19, 2012 11:21 am

phazzard wrote:[2012-07-12 03:00:00,756] INFO MediaScannerService - Starting to scan media library.
[2012-07-12 03:06:42,273] INFO MediaScannerService - Scanned media library with 250 entries.
[2012-07-12 03:12:23,851] INFO MediaScannerService - Scanned media library with 500 entries.
[2012-07-12 03:18:00,890] INFO MediaScannerService - Scanned media library with 750 entries.
[2012-07-12 03:22:53,094] INFO MediaScannerService - Scanned media library with 1000 entries.


Yeah, that's very slow - around 1.5 seconds per file. Is this a first-time scan or an incremental scan? Where are the files located, on a network drive?

Thanks,
Sindre
Subsonic developer
User avatar
sindre_mehus
 
Posts: 1955
Joined: Tue Nov 29, 2005 6:19 pm
Location: Oslo, Norway

Re: Subsonic 4.7.beta2 released

Postby HighCast » Thu Jul 19, 2012 11:49 am

That must be something related to the system itself - my server-workstation is running with 7200 rpm laptop disks (2,5" SATA2) and the re-scan is fast.
By my point of view, the "incremental" scan - as daily scan - has been improved greatly.

Code: Select all
[7/19/12 2:45:47 PM EEST]    INFO   MediaScannerService   Starting to scan media library.
[7/19/12 2:45:53 PM EEST]    INFO   MediaScannerService   Scanned media library with 250 entries.
[7/19/12 2:45:55 PM EEST]    INFO   MediaScannerService   Scanned media library with 500 entries.
[7/19/12 2:45:58 PM EEST]    INFO   MediaScannerService   Scanned media library with 750 entries.
[7/19/12 2:46:00 PM EEST]    INFO   MediaScannerService   Scanned media library with 1000 entries.
[7/19/12 2:46:03 PM EEST]    INFO   MediaScannerService   Scanned media library with 1250 entries.
[7/19/12 2:46:05 PM EEST]    INFO   MediaScannerService   Scanned media library with 1500 entries.
[7/19/12 2:46:09 PM EEST]    INFO   MediaScannerService   Scanned media library with 1750 entries.
HighCast
 
Posts: 49
Joined: Tue Nov 16, 2010 7:43 am
Location: Finland

Re: Subsonic 4.7.beta2 released

Postby phazzard » Thu Jul 19, 2012 6:44 pm

The files are stored on 5 3tb external WD drives. They are connected to a PC dedicated to housing music and video. 1 of the drives uses usb 2.0, the other 4 usb 3.0. The system used is a newer win 7 system, I can check specific statistics tonight when I get home. The odd thing to me is I have used subsonic exclusivly for my music files for awhile now and never had this issue with any previous version. The same quantity of files would take 4-5 hours on a re-scan on previous versions. I have done 2 re-scans with the new version and both times it has taken close to 2 weeks? Nothing has changed with my computer setup or size of files since the last version of Subsonic?
phazzard
 
Posts: 49
Joined: Thu Jul 08, 2010 6:43 pm

Re: Subsonic 4.7.beta2 released

Postby tkelito » Fri Jul 20, 2012 5:05 am

Found a strange bug with the indexing of files.

Added about 40 albums or so. Ran an index, went through without issue. They showed up in the Recently Added feed and under the proper Artist names. Then on a hard refresh of the webpage they disappeared. I can find the albums if I search, so they are in the index, but they do not show up under their artist name or in the recently added section. So unless you knew to search for them, you wouldn't have any idea they existed. I'm not sure even how to fix this besides scrub the index and rebuild. Which as everyone else has pointed out, is slower than dirt on 4.7 beta 2.

Confirmed they don't show up by one of my users.
tkelito
 
Posts: 9
Joined: Thu Aug 04, 2011 3:03 pm

Re: Subsonic 4.7.beta2 released

Postby sindre_mehus » Fri Jul 20, 2012 9:39 am

phazzard wrote:The files are stored on 5 3tb external WD drives. They are connected to a PC dedicated to housing music and video. 1 of the drives uses usb 2.0, the other 4 usb 3.0. The system used is a newer win 7 system, I can check specific statistics tonight when I get home. The odd thing to me is I have used subsonic exclusivly for my music files for awhile now and never had this issue with any previous version. The same quantity of files would take 4-5 hours on a re-scan on previous versions. I have done 2 re-scans with the new version and both times it has taken close to 2 weeks? Nothing has changed with my computer setup or size of files since the last version of Subsonic?


Maybe the huge number of songs makes some database queries slow.

It would be tremendously helpful if you could zip the c:\subsonic\db directory and send it to me (with Dropbox or similar), so I could try to reproduce the problem locally.

Thanks
Sindre
Subsonic developer
User avatar
sindre_mehus
 
Posts: 1955
Joined: Tue Nov 29, 2005 6:19 pm
Location: Oslo, Norway

Re: Subsonic 4.7.beta2 released

Postby muvipix » Fri Jul 20, 2012 10:00 am

Sindre, can you please take a look at this - viewtopic.php?f=2&t=9646&p=43696#p43696

It's 4.7.beta2 related and the post is getting some reads, but no solutions. I don't have an active user named ron (even though it's my name)?

Thanks!
muvipix
 
Posts: 25
Joined: Sat Jan 07, 2012 8:07 pm

Why I have reverted to Version 4.6..

Postby Schakine » Sat Jul 21, 2012 10:37 am

Think it will help some of us to clarify some issues with 4.7 Beta..
With an external HDD 4.7 do not scan properly the list of tracks taking an awful lot of time to do it ans stopping all the way through..and sometimes not doing it at all..the answer is to come back to 4.6..
ffmpeg.exe furnished with 4.7 do not read some FLAC s,therefore stop converting it to MP3 ..Only ffmpeg coming with SS 4.5 is doing the job properly (thanks to Gary J.) but we need to write the strings that were included in 4.5 for transcoding to be done smoothly..This works also for 24 bits tracks..
That's all folks..
I am sure the final version of 4.7 will correct all this..thank u Sindre!

Mod: Moved post to keep all 4.7 posts together
User avatar
Schakine
 
Posts: 38
Joined: Fri May 27, 2011 8:05 pm
Location: Paris (France)

Re: Subsonic 4.7.beta2 released

Postby sindre_mehus » Sat Jul 21, 2012 10:45 pm

Good news! I've fixed the problem with media scanning being so slow on large collections. It was a missing database index causing some queries to take very long.

Thanks to phazzard for providing test data!

Sindre
Subsonic developer
User avatar
sindre_mehus
 
Posts: 1955
Joined: Tue Nov 29, 2005 6:19 pm
Location: Oslo, Norway

Re: Subsonic 4.7.beta2 released

Postby phazzard » Sat Jul 21, 2012 11:14 pm

Great news - Cannot wait to get my hands on the final release. As always much appreciated. Getting ready to make another donation, I urge everyone else to do the same!

Thanks
phazzard
 
Posts: 49
Joined: Thu Jul 08, 2010 6:43 pm

Re: Subsonic 4.7.beta2 released

Postby tkelito » Sun Jul 22, 2012 3:41 am

Great to hear the slow scanning issue has been resolved. Any thoughts on the index losing files? I dumped my index and rebuilt it from scratch only to find today that an album shows up but all the songs are missing. I can search for the songs and find/play them but they do not show up if I click on the album in any of the main views or through the A-Z list. Strange issue but I assume it is because the indexing process is broken.

Here is an example, songs do not show up in the album view, but I can obviously find them/play them via search. Just the album art shows up in the view. The only resolution is to dump the index and rescan, which takes hours, and then I will find other things "missing".

Image
tkelito
 
Posts: 9
Joined: Thu Aug 04, 2011 3:03 pm

Re: Subsonic 4.7.beta2 released

Postby sindre_mehus » Mon Jul 23, 2012 10:03 am

tkelito wrote:Great to hear the slow scanning issue has been resolved. Any thoughts on the index losing files? I dumped my index and rebuilt it from scratch only to find today that an album shows up but all the songs are missing. I can search for the songs and find/play them but they do not show up if I click on the album in any of the main views or through the A-Z list. Strange issue but I assume it is because the indexing process is broken.


I *think* this has been fixed but not yet released. I hope to put out a new beta version in not so long, so please try again then.
Subsonic developer
User avatar
sindre_mehus
 
Posts: 1955
Joined: Tue Nov 29, 2005 6:19 pm
Location: Oslo, Norway

Re: Subsonic 4.7.beta2 released

Postby rubbersoul » Tue Jul 24, 2012 4:02 am

i feel really stupid, but i thought i read in the changelog that music was now sorted by id3 tags. my music still appears in the haphazard folder structure i have and isn't sorted by id3 tags. i'm running the latest beta server in debian.

i have noticed that the folders i have sorted: artist/year - album/# - title, have now been changed to sort newest album first, so it appears it knows the year somehow. unfortunately most of my music folders are various stages of organization and aren't labeled so nicely. almost all my music is tagged however, so i expected the organization to work for this server release. is it working for other people or does it work differently than i think.

fwiw, i haven't been seeing any problems with media scan times. i've got about 60k songs and it doesn't take very long to scan with modest hardware (less than an hour i think).
rubbersoul
 
Posts: 127
Joined: Thu Aug 18, 2011 2:27 pm

Re: Subsonic 4.7.beta2 released

Postby rubbersoul » Tue Jul 24, 2012 4:14 am

supra92 wrote:Agreed with Gary -- the whole point of databases is to present any data in any form for its users. It would be, however, incumbent upon Sindre to implement something that would provide that level of flexibility to the rest of us... and his time is indeed limited.

Having used EAC (Exact Audio Copy) for years to rip FLACs from CDs, I think EAC's naming convention method provides the utmost in flexibility, albeit perhaps not in the most entry-level-user-friendly sort of way:

Image

This is pretty much the ultimate because it not only allows you to choose *what* you want to see, but also *how* it is displayed. In the "Naming Scheme" textbox, for example, one types in:

%A\%Y - %C\%N - %A - %T      to get:     Beatles\1969 - Abbey Road\01 - Beatles - Come Together.flac

Not only do you get to pick which ID3 tags to show, it allows you define the spacing and the separator characters as well.

So for Subsonic, for example, there could be an "Album Display Scheme" textbox in Settings, where one could do the following (and we could add %G for Genre):
  • %C                             Abbey Road
  • %Y - %C                      1969 - Abbey Road
  • %Y-%C                        1969-Abbey Road
  • %C (%Y)                      Abbey Road (1969)
  • %C [%Y]                      Abbey Road [1969]
  • %G - %C                      Rock - Abbey Road
  • %G ... %C                   Rock ... Abbey Road
  • %G -- %Y -- %C            Rock -- 1969 -- Abbey Road
  • %Y, %C (%G)                1969, Abbey Road (Rock)

etcetera, etcetera...

The options are unlimited, really, so each of us can custom-tailor the display of albums under an artist to exactly how we want. Then, beneath that Album Display Scheme textbox, there's a simple pair of radio buttons: "Sort Ascending", and "Sort Descending".

This solution, naturally, would require a return to 4.7b1's practice of no longer displaying the foldername (because we're creating our own display from the ID3 tags).

From what I can tell from this thread thus far, it's possible this might address the concern of everyone who's posted. Even for someone like me who has previously wanted foldernames so that SS would display things chronologically, that is now achievable through ID3 tags by simply choosing "%Y - %C" and selecting the "Sort Ascending" radio button.

I don't know if that would be an overly-complicated solution for the average SS user, but.... who IS the average SS user? I'd suggest that most people using SS know music and know computers... and if a person can figure out SS's transcoding mechanism, one would think the Album Display Scheme should be a piece of cake.

I don't know how easy or difficult this would be for Sindre to implement, but it sure seems like it would do the trick.

Cheers,
Supra92
if you think eac does a nice job at this, i would suggest you check out foobar2000 and their implementation called "titleformat" it is by far the most powerful implementation of custom tag formatting and displaying. i would love to see something like titleformat in subsonic!
rubbersoul
 
Posts: 127
Joined: Thu Aug 18, 2011 2:27 pm

Re: Subsonic 4.7.beta2 released

Postby asayler » Tue Jul 24, 2012 2:41 pm

Hi Sindre,

Any thoughts on the Linux "dash in directory path" bugs that appears to have cropped up in 4.7:

viewtopic.php?f=5&t=9904
viewtopic.php?f=2&t=9863

-Andy
asayler
 
Posts: 29
Joined: Sat Nov 12, 2011 11:12 pm

Re: Subsonic 4.7.beta2 released

Postby kargath » Tue Jul 24, 2012 6:10 pm

I'm having an issue that I haven't seen covered here. I think have an interesting setup, but it shouldn't have an affect on this issue... I have a WinXP 32-bit machine that's my main media "hub" if you will. That server has SS setup for strictly music. Then on another machine on the network that runs Win7 x64, I have SS setup to look at the video network shares that are on the winXP box.

Everything was working great until I upgraded from 4.6 to 4.7b2. The Win7x64 SS can no longer "see" my media folders. (It just says "Folder Not Found" when I try to add them). I verified I have access to them on the network... I even tried mapping the folder to a drive letter to see if that would help.

Has something changed with the way SS looks at network shares?

I need the separate servers since there's no user level access control to media folders. Would be really awesome if we could set up user groups and then give those user groups access to specific media locations... though .. I'd still have to use the Win7x64 box for the video since it's far more powerful and can handle all of the re-encodes on the fly.
kargath
 
Posts: 33
Joined: Wed Feb 15, 2012 2:31 pm

PreviousNext

Return to Announcements

Who is online

Users browsing this forum: No registered users and 4 guests